{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T19:58:21Z","timestamp":1778788701537,"version":"3.51.4"},"reference-count":37,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2025,4,23]],"date-time":"2025-04-23T00:00:00Z","timestamp":1745366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>This paper presents strategies for effectively integrating AI tools into programming education and provides recommendations for enhancing student learning outcomes through intelligent educational systems. Learning computer programming is a cognitively demanding task that requires dedication, logical reasoning, and persistence. Many beginners struggle with debugging and often lack effective problem-solving strategies. To address these issues, this study investigates PyChatAI\u2014a bilingual, AI-powered chatbot designed to support novice Python programmers by providing real-time feedback, answering coding-related questions, and fostering independent problem-solving skills. PyChatAI offers continuous, personalised assistance and is particularly beneficial for students who prefer remote or low-pressure learning environments. An empirical evaluation employing a Solomon Four-Group design revealed significant improvements across all programming skill areas, with especially strong gains in theoretical understanding, code writing, and debugging proficiency.<\/jats:p>","DOI":"10.3390\/computers14050158","type":"journal-article","created":{"date-parts":[[2025,4,23]],"date-time":"2025-04-23T12:04:33Z","timestamp":1745409873000},"page":"158","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["PyChatAI: Enhancing Python Programming Skills\u2014An Empirical Study of a Smart Learning System"],"prefix":"10.3390","volume":"14","author":[{"given":"Manal","family":"Alanazi","sequence":"first","affiliation":[{"name":"Department of Computer Science and Information Technology, La Trobe University, Melbourne 3086, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9519-886X","authenticated-orcid":false,"given":"Ben","family":"Soh","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Technology, La Trobe University, Melbourne 3086, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5199-3677","authenticated-orcid":false,"given":"Halima","family":"Samra","sequence":"additional","affiliation":[{"name":"Computer Science & Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alice","family":"Li","sequence":"additional","affiliation":[{"name":"La Trobe Business School, La Trobe University, Melbourne 3086, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,23]]},"reference":[{"key":"ref_1","first-page":"37","article-title":"Challenges related to computer programming education in Saudi Arabia","volume":"6","author":"Alharthi","year":"2024","journal-title":"Proc. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.compedu.2017.02.010","article-title":"Computer usage and attitudes among Saudi Arabian undergraduate students","volume":"110","author":"Alothman","year":"2017","journal-title":"Comput. Educ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"44","DOI":"10.3991\/ijim.v17i13.38439","article-title":"Effects on Saudi Female Student Learning Experiences in a Programming Subject Using Mobile Devices: An Empirical Study","volume":"17","author":"Alanazi","year":"2023","journal-title":"Int. J. Interact. Mob. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Alasmari, O.A., Singer, J., and Ada, M.B. (2023, January 26\u201328). Do current online coding tutorial systems address novice programmer difficulties?. Proceedings of the 15th International Conference on Education Technology and Computers, Barcelona, Spain.","DOI":"10.1145\/3629296.3629333"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhong, X., and Zhan, Z. (2024). An intelligent tutoring system for programming education based on informative tutoring feedback: System development, algorithm design, and empirical study. Interact. Technol. Smart Educ., ahead-of-print.","DOI":"10.1108\/ITSE-09-2023-0182"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"66","DOI":"10.34190\/ejel.22.6.3380","article-title":"Using ChatGPT in Teaching Computer Programming and Studying Its Impact on Students Performance","volume":"22","author":"Abdulla","year":"2024","journal-title":"Electron. J. E-Learn."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.69692\/SUJMRD100101","article-title":"ChatGPT Enhances Programming Skills of Computer Engineering Students","volume":"10","author":"Mekthanavanh","year":"2024","journal-title":"Souphanouvong Univ. J. Multidiscip. Res. Dev."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Stone, I. (2024, January 5\u20136). Investigating the Use of ChatGPT to Support the Learning of Python Programming Among Upper Secondary School Students: A Design-Based Research Study. Proceedings of the 2024 Conference on United Kingdom & Ireland Computing Education Research, Manchester, UK.","DOI":"10.1145\/3689535.3689537"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Maguire, J., and Cutts, Q. (2020, January 3\u20134). Supporting the Computing Science Education Research Community with Rolling Reviews. Proceedings of the United Kingdom & Ireland Computing Education Research Conference, Glasgow, UK.","DOI":"10.1145\/3416465.3416477"},{"key":"ref_10","first-page":"5","article-title":"Scaffolding as a teaching strategy","volume":"52","year":"2002","journal-title":"Adolesc. Learn. Dev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"100147","DOI":"10.1016\/j.caeai.2023.100147","article-title":"The effect of generative artificial intelligence (AI)-based tool use on students\u2019 computational thinking skills, programming self-efficacy and motivation","volume":"4","author":"Yilmaz","year":"2023","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rahman, M., and Watanobe, Y. (2023). ChatGPT for education and research: Opportunities, threats, and strategies. Appl. Sci., 13.","DOI":"10.20944\/preprints202303.0473.v1"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Silva, C.A.G.D., Ramos, F.N., De Moraes, R.V., and Santos, E.L.D. (2024). ChatGPT: Challenges and benefits in software programming for higher education. Sustainability, 16.","DOI":"10.3390\/su16031245"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Tick, A. (2024, January 19\u201321). Exploring ChatGPT\u2019s Potential and Concerns in Higher Education. Proceedings of the 2024 IEEE 22nd Jubilee International Symposium on Intelligent Systems and Informatics (SISY), Pula, Croatia.","DOI":"10.1109\/SISY62279.2024.10737595"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wieser, M., Sch\u00f6ffmann, K., Stefanics, D., Bollin, A., and Pasterk, S. (2023, January 23\u201325). Investigating the role of ChatGPT in supporting text-based programming education for students and teachers. Proceedings of the International Conference on Informatics in Schools: Situation, Evolution, and Perspectives, Lausanne, Switzerland.","DOI":"10.1007\/978-3-031-44900-0_4"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ma, B., Chen, L., and Konomi, S.I. (2024, January 8\u201312). Enhancing programming education with ChatGPT: A case study on student perceptions and interactions in a Python course. Proceedings of the International Conference on Artificial Intelligence in Education, Recife, Brazil.","DOI":"10.1007\/978-3-031-64315-6_9"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1603","DOI":"10.46328\/ijemst.4471","article-title":"ChatGPT as a learning assistant: Its impact on students learning and experiences","volume":"12","author":"Jalon","year":"2024","journal-title":"Int. J. Educ. Math. Sci. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1007\/s44163-024-00203-7","article-title":"AI chatbots in programming education: Guiding success or encouraging plagiarism","volume":"4","author":"Sidan","year":"2024","journal-title":"Discov. Artif. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s44217-024-00126-6","article-title":"The role and impact of ChatGPT in educational practices: Insights from an Australian higher education case study","volume":"3","author":"Sandu","year":"2024","journal-title":"Discov. Educ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"114146","DOI":"10.1109\/ACCESS.2024.3445432","article-title":"Does ChatGPT help novice programmers write better code? Results from static code analysis","volume":"12","author":"Haindl","year":"2024","journal-title":"IEEE Access"},{"key":"ref_21","first-page":"25","article-title":"Python-bot: A chatbot for teaching python programming","volume":"29","author":"Okonkwo","year":"2020","journal-title":"Eng. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Carreira, G., Silva, L., Mendes, A.J., and Oliveira, H.G. (2022, January 17\u201319). Pyo, a chatbot assistant for introductory programming students. Proceedings of the 2022 International Symposium on Computers in Education (SIIE), Coimbra, Portugal.","DOI":"10.1109\/SIIE56031.2022.9982349"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Abolnejadian, M., Alipour, S., and Taeb, K. (2024, January 11\u201316). Leveraging chatgpt for adaptive learning through personalized prompt-based instruction: A cs1 education case study. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613905.3637148"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"7743","DOI":"10.1080\/10447318.2023.2269006","article-title":"ChatGPT in the classroom. Exploring its potential and limitations in a functional programming course","volume":"40","author":"Popovici","year":"2024","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_25","first-page":"7","article-title":"ChatGPT in programming education: ChatGPT as a programming assistant","volume":"2023","year":"2023","journal-title":"InspirED Teach. Voice"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Xue, Y., Chen, H., Bai, G.R., Tairas, R., and Huang, Y. (2024, January 14\u201320). Does ChatGPT help with introductory programming? An experiment of students using ChatGPT in cs1. Proceedings of the 46th International Conference on Software Engineering: Software Engineering Education and Training, Lisbon, Portugal.","DOI":"10.1145\/3639474.3640076"},{"key":"ref_27","first-page":"386","article-title":"From chalkboards to AI-powered learning","volume":"27","author":"Er","year":"2024","journal-title":"Educ. Technol. Soc."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Eilermann, S., Wehmeier, L., Niggemann, O., and Deuter, A. (2023, January 18\u201320). KIAAA: An AI assistant for teaching programming in the field of automation. Proceedings of the 2023 IEEE 21st International Conference on Industrial Informatics (INDIN), Lemgo, Germany.","DOI":"10.1109\/INDIN51400.2023.10218157"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1111\/bjet.13504","article-title":"Exploring the impact of VoiceBots on multimedia programming education among Ghanaian university students","volume":"56","author":"Essel","year":"2025","journal-title":"Br. J. Educ. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"15332","DOI":"10.1109\/ACCESS.2020.2966919","article-title":"Xatkit: A multimodal low-code chatbot development framework","volume":"8","author":"Daniel","year":"2020","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Daniel, G., and Cabot, J. (2021, January 25\u201328). The software challenges of building smart chatbots. Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), Madrid, Spain.","DOI":"10.1109\/ICSE-Companion52605.2021.00138"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103032","DOI":"10.1016\/j.scico.2023.103032","article-title":"Applying model-driven engineering to the domain of chatbots: The Xatkit experience","volume":"232","author":"Daniel","year":"2024","journal-title":"Sci. Comput. Program."},{"key":"ref_33","first-page":"644","article-title":"Revision-Bot: A Chatbot for Studying Past Questions in Introductory Programming","volume":"49","author":"Okonkwo","year":"2022","journal-title":"IAENG Int. J. Comput. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1145\/3649217.3653543","article-title":"Iris: An ai-driven virtual tutor for computer science education","volume":"Volume 1","author":"Bassner","year":"2024","journal-title":"Proceedings of the 2024 on Innovation and Technology in Computer Science Education"},{"key":"ref_35","first-page":"3290","article-title":"Ejava chatbot for learning programming language: Apost-pandemic alternative virtual tutor","volume":"8","author":"Daud","year":"2020","journal-title":"Int. J."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chrysafiadi, K., and Virvou, M. (2024). PerFuSIT: Personalized Fuzzy Logic Strategies for Intelligent Tutoring of Programming. Electronics, 13.","DOI":"10.20944\/preprints202409.1543.v1"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"30","DOI":"10.2478\/aei-2022-0005","article-title":"Impact of virtual assistant on programming novices\u2019 performance, behavior and motivation","volume":"22","year":"2022","journal-title":"Acta Electrotech. Inform."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/5\/158\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:20:25Z","timestamp":1760030425000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/5\/158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,23]]},"references-count":37,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["computers14050158"],"URL":"https:\/\/doi.org\/10.3390\/computers14050158","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,23]]}}}