{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T20:27:58Z","timestamp":1773520078278,"version":"3.50.1"},"reference-count":34,"publisher":"Elsevier BV","issue":"4","license":[{"start":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T00:00:00Z","timestamp":1737676800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T00:00:00Z","timestamp":1737676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008567","name":"Leeds Beckett University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008567","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Artif Intell Educ"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The increasing prevalence of artificial intelligence in educational domains raises both opportunities and challenges in the context of academic integrity and pedagogical efficacy. This study outlines an innovative project that investigates the use of ChatGPT as a tool for enhancing the critical evaluation skills of master\u2019s students in biomedical science. Using a dual approach combining AI-generated essay writing with subsequent student-led critical evaluation, this project sought to foster deeper critical evaluation skills in learners. By having participants critically assess AI-generated essays, supported critical evaluation based on peer-reviewed literature, the project aimed to deepen their evaluative skills. Outputs from the tasks were compared against academic benchmarks considering factors such as marks, writing, and overall quality. Participant perceptions were collected through a combination of a focus group session and an evaluation questionnaire. The key finding of this project was that while ChatGPT demonstrated proficiency in structural coherence and grammatical accuracy, it did not augment academic performance\u2013 participant marks for the AI-generated essays aligned closely with their overall module marks, showing no overall improvement. However, this study did see an increase in marks for participants\u2019 critical evaluations. This suggests that ChatGPT was more effective as an assessment tool when used for critical evaluation tasks, aligning with pedagogical emphasis on nurturing critical evaluation skills. User interaction with AI emerged as a significant variable that influenced the tool\u2019s efficacy, highlighting the need for a nuanced approach to its integration into educational settings. The study concludes that while ChatGPT offers promising avenues for both drafting and assessment, and demonstrated a high level of factual accuracy, it is not a substitute for human-led academic enquiry, and students preferred writing their own essays.<\/jats:p>","DOI":"10.1007\/s40593-024-00452-8","type":"journal-article","created":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T11:16:01Z","timestamp":1737717361000},"page":"1793-1824","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":35,"title":["ChatGPT in the Classroom: Evaluating its Role in Fostering Critical Evaluation Skills"],"prefix":"10.1016","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0519-4556","authenticated-orcid":false,"given":"Angela","family":"Oates","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3490-8343","authenticated-orcid":false,"given":"Donna","family":"Johnson","sequence":"additional","affiliation":[]}],"member":"78","published-online":{"date-parts":[[2025,1,24]]},"reference":[{"issue":"2","key":"452_CR1","first-page":"163","volume":"11","author":"RM Aiken","year":"2000","unstructured":"Aiken, R. M., & Epstein, R. G. (2000). Ethical guidelines for AI in education: Starting a conversation. International Journal of Artificial Intelligence in Education, 11(2), 163\u2013176.","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"452_CR2","doi-asserted-by":"crossref","unstructured":"Alaswad, S., Kalganova, T., & Awad, W. (2023). Investigating the Value of Using Emotionally Intelligent Artificial Conversational Agents to Carry out Assessments in Higher Education. 2023 International Conference on IT Innovation and Knowledge Discovery (ITIKD), 1\u20135.","DOI":"10.1109\/ITIKD56332.2023.10099518"},{"key":"452_CR3","doi-asserted-by":"crossref","unstructured":"Ali, M., & Abdel-Haq, M. K. (2021). Bibliographical analysis of artificial intelligence learning in higher education: Is the role of the human educator and educated a thing of the past? Fostering communication and learning with Underutilized technologies in Higher Education (pp. 36\u201352). IGI Global.","DOI":"10.4018\/978-1-7998-4846-2.ch003"},{"issue":"17","key":"452_CR4","first-page":"8427","volume":"12","author":"J Belda-Medina","year":"2022","unstructured":"Belda-Medina, J., & Calvo-Ferrer, J. R. (2022). Using chatbots as AI Conversational partners in Language Learning. NATO Advanced Science Institutes Series E: Applied Sciences, 12(17), 8427.","journal-title":"NATO Advanced Science Institutes Series E: Applied Sciences"},{"issue":"2","key":"452_CR5","first-page":"91","volume":"16","author":"E Benke","year":"2024","unstructured":"Benke, E., & Sz\u0151ke, A. (2024). Academic integrity in the time of artificial intelligence: Exploring student attitudes. Italian Journal of Sociology of Education 16(Italian Journal of Sociology of Education, 16(2), 91\u2013108.","journal-title":"Italian Journal of Sociology of Education 16(Italian Journal of Sociology of Education"},{"key":"452_CR6","unstructured":"Bloom, B. S. (1956). Taxonomy of Educational objectives: The classification of Educational Goals. Longmans."},{"key":"452_CR7","unstructured":"Bozkurt, A., & Sharma, R. C. (2023). Generative AI and prompt Engineering: The art of whispering to let the Genie out of the Algorithmic World. Asian Journal of Distance Education. http:\/\/asianjde.com\/ojs\/index.php\/AsianJDE\/article\/view\/749"},{"key":"452_CR8","unstructured":"ChatGPT. (n.d.). Retrieved September 22 (2023). from https:\/\/chat.openai.com"},{"issue":"103503","key":"452_CR9","doi-asserted-by":"publisher","first-page":"103503","DOI":"10.1016\/j.artint.2021.103503","volume":"298","author":"C Conati","year":"2021","unstructured":"Conati, C., Barral, O., Putnam, V., & Rieger, L. (2021). Toward personalized XAI: A case study in intelligent tutoring systems. Artificial Intelligence, 298(103503), 103503.","journal-title":"Artificial Intelligence"},{"key":"452_CR10","unstructured":"Costello, C. (2020). (n.d.). PEEL Paragraph Writing. Virtual \u200bLibrary. Retrieved May 20, from https:\/\/www.virtuallibrary.info\/peel-paragraph-writing.html"},{"key":"452_CR11","unstructured":"Demaria, M. C., Hodgson, Y., & Czech, D. P. (2018). Perceptions of transferable skills among Biomedical Science Students in the final-year of their degree: What are the implications for Graduate Employability? International Journal of Innovation in Science and Mathematics Education, 26(7). https:\/\/openjournals.library.sydney.edu.au\/index.php\/CAL\/article\/view\/12651"},{"key":"452_CR12","doi-asserted-by":"publisher","unstructured":"Dickey, E., Bejarano, A., & Garg, C. (2023). Innovating computer programming pedagogy: The AI-Lab framework for Generative AI adoption. In arXiv [cs.CY]. arXiv. https:\/\/doi.org\/10.1007\/s42979-024-03074-y","DOI":"10.1007\/s42979-024-03074-y"},{"key":"452_CR13","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.iotcps.2023.06.002","volume":"4","author":"SS Gill","year":"2024","unstructured":"Gill, S. S., Xu, M., Patros, P., Wu, H., Kaur, R., Kaur, K., Fuller, S., Singh, M., Arora, P., Parlikad, A. K., Stankovski, V., Abraham, A., Ghosh, S. K., Lutfiyya, H., Kanhere, S. S., Bahsoon, R., Rana, O., Dustdar, S., Sakellariou, R., & Buyya, R. (2024). Transformative effects of ChatGPT on modern education: Emerging era of AI chatbots. Internet of Things and Cyber-Physical Systems, 4, 19\u201323.","journal-title":"Internet of Things and Cyber-Physical Systems"},{"issue":"2","key":"452_CR14","doi-asserted-by":"publisher","first-page":"24","DOI":"10.14742\/ajet.6646","volume":"37","author":"N Gonz\u00e1lez-Castro","year":"2021","unstructured":"Gonz\u00e1lez-Castro, N., Mu\u00f1oz-Merino, P. J., Alario-Hoyos, C., & Kloos, C. D. (2021). Adaptive learning module for a conversational agent to support MOOC learners. Australasian Journal of Educational Technology, 37(2), 24\u201344.","journal-title":"Australasian Journal of Educational Technology"},{"key":"452_CR15","unstructured":"Gupta, A. (2024). When generative artificial intelligence meets academic integrity: educational opportunities & challenges in a digital age. 14."},{"key":"452_CR16","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.susoc.2022.05.004","volume":"3","author":"A Haleem","year":"2022","unstructured":"Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3, 275\u2013285.","journal-title":"Sustainable Operations and Computers"},{"issue":"01","key":"452_CR17","doi-asserted-by":"publisher","first-page":"71","DOI":"10.56741\/jpes.v2i01.302","volume":"2","author":"UK Hisan","year":"2023","unstructured":"Hisan, U. K., & Amri, M. M. (2023). ChatGPT and Medical Education: A double-edged Sword. Journal of Pedagogy and Education Science, 2(01), 71\u201389.","journal-title":"Journal of Pedagogy and Education Science"},{"key":"452_CR18","unstructured":"Kacperski, C., Ulloa, R., Bonnay, D., Kulshrestha, J., Selb, P., & Spitz, A. (2023). Who are the users of ChatGPT? Implications for the digital divide from web tracking data. In arXiv [cs.CY]. arXiv. http:\/\/arxiv.org\/abs\/2309.02142"},{"issue":"1","key":"452_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.36548\/jaicn.2019.1.001","volume":"1","author":"DNM Kumar","year":"2019","unstructured":"Kumar, D. N. M. (2019). Implementation of artificial intelligence in imparting education and evaluating student performance. Journal of Artificial Intelligence and Capsule Networks, 1(1), 1\u20139.","journal-title":"Journal of Artificial Intelligence and Capsule Networks"},{"issue":"2","key":"452_CR20","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1080\/10494820.2020.1811735","volume":"29","author":"KC Li","year":"2021","unstructured":"Li, K. C., & Wong, B. T. M. (2021). Features and trends of personalised learning: A review of journal publications from 2001 to 2018. Interactive Learning Environments, 29(2), 182\u2013195.","journal-title":"Interactive Learning Environments"},{"issue":"3","key":"452_CR21","first-page":"80","volume":"6","author":"A Mallik","year":"2017","unstructured":"Mallik, A., & Mallik, L. (2017). A review of Education Technology in Digital Age: Classroom Learning for Future and Beyond. Psycho-Educational Research Reviews, 6(3), 80\u201392.","journal-title":"Psycho-Educational Research Reviews"},{"key":"452_CR22","doi-asserted-by":"crossref","unstructured":"Me\u00e7a, A., & Shk\u00eblzeni, N. (2024). Academic integrity in the face of generative language models. Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (pp. 58\u201370). Springer Nature Switzerland.","DOI":"10.1007\/978-3-031-50215-6_5"},{"issue":"5","key":"452_CR23","doi-asserted-by":"publisher","first-page":"59","DOI":"10.14742\/ajet.8902","volume":"39","author":"B Nguyen Thanh","year":"2023","unstructured":"Nguyen Thanh, B., Vo, D. T. H., Nguyen Nhat, M., Pham, T. T. T., Trung, T., H., & Xuan, H., S (2023). Race with the machines: Assessing the capability of generative AI in solving authentic assessments. Australasian Journal of Educational Technology, 39(5), 59\u201381.","journal-title":"Australasian Journal of Educational Technology"},{"key":"452_CR24","doi-asserted-by":"publisher","unstructured":"Petrovska, O., Clift, L., Moller, F., & Pearsall, R. (2024, January 5). Incorporating generative AI into software development education. Proceedings of the 8th Conference on Computing Education Practice. CEP \u201924: Computing Education Practice, Durham United Kingdom. https:\/\/doi.org\/10.1145\/3633053.3633057","DOI":"10.1145\/3633053.3633057"},{"issue":"5","key":"452_CR25","doi-asserted-by":"publisher","first-page":"669","DOI":"10.3233\/HSM-201118","volume":"40","author":"A Rakowska","year":"2021","unstructured":"Rakowska, A., & de Juana-Espinosa, S. (2021). Ready for the future? Employability skills and competencies in the twenty-first century: The view of international experts. Human Systems Management, 40(5), 669\u2013684.","journal-title":"Human Systems Management"},{"key":"452_CR26","unstructured":"Ranasinghe, A. I., & Leisher, D. (2009). The benefit of integrating technology into the classroom. m-hikari.com. http:\/\/www.m-hikari.com\/imf-password2009\/37-40-2009\/ranasingheIMF37-40-2009.pdf?utm_source=Buncee%26utm_campaign=aa3b6ee8c0-EMAIL_CAMPAIGN_2020_07_30_10_40_COPY_01%26utm_medium=email%26utm_term=0_2a223d00c6-aa3b6ee8c0-410994845"},{"key":"452_CR27","unstructured":"Schmohl, T., Watanabe, A., Fr\u00f6hlich, N., & Herzberg, D. (2020). How artificial intelligence can improve the Academic Writing of students. In Conference Proceedings. The Future of Education 2020. conference.pixel-online.net"},{"key":"452_CR28","doi-asserted-by":"publisher","unstructured":"Sok, S., & Heng, K. (2023). ChatGPT for Education and Research: A Review of Benefits and Risks. In Available at SSRN 4378735. https:\/\/doi.org\/10.2139\/ssrn.4378735","DOI":"10.2139\/ssrn.4378735"},{"issue":"1","key":"452_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4018\/JCIT.2021010101","volume":"23","author":"F Tahiru","year":"2021","unstructured":"Tahiru, F. (2021). AI in education: A systematic literature review. Journal of Cases on Information Technology (JCIT), 23(1), 1\u201320.","journal-title":"Journal of Cases on Information Technology (JCIT)"},{"key":"452_CR30","unstructured":"Trucano, M. (2023). AI and the next digital divide in education. https:\/\/policycommons.net\/artifacts\/4514806\/ai-and-the-next-digital-divide-in-education\/5324561\/"},{"issue":"124167","key":"452_CR31","doi-asserted-by":"publisher","first-page":"124167","DOI":"10.1016\/j.eswa.2024.124167","volume":"252","author":"S Wang","year":"2024","unstructured":"Wang, S., Wang, F., Zhu, Z., Wang, J., Tran, T., & Du, Z. (2024). Artificial intelligence in education: A systematic literature review. Expert Systems with Applications, 252(124167), 124167.","journal-title":"Expert Systems with Applications"},{"key":"452_CR32","doi-asserted-by":"publisher","unstructured":"Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023, April 19). Why Johnny can\u2019t prompt: How non-AI experts try (and fail) to design LLM prompts. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. CHI \u201923: CHI Conference on Human Factors in Computing Systems, Hamburg Germany. https:\/\/doi.org\/10.1145\/3544548.3581388","DOI":"10.1145\/3544548.3581388"},{"issue":"1","key":"452_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41239-019-0171-0","volume":"16","author":"O Zawacki-Richter","year":"2019","unstructured":"Zawacki-Richter, O., Mar\u00edn, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education\u2013 where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1\u201327.","journal-title":"International Journal of Educational Technology in Higher Education"},{"key":"452_CR34","doi-asserted-by":"publisher","unstructured":"Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J. B., Yuan, J., & Li, Y. (2021). A review of Artificial Intelligence (AI) in education from 2010 to 2020. Complexity, 2021. https:\/\/doi.org\/10.1155\/2021\/8812542","DOI":"10.1155\/2021\/8812542"}],"container-title":["International Journal of Artificial Intelligence in Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40593-024-00452-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40593-024-00452-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40593-024-00452-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T18:12:37Z","timestamp":1772647957000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40593-024-00452-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,24]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["452"],"URL":"https:\/\/doi.org\/10.1007\/s40593-024-00452-8","relation":{},"ISSN":["1560-4292","1560-4306"],"issn-type":[{"value":"1560-4292","type":"print"},{"value":"1560-4306","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,24]]},"assertion":[{"value":"15 December 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 January 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}