{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T21:43:13Z","timestamp":1788298993867,"version":"build-2803163510"},"reference-count":21,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T00:00:00Z","timestamp":1767830400000},"content-version":"vor","delay-in-days":7,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100006402","name":"Fasa University of Medical Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006402","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Health Science Reports"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background and Aims<\/jats:title>\n                    <jats:p>ChatGPT is a popular large language model with potential educational applications in medicine. However, its performance in standardized, multi\u2010disciplinary medical exams has not been comprehensively assessed. This study evaluates ChatGPT's accuracy and quality in Iran's national medical pre\u2010internship exam.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We tested ChatGPT (GPT\u20103.5, May 3rd version) on 195 multiple\u2010choice questions from the March 2022 Iranian pre\u2010internship exam, covering 23 medical specialties. Questions with visual content were excluded. Each question was asked in a new chat to avoid memory bias. Responses were evaluated by 55 experts using a 5\u2010point Likert scale and compared against the official answer key. Data were analyzed descriptively using SPSS.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>ChatGPT answered 68.6% of questions correctly. Expert ratings averaged 4.23\/5 (SD\u2009=\u20091.21), indicating good to excellent quality. Best\u2010performing specialties included pharmacology (85.7%), otorhinolaryngology (83.3%), and dermatology (83.3%). Lower performance was observed in pulmonology (42.9%) and epidemiology (50%).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>ChatGPT shows promise as a supplemental educational tool in medical education, but its accuracy varies by specialty. Faculty guidance is essential to ensure responsible integration until further improvements and validations are made.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/hsr2.71492","type":"journal-article","created":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T06:07:01Z","timestamp":1767938821000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Examining the Performance of ChatGPT in Comprehensive Pre\u2010Internship Exam: The Potential of Artificial Intelligence in Medical Education"],"prefix":"10.1002","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3401-7244","authenticated-orcid":false,"given":"Michaeel","family":"Motaghi Niko","sequence":"first","affiliation":[{"name":"Department of Nursing Shahrekord University of Medical Sciences Shahrekord Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7658-4124","authenticated-orcid":false,"given":"Zahra","family":"Karbasi","sequence":"additional","affiliation":[{"name":"Department of Health Information Sciences, Faculty of Management and Medical Information Sciences Kerman University of Medical Sciences Kerman Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maryam","family":"Kazemi","sequence":"additional","affiliation":[{"name":"Noncommunicable Diseases Research Center Fasa University of Medical Sciences Fasa Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4090-391X","authenticated-orcid":false,"given":"Maryam","family":"Zahmatkeshan","sequence":"additional","affiliation":[{"name":"Noncommunicable Diseases Research Center Fasa University of Medical Sciences Fasa Iran"},{"name":"School of Allied Medical Sciences Fasa University of Medical Sciences Fasa Iran"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,1,8]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0300-7"},{"key":"e_1_2_12_3_1","first-page":"1877","article-title":"Language Models Are Few\u2010Shot Learners","volume":"33","author":"Brown T.","year":"2020","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2016.146"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41440-024-01624-8"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.nepr.2022.103537"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.2196\/47737"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.2196\/45312"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2023.109732"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1093\/asj\/sjad128"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2023.2187684"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.1093\/ehjdh\/ztad029"},{"key":"e_1_2_12_13_1","volume-title":"Quality of Design and Analysis of Pre\u2010Internship Exams for Medical Students of Hamadan University of Medical Sciences in the Years 2018 to 2020","author":"Rostami M. M.","year":"2022"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2023.1240915"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcpdig.2023.06.004"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.1097\/JCMA.0000000000000946"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.2196\/48039"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1152\/advan.00036.2023"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0043-1774399"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2023-100815"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/1471-0528.17641"}],"container-title":["Health Science Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/hsr2.71492","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/hsr2.71492","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/hsr2.71492","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T11:25:59Z","timestamp":1771241159000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/hsr2.71492"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":21,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1002\/hsr2.71492"],"URL":"https:\/\/doi.org\/10.1002\/hsr2.71492","archive":["Portico"],"relation":{},"ISSN":["2398-8835","2398-8835"],"issn-type":[{"value":"2398-8835","type":"print"},{"value":"2398-8835","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]},"assertion":[{"value":"2024-09-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e71492"}}