{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T09:02:58Z","timestamp":1784710978583,"version":"3.55.0"},"reference-count":17,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T00:00:00Z","timestamp":1782345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Artificial intelligence and large language models (LLMs) have developed rapidly in recent years and involved in medical education, in addition to clinical care. However, it remains unknown how the performance of LLMs in neonatal resuscitation compares to that of healthcare professionals (HCPs). In this exploratory study, we aimed to investigate and compare the performance of LLMs with those of HCPs on 3 sources of examination questions in the neonatal resuscitation training in Canada and China.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      In this bi-center study, we evaluated the overall accuracy, accuracy across question types, and reliability of LLMs\u2019 (ChatGPT-5 and DeepSeek-R1) responses to neonatal resuscitation questions from workshop in China, NRP\u00ae textbook (8\n                      <jats:sup>th<\/jats:sup>\n                      edition), and Kahoot quizzes in Canada. Each LLM was tested three times per question with one-week intervals in August and September, 2025. Comparisons with historical scores of HCPs in the training courses in China (2022\u20132024) and Canada (2022\u20132025) were performed.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Both LLMs performed comparably to HCPs in Chinese examinations, and showed similar accuracy in NRP\u00ae textbook questions with higher scores on multiple-choice than on short answer questions. ChatGPT achieved higher accuracy than DeepSeek and HCPs in the Kahoot quizzes. ChatGPT also had higher accuracy on scenario-based than on non-scenario-based questions in the workshop examination. High reliability of LLMs\u2019 responses was found (Fleiss\u2019 Kappa&amp;gt;0.89).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Both ChatGPT and DeepSeek achieved accuracy comparable to that of HCPs and showed high consistency on selected neonatal resuscitation written examinations. The findings warrant further research to explore their potential integration in neonatal resuscitation training.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/frai.2026.1838877","type":"journal-article","created":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T05:30:48Z","timestamp":1782365448000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Performance of large language models in neonatal resuscitation assessments versus healthcare providers: an exploratory study"],"prefix":"10.3389","volume":"9","author":[{"given":"Chenguang","family":"Xu","sequence":"first","affiliation":[{"name":"NICU, The University of Hong Kong-Shenzhen Hospital","place":["Shenzhen, China"]},{"name":"Shenzhen University Medical School","place":["Shenzhen, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yihua","family":"Chen","sequence":"additional","affiliation":[{"name":"NICU, The University of Hong Kong-Shenzhen Hospital","place":["Shenzhen, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shelley","family":"Skelding","sequence":"additional","affiliation":[{"name":"NICU, University of Alberta","place":["Edmonton, AB, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dianna","family":"Wang","sequence":"additional","affiliation":[{"name":"NICU, University of Alberta","place":["Edmonton, AB, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qianshen","family":"Zhang","sequence":"additional","affiliation":[{"name":"NICU, The University of Hong Kong-Shenzhen Hospital","place":["Shenzhen, China"]},{"name":"Shenzhen University Medical School","place":["Shenzhen, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Georg M.","family":"Schm\u00f6lzer","sequence":"additional","affiliation":[{"name":"NICU, University of Alberta","place":["Edmonton, AB, Canada"]},{"name":"Centre for the Studies of Asphyxia and Resuscitation, Neonatal Research Unit, Royal Alexandra Hospital","place":["Edmonton, AB, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Po-Yin","family":"Cheung","sequence":"additional","affiliation":[{"name":"NICU, The University of Hong Kong-Shenzhen Hospital","place":["Shenzhen, China"]},{"name":"NICU, University of Alberta","place":["Edmonton, AB, Canada"]},{"name":"Centre for the Studies of Asphyxia and Resuscitation, Neonatal Research Unit, Royal Alexandra Hospital","place":["Edmonton, AB, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,6,25]]},"reference":[{"key":"ref1","volume-title":"Textbook of Neonatal Resuscitation","year":"2021"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"1391","DOI":"10.1186\/s12909-024-06399-7","article-title":"Large language models improve clinical decision making of medical students through patient simulation and structured feedback: a randomized controlled trial","volume":"24","author":"Br\u00fcgge","year":"2024","journal-title":"BMC Med. Educ."},{"key":"ref3","doi-asserted-by":"publisher","first-page":"110563","DOI":"10.1016\/j.resuscitation.2025.110563","article-title":"Evaluating artificial intelligence competency in education: performance evaluation of ChatGPT in the neonatal resuscitation program exam","volume":"209","author":"Demirtas","year":"2025","journal-title":"Resuscitation"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"e51435","DOI":"10.2196\/51435","article-title":"ChatGPT may improve access to language-concordant Care for Patients with non-English Language Preferences","volume":"10","author":"Dzuali","year":"2024","journal-title":"JMIR Med Educ."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"109732","DOI":"10.1016\/j.resuscitation.2023.109732","article-title":"Can ChatGPT pass the life support exams without entering the American heart association course?","volume":"185","author":"Fija\u010dko","year":"2023","journal-title":"Resuscitation"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"e2440969","DOI":"10.1001\/jamanetworkopen.2024.40969","article-title":"Large language model influence on diagnostic reasoning: a randomized clinical trial","volume":"7","author":"Goh","year":"2024","journal-title":"JAMA Netw. Open"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1038\/s41746-025-01475-8","article-title":"Large language model agents can use tools to perform clinical calculations","volume":"8","author":"Goodell","year":"2025","journal-title":"NPJ Digit Med."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1097\/SIH.0000000000000861","article-title":"Exploring the use of a large language model in simulation debriefing: an observational simulation-based pilot study","volume":"20","author":"Hong","year":"2025","journal-title":"Simul. Healthc."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"e262443","DOI":"10.1001\/jamanetworkopen.2026.2443","article-title":"Large language models using clinical text in Pediatrics: a scoping review","volume":"9","author":"Huang","year":"2026","journal-title":"JAMA Netw. Open"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"110451","DOI":"10.1016\/j.resuscitation.2024.110451","article-title":"ChatGPT and pediatric advanced life support: a performance evaluation","volume":"205","author":"Kokulu","year":"2024","journal-title":"Resuscitation"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"e76056","DOI":"10.2196\/76056","article-title":"Performance of DeepSeek and GPT models on Pediatric board preparation questions: comparative evaluation","volume":"4","author":"Mansoor","year":"2025","journal-title":"JMIR AI."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1159\/000542539","article-title":"Effectiveness of neonatal resuscitation training programs, implementation, and scale-up in low and middle-income countries","volume":"122","author":"Sihota","year":"2025","journal-title":"Neonatology"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"e81399","DOI":"10.2196\/81399","article-title":"Performance evaluation of large language models in multilingual medical multiple-choice questions: mixed methods study","volume":"12","author":"Strasser","year":"2026","journal-title":"JMIR Med Educ."},{"key":"ref15","doi-asserted-by":"publisher","first-page":"e064683","DOI":"10.1542\/peds.2023-064683","article-title":"Large language models in Pediatric education: current uses and future potential","volume":"154","author":"Suresh","year":"2024","journal-title":"Pediatrics"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"1518049","DOI":"10.3389\/frai.2025.1518049","article-title":"Benefits, limits, and risks of ChatGPT in medicine","volume":"8","author":"Tangsrivimol","year":"2025","journal-title":"Front Artif Intell."},{"key":"ref17","doi-asserted-by":"publisher","first-page":"109783","DOI":"10.1016\/j.resuscitation.2023.109783","article-title":"ChatGPT can pass the AHA exams: open-ended questions outperform multiple-choice format","volume":"188","author":"Zhu","year":"2023","journal-title":"Resuscitation"}],"updated-by":[{"DOI":"10.3389\/frai.2026.1934012","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T00:00:00Z","timestamp":1784678400000}}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2026.1838877\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T08:30:08Z","timestamp":1784709008000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2026.1838877\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,25]]},"references-count":17,"alternative-id":["10.3389\/frai.2026.1838877"],"URL":"https:\/\/doi.org\/10.3389\/frai.2026.1838877","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,25]]},"article-number":"1838877"}}