{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T12:18:55Z","timestamp":1788005935694,"version":"build-2784847793"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T00:00:00Z","timestamp":1778457600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T00:00:00Z","timestamp":1783987200000},"content-version":"vor","delay-in-days":64,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Oral Health"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>This study evaluates the performance of ChatGPT-4o on practice questions from the U.S. Integrated National Board Dental Examination (INBDE) and the Chinese Dental Licensing Examination to assess its potential and limitations in a high-stakes dental context.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      ChatGPT-4o and human participants (ten dental undergraduate students, ten graduate students specializing in oral and maxillofacial surgery (OMS), and ten OMS specialists with over five years of clinical experience) were tested on all available questions categorized under oral and maxillofacial surgery from the U.S. Dental Decks online platform (English) and\n                      <jats:italic>the 2024 Chinese Dental Licensing Exam Question Bank<\/jats:italic>\n                      (simplified Chinese). Accuracy (percentage of correct responses) was compared between groups using chi-squared tests.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      ChatGPT-4o achieved an overall accuracy of 90% (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u2009252) on the U.S. Dental Decks, outperforming all human participants on English-language questions (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001), with a moderate magnitude of difference. In contrast, its accuracy on the Chinese question bank was 71% (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u2009567,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001 vs. English performance), a level comparable to that of dental undergraduate and OMS graduate students, but lower than that of OMS specialists (87%,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001), with differences of modest magnitude. By question type, accuracy on the U.S. Dental Decks was consistent across all formats. In the Chinese question bank, performance varied modestly by question type, with the highest accuracy observed for A1-type questions (76%) and the lowest for A2-type questions (61%).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>ChatGPT-4o demonstrated higher accuracy on English-language questions than on Chinese questions, suggesting a potential language-related performance gap. This finding highlights the importance of localized training data for Artificial Intelligence (AI) systems. Its performance in non-English contexts should be interpreted with caution, as it may not yet reach specialist-level expertise.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12903-026-08551-9","type":"journal-article","created":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T02:53:26Z","timestamp":1778468006000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of ChatGPT-4o in oral and maxillofacial surgery examinations: a comparative study of performance on U.S. dental decks and Chinese dental licensing examination practice questions"],"prefix":"10.1186","volume":"26","author":[{"given":"Hao","family":"Zheng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zohreh Yousefian","family":"Zare","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Menghong","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuzhu","family":"Pan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuyao","family":"Ren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoyue","family":"Cui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuexiao","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,11]]},"reference":[{"key":"8551_CR1","doi-asserted-by":"publisher","first-page":"2792","DOI":"10.7150\/ijms.111780","volume":"22","author":"E Yu","year":"2025","unstructured":"Yu E, Chu X, Zhang W, Meng X, Yang Y, Ji X, et al. Large language models in medicine: applications, challenges, and future directions. Int J Med Sci. 2025;22:2792\u2013801.","journal-title":"Int J Med Sci"},{"key":"8551_CR2","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1038\/s43856-023-00370-1","volume":"3","author":"J Clusmann","year":"2023","unstructured":"Clusmann J, Kolbinger FR, Muti HS, Carrero ZI, Eckardt J-N, Laleh NG, et al. The future landscape of large language models in medicine. Commun Med. 2023;3:141.","journal-title":"Commun Med"},{"key":"8551_CR3","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.iotcps.2023.04.003","volume":"3","author":"PP Ray","year":"2023","unstructured":"Ray PP. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Physical Syst. 2023;3:121\u201354.","journal-title":"Internet Things Cyber-Physical Syst"},{"key":"8551_CR4","doi-asserted-by":"publisher","first-page":"e52483","DOI":"10.2196\/52483","volume":"10","author":"Y Wu","year":"2024","unstructured":"Wu Y, Zheng Y, Feng B, Yang Y, Kang K, Zhao A. Embracing ChatGPT for medical education: exploring its impact on doctors and medical students. JMIR Med Educ. 2024;10:e52483.","journal-title":"JMIR Med Educ"},{"key":"8551_CR5","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1186\/s12909-025-06785-9","volume":"25","author":"KY Chan","year":"2025","unstructured":"Chan KY, Yuen TH, Co M. Using ChatGPT for medical education: the technical perspective. BMC Med Educ. 2025;25:201.","journal-title":"BMC Med Educ"},{"key":"8551_CR6","first-page":"23","volume":"13","author":"A Smirnova","year":"2022","unstructured":"Smirnova A. Licensing exams in Canada: a closer look at the validity of the MCCQE Part II. Can Med Educ J. 2022;13:23\u20139.","journal-title":"Can Med Educ J"},{"key":"8551_CR7","doi-asserted-by":"publisher","first-page":"100311","DOI":"10.1016\/j.clinme.2025.100311","volume":"25","author":"I Walker","year":"2025","unstructured":"Walker I, Patel R. The medical licensing assessment (MLA) content map: a list is not a syllabus, and a syllabus is not a curriculum. Clin Med. 2025;25:100311.","journal-title":"Clin Med"},{"key":"8551_CR8","doi-asserted-by":"publisher","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","volume":"2","author":"TH Kung","year":"2023","unstructured":"Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepa\u00f1o C, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health. 2023;2:e0000198.","journal-title":"PLOS Digit Health"},{"key":"8551_CR9","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1053\/j.semnuclmed.2024.05.005","volume":"55","author":"GM Currie","year":"2025","unstructured":"Currie GM, Hawk KE, Rohren EM. Generative artificial intelligence biases, limitations and risks in nuclear medicine: an argument for appropriate use framework and recommendations. Semin Nucl Med. 2025;55:423\u201336.","journal-title":"Semin Nucl Med"},{"key":"8551_CR10","doi-asserted-by":"publisher","first-page":"e56532","DOI":"10.2196\/56532","volume":"26","author":"WJ Waldock","year":"2024","unstructured":"Waldock WJ, Zhang J, Guni A, Nabeel A, Darzi A, Ashrafian H. The accuracy and capability of artificial intelligence solutions in health care examinations and certificates: systematic review and meta-analysis. J Med Internet Res. 2024;26:e56532.","journal-title":"J Med Internet Res"},{"key":"8551_CR11","doi-asserted-by":"publisher","first-page":"616","DOI":"10.1016\/j.identj.2023.12.007","volume":"74","author":"RCW Chau","year":"2024","unstructured":"Chau RCW, Thu KM, Yu OY, Hsung RT, Lo ECM, Lam WYH. Performance of generative artificial intelligence in dental licensing examinations. Int Dent J. 2024;74:616\u201321.","journal-title":"Int Dent J"},{"key":"8551_CR12","doi-asserted-by":"publisher","first-page":"271","DOI":"10.5624\/isd.20240037","volume":"54","author":"M Dashti","year":"2024","unstructured":"Dashti M, Ghasemi S, Ghadimi N, Hefzi D, Karimian A, Zare N, et al. Performance of ChatGPT 3.5 and 4 on U.S. dental examinations: the INBDE, ADAT, and DAT. Imaging Sci Dent. 2024;54:271\u20135.","journal-title":"Imaging Sci Dent"},{"key":"8551_CR13","doi-asserted-by":"publisher","first-page":"2307","DOI":"10.1016\/j.jds.2025.05.012","volume":"20","author":"C Chan-Chia Lin","year":"2025","unstructured":"Chan-Chia Lin C, Sun JS, Chang CH, Chang YH, Zwei-Chieng Chang J. Performance of artificial intelligence chatbots in National dental licensing examination. J Dent Sci. 2025;20:2307\u201314.","journal-title":"J Dent Sci"},{"key":"8551_CR14","doi-asserted-by":"publisher","first-page":"1709","DOI":"10.1016\/j.jds.2025.03.030","volume":"20","author":"YH Wu","year":"2025","unstructured":"Wu YH, Tso KY, Chiang CP. Performance of ChatGPT in answering the oral pathology questions of various types or subjects from Taiwan National Dental Licensing Examinations. J Dent Sci. 2025;20:1709\u201315.","journal-title":"J Dent Sci"},{"key":"8551_CR15","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1016\/j.ijom.2024.06.003","volume":"53","author":"B Quah","year":"2024","unstructured":"Quah B, Yong CW, Lai CWM, Islam I. Performance of large language models in oral and maxillofacial surgery examinations. Int J Oral Maxillofac Surg. 2024;53:881\u20136.","journal-title":"Int J Oral Maxillofac Surg"},{"key":"8551_CR16","doi-asserted-by":"publisher","first-page":"e001632","DOI":"10.1136\/bmjmed-2025-001632","volume":"4","author":"CHART Collaborative","year":"2025","unstructured":"CHART Collaborative. Reporting guideline for chatbot health advice studies: the Chatbot Assessment Reporting Tool (CHART) statement. BMJ Med. 2025;4:e001632.","journal-title":"BMJ Med"},{"key":"8551_CR17","doi-asserted-by":"publisher","first-page":"e0000397","DOI":"10.1371\/journal.pdig.0000397","volume":"2","author":"C Fang","year":"2023","unstructured":"Fang C, Wu Y, Fu W, Ling J, Wang Y, Liu X, et al. How does ChatGPT-4 preform on non-English national medical licensing examination? An evaluation in Chinese language. PLOS Digit Health. 2023;2:e0000397.","journal-title":"PLOS Digit Health"},{"key":"8551_CR18","doi-asserted-by":"publisher","first-page":"e60807","DOI":"10.2196\/60807","volume":"26","author":"M Liu","year":"2024","unstructured":"Liu M, Okuhara T, Chang X, Shirabe R, Nishiie Y, Okada H, et al. Performance of ChatGPT across different versions in medical licensing examinations worldwide: systematic review and meta-analysis. J Med Internet Res. 2024;26:e60807.","journal-title":"J Med Internet Res"},{"key":"8551_CR19","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1038\/s43856-025-00802-0","volume":"5","author":"H Ji","year":"2025","unstructured":"Ji H, Wang X, Sia CH, Yap J, Lim ST, Djohan AH, et al. Large language model comparisons between English and Chinese query performance for cardiovascular prevention. Commun Med (Lond). 2025;5:177.","journal-title":"Commun Med (Lond)"},{"key":"8551_CR20","doi-asserted-by":"publisher","first-page":"e69929","DOI":"10.2196\/69929","volume":"27","author":"W Zhong","year":"2025","unstructured":"Zhong W, Liu Y, Liu Y, Yang K, Gao H, Yan H, et al. Performance of ChatGPT-4o and four open-source large language models in generating diagnoses based on china\u2019s rare disease catalog: comparative study. J Med Internet Res. 2025;27:e69929.","journal-title":"J Med Internet Res"},{"key":"8551_CR21","doi-asserted-by":"publisher","first-page":"14119","DOI":"10.1038\/s41598-025-98949-2","volume":"15","author":"D Luo","year":"2025","unstructured":"Luo D, Liu M, Yu R, Liu Y, Jiang W, Fan Q, et al. Evaluating the performance of GPT-3.5, GPT-4, and GPT-4o in the Chinese National Medical Licensing Examination. Sci Rep. 2025;15:14119.","journal-title":"Sci Rep"},{"key":"8551_CR22","unstructured":"Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, et al. Language models are few-shot learners. Adv Neural Inf Process Syst. 2020;33:1877\u20131901."},{"key":"8551_CR23","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1162\/dint_a_00232","volume":"5","author":"L Li","year":"2023","unstructured":"Li L, Zhang H, Li C, You H, Cui W. Evaluation on ChatGPT for Chinese language understanding. Data Intell. 2023;5:885\u2013903.","journal-title":"Data Intell"}],"container-title":["BMC Oral Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12903-026-08551-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12903-026-08551-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12903-026-08551-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T11:49:49Z","timestamp":1788004189000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s12903-026-08551-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,11]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["8551"],"URL":"https:\/\/doi.org\/10.1186\/s12903-026-08551-9","relation":{},"ISSN":["1472-6831"],"issn-type":[{"value":"1472-6831","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,11]]},"assertion":[{"value":"15 December 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 May 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Ethical approval was waived by the Medical Ethics Committee of the School of Stomatology, China Medical University, as the study posed minimal risk and involved anonymous, non-identifiable data collected for educational evaluation purposes only. Informed consent to participate was waived by the Medical Ethics Committee of the School of Stomatology, China Medical University, as no personal identifiers were collected and participation did not affect academic evaluation or student welfare.","order":1,"name":"Ethics","label":"Ethical approval and consent to participate","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","label":"Consent for publication","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"1247"}}