{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T18:30:58Z","timestamp":1795113058719,"version":"4.10.3"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T00:00:00Z","timestamp":1766966400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T00:00:00Z","timestamp":1766966400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Educ"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background\/purpose<\/jats:title>\n                    <jats:p>This study aimed to compare the performance of seven leading large language models (Gemini 2.5 Pro, Grok-4, GPT-5, Claude-4, Copilot, Perplexity, and GPT-4o) on pediatric dentistry questions from the Turkish Dentistry Specialization Examination (DUS), and to identify differences in their performance on information-based versus case-based question types.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and methods<\/jats:title>\n                    <jats:p>\n                      Seven large language models (Gemini 2.5 Pro, Grok-4, GPT-5, Claude-4, Copilot, Perplexity, and GPT-4o) were evaluated on 127 multiple-choice questions from the DUS pediatric dentistry question bank (2012\u20132021), classified by experts as information-based (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u200996) and case-based (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u200931). Questions were input in Turkish without modification, and responses were assessed against official answer keys.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Significant differences were observed in overall accuracy rates (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001). The highest overall accuracy was recorded for Gemini 2.5 Pro (94.5%; 120\/127), while the lowest performance was seen with GPT-4o (63.0%; 80\/127). For information-based questions, Gemini answered 92\/96 correctly (95.8%) and GPT-4o 66\/96 (68.7%); for case-based questions, Gemini answered 28\/31 correctly (90.3%) and Perplexity 5\/31 (16.1%). Pairwise Wilcoxon comparisons statistically supported Gemini\u2019s significant superiority over many models and the notably weak performance of GPT-4o and Perplexity on case-based questions (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>LLMs can serve as effective \u201cco\u2011pilots\u201d for information retrieval and exam preparation in dental education but are currently unreliable for diagnostic and treatment decision\u2011making. Clinicians and students should use LLM outputs for review and learning while retaining final decisions based on professional experience, ethical responsibility, and patient\u2011centered judgment. Future research should evaluate and enhance LLMs\u2019 multimodal and visual\u2011data processing capabilities to improve clinical applicability.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12909-025-08315-z","type":"journal-article","created":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T17:05:05Z","timestamp":1767027905000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Performance comparison of large language models on pediatric dentistry questions in the Turkish dentistry specialization examination"],"prefix":"10.1186","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4009-1096","authenticated-orcid":false,"given":"Hatice K\u00fcbra","family":"Ba\u015fkan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2463-4011","authenticated-orcid":false,"given":"Beyhan","family":"Ba\u015fkan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,12,29]]},"reference":[{"key":"8315_CR1","doi-asserted-by":"crossref","unstructured":"Xu X, et al. Development and evaluation of a retrieval-augmented large Language model framework for enhancing endodontic education. Int J Med Informatics. 2025;106006.","DOI":"10.1016\/j.ijmedinf.2025.106006"},{"key":"8315_CR2","doi-asserted-by":"publisher","first-page":"e71186","DOI":"10.2196\/71186","volume":"27","author":"H Mart\u00ednez-Mart\u00ednez","year":"2025","unstructured":"Mart\u00ednez-Mart\u00ednez H, et al. Perceptions of, barriers to, and facilitators of the use of AI in primary care: systematic review of qualitative studies. J Med Internet Res. 2025;27:e71186.","journal-title":"J Med Internet Res"},{"issue":"9","key":"8315_CR3","first-page":"e68813","volume":"16","author":"J Aleksander","year":"2024","unstructured":"Aleksander J, et al. GPT-4o vs. Human candidates: performance analysis in the Polish final dentistry examination. Cureus. 2024;16(9):e68813.","journal-title":"Cureus"},{"key":"8315_CR4","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.amsu.2017.12.005","volume":"25","author":"S Shah","year":"2018","unstructured":"Shah S. Paediatric dentistry-novel evolvement. Annals Med Surg. 2018;25:21\u20139.","journal-title":"Annals Med Surg"},{"issue":"9","key":"8315_CR5","first-page":"e69250","volume":"16","author":"N Alharbi","year":"2024","unstructured":"Alharbi N, Alharbi AS. AI-driven innovations in pediatric dentistry: enhancing care and improving outcome. Cureus. 2024;16(9):e69250.","journal-title":"Cureus"},{"issue":"7","key":"8315_CR6","first-page":"e88505","volume":"17","author":"S Naik","year":"2025","unstructured":"Naik S, et al. Comparative evaluation of diagnosis and treatment plan given by pediatric dentists and generated by chatgpt: A Cross-Sectional pilot study. Cureus. 2025;17(7):e88505.","journal-title":"Cureus"},{"issue":"1 A","key":"8315_CR7","first-page":"119","volume":"71","author":"R Ali","year":"2021","unstructured":"Ali R, Sultan AS, Zahid N. Evaluating the effectiveness of\u2019mcq development workshop using cognitive model framework: A pre-post study. J Pak Med Assoc. 2021;71(1 A):119.","journal-title":"J Pak Med Assoc"},{"issue":"7","key":"8315_CR8","doi-asserted-by":"publisher","first-page":"1098","DOI":"10.1111\/jerd.13046","volume":"35","author":"F Eggmann","year":"2023","unstructured":"Eggmann F, et al. Implications of large Language models such as ChatGPT for dental medicine. J Esthetic Restor Dentistry. 2023;35(7):1098\u2013102.","journal-title":"J Esthetic Restor Dentistry"},{"key":"8315_CR9","doi-asserted-by":"publisher","first-page":"e60684","DOI":"10.2196\/60684","volume":"26","author":"D Stephan","year":"2024","unstructured":"Stephan D, et al. AI in dental Radiology\u2014Improving the efficiency of reporting with chatgpt: comparative study. J Med Internet Res. 2024;26:e60684.","journal-title":"J Med Internet Res"},{"issue":"1","key":"8315_CR10","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1186\/s12903-025-05926-2","volume":"25","author":"BE Yilmaz","year":"2025","unstructured":"Yilmaz BE, Gokkurt BN, Yilmaz, Ozbey F. Artificial intelligence performance in answering multiple-choice oral pathology questions: a comparative analysis. BMC Oral Health. 2025;25(1):573.","journal-title":"BMC Oral Health"},{"issue":"1","key":"8315_CR11","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1186\/s12909-024-06389-9","volume":"25","author":"S Sismanoglu","year":"2025","unstructured":"Sismanoglu S, Capan BS. Performance of artificial intelligence on Turkish dental specialization exam: can ChatGPT-4.0 and gemini advanced achieve comparable results to humans? BMC Med Educ. 2025;25(1):214.","journal-title":"BMC Med Educ"},{"key":"8315_CR12","unstructured":"Student Selection and Placement Center (\u00d6SYM), Ankara: \u00d6SYM, \u2018. https:\/\/www.osym.gov.tr\/TR,15070\/dus-cikmis-sorular.html\u2019. Accessed January 2025."},{"issue":"3","key":"8315_CR13","doi-asserted-by":"publisher","first-page":"271","DOI":"10.5624\/isd.20240037","volume":"54","author":"M Dashti","year":"2024","unstructured":"Dashti M, et al. Performance of ChatGPT 3.5 and 4 on US dental examinations: the INBDE, ADAT, and DAT. Imaging Sci Dentistry. 2024;54(3):271.","journal-title":"Imaging Sci Dentistry"},{"issue":"14","key":"8315_CR14","doi-asserted-by":"publisher","first-page":"2046","DOI":"10.3390\/healthcare11142046","volume":"11","author":"SA Meo","year":"2023","unstructured":"Meo SA, et al. ChatGPT knowledge evaluation in basic and clinical medical sciences: multiple choice question examination-based performance. Healthcare. 2023;11(14):2046.","journal-title":"Healthcare"},{"key":"8315_CR15","doi-asserted-by":"publisher","first-page":"30","DOI":"10.3352\/jeehp.2023.20.30","volume":"20","author":"BC Torres-Zegarra","year":"2023","unstructured":"Torres-Zegarra BC, et al. Performance of ChatGPT, Bard, Claude, and Bing on the Peruvian National licensing medical examination: a cross-sectional study. J Educational Evaluation Health Professions. 2023;20:30.","journal-title":"J Educational Evaluation Health Professions"},{"issue":"7","key":"8315_CR16","doi-asserted-by":"publisher","first-page":"682","DOI":"10.1002\/JPER.23-0514","volume":"95","author":"A Danesh","year":"2024","unstructured":"Danesh A, et al. Artificial intelligence in dental education: chatgpt\u2019s performance on the periodontic in-service examination. J Periodontol. 2024;95(7):682\u20137.","journal-title":"J Periodontol"},{"issue":"1","key":"8315_CR17","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s00276-025-03723-8","volume":"47","author":"BN Gokkurt Yilmaz","year":"2025","unstructured":"Gokkurt Yilmaz BN, Ozbey F, Yilmaz BE. Evaluation of the performance of different large Language models on head and neck anatomy questions in the dentistry specialization exam in Turkey. Surg Radiol Anat. 2025;47(1):211.","journal-title":"Surg Radiol Anat"},{"issue":"7","key":"8315_CR18","doi-asserted-by":"publisher","first-page":"1740","DOI":"10.1111\/jerd.13447","volume":"37","author":"ZM Ozdemir","year":"2025","unstructured":"Ozdemir ZM, Yapici E. Evaluating the Accuracy, Reliability, Consistency, and readability of different large Language models in restorative dentistry. J Esthetic Restor Dentistry. 2025;37(7):1740\u201352.","journal-title":"J Esthetic Restor Dentistry"},{"issue":"2","key":"8315_CR19","doi-asserted-by":"publisher","first-page":"e0000198","DOI":"10.1371\/journal.pdig.0000198","volume":"2","author":"TH Kung","year":"2023","unstructured":"Kung TH, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large Language models. PLoS Digit Health. 2023;2(2):e0000198.","journal-title":"PLoS Digit Health"},{"key":"8315_CR20","first-page":"1","volume":"0","author":"S Patil","year":"2025","unstructured":"Patil S, et al. Reliability and performance of four large Language models in orthodontic knowledge assessment. J Dent Educ. 2025;0:1\u20134.","journal-title":"J Dent Educ"},{"issue":"1","key":"8315_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10143-025-03472-7","volume":"48","author":"S Sau","year":"2025","unstructured":"Sau S, et al. Accuracy and quality of ChatGPT-4o and Google gemini performance on image-based neurosurgery board questions. Neurosurg Rev. 2025;48(1):1\u20139.","journal-title":"Neurosurg Rev"},{"issue":"1","key":"8315_CR22","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1186\/s12909-025-06849-w","volume":"25","author":"R Eraslan","year":"2025","unstructured":"Eraslan R, et al. Exploring the potential of artificial intelligence chatbots in prosthodontics education. BMC Med Educ. 2025;25(1):321.","journal-title":"BMC Med Educ"},{"issue":"1","key":"8315_CR23","doi-asserted-by":"publisher","first-page":"25","DOI":"10.5152\/CRDS.2024.23261","volume":"34","author":"RT O\u011fuzman","year":"2024","unstructured":"O\u011fuzman RT, Yurdabakan ZZ. Performance of chat generative pretrained transformer and bard on the questions asked in the dental specialty entrance examination in Turkey regarding bloom\u2019s revised taxonomy. Curr Res Dent Sci. 2024;34(1):25\u201334.","journal-title":"Curr Res Dent Sci"},{"issue":"1","key":"8315_CR24","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1186\/s12903-025-05965-9","volume":"25","author":"H Esmailpour","year":"2025","unstructured":"Esmailpour H, et al. Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses. BMC Oral Health. 2025;25(1):574.","journal-title":"BMC Oral Health"},{"issue":"2","key":"8315_CR25","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1016\/j.jds.2024.08.020","volume":"20","author":"H-S Kim","year":"2025","unstructured":"Kim H-S, Kim G-T. Can a large Language model create acceptable dental board-style examination questions? A cross-sectional prospective study. J Dent Sci. 2025;20(2):895\u2013900.","journal-title":"J Dent Sci"},{"issue":"5","key":"8315_CR26","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1097\/ACM.0000000000005626","volume":"99","author":"MC Laupichler","year":"2024","unstructured":"Laupichler MC, et al. Large Language models in medical education: comparing ChatGPT-to human-generated exam questions. Acad Med. 2024;99(5):508\u201312.","journal-title":"Acad Med"},{"issue":"7","key":"8315_CR27","doi-asserted-by":"publisher","first-page":"e28198","DOI":"10.1016\/j.heliyon.2024.e28198","volume":"10","author":"WM Ahmed","year":"2024","unstructured":"Ahmed WM, et al. The quality of AI-generated dental caries multiple choice questions: A comparative analysis of ChatGPT and Google bard Language models. Heliyon. 2024;10(7):e28198.","journal-title":"Heliyon"},{"issue":"1","key":"8315_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12909-025-07875-4","volume":"25","author":"BN Gokkurt Yilmaz","year":"2025","unstructured":"Gokkurt Yilmaz BN, Ozbey F, Yilmaz BE. Effect of artificial intelligence-assisted personalized feedback on radiographic diagnostic performance of dental students: a controlled study. BMC Med Educ. 2025;25(1):1\u20139.","journal-title":"BMC Med Educ"},{"issue":"7","key":"8315_CR29","first-page":"e27405","volume":"14","author":"P Agrawal","year":"2022","unstructured":"Agrawal P, Nikhade P, Nikhade PP. Artificial intelligence in dentistry: past, present, and future. Cureus. 2022;14(7):e27405.","journal-title":"Cureus"},{"issue":"l7","key":"8315_CR30","first-page":"1488","volume":"87","author":"TT Nguyen","year":"2021","unstructured":"Nguyen TT, et al. Use of artificial intelligence in dentistry: current clinical trends and research advances. J Can Dent Assoc. 2021;87(l7):1488\u20132159.","journal-title":"J Can Dent Assoc"},{"issue":"11","key":"8315_CR31","doi-asserted-by":"publisher","first-page":"1570","DOI":"10.1002\/jdd.13337","volume":"87","author":"CS Kim","year":"2023","unstructured":"Kim CS, et al. Artificial intelligence (AI) in dental curricula: ethics and responsible integration. J Dent Educ. 2023;87(11):1570\u20133.","journal-title":"J Dent Educ"},{"issue":"8","key":"8315_CR32","first-page":"871","volume":"60","author":"C Han","year":"2025","unstructured":"Han C, et al. Preliminary exploration of the applications of five large Language models in the field of oral auxiliary diagnosis, treatment and health consultation. Zhonghua Kou Qiang Yi Xue Za zhi\u2009=\u2009Zhonghua Kouqiang Yixue Zazhi\u2009=\u2009Chinese. J Stomatology. 2025;60(8):871\u20138.","journal-title":"J Stomatology"},{"issue":"6","key":"8315_CR33","doi-asserted-by":"publisher","first-page":"261","DOI":"10.3390\/dj13060261","volume":"13","author":"V Ronsivalle","year":"2025","unstructured":"Ronsivalle V, et al. Current applications of chatbots powered by large Language models in oral and maxillofacial surgery: A systematic review. Dentistry J. 2025;13(6):261.","journal-title":"Dentistry J"},{"issue":"1","key":"8315_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12903-025-06050-x","volume":"25","author":"Y \u00d6zbay","year":"2025","unstructured":"\u00d6zbay Y, Erdo\u011fan D, Din\u00e7er GA. Evaluation of the performance of large Language models in clinical decision-making in endodontics. BMC Oral Health. 2025;25(1):1\u20139.","journal-title":"BMC Oral Health"}],"container-title":["BMC Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-025-08315-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12909-025-08315-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-025-08315-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T17:05:07Z","timestamp":1767027907000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s12909-025-08315-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,29]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["8315"],"URL":"https:\/\/doi.org\/10.1186\/s12909-025-08315-z","relation":{},"ISSN":["1472-6920"],"issn-type":[{"value":"1472-6920","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,29]]},"assertion":[{"value":"24 September 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 November 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 December 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable. Because this study does not involve research on human subjects, it does not require compliance with the Declaration of Helsinki.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1734"}}