{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T18:07:30Z","timestamp":1780337250635,"version":"3.54.1"},"reference-count":27,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T00:00:00Z","timestamp":1780272000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:sec id=\"sec001\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to evaluate and compare the performance of eight contemporary LLMs on the endodontics section of the DUS, assessing their accuracy in both theoretical knowledge and simulated clinical scenarios from historical exam data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec002\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The performance of eight different large language models (Claude 4, DeepSeek V3, Gemini 2.5 Pro, ChatGPT-4o, ChatGPT-5, Grok 4, LLaMA 4, and Perplexity) was evaluated using 127 multiple-choice endodontics questions from the Specialization Exam in Dentistry (DUS) administered by the Student Selection and Placement Center (\u00d6SYM) between 2012 and 2021. The models\u2019 responses were compared against the official answer keys. Statistical analyses were performed using Pearson\u2019s chi-square and McNemar tests, with a significance level of \u03b1\u2009=\u20090.05.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec003\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Significant differences existed among LLMs in overall accuracy (p\u2009&lt;\u20090.001). Gemini 2.5 Pro achieved the highest accuracy (90.6%), outperforming ChatGPT-4o (61.4%) and LLaMA 4 (71.7%). In Clinical Practice Questions (CPQ), Gemini 2.5 Pro (93.9%) surpassed ChatGPT-4o (57.6%; p\u2009=\u20090.019). For General Knowledge and Concept Questions (GKCQ), Gemini 2.5 Pro (89.4%), Grok 4 (85.1%), and DeepSeek V3 (84.0%) exceeded ChatGPT-4o (62.8%; p\u2009&lt;\u20090.001). No significant intra-model differences emerged between CPQ and GKCQ performance (p\u2009&gt;\u20090.05).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec004\">\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Contemporary LLMs demonstrate substantial competence in endodontic knowledge, with Gemini 2.5 Pro excelling in both theoretical and clinical queries. However, significant performance variability across models (61.4%\u221290.6%) and the complexity of retrieving and resolving clinical exam queries necessitate domain-specific optimization and expert oversight for reliable integration into dental education and practice.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1371\/journal.pone.0350457","type":"journal-article","created":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T17:27:32Z","timestamp":1780334852000},"page":"e0350457","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["A comparative analysis of the performance of leading large language models on the endodontics section of the dentistry specialization exam in T\u00fcrkiye"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2463-4011","authenticated-orcid":true,"given":"Beyhan","family":"Ba\u015fkan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hatice K\u00fcbra","family":"Ba\u015fkan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nevzat","family":"Ko\u00e7","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,6,1]]},"reference":[{"issue":"1","key":"pone.0350457.ref001","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1186\/s12909-023-04698-z","article-title":"Revolutionizing healthcare: the role of artificial intelligence in clinical practice","volume":"23","author":"SA Alowais","year":"2023","journal-title":"BMC Med Educ"},{"issue":"1","key":"pone.0350457.ref002","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10916-023-01925-4","article-title":"Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios","volume":"47","author":"M Cascella","year":"2023","journal-title":"J Med Syst"},{"key":"pone.0350457.ref003","doi-asserted-by":"crossref","first-page":"1085251","DOI":"10.3389\/fdmed.2023.1085251","article-title":"Artificial intelligence in dentistry-A review","volume":"4","author":"H Ding","year":"2023","journal-title":"Front Dent Med"},{"issue":"3","key":"pone.0350457.ref004","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1016\/j.identj.2023.12.007","article-title":"Performance of Generative Artificial Intelligence in Dental Licensing Examinations","volume":"74","author":"RCW Chau","year":"2024","journal-title":"Int Dent J"},{"key":"pone.0350457.ref005","first-page":"1","article-title":"Examining the Role of Artificial Intelligence in Assessment: A Comparative Study of ChatGPT and Educator\u2010Generated Multiple\u2010Choice Questions in a Dental Exam","volume":"0","author":"NE \u00d6zer","year":"2025","journal-title":"Eur J Dent Educ"},{"issue":"1","key":"pone.0350457.ref006","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1111\/jerd.12844","article-title":"Applications of artificial intelligence in dentistry: A comprehensive review","volume":"34","author":"F Carrillo-Perez","year":"2022","journal-title":"J Esthet Restor Dent"},{"issue":"2","key":"pone.0350457.ref007","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1002\/ca.24243","article-title":"Comparative assessment of three AI platforms in answering USMLE Step 1 anatomy questions or identifying anatomical structures on radiographs","volume":"38","author":"KMK Al-Khater","year":"2025","journal-title":"Clin Anat"},{"issue":"7","key":"pone.0350457.ref008","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1002\/JPER.23-0514","article-title":"Artificial intelligence in dental education: ChatGPT\u2019s performance on the periodontic in-service examination","volume":"95","author":"A Danesh","year":"2024","journal-title":"J Periodontol"},{"issue":"3","key":"pone.0350457.ref009","doi-asserted-by":"crossref","first-page":"299","DOI":"10.5933\/JKAPD.2024.51.3.299","article-title":"Evaluating the Accuracy of Artificial Intelligence-Based Chatbots on Pediatric Dentistry Questions in the Korean National Dental Board Exam","volume":"51","author":"YS Jung","year":"2024","journal-title":"J Korean Acad Pediatr Dent"},{"issue":"2","key":"pone.0350457.ref010","first-page":"85","article-title":"Artificial Intelligence in Endodontics: A Scoping Review","volume":"19","author":"S Asgary","year":"2024","journal-title":"Iran Endod J"},{"issue":"4","key":"pone.0350457.ref011","doi-asserted-by":"crossref","first-page":"2307","DOI":"10.1016\/j.jds.2025.05.012","article-title":"Performance of artificial intelligence chatbots in National dental licensing examination","volume":"20","author":"C Chan-Chia Lin","year":"2025","journal-title":"J Dent Sci"},{"key":"pone.0350457.ref012"},{"issue":"2","key":"pone.0350457.ref013","doi-asserted-by":"crossref","first-page":"102644","DOI":"10.1016\/j.jormas.2025.102644","article-title":"Can large language models perform clinical anamnesis? Comparative evaluation of ChatGPT, Claude, and Gemini in diagnostic reasoning through case-based questioning in oral and maxillofacial disorders","volume":"127","author":"BE Yilmaz","year":"2026","journal-title":"J Stomatol Oral Maxillofac Surg"},{"issue":"1","key":"pone.0350457.ref014","doi-asserted-by":"crossref","first-page":"1308","DOI":"10.1186\/s12909-025-07896-z","article-title":"Evaluating large language models using national endodontic specialty examination questions: are they ready for real-world dentistry?","volume":"25","author":"EC \u00c7eki\u00e7","year":"2025","journal-title":"BMC Med Educ"},{"issue":"3","key":"pone.0350457.ref015","doi-asserted-by":"crossref","first-page":"1454","DOI":"10.1016\/j.jds.2025.01.025","article-title":"Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey","volume":"20","author":"B Tosun","year":"2025","journal-title":"J Dent Sci"},{"issue":"1","key":"pone.0350457.ref016","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1186\/s12909-024-06389-9","article-title":"Performance of artificial intelligence on Turkish dental specialization exam: can ChatGPT-4.0 and gemini advanced achieve comparable results to humans?","volume":"25","author":"S Sismanoglu","year":"2025","journal-title":"BMC Med Educ"},{"issue":"1","key":"pone.0350457.ref017","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1186\/s12903-025-06050-x","article-title":"Evaluation of the performance of large language models in clinical decision-making in endodontics","volume":"25","author":"Y \u00d6zbay","year":"2025","journal-title":"BMC Oral Health"},{"issue":"1","key":"pone.0350457.ref018","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1186\/s12903-025-05926-2","article-title":"Artificial intelligence performance in answering multiple-choice oral pathology questions: a comparative analysis","volume":"25","author":"BE Yilmaz","year":"2025","journal-title":"BMC Oral Health"},{"issue":"1","key":"pone.0350457.ref019","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1186\/s12909-025-07371-9","article-title":"Assessing ChatGPT-4\u2019s performance on the US prosthodontic exam: impact of fine-tuning and contextual prompting vs. base knowledge, a cross-sectional study","volume":"25","author":"M Dashti","year":"2025","journal-title":"BMC Med Educ"},{"key":"pone.0350457.ref020","doi-asserted-by":"crossref","first-page":"10802","DOI":"10.3390\/app142310802","article-title":"Clinical, research, and educational applications of ChatGPT in dentistry: a narrative review","volume":"14","author":"F Puleio","year":"2024","journal-title":"Applied Sciences"},{"issue":"11","key":"pone.0350457.ref021","doi-asserted-by":"crossref","first-page":"970","DOI":"10.1016\/j.adaj.2023.07.016","article-title":"The performance of artificial intelligence language models in board-style dental knowledge assessment: A preliminary study on ChatGPT","volume":"154","author":"A Danesh","year":"2023","journal-title":"J Am Dent Assoc"},{"issue":"1","key":"pone.0350457.ref022","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.jds.2025.06.007","article-title":"Clinical decision support of advanced large language models in endodontic disease","volume":"21","author":"J Li","year":"2026","journal-title":"J Dent Sci"},{"issue":"1","key":"pone.0350457.ref023","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1186\/s12909-025-06849-w","article-title":"Exploring the potential of artificial intelligence chatbots in prosthodontics education","volume":"25","author":"R Eraslan","year":"2025","journal-title":"BMC Med Educ"},{"issue":"11","key":"pone.0350457.ref024","doi-asserted-by":"crossref","first-page":"1546","DOI":"10.1111\/iej.14127","article-title":"Artificial intelligence in endodontics: Fundamental principles, workflow, and tasks","volume":"57","author":"SA Ourang","year":"2024","journal-title":"Int Endod J"},{"issue":"1","key":"pone.0350457.ref025","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/s12903-025-07346-8","article-title":"Comparison of chatbots\u2019 accuracy in endodontics questions in dentistry specialization exam in T\u00fcrkiye: ChatGPT-4o, Gemini Advanced, Copilot, and Claude","volume":"26","author":"C Turan G\u00f6kduman","year":"2025","journal-title":"BMC Oral Health"},{"issue":"2","key":"pone.0350457.ref026","doi-asserted-by":"crossref","first-page":"221","DOI":"10.11607\/ijp.8852","article-title":"Performance of an Artificial Intelligence-Based Chatbot (ChatGPT) Answering the European Certification in Implant Dentistry Exam","volume":"37","author":"M Revilla-Le\u00f3n","year":"2024","journal-title":"Int J Prosthodont"},{"issue":"1","key":"pone.0350457.ref027","article-title":"Evaluating ChatGPT and Google Gemini Performance and Implications in Turkish Dental Education","volume":"17","author":"I Kinikoglu","year":"2025","journal-title":"Cureus"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0350457","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T17:27:36Z","timestamp":1780334856000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0350457"}},"subtitle":[],"editor":[{"given":"Thiago Machado","family":"Ardenghi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,6,1]]},"references-count":27,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6,1]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0350457","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,1]]}}}