{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T07:02:46Z","timestamp":1789714966591,"version":"4.0.1"},"reference-count":38,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T00:00:00Z","timestamp":1789603200000},"content-version":"vor","delay-in-days":259,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Dentistry"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Prosthodontics is a specialized branch of dentistry that encompasses a wide range of dental procedures, requiring advanced knowledge and expertise for both healthcare professionals. In this study, we assessed the performance of four widely accessible chatbots, ChatGPT\u20105, Claude 4, Microsoft Copilot, and DeepSeek\u2010V3, using 150 clinical scenario\u2010based prosthodontics multiple\u2010choice questions (MCQs). Evaluating their performance is crucial to ensure reliability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>A total of 150 questions compiled from Bootcamp in English were presented to the four chatbots. We then employed multiple evaluation criteria, such as bilingual evaluation understudy (BLEU), word error rate (WER), cosine semantic similarity, and Flesch reading ease (FRE) score, to provide a more comprehensive assessment of lexical similarity, error rate, semantic consistency, and readability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Among the four chatbots, Microsoft Copilot (accuracy: 74%; confidence interval [CI]: 72.2%\u201376.2%) and ChatGPT\u20105 (accuracy: 73%; CI: 71.5%\u201375.8%) demonstrated the best overall performance, achieving high accuracy at 95% CI. Particularly, ChatGPT\u20105 showed the fewest word errors (WER: 7.86 [95% CI: 6.61\u20139.10]) and FRE readability of FRE: 20.22 (95% CI: 16.26\u201324.19) compared to Microsoft Copilot. In terms of alignment with reference outputs, based on the BLEU score, Claude 4 (0.0106 [95% CI: 0.0058\u20130.0154]) maintained higher scores compared to other analyzed chatbots. Collectively, ChatGPT\u20105 produced a high level of observed accuracy with relatively fewer errors, moderate alignment with the reference answers, and favorable readability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This study suggests that ChatGPT\u20105 demonstrated a favorable overall performance in prosthodontic clinical scenarios, with high observed accuracy, good textual and semantic alignment, relatively fewer errors, and favorable readability.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1155\/ijod\/5985234","type":"journal-article","created":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T06:19:27Z","timestamp":1789712367000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating AI Chatbots in Prosthodontics Education: A Quantitative MCQ\u2010Based Assessment"],"prefix":"10.1155","volume":"2026","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7246-5497","authenticated-orcid":false,"given":"Shankargouda","family":"Patil","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2869-3765","authenticated-orcid":false,"given":"Samuel","family":"Bybee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5613-2924","authenticated-orcid":false,"given":"Venkata Suresh","family":"Venkataiah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6458-1232","authenticated-orcid":false,"given":"Shareef","family":"Amor","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allahe","family":"Majidi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3354-7956","authenticated-orcid":false,"given":"Shilpa","family":"Bhandi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6230-0103","authenticated-orcid":false,"given":"Frank W.","family":"Licari","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,17]]},"reference":[{"key":"e_1_2_13_1_2","first-page":"146","article-title":"Prosthodontic Rehabilitation of Maxillofacial Defects in a Nigerian Teaching Hospital: A 9-Year Review","volume":"18","author":"Ogunrinde T. J.","year":"2020","journal-title":"Annals of Ibadan Postgraduate Medicine"},{"key":"e_1_2_13_2_2","doi-asserted-by":"publisher","DOI":"10.1159\/000092177"},{"key":"e_1_2_13_3_2","doi-asserted-by":"publisher","DOI":"10.3390\/jcm14051495"},{"key":"e_1_2_13_4_2","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph20075364"},{"key":"e_1_2_13_5_2","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.81283"},{"key":"e_1_2_13_6_2","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.66126"},{"key":"e_1_2_13_7_2","doi-asserted-by":"publisher","DOI":"10.2147\/AMEP.S573041"},{"key":"e_1_2_13_8_2","doi-asserted-by":"publisher","DOI":"10.1055\/s-0043-1772674"},{"key":"e_1_2_13_9_2","doi-asserted-by":"publisher","DOI":"10.7861\/fhj.2021-0095"},{"key":"e_1_2_13_10_2","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2023.1237704"},{"key":"e_1_2_13_11_2","article-title":"A Qualitative Thematic Analysis of Addressing the Why: An Artificial Intelligence (AI) in Healthcare Symposium","volume":"14","author":"Borgstadt J. T.","year":"2022","journal-title":"Cureus"},{"key":"e_1_2_13_12_2","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.43271"},{"key":"e_1_2_13_13_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-026-36839-x"},{"key":"e_1_2_13_14_2","doi-asserted-by":"publisher","DOI":"10.3390\/dj13070279"},{"key":"e_1_2_13_15_2","doi-asserted-by":"publisher","DOI":"10.3390\/app16073296"},{"key":"e_1_2_13_16_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-025-07880-7"},{"key":"e_1_2_13_17_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12903-025-06294-7"},{"key":"e_1_2_13_18_2","doi-asserted-by":"publisher","DOI":"10.2196\/40789"},{"key":"e_1_2_13_19_2","article-title":"Benchmarking Open-Source Large Language Models, GPT-4 and Claude 2 on Multiple-Choice Questions in Nephrology","volume":"1","author":"Wu S.","year":"2024","journal-title":"NEJM AI"},{"key":"e_1_2_13_20_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1996.tb00479.x"},{"key":"e_1_2_13_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rmal.2025.100184"},{"key":"e_1_2_13_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2025.116690"},{"key":"e_1_2_13_23_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-022-02240-8"},{"key":"e_1_2_13_24_2","doi-asserted-by":"publisher","DOI":"10.1093\/ajhp\/37.2.215"},{"key":"e_1_2_13_25_2","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/978-1-4614-2071-2_8","volume-title":"Excel 2010 for Educational and Psychological Statistics","author":"Quirk T.","year":"2012"},{"key":"e_1_2_13_26_2","first-page":"1","article-title":"A New Composite Mann\u2013Whitney Test for Two-Sample Survival Comparisons With Right-Censored Data","volume":"18","author":"Hussain A. A.","year":"2026","journal-title":"Journal of Statistical Computation and Simulation"},{"key":"e_1_2_13_27_2","doi-asserted-by":"publisher","DOI":"10.4103\/jpbs.jpbs_78_25"},{"key":"e_1_2_13_28_2","doi-asserted-by":"publisher","DOI":"10.18295\/2075-0528.2970"},{"key":"e_1_2_13_29_2","doi-asserted-by":"publisher","DOI":"10.11607\/ijp.8852"},{"key":"e_1_2_13_30_2","doi-asserted-by":"publisher","DOI":"10.1055\/s-0045-1809155"},{"key":"e_1_2_13_31_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-025-06849-w"},{"key":"e_1_2_13_32_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12903-025-07573-z"},{"key":"e_1_2_13_33_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12967-026-07763-5"},{"key":"e_1_2_13_34_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41405-024-00277-6"},{"key":"e_1_2_13_35_2","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2025.1495378"},{"key":"e_1_2_13_36_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooag054"},{"key":"e_1_2_13_37_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12903-025-05857-y"},{"key":"e_1_2_13_38_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0317423"}],"container-title":["International Journal of Dentistry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/ijod\/5985234","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1155\/ijod\/5985234","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/ijod\/5985234","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T06:19:28Z","timestamp":1789712368000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/ijod\/5985234"}},"subtitle":[],"editor":[{"given":"Hannah","family":"Wesley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1155\/ijod\/5985234"],"URL":"https:\/\/doi.org\/10.1155\/ijod\/5985234","archive":["Portico"],"relation":{},"ISSN":["1687-8728","1687-8736"],"issn-type":[{"value":"1687-8728","type":"print"},{"value":"1687-8736","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]},"assertion":[{"value":"2026-04-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"5985234"}}