{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T14:02:32Z","timestamp":1790863352280,"version":"4.1.0"},"reference-count":32,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"4","license":[{"start":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T00:00:00Z","timestamp":1790812800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,10]]},"abstract":"Abstract<\/jats:title>\n \n Aims:<\/jats:title>\n This study aimed to investigate the consistency of ratings, the quality of chatbot-generated removable partial denture (RPD) designs, and the repeatability of chatbot outputs over time through standardized Kennedy classification-based RPD design prompts.<\/jats:p>\n <\/jats:sec>\n \n Settings and Design:<\/jats:title>\n This study used a cross-sectional design to test the consistency of four AI chatbots among raters (ChatGPT; GPT-4; OpenAI, Copilot 1.25062.106.0; Microsoft, AI Chat-AI language model; DeepAI, Claude AI; Claude 3 Opus; Anthropic) on RPD design for 80 virtual Kennedy-classified cases (40 maxillary\/40 mandibular).<\/jats:p>\n <\/jats:sec>\n \n Materials and Methods:<\/jats:title>\n Eighty partially edentulous virtual cases (Class I, I Mod 2, II, II Mod 1, II Mod 2, III Mod 1, III Mod 2, and IV) were assigned to AI chatbots. Each case was randomly assessed three times daily, resulting in 960 responses evaluated. Four removable prosthodontists scored responses using a modified global quality score based on a five-point Likert scale.<\/jats:p>\n <\/jats:sec>\n \n Statistical Analysis Used:<\/jats:title>\n \n Statistical analyses used the intraclass correlation coefficient (ICC) and two-way Analysis of variance ANOVA (\n P<\/jats:italic>\n \u2264 0.05). Interobserver reliability was measured using the ICC, technical quality was compared with an expert consensus reference standard, and repeated-measures ANOVA demonstrated significant temporal variation in chatbot outputs.\n <\/jats:p>\n <\/jats:sec>\n \n Results:<\/jats:title>\n \n All chatbots showed excellent interobserver reliability (ICC >0.90), but the resulting RPD designs had lower scores compared with the expert gold reference standards. Repeated-measures analysis indicated significant intra-rater variability across all chatbots (\n P<\/jats:italic>\n < 0.001), suggesting lower repeatability.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions:<\/jats:title>\n AI chatbots showed excellent interobserver reliability but limited technical quality and temporal stability in the RPD framework design. ChatGPT (GPT-4; OpenAI) performed best, but all models still need expert supervision and further optimisation before use.<\/jats:p>\n <\/jats:sec>","DOI":"10.4103\/jips.jips_182_26","type":"journal-article","created":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T10:01:55Z","timestamp":1790848915000},"page":"362-369","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":0,"title":["Interobserver reliability and temporal variability of artificial intelligence chatbots in Kennedy-classified removable partial denture design: A cross-sectional analysis"],"prefix":"10.4103","volume":"26","author":[{"given":"Shady M.","family":"El Naggar","sequence":"first","affiliation":[{"name":"Department of Removable Prosthodontics, Faculty of Dentistry, Benha National University, Obour City, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ahmed M.","family":"Esmat","sequence":"additional","affiliation":[{"name":"Department of Fixed and Removable Prosthodontics, Oral and Dental Research Institute, National Research Centre, Cairo, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eman G.","family":"Helal","sequence":"additional","affiliation":[{"name":"Department of Fixed and Removable Prosthodontics, Oral and Dental Research Institute, National Research Centre, Cairo, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maie F.","family":"Khalil","sequence":"additional","affiliation":[{"name":"Department of Fixed and Removable Prosthodontics, Oral and Dental Research Institute, National Research Centre, Cairo, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ayman M.","family":"Gouda","sequence":"additional","affiliation":[{"name":"Department of Oral and Maxillofacial Surgery, Faculty of Dentistry, Cairo University, Cairo, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2026,10,1]]},"reference":[{"key":"R1-20261001","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1111\/jopr.70091","article-title":"Harnessing AI in prosthodontics and implant dentistry: An umbrella review of systematic evidence","volume":"35","author":"Alfaraj","year":"2026","journal-title":"J Prosthodont"},{"key":"R2-20261001","doi-asserted-by":"crossref","first-page":"573041","DOI":"10.2147\/AMEP.S573041","article-title":"Application of artificial intelligence in education of prosthodontics and implant dentistry: A review","volume":"17","author":"Gan","year":"2026","journal-title":"Adv Med Educ Pract"},{"key":"R3-20261001","doi-asserted-by":"crossref","first-page":"337","DOI":"10.23736\/S2724-6329.25.05217-9","article-title":"Artificial intelligence in dentistry: A narrative review of applications, challenges, and future directions","volume":"74","author":"DI Cosola","year":"2025","journal-title":"Minerva Dent Oral Sci"},{"key":"R4-20261001","doi-asserted-by":"crossref","first-page":"238","DOI":"10.6026\/973206300200238","article-title":"Artificial intelligence in prosthodontics","volume":"20","author":"Al Hendi","year":"2024","journal-title":"Bioinformation"},{"key":"R5-20261001","first-page":"1","article-title":"Knowledge mapping of artificial intelligence in prosthodontics during 1995-2024: A bibliometric analysis","volume":"11","author":"Hu","year":"2025","journal-title":"Digit Health"},{"key":"R6-20261001","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1186\/s12903-025-07300-8","article-title":"Can artificial intelligence optimize treatment planning and outcome prediction in fixed tooth- and implant-supported prosthodontics? A scoping review","volume":"26","author":"Khaohoen","year":"2025","journal-title":"BMC Oral Health"},{"key":"R7-20261001","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1186\/s13005-025-00521-w","article-title":"Machine learning in dentistry and oral surgery: Charting the course with bibliometric insights","volume":"21","author":"Liu","year":"2025","journal-title":"Head Face Med"},{"key":"R8-20261001","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1111\/cid.13307","article-title":"Deep learning in the overall process of implant prosthodontics: A state-of-the-art review","volume":"26","author":"Ying","year":"2024","journal-title":"Clin Implant Dent Relat Res"},{"key":"R9-20261001","doi-asserted-by":"crossref","first-page":"358","DOI":"10.2186\/jpr.JPR_D_23_00073","article-title":"Applications and performance of artificial intelligence models in removable prosthodontics: A literature review","volume":"68","author":"Ali","year":"2024","journal-title":"J Prosthodont Res"},{"key":"R10-20261001","doi-asserted-by":"crossref","first-page":"115","DOI":"10.2186\/jpr.JPOR_2019_354","article-title":"A system for designing removable partial dentures using artificial intelligence. Part 1. Classification of partially edentulous arches using a convolutional neural network","volume":"65","author":"Takahashi","year":"2021","journal-title":"J Prosthodont Res"},{"key":"R11-20261001","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.identj.2024.11.005","article-title":"Deep learning architecture to infer Kennedy classification of partially edentulous arches using object detection techniques and piecewise annotations","volume":"75","author":"Khurshid","year":"2025","journal-title":"Int Dent J"},{"key":"R12-20261001","first-page":"155","article-title":"A novel artificial intelligence approach to Kennedy classification for partially edentulous patients using panoramic radiographs","volume":"33","author":"Hassan","year":"2025","journal-title":"Eur J Prosthodont Restor Dent"},{"key":"R13-20261001","doi-asserted-by":"crossref","first-page":"27855","DOI":"10.1038\/srep27855","article-title":"An ontology-driven, case-based clinical decision support model for removable partial denture design","volume":"6","author":"Chen","year":"2016","journal-title":"Sci Rep"},{"key":"R14-20261001","doi-asserted-by":"crossref","first-page":"e944310","DOI":"10.12659\/MSM.944310","article-title":"The potential of artificial intelligence in prosthodontics: A comprehensive review","volume":"30","author":"Aljulayfi","year":"2024","journal-title":"Med Sci Monit"},{"key":"R15-20261001","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1186\/s12909-024-05630-9","article-title":"Comparative accuracy of ChatGPT-4, Microsoft copilot and Google Gemini in the Italian entrance test for healthcare sciences degrees: A cross-sectional study","volume":"24","author":"Rossettini","year":"2024","journal-title":"BMC Med Educ"},{"key":"R16-20261001","doi-asserted-by":"crossref","first-page":"102900","DOI":"10.1016\/j.artmed.2024.102900","article-title":"Transformers and large language models in healthcare: A review","volume":"154","author":"Nerella","year":"2024","journal-title":"Artif Intell Med"},{"key":"R17-20261001","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.prosdent.2026.02.009","article-title":"Performance of large language models conducting systematic review tasks in prosthodontics","volume":"136","author":"Rokhshad","year":"2026","journal-title":"J Prosthet Dent"},{"key":"R18-20261001","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1186\/s12909-025-07371-9","article-title":"Assessing ChatGPT-4\u2019s performance on the US prosthodontic exam: Impact of fine-tuning and contextual prompting versus base knowledge, a cross-sectional study","volume":"25","author":"Dashti","year":"2025","journal-title":"BMC Med Educ"},{"key":"R19-20261001","doi-asserted-by":"crossref","first-page":"1454","DOI":"10.1016\/j.jds.2025.01.025","article-title":"Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey","volume":"20","author":"Tosun","year":"2025","journal-title":"J Dent Sci"},{"key":"R20-20261001","doi-asserted-by":"crossref","first-page":"1548","DOI":"10.1186\/s12903-025-06863-w","article-title":"Evaluating the performance of AI chatbots in responding to dental implant FAQs: A comparative study","volume":"25","author":"Tuzlal\u0131","year":"2025","journal-title":"BMC Oral Health"},{"key":"R21-20261001","first-page":"e70302","article-title":"Evaluating large language models in dental anesthesiology: A comparative analysis of ChatGPT-4, claude 3 opus, and Gemini 1.0 on the Japanese dental society of anesthesiology board certification exam","volume":"16","author":"Fujimoto","year":"2024","journal-title":"Cureus"},{"key":"R22-20261001","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1186\/s12903-025-07573-z","article-title":"Assessment of artificial intelligence chatbots in responding to dental occlusion questions: A comparative study","volume":"26","author":"Alqahtani","year":"2025","journal-title":"BMC Oral Health"},{"key":"R23-20261001","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1186\/s12903-025-07612-9","article-title":"Can artificial intelligence chatbots think like dentists? A comparative analysis based on dental specialty examination questions in restorative dentistry","volume":"26","author":"Haberal","year":"2026","journal-title":"BMC Oral Health"},{"key":"R24-20261001","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1186\/s12903-025-05965-9","article-title":"Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses","volume":"25","author":"Esmailpour","year":"2025","journal-title":"BMC Oral Health"},{"key":"R25-20261001","doi-asserted-by":"crossref","first-page":"106564","DOI":"10.1016\/j.jdent.2026.106564","article-title":"Performance and repeatability of different models of chat generative pretrained transformer (GPT) in generating removable partial denture framework designs. A comparative study","volume":"168","author":"Alharbi","year":"2026","journal-title":"J Dent"},{"key":"R26-20261001","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fdmed.2025.1667504","article-title":"Biomechanical considerations in RPD design: Application and perspective of finite element method in distal extension removable partial denture rehabilitation","volume":"6","author":"Zhu","year":"2025","journal-title":"Front Dent Med"},{"key":"R27-20261001","doi-asserted-by":"crossref","first-page":"5802","DOI":"10.1038\/s41598-026-36839-x","article-title":"Evaluation of three artificial intelligence chatbots for generating clinical hematology multiple choice questions for medical students","volume":"16","author":"Boufrikha","year":"2026","journal-title":"Sci Rep"},{"key":"R28-20261001","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1111\/iej.14014","article-title":"Validity and reliability of artificial intelligence chatbots as public sources of information on endodontics","volume":"57","author":"Mohammad-Rahimi","year":"2024","journal-title":"Int Endod J"},{"key":"R29-20261001","doi-asserted-by":"crossref","first-page":"240180","DOI":"10.1098\/rsos.240180","article-title":"Personality testing of large language models: Limited temporal stability, but highlighted prosociality","volume":"11","author":"Bodro\u017ea","year":"2024","journal-title":"R Soc Open Sci"},{"key":"R30-20261001","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.prosdent.2025.03.009","article-title":"Evaluating the validity and consistency of artificial intelligence chatbots in responding to patients\u2019 frequently asked questions in prosthodontics","volume":"134","author":"Gheisarifar","year":"2025","journal-title":"J Prosthet Dent"},{"key":"R31-20261001","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1186\/s12909-025-07880-7","article-title":"Artificial intelligence in dental education: Can AI-based chatbots compete with general practitioners?","volume":"25","author":"Bulut","year":"2025","journal-title":"BMC Med Educ"},{"key":"R32-20261001","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1519\/JSC.0000000000001578","article-title":"Reliability and validity of cervical range of motion and muscle strength testing","volume":"31","author":"Kubas","year":"2017","journal-title":"J Strength Cond Res"}],"container-title":["The Journal of Indian Prosthodontic Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.4103\/jips.jips_182_26","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T13:29:15Z","timestamp":1790861355000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.4103\/jips.jips_182_26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10]]},"references-count":32,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.4103\/jips.jips_182_26","relation":{},"ISSN":["0972-4052","1998-4057"],"issn-type":[{"value":"0972-4052","type":"print"},{"value":"1998-4057","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10]]},"assertion":[{"value":"2026-04-24","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-12","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}