{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T23:56:31Z","timestamp":1790207791978,"version":"4.1.0"},"reference-count":37,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T00:00:00Z","timestamp":1782086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background\/Objectives: Periodontitis is a highly prevalent chronic disease requiring accurate diagnosis for effective treatment planning. Artificial intelligence (AI) has emerged as a potential tool to support clinical decision-making. This study aimed to compare the diagnostic performance and classification error patterns of a large language model (LLM) and a neural network (NN) in periodontitis classification according to the current staging and grading system. Methods: This retrospective study included 110 patients with periodontal disease. Clinical and demographic variables (age, sex, smoking status, number of teeth, API, BOP, PPD, and CAL) were analyzed. Reference diagnoses were established by two experts. Cases were evaluated using an LLM and a neural network. Model performance was assessed using accuracy, confusion matrices, and Cohen\u2019s kappa coefficient, along with error analysis. Results: The LLM achieved 62% accuracy for stage and 63% for grade classification (\u03ba = 0.48). The neural network showed higher performance, with 85% accuracy for stage and 79% for grade (\u03ba = 0.79 and \u03ba = 0.67, respectively). The LLM more often underestimated disease severity, whereas the neural network tended to overestimate progression. Differences between models were statistically significant (p &lt; 0.0001). Conclusions: In this dataset and classification task, the task-specific neural network demonstrated higher diagnostic performance than the evaluated large language model. However, the findings should be interpreted in light of the fundamentally different training paradigms and intended applications of these AI systems. Further research is required to optimize and validate AI-based approaches for clinical use.<\/jats:p>","DOI":"10.3390\/jcm15124837","type":"journal-article","created":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T01:03:23Z","timestamp":1782263003000},"page":"4837","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Diagnostic Performance and Error Patterns of a Large Language Model and Neural Network in Periodontitis Classification: A Comparative Study"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5812-6915","authenticated-orcid":false,"given":"Agata","family":"Ossowska","sequence":"first","affiliation":[{"name":"Department of Periodontology and Oral Mucosa Diseases, Medical University of Gdansk, 80-200 Gdansk, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2846-1469","authenticated-orcid":false,"given":"Aida","family":"Kusiak","sequence":"additional","affiliation":[{"name":"Department of Periodontology and Oral Mucosa Diseases, Medical University of Gdansk, 80-200 Gdansk, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1515-9064","authenticated-orcid":false,"given":"Albert","family":"Camlet","sequence":"additional","affiliation":[{"name":"Department of Periodontology and Oral Mucosa Diseases, Medical University of Gdansk, 80-200 Gdansk, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9127-7368","authenticated-orcid":false,"given":"Dariusz","family":"\u015awietlik","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Neural Networks, Medical University of Gdansk, 80-210 Gdansk, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"S162","DOI":"10.1111\/jcpe.12946","article-title":"Periodontitis: Consensus report of Workgroup 2 of the 2017 World Workshop on the Classification of Periodontal and Peri-Implant Diseases and Conditions","volume":"45","author":"Papapanou","year":"2018","journal-title":"J. Clin. Periodontol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1177\/0022034514552491","article-title":"Global Burden of Severe Periodontitis in 1990\u20132010: A Systematic Review and Meta-regression","volume":"93","author":"Kassebaum","year":"2014","journal-title":"J. Dent. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"S24","DOI":"10.1111\/jcpe.12089","article-title":"Periodontitis and atherosclerotic cardiovascular disease: Consensus report of the Joint EFP\/AAP Workshop on Periodontitis and Systemic Diseases","volume":"40","author":"Tonetti","year":"2013","journal-title":"J. Clin. Periodontol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"GBD 2017 Oral Disorders Collaborators, Bernabe, E., Marcenes, W., Hernandez, C.R., Bailey, J., Abreu, L.G., Alipour, V., Amini, S., Arabloo, J., and Arefi, Z. (2020). Global, Regional, and National Levels and Trends in Burden of Oral Conditions from 1990 to 2017: A Systematic Analysis for the Global Burden of Disease 2017 Study. J. Dent. Res., 99, 362\u2013373.","DOI":"10.1177\/0022034520908533"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"S149","DOI":"10.1111\/jcpe.12945","article-title":"Staging and grading of periodontitis: Framework and proposal of a new classification and case definition","volume":"45","author":"Tonetti","year":"2018","journal-title":"J. Clin. Periodontol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1902\/jop.1990.61.8.497","article-title":"Comparison of Measurement Variability Using a Standard and Constant Force Periodontal Probe","volume":"61","author":"Osborn","year":"1990","journal-title":"J. Periodontol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1177\/10454411970080030601","article-title":"Periodontal Probing","volume":"8","author":"Hefti","year":"1997","journal-title":"Crit. Rev. Oral Biol. Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1177\/0022034520915714","article-title":"Artificial Intelligence in Dentistry: Chances and Challenges","volume":"99","author":"Schwendicke","year":"2020","journal-title":"J. Dent. Res."},{"key":"ref_9","first-page":"508","article-title":"Developments, application, and performance of artificial intelligence in dentistry\u2014A systematic review","volume":"16","author":"Khanagar","year":"2021","journal-title":"J. Dent. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.jdent.2018.07.015","article-title":"Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm","volume":"77","author":"Lee","year":"2018","journal-title":"J. Dent."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"8495","DOI":"10.1038\/s41598-019-44839-3","article-title":"Deep Learning for the Radiographic Detection of Periodontal Bone Loss","volume":"9","author":"Krois","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_12","unstructured":"Bommasani, R., Hudson, D.A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M.S., Bohg, J., Bosselut, A., and Brunskill, E. (2021). On the Opportunities and Risks of Foundation Models. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Giorgetti, C., Giorgetti, A., Pelotti, S., and Contissa, G. (2026). AI and shared decision-making: A systematic review. AI Soc., ahead of print.","DOI":"10.1007\/s00146-026-02955-5"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1177\/0968533220945766","article-title":"Artificial intelligence in clinical decision-making: Rethinking liability","volume":"20","author":"Smith","year":"2020","journal-title":"Med. Law Int."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1007\/s00146-020-01019-6","article-title":"Clinical AI: Opacity, accountability, responsibility and liability","volume":"36","author":"Smith","year":"2021","journal-title":"AI Soc."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kung, T.H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepa\u00f1o, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., and Maningo, J. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS Digit Health, 2.","DOI":"10.1371\/journal.pdig.0000198"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jafer, M., Ibraheem, W., Dawood, T., Abbas, A., Hakami, K., Khurayzi, T., Hakami, A.J., Alqahtani, S., Aldosari, M., and Ageely, K. (2025). The Application and Performance of Artificial Intelligence (AI) Models in the Diagnosis, Classification, and Prediction of Periodontal Diseases: A Systematic Review. Diagnostics, 15.","DOI":"10.3390\/diagnostics15243247"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: The convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat. Med."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kelly, C.J., Karthikesalingam, A., Suleyman, M., Corrado, G., and King, D. (2019). Key challenges for delivering clinical impact with artificial intelligence. BMC Med., 17.","DOI":"10.1186\/s12916-019-1426-2"},{"key":"ref_21","first-page":"S74","article-title":"Periodontal health and gingival diseases and conditions on an intact and a reduced periodontium: Consensus report of workgroup 1 of the 2017 World Workshop on the Classification of Periodontal and Peri-Implant Diseases and Conditions","volume":"89","author":"Chapple","year":"2018","journal-title":"J. Periodontol."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Butera, A., Gallo, S., Pascadopoli, M., Taccardi, D., and Scribante, A. (2022). Home Oral Care of Periodontal Patients Using Antimicrobial Gel with Postbiotics, Lactoferrin, and Aloe Barbadensis Leaf Juice Powder vs. Conventional Chlorhexidine Gel: A Split-Mouth Randomized Clinical Trial. Antibiotics, 11.","DOI":"10.3390\/antibiotics11010118"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3993","DOI":"10.1111\/odi.14829","article-title":"Ozonized gels vs chlorhexidine in non-surgical periodontal treatment: A randomized clinical trial","volume":"30","author":"Scribante","year":"2024","journal-title":"Oral Dis."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Tayeb, S., Barausse, C., Pellegrino, G., Sansavini, M., Pistilli, R., and Felice, P. (2025). Comparing Artificial Intelligence (ChatGPT, Gemini, DeepSeek) and Oral Surgeons in Detecting Clinically Relevant Drug\u2013Drug Interactions in Dental Therapy. Appl. Sci., 15.","DOI":"10.3390\/app152312851"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"105868","DOI":"10.1016\/j.jdent.2025.105868","article-title":"Impact of artificial intelligence assistance on diagnosing periapical radiolucencies: A randomized controlled trial","volume":"160","author":"Pul","year":"2025","journal-title":"J. Dent."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Thurzo, A., Urbanov\u00e1, W., Nov\u00e1k, B., Czako, L., Siebert, T., Stano, P., Marekov\u00e1, S., Fountoulaki, G., Kosn\u00e1\u010dov\u00e1, H., and Varga, I. (2022). Where Is the Artificial Intelligence Applied in Dentistry? Systematic Review and Literature Analysis. Healthcare, 10.","DOI":"10.3390\/healthcare10071269"},{"key":"ref_27","first-page":"9","article-title":"Implementation of the 2017 Classification of Periodontal and Peri-Implant Diseases by Clinical Dental Hygienists","volume":"99","author":"Li","year":"2025","journal-title":"J. Dent. Hyg."},{"key":"ref_28","first-page":"123","article-title":"The New System for Classification of Periodontal and Peri-Implant Disease: A Questionnaire Study of Implementation by Swedish Dental Hygienists","volume":"22","author":"Malmqvist","year":"2024","journal-title":"Int. J. Dent. Hyg."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Camlet, A., Kusiak, A., Ossowska, A., and \u015awietlik, D. (2025). Advances in Periodontal Diagnostics: Application of MultiModal Language Models in Visual Interpretation of Panoramic Radiographs. Diagnostics, 15.","DOI":"10.3390\/diagnostics15151851"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ossowska, A., Kusiak, A., and \u015awietlik, D. (2022). Artificial Intelligence in Dentistry-Narrative Review. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19063449"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"6629","DOI":"10.1007\/s00784-022-04617-4","article-title":"Application of deep machine learning for the radiographic diagnosis of periodontitis","volume":"26","author":"Chang","year":"2022","journal-title":"Clin. Oral Investig."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ji, E.Y., George, K.A., Ahmadi, Z., Bender, E., Finkelman, M., Mintline, M., Parad, S., Porto, T., Sheng, C.C., and Tadinada, A. (2026). Integrating Artificial Intelligence in Periodontal Diagnosis: A Comparative Evaluation of ChatGPT-4 and Dental Educators. J. Dent. Educ., ahead of print.","DOI":"10.1002\/jdd.70197"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1007\/s00784-024-05799-9","article-title":"Performance of ChatGPT in classifying periodontitis according to the 2018 classification of periodontal diseases","volume":"28","author":"Eroglu","year":"2024","journal-title":"Clin. Oral Investig."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"38","DOI":"10.5051\/jpis.2201060053","article-title":"Determination of the stage and grade of periodontitis according to the current classification of periodontal and peri-implant diseases and conditions (2018) using machine learning algorithms","volume":"53","author":"Pence","year":"2023","journal-title":"J. Periodontal Implant. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Nantakeeratipat, T. (2026). Large language model bias auditing for periodontal diagnosis using an ambiguity-probe methodology: A pilot study. Front. Digit. Health, 7.","DOI":"10.3389\/fdgth.2025.1687820"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"105764","DOI":"10.1016\/j.jdent.2025.105764","article-title":"Accuracy, consistency, and contextual understanding of large language models in restorative dentistry and endodontics","volume":"157","author":"Lafourcade","year":"2025","journal-title":"J. Dent."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1111\/eje.12937","article-title":"ChatGPT-A double-edged sword for healthcare education? Implications for assessments of dental students","volume":"28","author":"Ali","year":"2024","journal-title":"Eur. J. Dent. Educ."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/12\/4837\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T01:30:40Z","timestamp":1782264640000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/12\/4837"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,22]]},"references-count":37,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["jcm15124837"],"URL":"https:\/\/doi.org\/10.3390\/jcm15124837","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,22]]}}}