{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T01:46:23Z","timestamp":1785721583496,"version":"3.56.0"},"reference-count":13,"publisher":"Wiley","issue":"7","license":[{"start":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T00:00:00Z","timestamp":1775952000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T00:00:00Z","timestamp":1775952000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Oral Pathology Medicine"],"published-print":{"date-parts":[[2026,8]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Artificial intelligence (AI) technologies, particularly large language models (LLMs) such as ChatGPT, are increasingly utilised in medical education and clinical information retrieval. Nevertheless, their capacity to accurately reproduce recommendations from established clinical practice guidelines (CPGs) has not been thoroughly examined. The present study evaluated the concordance between responses generated by GPT\u20105 and recommendations contained in German CPGs addressing oral potentially malignant disorders (OPMDs) and oral carcinomas (OCs).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A cross\u2010sectional analytical comparison was performed between GPT\u20105 outputs and German CPG recommendations available as of October 2025. Individual guideline statements were entered verbatim into GPT\u20105, which was asked to confirm or reject the statements. To assess methodological robustness, inverted versions of the same statements were additionally tested. GPT\u20105 was accessed through the free version without internet connectivity to ensure that responses originated solely from the model's internal training data. Accuracy was defined as the proportion of correctly classified statements. Concordance between guideline content and model responses was quantified using Cohen's \ud835\udf79.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Two German CPGs comprising 111 recommendations were included: the S2k guideline for OPMDs (15 recommendations) and the S3 guideline for OCs (96 recommendations). GPT\u20105 correctly affirmed all authentic recommendations and rejected all inverted statements. Agreement between guideline statements and GPT\u20105 responses was perfect when the original recommendations were analysed (\ud835\udf79 =\u20091.0) and remained very high when both original and inverted statements were evaluated jointly (\ud835\udf79 =\u20090.96). The majority of references cited within the guidelines were published in English (&gt;\u200993%) and originated from outside Germany (&gt;\u200977%).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>When guideline recommendations were presented verbatim, GPT\u20105 demonstrated complete concordance with German oral oncology CPGs. These findings indicate that the model is capable of recognising and retrieving established guideline information. However, this experimental design evaluates recognition of existing statements rather than autonomous clinical reasoning. At present, LLMs should therefore be regarded primarily as educational and informational tools rather than a replacement for expert clinical judgement in oral oncology.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/jop.70140","type":"journal-article","created":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T00:05:48Z","timestamp":1776038748000},"page":"856-860","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluation of\n                    <scp>GPT<\/scp>\n                    \u20105, a Large Language Model, in Replicating German Clinical Practice Guideline Recommendations in Oral Oncology: A Cross\u2010Sectional Concordance Study"],"prefix":"10.1111","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-1399-4270","authenticated-orcid":false,"given":"Julius","family":"Hirsch","sequence":"first","affiliation":[{"name":"Private Oral and Maxillofacial Surgery Practice \u201cDr. Dr. Hirsch &amp; S\u00f6hne\u201d  Ulm Germany"},{"name":"Department of Medicine Danube Private University  Krems an der Donau Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1570-2289","authenticated-orcid":false,"given":"Keskanya","family":"Subbalekha","sequence":"additional","affiliation":[{"name":"Department of Oral and Maxillofacial Surgery, Faculty of Dentistry Chulalongkorn University  Bangkok Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6805-2921","authenticated-orcid":false,"given":"Chatpong","family":"Tangmanee","sequence":"additional","affiliation":[{"name":"Department of Statistics Chulalongkorn University Business School  Bangkok Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3409-7555","authenticated-orcid":false,"given":"Christian","family":"Stoll","sequence":"additional","affiliation":[{"name":"Department of Oral Craniomaxillofacial and Plastic Surgery, Faculty of Medicine, Brandenburg Medical School Theodor Fontane  Brandenburg an der Havel Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7427-3461","authenticated-orcid":false,"given":"Poramate","family":"Pitak\u2010Arnnop","sequence":"additional","affiliation":[{"name":"Department of Oral Craniomaxillofacial and Plastic Surgery, Faculty of Medicine, Brandenburg Medical School Theodor Fontane  Brandenburg an der Havel Germany"},{"name":"Department of Oral, Craniomaxillofacial Plastic, Head and Neck Surgery, Sana Hospital Offenbach Academic Teaching Hospital of Goethe University of Frankfurt  Offenbach am Main Germany"},{"name":"Department of Plastic, Reconstructive, Aesthetic and Hand Surgery, Bayreuth Medical Centre, Faculty of Medicine, Campus Oberfranken Friedrich\u2010Alexander University of Erlangen\u2010Nuremberg  Bayreuth Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,4,12]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2023.e23050"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2024.104620"},{"key":"e_1_2_12_4_1","unstructured":"AWMF \u201cS2k\u2010Leitlinie Diagnostik und Management von Vorl\u00e4uferl\u00e4sionen des oralen Plattenepithelkarzinoms in der Zahn\u2010 Mund\u2010 und Kieferheilkunde. Version 2.1 \u201d accessed October 14 2025 https:\/\/register.awmf.org\/de\/leitlinien\/detail\/007\u2010092."},{"key":"e_1_2_12_5_1","unstructured":"AWMF \u201cS3\u2010Leitlinie Diagnostik und Therapie des Mundh\u00f6hlenkarzinoms. Version 3.0 \u201d accessed October 14 2025 https:\/\/register.awmf.org\/de\/leitlinien\/detail\/007\u2010100OL."},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-52760-9_5"},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1097\/CORR.0000000000003234"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.isci.2024.111493"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41698\u2010024\u201000733\u20104"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.2519\/jospt.2023.12000"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.2519\/jospt.2024.12151"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2025.1574287"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00405\u2010024\u201008525\u2010z"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.818"}],"container-title":["Journal of Oral Pathology &amp; Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jop.70140","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/jop.70140","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jop.70140","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T01:21:44Z","timestamp":1785720104000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jop.70140"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,12]]},"references-count":13,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,8]]}},"alternative-id":["10.1111\/jop.70140"],"URL":"https:\/\/doi.org\/10.1111\/jop.70140","archive":["Portico"],"relation":{},"ISSN":["0904-2512","1600-0714"],"issn-type":[{"value":"0904-2512","type":"print"},{"value":"1600-0714","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,12]]},"assertion":[{"value":"2025-10-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}