{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T05:04:20Z","timestamp":1789535060868,"version":"build-2803163510"},"reference-count":26,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T00:00:00Z","timestamp":1789516800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Endocrinol."],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Large language models (LLMs) may assist in the prevention of diabetes-related foot ulcers; however, their performance in classification may not translate effectively to context-dependent decisions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to evaluate the accuracy, clinical actionability, reproducibility, and safety of five public LLM web interfaces in the context of the International Working Group on the Diabetic Foot (IWGDF) 2023 risk stratification and preventive management.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A prespecified, paired, blinded, noninterventional pilot benchmark was conducted using 20 translated, de-identified, curated cases structured in a fixed clinical sequence and evenly distributed across the four IWGDF risk categories. These input conditions represent an idealized, best-case benchmark rather than routine clinical documentation. Each interface assessed all cases under standardized no-search conditions. The primary outcome was exact agreement with a frozen multidisciplinary consensus risk category. Additional outcomes included screening frequency, need for referral, specialty and urgency of referrals, completeness, interreviewer reliability, repeated-generation stability, and safety.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Each interface classified 20\/20 cases in concordance with the frozen IWGDF reference (100%; Wilson 95% CI 83.9%-100.0%). The 16.1-percentage-point interval below the observed ceiling indicates limited precision and remains compatible with clinically meaningful error in new cases. Of 100 primary outputs, agreement was observed in 89\/100 (89.0%) for referral need, 68\/75 (90.7%) for referral specialty, and 92\/100 (92.0%) for urgency. Median information-item and mandatory-measure coverage was 100.0% for both measures; however, completeness scoring had limited inter-reviewer reliability and should be interpreted cautiously. In an exploratory, hypothesis-generating four-case repeated-generation substudy, all-three-generation consensus concordance was observed in 16\/20 interface-case combinations for referral need, 14\/15 eligible combinations for specialty, and 19\/20 combinations for urgency. These descriptive counts are not estimates of failure probability or tail behavior. Under the prespecified curated no-search benchmark conditions, no major safety errors were observed among 140 outputs; this absence of observed events does not establish safety in routine clinical use.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Performance was highest for structured guideline mapping, though reliability diminished in referral and individualized management across repeated generations. These findings highlight the necessity for auditable, clinician-supervised decision support instead of autonomous deployment.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fendo.2026.1977377","type":"journal-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T04:31:00Z","timestamp":1789533060000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["From risk classification to clinical action: a prespecified paired pilot benchmark of public large language model interfaces for diabetes-related foot ulcer prevention"],"prefix":"10.3389","volume":"17","author":[{"given":"Yang","family":"Wen","sequence":"first","affiliation":[{"name":"Department of Lower Extremity and Orthopedic Surgery, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liyuan","family":"Chen","sequence":"additional","affiliation":[{"name":"Medical Department, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Deng","sequence":"additional","affiliation":[{"name":"Department of Lower Extremity and Orthopedic Surgery, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiaping","family":"Lan","sequence":"additional","affiliation":[{"name":"Department of Lower Extremity and Orthopedic Surgery, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Lower Extremity and Orthopedic Surgery, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Lower Extremity and Orthopedic Surgery, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Lower Extremity and Orthopedic Surgery, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Lower Extremity and Orthopedic Surgery, Suining Central Hospital","place":["Suining, Sichuan, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,16]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.2337\/dci22-0043","article-title":"Etiology, epidemiology, and disparities in the burden of diabetic foot ulcers","volume":"46","author":"McDermott","year":"2023","journal-title":"Diabetes Care"},{"key":"B2","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1111\/iwj.70795","article-title":"Diabetic foot ulcers: a review","volume":"330","author":"Armstrong","year":"2023","journal-title":"JAMA"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1002\/dmrr.3651","article-title":"Guidelines on the prevention of foot ulcers in persons with diabetes (IWGDF 2023 update)","volume":"40","author":"Bus","year":"2024","journal-title":"Diabetes Metab Res Rev"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1002\/dmrr.3657","article-title":"Practical guidelines on the prevention and management of diabetes-related foot disease (IWGDF 2023 update)","volume":"40","author":"Schaper","year":"2024","journal-title":"Diabetes Metab Res Rev"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1002\/dmrr.3686","article-title":"The intersocietal IWGDF, ESVS, SVS guidelines on peripheral artery disease in people with diabetes and a foot ulcer","volume":"40","author":"Fitridge","year":"2024","journal-title":"Diabetes Metab Res Rev"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.2337\/dc26-S012","article-title":"12. Retinopathy, neuropathy, and foot care: standards of care in diabetes-2026","volume":"49","author":"American Diabetes Association Professional Practice Committee for","year":"2026","journal-title":"Diabetes Care"},{"key":"B7","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1186\/s13047-022-00597-6","article-title":"Patient-perceived and practitioner-perceived barriers to accessing foot care services for people with diabetes mellitus: a systematic literature review","volume":"15","author":"McPherson","year":"2022","journal-title":"J Foot Ankle Res"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-024-02855-5","article-title":"Adapted large language models can outperform medical experts in clinical text summarization","volume":"30","author":"Van Veen","year":"2024","journal-title":"Nat Med"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-024-03097-1","article-title":"Evaluation and mitigation of the limitations of large language models in clinical decision-making","volume":"30","author":"Hager","year":"2024","journal-title":"Nat Med"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2024.21700","article-title":"Testing and evaluation of health care applications of large language models: a systematic review","volume":"333","author":"Bedi","year":"2025","journal-title":"JAMA"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.2196\/58041","article-title":"Enhancement of the performance of large language models in diabetes education through retrieval-augmented generation: comparative study","volume":"26","author":"Wang","year":"2024","journal-title":"J Med Internet Res"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.80737","article-title":"Evaluating the performance and safety of large language models in generating type 2 diabetes mellitus management plans: a comparative study with physicians using real patient records","volume":"17","author":"Mondal","year":"2025","journal-title":"Cureus"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2026.1667159","article-title":"Comparative assessment of large language models in diabetic foot infection management: alignment with IWGDF\/IDSA guidelines","volume":"17","author":"Wu","year":"2026","journal-title":"Front Endocrinol (Lausanne)"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01258-7","article-title":"A framework for human evaluation of large language models in healthcare derived from literature review","volume":"7","author":"Tam","year":"2024","journal-title":"NPJ Digit Med"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1161\/cir.0000000000001251","article-title":"2024 ACC\/AHA\/AACVPR\/APMA\/ABC\/SCAI\/SVM\/SVN\/SVS\/SIR\/VESS guideline for the management of lower extremity peripheral artery disease: a report of the American College of Cardiology\/American Heart Association Joint Committee on Clinical Practice Guidelines","volume":"149","author":"Gornik","year":"2024","journal-title":"Circulation"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1161\/cir.0000000000001192","article-title":"Current status and principles for the treatment and prevention of diabetic foot ulcers in the cardiovascular patient population: a scientific statement from the American Heart Association","volume":"149","author":"Gallagher","year":"2024","journal-title":"Circulation"},{"key":"B17","doi-asserted-by":"publisher","first-page":"638","DOI":"10.1186\/s12913-026-14318-3","article-title":"Barriers and facilitators to implementing a national guideline on foot assessment in people with diabetes in primary care: a qualitative study with insights to advance guideline practice, Singapore","volume":"26","author":"Premikha","year":"2026","journal-title":"BMC Health Serv Res"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.2196\/57978","article-title":"The evaluation of generative AI should include repetition to assess stability","volume":"12","author":"Zhu","year":"2024","journal-title":"JMIR Mhealth Uhealth"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2024-081554","article-title":"FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare","volume":"388","author":"Lekadir","year":"2025","journal-title":"BMJ"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2023.12.014","article-title":"Evaluating capabilities of large language models: performance of GPT-4 on surgical knowledge assessments","volume":"175","author":"Beaulieu-Jones","year":"2024","journal-title":"Surgery"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-025-04151-2","article-title":"Holistic evaluation of large language models for medical tasks with MedHELM","volume":"32","author":"Bedi","year":"2026","journal-title":"Nat Med"},{"key":"B22","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1038\/s41746-025-01963-x","article-title":"The evaluation illusion of large language models in medicine","volume":"8","author":"Agrawal","year":"2025","journal-title":"NPJ Digit Med"},{"key":"B23","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1038\/s43856-026-01576-9","article-title":"Multidisciplinary blinded randomized expert evaluation of large language models for clinical diagnosis and management","volume":"6","author":"Chen","year":"2026","journal-title":"Commun Med (Lond)"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/j.annonc.2025.09.001","article-title":"ESMO guidance on the use of large language models in clinical practice (ELCAP)","volume":"36","author":"Wong","year":"2025","journal-title":"Ann Oncol"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.2196\/88058","article-title":"Enhancing physician resilience to generative AI: multilevel framework for shared authority, verification, and skill preservation","volume":"28","author":"Pan","year":"2026","journal-title":"J Med Internet Res"},{"key":"B26","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1038\/s41746-025-01684-1","article-title":"Evaluating large language model workflows in clinical decision support for triage and referral and diagnosis","volume":"8","author":"Gaber","year":"2025","journal-title":"NPJ Digit Med"}],"container-title":["Frontiers in Endocrinology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2026.1977377\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T04:31:10Z","timestamp":1789533070000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2026.1977377\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,16]]},"references-count":26,"alternative-id":["10.3389\/fendo.2026.1977377"],"URL":"https:\/\/doi.org\/10.3389\/fendo.2026.1977377","relation":{},"ISSN":["1664-2392"],"issn-type":[{"value":"1664-2392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,16]]},"article-number":"1977377"}}