{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T19:44:12Z","timestamp":1779306252250,"version":"3.51.4"},"reference-count":16,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T00:00:00Z","timestamp":1772064000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM014306"],"award-info":[{"award-number":["R01LM014306"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM014344"],"award-info":[{"award-number":["R01LM014344"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01LM014573"],"award-info":[{"award-number":["R01LM014573"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Clinical practice guidelines (CPGs) provide evidence-based recommendations for patient care; however, integrating them into artificial intelligence (AI) remains challenging. Previous approaches, such as rule-based systems or black-box AI models, face significant limitations, including poor interpretability, inconsistent adherence to guidelines, and narrow domain applicability. To address this, we develop and validate CPGPrompt, an auto-prompting system that converts narrative clinical guidelines into large language models (LLMs).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>Our framework translates CPGs into structured decision trees and utilizes an LLM to dynamically navigate them for patient case evaluation. Synthetic vignettes were generated across 3 domains\u2014headache, lower back pain, and prostate cancer\u2014and distributed into 4 categories to test different decision scenarios. System performance was assessed on both binary specialty referral decisions and fine-grained pathway classification tasks.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The binary specialty referral classification achieved consistently strong performance across all domains (F1: 0.85-1.00), with high recall (1.00\u2009\u00b1\u20090.00). In contrast, multiclass pathway assignment showed reduced performance, with domain-specific variations: headache (F1: 0.47), lower back pain (F1: 0.72), and prostate cancer (F1: 0.77).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Domain-specific performance differences reflected the structure of each guideline. The headache guideline highlighted challenges with negation handling. The lower back pain guideline required temporal reasoning. In contrast, prostate cancer pathways benefited from quantifiable laboratory tests, resulting in more reliable decision-making.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>CPGPrompt demonstrates generalizability across diverse clinical domains while maintaining high sensitivity for referral decisions. Its transparent, auditable framework enables the systematic identification of failure modes and provides advantages over black-box AI approaches. However, persistent challenges with subjective clinical assessments indicate a need for targeted improvements and greater clinical robustness.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocag026","type":"journal-article","created":{"date-parts":[[2026,2,3]],"date-time":"2026-02-03T12:31:06Z","timestamp":1770121866000},"page":"855-862","source":"Crossref","is-referenced-by-count":2,"title":["CPGPrompt: translating clinical guidelines into large language model-executable decision support"],"prefix":"10.1093","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-5958-8259","authenticated-orcid":false,"given":"Ruiqi","family":"Deng","sequence":"first","affiliation":[{"name":"Information Science (Health Tech), Cornell Tech , Cornell University, New York, NY 10044,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-2947-7994","authenticated-orcid":false,"given":"Geoffrey","family":"Martin","sequence":"additional","affiliation":[{"name":"Systems Engineering, Cornell University , Ithaca, NY 14853,","place":["United States"]},{"name":"Population Health Sciences, Weill Cornell Medicine , New York, NY 10065,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tony","family":"Wang","sequence":"additional","affiliation":[{"name":"Computer and Information Science, Cornell University , Ithaca, NY 14853,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0077-3615","authenticated-orcid":false,"given":"Gongbo","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University , New York, NY 10032,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5448-3626","authenticated-orcid":false,"given":"Yi","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Medicine, Weill Cornell Medicine , New York, NY 10065,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9624-0214","authenticated-orcid":false,"given":"Chunhua","family":"Weng","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University , New York, NY 10032,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanshan","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Health Information Management, University of Pittsburgh , Pittsburgh, PA 15260,","place":["United States"]},{"name":"Clinical and Translational Science Institute, University of Pittsburgh , Pittsburgh, PA 15213,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2817-9124","authenticated-orcid":false,"given":"Justin F","family":"Rousseau","sequence":"additional","affiliation":[{"name":"Department of Neurology, UT Southwestern Medical Center , Dallas, TX 75390,","place":["United States"]},{"name":"Peter O\u2019Donnell Jr. Brain Institute, UT Southwestern Medical Center , Dallas, TX 75225,","place":["United States"]},{"name":"Clinical Informatics Center, University of Texas Southwestern Medical Center , Dallas, TX 75390,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9309-8331","authenticated-orcid":false,"given":"Yifan","family":"Peng","sequence":"additional","affiliation":[{"name":"Population Health Sciences, Weill Cornell Medicine , New York, NY 10065,","place":["United States"]},{"name":"Institute of Artificial Intelligence for Digital Health, Weill Cornell Medicine , New York, NY 10065,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2026,2,26]]},"reference":[{"key":"2026041617414646800_ocag026-B1","author":"Donaldson"},{"key":"2026041617414646800_ocag026-B2","doi-asserted-by":"publisher","first-page":"744","DOI":"10.1016\/j.jbi.2013.06.009","article-title":"Computer-interpretable clinical guidelines: a methodological review","volume":"46","author":"Peleg","year":"2013","journal-title":"J Biomed Inform"},{"key":"2026041617414646800_ocag026-B3","doi-asserted-by":"publisher","first-page":"e062158","DOI":"10.1136\/bmjopen-2022-062158","article-title":"Barriers and enablers to implementing clinical practice guidelines in primary care: an overview of systematic reviews","volume":"13","author":"Wang","year":"2023","journal-title":"BMJ Open"},{"key":"2026041617414646800_ocag026-B4","doi-asserted-by":"crossref","DOI":"10.1007\/0-387-36278-9","volume-title":"Biomedical Informatics: Computer Applications in Health Care and Biomedicine","author":"Shortliffe","year":"2006","edition":"3rd"},{"key":"2026041617414646800_ocag026-B5","author":"Li","year":"2023"},{"key":"2026041617414646800_ocag026-B6","author":"Zhu","year":"2024"},{"key":"2026041617414646800_ocag026-B7","doi-asserted-by":"publisher","DOI":"10.3390\/bioengineering12060631","article-title":"Large language models in healthcare and medical applications: a review","volume":"12","author":"Maity","year":"2025","journal-title":"Bioengineering (Basel)"},{"key":"2026041617414646800_ocag026-B8","doi-asserted-by":"publisher","first-page":"e64115","DOI":"10.7759\/cureus.64115","article-title":"Artificial intelligent agent architecture and clinical decision-making in the healthcare sector","volume":"16","author":"Huang","year":"2024","journal-title":"Cureus"},{"key":"2026041617414646800_ocag026-B9","first-page":"1","author":"Chen","year":"2025"},{"key":"2026041617414646800_ocag026-B10","doi-asserted-by":"publisher","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","article-title":"Large language models in medicine","volume":"29","author":"Thirunavukarasu","year":"2023","journal-title":"Nat Med"},{"key":"2026041617414646800_ocag026-B11","author":"Liu","year":"2023"},{"key":"2026041617414646800_ocag026-B12","first-page":"670","article-title":"Guideline for primary care management of headache in adults","volume":"61","author":"Becker","year":"2015","journal-title":"Can Fam Physician"},{"key":"2026041617414646800_ocag026-B13","author":"Toward Optimized Practice Program","year":"2015"},{"key":"2026041617414646800_ocag026-B14","first-page":"33","article-title":"Guideline for referral of patients with suspected prostate cancer by family physicians and other primary care providers","volume":"61","author":"Young","year":"2015","journal-title":"Can Fam Physician"},{"key":"2026041617414646800_ocag026-B15","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1002\/hast.973","article-title":"Artificial intelligence and black-box medical decisions: accuracy versus explainability","volume":"49","author":"London","year":"2019","journal-title":"Hastings Cent Rep"},{"key":"2026041617414646800_ocag026-B16","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1007\/s12553-022-00672-9","article-title":"A systematic review of technologies and standards used in the development of rule-based clinical decision support systems","volume":"12","author":"Papadopoulos","year":"2022","journal-title":"Health Technol"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocag026\/67138169\/ocag026.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/4\/855\/67138169\/ocag026.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/4\/855\/67138169\/ocag026.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T21:43:22Z","timestamp":1776375802000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/33\/4\/855\/8499741"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,26]]},"references-count":16,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,2,26]]},"published-print":{"date-parts":[[2026,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocag026","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,4]]},"published":{"date-parts":[[2026,2,26]]}}}