{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,27]],"date-time":"2025-09-27T00:04:11Z","timestamp":1758931451225,"version":"3.44.0"},"reference-count":59,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T00:00:00Z","timestamp":1758844800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Digital health tools have the potential to significantly improve the delivery of healthcare services. However, their adoption remains comparatively limited due, in part, to challenges surrounding usability and trust. Large Language Models (LLMs) have emerged as general-purpose models with the ability to process complex information and produce human-quality text, presenting a wealth of potential applications in healthcare. Directly applying LLMs in clinical settings is not straightforward, however, as LLMs are susceptible to providing inconsistent or nonsensical answers. We demonstrate how LLM-based systems, with LLMs acting as agents, can utilize external tools and provide a novel interface between clinicians and digital technologies. This enhances the utility and practical impact of digital healthcare tools and AI models while addressing current issues with using LLMs in clinical settings, such as hallucinations. We illustrate LLM-based interfaces with examples of cardiovascular disease and stroke risk prediction, quantitatively assessing their performance and highlighting the benefit compared to traditional interfaces for digital tools.<\/jats:p>","DOI":"10.3389\/frai.2025.1623339","type":"journal-article","created":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T05:31:58Z","timestamp":1758864718000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Redefining digital health interfaces with large language models"],"prefix":"10.3389","volume":"8","author":[{"given":"Fergus","family":"Imrie","sequence":"first","affiliation":[]},{"given":"Paulius","family":"Rauba","sequence":"additional","affiliation":[]},{"given":"Mihaela","family":"van der Schaar","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,9,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"10","DOI":"10.31478\/202206e","article-title":"The promise of digital health: then, now, and the future","volume":"2022","author":"Abernethy","year":"2022","journal-title":"NAM Perspect"},{"key":"B2","doi-asserted-by":"publisher","first-page":"e008073","DOI":"10.1136\/bmjopen-2015-008073","article-title":"Sustainability of professionals' adherence to clinical practice guidelines in medical care: a systematic review","volume":"5","author":"Ament","year":"2015","journal-title":"BMJ Open"},{"key":"B3","doi-asserted-by":"publisher","first-page":"e15154","DOI":"10.2196\/15154","article-title":"Artificial intelligence and human trust in healthcare: focus on clinicians","volume":"22","author":"Asan","year":"2020","journal-title":"J. Med. Internet Res"},{"key":"B4","doi-asserted-by":"publisher","first-page":"e188","DOI":"10.7861\/fhj.2021-0095","article-title":"Artificial intelligence in healthcare: transforming the practice of medicine","volume":"8","author":"Bajwa","year":"2021","journal-title":"Future Health. J"},{"key":"B5","doi-asserted-by":"publisher","first-page":"1458","DOI":"10.1001\/jama.282.15.1458","article-title":"Why don't physicians follow clinical practice guidelines? a framework for improvement","volume":"282","author":"Cabana","year":"1999","journal-title":"JAMA"},{"key":"B6","unstructured":"Chase\n              H.\n            \n          \n          Langchain\n          \n          2022"},{"key":"B7","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1161\/CIRCULATIONAHA.107.699579","article-title":"General cardiovascular risk profile for use in primary care","volume":"117","author":"D'Agostino","year":"2008","journal-title":"Circulation"},{"key":"B8","doi-asserted-by":"publisher","first-page":"94","DOI":"10.7861\/futurehosp.6-2-94","article-title":"The potential for artificial intelligence in healthcare","volume":"6","author":"Davenport","year":"2019","journal-title":"Future Health. J"},{"key":"B9","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1001\/jamainternmed.2014.368","article-title":"Clinical questions raised by clinicians at the point of care: a systematic review","volume":"174","author":"Del Fiol","year":"2014","journal-title":"JAMA Intern. Med"},{"key":"B10","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.18653\/v1\/2024.emnlp-main.64","article-title":"\u201cA survey on in-context learning,\u201d","volume-title":"Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing","author":"Dong","year":"2024"},{"key":"B11","doi-asserted-by":"publisher","first-page":"429","DOI":"10.2217\/pme-2018-0044","article-title":"Wearables and the medical revolution","volume":"15","author":"Dunn","year":"2018","journal-title":"Per. Med"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2296-8-1","article-title":"Barriers to apply cardiovascular prediction rules in primary care: a postal survey","volume":"8","author":"Eichler","year":"2007","journal-title":"BMC Fam. Pract"},{"key":"B13","unstructured":"33055121\n          Proposed regulatory framework for modifications to artificial intelligence\/machine learning (AI\/ML)-based software as a medical device (SaMD\n          \n          2019"},{"key":"B14","doi-asserted-by":"publisher","first-page":"2864","DOI":"10.1001\/jama.285.22.2864","article-title":"Validation of clinical classification schemes for predicting strokeresults from the national registry of atrial fibrillation","volume":"285","author":"Gage","year":"2001","journal-title":"JAMA"},{"key":"B15","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1093\/jamia\/ocy145","article-title":"Physician stress and burnout: the impact of health information technology","volume":"26","author":"Gardner","year":"2019","journal-title":"J. Am. Med. Inform. Assoc"},{"key":"B16","unstructured":"Goldfarb\n              A.\n            \n            \n              Teodoridis\n              F.\n            \n          \n          Why is AI Adoption in Health Care Lagging\n          \n          2022"},{"key":"B17","doi-asserted-by":"publisher","first-page":"j2099","DOI":"10.1136\/bmj.j2099","article-title":"Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: Prospective cohort study","volume":"357","author":"Hippisley-Cox","year":"2017","journal-title":"BMJ"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1276","DOI":"10.1001\/jama.2018.1171","article-title":"Electronic health record usability issues and potential contribution to patient harm","volume":"319","author":"Howe","year":"2018","journal-title":"JAMA"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pdig.0000276","article-title":"AutoPrognosis 2.0: democratizing diagnostic and prognostic modeling in healthcare with automated machine learning","volume":"2","author":"Imrie","year":"","journal-title":"PLOS Digit. Health"},{"key":"B20","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1038\/s42256-023-00698-2","article-title":"Multiple stakeholders drive diverse interpretability requirements for machine learning in healthcare","volume":"5","author":"Imrie","year":"","journal-title":"Nat. Mach. Intell"},{"key":"B21","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1145\/3571730","article-title":"Survey of hallucination in natural language generation","volume":"55","author":"Ji","year":"2023","journal-title":"ACM Comput. Surv"},{"key":"B22","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-023-06160-y","article-title":"Health system-scale language models are all-purpose prediction engines","volume":"619","author":"Jiang","year":"2023","journal-title":"Nature"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1009","DOI":"10.1093\/jamia\/ocae015","article-title":"Question answering systems for health professionals at the point of care\u2014a systematic review","volume":"31","author":"Kell","year":"2024","journal-title":"J. Am. Med. Inform. Assoc"},{"key":"B24","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1186\/s12916-019-1426-2","article-title":"Key challenges for delivering clinical impact with artificial intelligence","volume":"17","author":"Kelly","year":"2019","journal-title":"BMC Med"},{"key":"B25","doi-asserted-by":"publisher","first-page":"8460","DOI":"10.18653\/v1\/2022.acl-long.579","article-title":"\u2018Internet-augmented dialogue generation","volume":"1","author":"Komeili","year":"2022","journal-title":"Proc. 60th Annu. Meet. Assoc. Comput. Linguist"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2202.01875","article-title":"Rethinking explainability as a dialogue: a practitioner's perspective","author":"Lakkaraju","year":"2022","journal-title":"arXiv preprint arXiv:2202.01875"},{"key":"B27","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/j.diii.2023.02.003","article-title":"Revolutionizing radiology with GPT-based models: current applications, future possibilities and limitations of ChatGPT","volume":"104","author":"Lecler","year":"2023","journal-title":"Diagn. Interv. Imaging"},{"key":"B28","doi-asserted-by":"publisher","first-page":"7155","DOI":"10.1038\/s41598-020-62922-y","article-title":"BEHRT: transformer for electronic health records","volume":"10","author":"Li","year":"2020","journal-title":"Sci. Rep"},{"key":"B29","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1378\/chest.09-1584","article-title":"Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the euro heart survey on atrial fibrillation","volume":"137","author":"Lip","year":"2010","journal-title":"Chest"},{"key":"B30","first-page":"4765","article-title":"A unified approach to interpreting model predictions","volume":"30","author":"Lundberg","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B31","doi-asserted-by":"publisher","first-page":"bbac409","DOI":"10.1093\/bib\/bbac409","article-title":"BioGPT: generative pre-trained transformer for biomedical text generation and mining","volume":"23","author":"Luo","year":"2022","journal-title":"Brief. Bioinformatics"},{"key":"B32","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1038\/s41746-019-0111-3","article-title":"Digital health: a path to validation","volume":"2","author":"Mathews","year":"2019","journal-title":"NPJ Digit. Med"},{"key":"B33","doi-asserted-by":"publisher","first-page":"1906","DOI":"10.18653\/v1\/2020.acl-main.173","article-title":"\u201cOn faithfulness and factuality in abstractive summarization,\u201d","author":"Maynez","year":"2020","journal-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics"},{"key":"B34","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1038\/s41586-023-05881-4","article-title":"Foundation models for generalist medical artificial intelligence","volume":"616","author":"Moor","year":"2023","journal-title":"Nature"},{"key":"B35","doi-asserted-by":"publisher","first-page":"105611","DOI":"10.1016\/j.clsr.2021.105611","article-title":"Transparency of machine-learning in healthcare: the GDPR & European health law","volume":"43","author":"Mourby","year":"2021","journal-title":"Comput. Law Secur. Rev"},{"key":"B36","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1001\/archinternmed.2010.66","article-title":"Barriers to routine risk-score use for healthy primary care patients: survey and qualitative study","volume":"170","author":"M\u00fcller-Riemenschneider","year":"2010","journal-title":"Arch. Intern. Med"},{"key":"B37","doi-asserted-by":"publisher","first-page":"2361","DOI":"10.1016\/j.jacc.2022.11.005","article-title":"The global burden of cardiovascular diseases and risk","volume":"80","author":"Muthiah","year":"2022","journal-title":"J. Am. Coll. Cardiol"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2112.09332","article-title":"WebGPT: browser-assisted question-answering with human feedback","author":"Nakano","year":"2021","journal-title":"arXiv preprint arXiv:2112.09332"},{"key":"B39","volume-title":"Cardiovascular Disease: Risk Assessment and Reduction, Including Lipid Modification","year":"2014"},{"key":"B40","volume-title":"Atrial Fibrillation: Diagnosis and Management","year":"2021"},{"key":"B41","doi-asserted-by":"publisher","first-page":"e428","DOI":"10.1016\/S2589-7500(24)00061-X","article-title":"Ethical and regulatory challenges of large language models in medicine","volume":"6","author":"Ong","year":"2024","journal-title":"Lancet Digit. Health"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2303.08774","article-title":"GPT-4 technical report","year":"2023","journal-title":"arXiv preprint arXiv"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2410.21276","article-title":"GPT-4o system card","year":"2024","journal-title":"arXiv preprint arXiv:2410.21276"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.168","article-title":"\u201cAre NLP models really able to solve simple math word problems?\u201d","author":"Patel","year":"2021","journal-title":"Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies"},{"key":"B45","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","article-title":"AI in health and medicine","volume":"28","author":"Rajpurkar","year":"2022","journal-title":"Nat. Med"},{"key":"B46","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1001\/jama.2019.0161","article-title":"A decade of health information technology usability challenges and the path forward","volume":"321","author":"Ratwani","year":"2019","journal-title":"JAMA"},{"key":"B47","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1016\/j.jbi.2013.06.011","article-title":"Development and validation of a continuous measure of patient condition using the electronic medical record","volume":"46","author":"Rothman","year":"2013","journal-title":"J. Biomed. Inform"},{"key":"B48","first-page":"68539","article-title":"Toolformer: language models can teach themselves to use tools","volume":"36","author":"Schick","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B49","doi-asserted-by":"publisher","first-page":"2439","DOI":"10.1093\/eurheartj\/ehab309","article-title":"SCORE2 risk prediction algorithms: new models to estimate 10-year risk of cardiovascular disease in Europe","volume":"42","year":"2021","journal-title":"Eur. Heart J"},{"key":"B50","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1016\/j.mayocp.2016.05.007","article-title":"Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction","volume":"91","author":"Shanafelt","year":"2016","journal-title":"Mayo Clin. Proc"},{"key":"B51","first-page":"1","article-title":"\u201cRetrieval-augmented large language models for adolescent idiopathic scoliosis patients in shared decision-making,\u201d","volume-title":"Proceedings of the 14th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics","author":"Shi","year":"2023"},{"key":"B52","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature"},{"key":"B53","doi-asserted-by":"crossref","DOI":"10.1145\/3571884.3597144","article-title":"\u201cThe user experience of ChatGPT: findings from a questionnaire study of early users,\u201d","volume-title":"Proceedings of the 5th International Conference on Conversational User Interfaces","author":"Skjuve","year":"2023"},{"key":"B54","doi-asserted-by":"publisher","first-page":"103637","DOI":"10.1016\/j.jbi.2020.103637","article-title":"Language models are an effective representation learning technique for electronic health record data","volume":"113","author":"Steinberg","year":"2021","journal-title":"J. Biomed. Inform"},{"key":"B55","unstructured":""},{"key":"B56","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1038\/s41746-020-0221-y","article-title":"An overview of clinical decision support systems: benefits, risks, and strategies for success","volume":"3","author":"Sutton","year":"2020","journal-title":"NPJ Digit. Med"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2211.09085","article-title":"Galactica: a large language model for science","author":"Taylor","year":"2022","journal-title":"arXiv preprint arXiv:2211.09085"},{"key":"B58","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1038\/s41746-022-00742-2","article-title":"A large language model for electronic health records","volume":"5","author":"Yang","year":"2022","journal-title":"NPJ Digit. Med"},{"key":"B59","article-title":"\u201cReAct: synergizing reasoning and acting in language models,\u201d","volume-title":"The Eleventh International Conference on Learning Representations","author":"Yao","year":"2023"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1623339\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,26]],"date-time":"2025-09-26T05:32:03Z","timestamp":1758864723000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2025.1623339\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,26]]},"references-count":59,"alternative-id":["10.3389\/frai.2025.1623339"],"URL":"https:\/\/doi.org\/10.3389\/frai.2025.1623339","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,26]]},"article-number":"1623339"}}