{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T20:02:36Z","timestamp":1785355356032,"version":"3.55.0"},"reference-count":21,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T00:00:00Z","timestamp":1783296000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"CHARP"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,7,29]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Aims<\/jats:title>\n                    <jats:p>Rising healthcare demand is increasingly outpacing available outpatient capacity in cardiology, where follow-up is often scheduled at fixed intervals despite substantial variation in individual patient risk. This uniform follow-up approach contributes to high outpatient workload and inefficient use of clinical resources. Accurate risk estimation using routinely collected electronic health record (EHR) data may support more individualized follow-up planning by identifying patients at very low risk of mortality or unplanned hospitalization, in whom follow-up intervals could be safely extended.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods and results<\/jats:title>\n                    <jats:p>We developed and validated a machine-learning model as part of the Cardiology Hospital Admission Risk Prediction (CHARP) program. The retrospective baseline cohort comprised 307 792 outpatient visits from 52 989 unique patients at Amsterdam UMC. The primary endpoint was a composite of unplanned cardiac hospitalization or all-cause death within 2 years; the 1-year composite endpoint served as a secondary outcome. Model development and validation were performed in a filtered, leakage-safe prediction cohort using gradient-boosted decision trees (XGBoost) with strict patient-level GroupKFold cross-validation. All predictions and performance metrics were retrospectively evaluated at the outpatient visit (trigger) level. Retrospective model performance was assessed using AUROC, AUPRC, Brier score, calibration curves, and SHAP-based explainability. The final model was technically deployed within the electronic health record to allow automated, visit-level risk estimation in a prospective silent-running environment. In the filtered prediction cohort (199 961 visits), the 2-year composite endpoint prevalence was 16.8%. Across five cross-validation folds, the CHARP model achieved a mean AUROC of 0.77 \u00b1 0.00 and AUPRC of 0.42 \u00b1 0.01, with a Brier score of 0.12, indicating strong overall discrimination and good calibration. Key predictors included NT-proBNP, renal function indices, prior hospitalizations, and cardiac function measures. The deployed CHARP pipeline successfully generated daily risk predictions for all scheduled cardiology outpatients in the EHR environment throughout the silent-running period.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This study shows that machine-learning applied to routine EHR data can deliver clinically meaningful, visit-level risk stratification for cardiology outpatients. The successful EHR integration of CHARP enables prospective evaluation of data-driven follow-up strategies aimed at reducing outpatient clinic burden through safe de-intensification of follow-up for low-risk patients.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/ehjdh\/ztag109","type":"journal-article","created":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T12:29:03Z","timestamp":1783340943000},"source":"Crossref","is-referenced-by-count":0,"title":["Cardiology hospital admission risk prediction: training, internal validation and technical implementation in the electronic health record"],"prefix":"10.1093","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0777-491X","authenticated-orcid":false,"given":"Jasper L","family":"Selder","sequence":"first","affiliation":[{"name":"Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam , De Boelelaan 1118, 1081 HZ Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivier V","family":"Witteman","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam , De Boelelaan 1118, 1081 HZ Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oscar M","family":"van der Meer","sequence":"additional","affiliation":[{"name":"Department of ICT, Amsterdam University Medical Centre, University of Amsterdam , Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Machteld J","family":"Boonstra","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam , De Boelelaan 1118, 1081 HZ Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8296-828X","authenticated-orcid":false,"given":"Stephan","family":"van der Zwaard","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam , De Boelelaan 1118, 1081 HZ Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Folkert W","family":"Asselbergs","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam , De Boelelaan 1118, 1081 HZ Amsterdam ,","place":["The Netherlands"]},{"name":"The National Institute for Health Research University College London Hospitals Biomedical Research Centre, University College London , London ,","place":["United Kingdom"]},{"name":"Institute of Health Informatics, University College London , London ,","place":["United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7013-0116","authenticated-orcid":false,"given":"Marlies P","family":"Schijven","sequence":"additional","affiliation":[{"name":"Department of Surgery, Amsterdam UMC, Location University of Amsterdam , Amsterdam ,","place":["The Netherlands"]},{"name":"Amsterdam Gastroenterology and Metabolism, Amsterdam UMC, University of Amsterdam , Amsterdam ,","place":["The Netherlands"]},{"name":"Amsterdam Public Health, Digital Health, Amsterdam UMC , Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albert C","family":"van Rossum","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam , De Boelelaan 1118, 1081 HZ Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cornelis P","family":"Allaart","sequence":"additional","affiliation":[{"name":"Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam , De Boelelaan 1118, 1081 HZ Amsterdam ,","place":["The Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,7,6]]},"reference":[{"key":"2026072915111978300_ztag109-B1","volume-title":"Health Workforce: Data and Statistics","author":"World Health Organization","year":"2020"},{"key":"2026072915111978300_ztag109-B2","volume-title":"Trendwatch Chartbook 2018","author":"Bates","year":"2018"},{"key":"2026072915111978300_ztag109-B3","doi-asserted-by":"crossref","first-page":"94","DOI":"10.7861\/futurehosp.6-2-94","article-title":"The potential for artificial intelligence in healthcare","volume":"6","author":"Davenport","year":"2019","journal-title":"Future Healthc J"},{"key":"2026072915111978300_ztag109-B4","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.jchf.2019.06.013","article-title":"Machine learning prediction of mortality and hospitalization in heart failure with preserved ejection fraction","volume":"8","author":"Angraal","year":"2020","journal-title":"JACC Heart Fail"},{"key":"2026072915111978300_ztag109-B5","doi-asserted-by":"crossref","first-page":"2809","DOI":"10.1287\/msom.2021.0971","article-title":"Predicting inpatient flow at a major hospital using interpretable analytics","volume":"24","author":"Bertsimas","year":"2022","journal-title":"Manuf Serv Oper Manag"},{"key":"2026072915111978300_ztag109-B6","doi-asserted-by":"crossref","DOI":"10.1001\/jamanetworkopen.2019.17221","article-title":"Development and validation of a machine learning model to aid discharge processes for inpatient surgical care","volume":"2","author":"Safavi","year":"2019","journal-title":"JAMA Netw Open"},{"key":"2026072915111978300_ztag109-B7","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2017-017199","article-title":"Prediction of early unplanned intensive care unit readmission in a UK tertiary care hospital: a cross-sectional machine learning approach","volume":"7","author":"Desautels","year":"2017","journal-title":"BMJ Open"},{"key":"2026072915111978300_ztag109-B8","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1186\/s12911-018-0620-z","article-title":"A machine learning model to predict the risk of 30-day readmissions in patients with heart failure: a retrospective analysis of electronic medical records data","volume":"18","author":"Golas","year":"2018","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026072915111978300_ztag109-B9","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1038\/s41746-020-0249-z","article-title":"Personalized predictions of patient outcomes during and after hospitalization using artificial intelligence","volume":"3","author":"Hilton","year":"2020","journal-title":"NPJ Digit Med"},{"key":"2026072915111978300_ztag109-B10","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0201016","article-title":"Predicting hospital admission at emergency department triage using machine learning","volume":"13","author":"Hong","year":"2018","journal-title":"PLoS One"},{"key":"2026072915111978300_ztag109-B11","doi-asserted-by":"crossref","first-page":"e7","DOI":"10.37765\/ajmc.2020.42147","article-title":"Predicting hospitalizations from electronic health record data","volume":"26","author":"Morawski","year":"2020","journal-title":"Am J Manag Care"},{"key":"2026072915111978300_ztag109-B12","first-page":"A16855","article-title":"Machine learning generated risk model to predict unplanned hospital admission in heart failure","volume":"136","author":"O\u2019Donovan","year":"2017","journal-title":"Circulation"},{"key":"2026072915111978300_ztag109-B13","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pmed.1002695","article-title":"Predicting the risk of emergency admission with machine learning: development and validation using linked electronic health records","volume":"15","author":"Rahimian","year":"2018","journal-title":"PLoS Med"},{"key":"2026072915111978300_ztag109-B14","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1038\/s41746-018-0029-1","article-title":"Scalable and accurate deep learning with electronic health records","volume":"1","author":"Rajkomar","year":"2018","journal-title":"NPJ Digit Med"},{"key":"2026072915111978300_ztag109-B15","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pdig.0000431","article-title":"Infusing behavior science into large language models for activity coaching","volume":"3","author":"Hegde","year":"2024","journal-title":"PLOS Digit Health"},{"key":"2026072915111978300_ztag109-B16","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1097\/CCM.0000000000005758","article-title":"Predicting Readmission or Death After Discharge From the ICU: External Validation and Retraining of a Machine Learning Mode","volume":"51","author":"de Hond","year":"2023","journal-title":"Crit Care Med"},{"key":"2026072915111978300_ztag109-B17","doi-asserted-by":"crossref","first-page":"177","DOI":"10.3390\/computers14050177","article-title":"Development and evaluation of a machine learning model for predicting 30-day readmission in general internal medicine","volume":"14","author":"Al Alawi","year":"2025","journal-title":"Computers"},{"key":"2026072915111978300_ztag109-B18","article-title":"External validation of epic\u2019s risk of unplanned readmission model","volume":"16","author":"Hwang","year":"2021","journal-title":"PLoS One"},{"key":"2026072915111978300_ztag109-B19","doi-asserted-by":"crossref","first-page":"11421","DOI":"10.1038\/s41598-023-45925-3","article-title":"Machine learning-based readmission and mortality prediction in heart failure patients","volume":"13","author":"Sabouri","year":"2023","journal-title":"Sci Rep"},{"key":"2026072915111978300_ztag109-B20","doi-asserted-by":"crossref","DOI":"10.1136\/bmj-2024-082505","article-title":"PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence method","volume":"388","author":"Moons","year":"2025","journal-title":"BMJ"},{"key":"2026072915111978300_ztag109-B21","first-page":"4765","article-title":"A unified approach to interpreting model predictions","volume":"30","author":"Lundberg","year":"2017","journal-title":"Adv Neural Inf Process Syst"}],"container-title":["European Heart Journal - Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ehjdh\/advance-article-pdf\/doi\/10.1093\/ehjdh\/ztag109\/68700956\/ztag109.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/7\/7\/ztag109\/68700956\/ztag109.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ehjdh\/article-pdf\/7\/7\/ztag109\/68700956\/ztag109.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T19:15:16Z","timestamp":1785352516000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ehjdh\/article\/doi\/10.1093\/ehjdh\/ztag109\/8725358"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,6]]},"references-count":21,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,29]]}},"URL":"https:\/\/doi.org\/10.1093\/ehjdh\/ztag109","relation":{},"ISSN":["2634-3916"],"issn-type":[{"value":"2634-3916","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,8]]},"published":{"date-parts":[[2026,7,6]]},"article-number":"ztag109"}}