{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T01:50:02Z","timestamp":1774317002033,"version":"3.50.1"},"reference-count":48,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2025,3,24]],"date-time":"2025-03-24T00:00:00Z","timestamp":1742774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"Cisco Research"},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R35GM128672"],"award-info":[{"award-number":["R35GM128672"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS 2124127"],"award-info":[{"award-number":["IIS 2124127"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000738","name":"Veterans Affairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000738","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Medical Center"},{"DOI":"10.13039\/100000738","name":"Department of Veterans Affairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000738","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>To quantify differences between (1) stratifying patients by predicted disease onset risk alone and (2) stratifying by predicted disease onset risk and severity of downstream outcomes. We perform a case study of predicting sepsis.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>We performed a retrospective analysis using observational data from Michigan Medicine at the University of Michigan (U-M) between 2016 and 2020 and the Beth Israel Deaconess Medical Center (BIDMC) between 2008 and 2012. We measured the correlation between the estimated sepsis risk and the estimated effect of sepsis on mortality using Spearman\u2019s correlation. We compared patients stratified by sepsis risk with patients stratified by sepsis risk and effect of sepsis on mortality.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The U-M and BIDMC cohorts included 7282 and 5942 ICU visits; 7.9% and 8.1% developed sepsis, respectively. Among visits with sepsis, 21.9% and 26.3% experienced mortality at U-M and BIDMC. The effect of sepsis on mortality was weakly correlated with sepsis risk (U-M: 0.35 [95% CI: 0.33-0.37], BIDMC: 0.31 [95% CI: 0.28-0.34]). High-risk patients identified by both stratification approaches overlapped by 66.8% and 52.8% at U-M and BIDMC, respectively. Accounting for risk of mortality identified an older population (U-M: age\u2009=\u200966.0 [interquartile range\u2014IQR: 55.0-74.0] vs age\u2009=\u200963.0 [IQR: 51.0-72.0], BIDMC: age\u2009=\u200974.0 [IQR: 61.0-83.0] vs age\u2009=\u200968.0 [IQR: 59.0-78.0]).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Predictive models that guide selective interventions ignore the effect of disease on downstream outcomes. Reformulating patient stratification to account for the estimated effect of disease on downstream outcomes identifies a different population compared to stratification on disease risk alone.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Models that predict the risk of disease and ignore the effects of disease on downstream outcomes could be suboptimal for stratification.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocaf036","type":"journal-article","created":{"date-parts":[[2025,3,29]],"date-time":"2025-03-29T03:03:51Z","timestamp":1743217431000},"page":"905-913","source":"Crossref","is-referenced-by-count":1,"title":["Reformulating patient stratification for targeting interventions by accounting for severity of downstream outcomes resulting from disease onset: a case study in sepsis"],"prefix":"10.1093","volume":"32","author":[{"given":"Fahad","family":"Kamran","sequence":"first","affiliation":[{"name":"Division of Computer Science and Engineering, Department of Electrical Engineering and Computer Science, University of Michigan , Ann Arbor, MI 48109,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7303-9123","authenticated-orcid":false,"given":"Donna","family":"Tjandra","sequence":"additional","affiliation":[{"name":"Division of Computer Science and Engineering, Department of Electrical Engineering and Computer Science, University of Michigan , Ann Arbor, MI 48109,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas S","family":"Valley","sequence":"additional","affiliation":[{"name":"Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan , Ann Arbor, MI 48109,","place":["United States"]},{"name":"VA Center for Clinical Management Research , Ann Arbor, MI 48105,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hallie C","family":"Prescott","sequence":"additional","affiliation":[{"name":"Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan , Ann Arbor, MI 48109,","place":["United States"]},{"name":"VA Center for Clinical Management Research , Ann Arbor, MI 48105,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9385-7158","authenticated-orcid":false,"given":"Nigam H","family":"Shah","sequence":"additional","affiliation":[{"name":"Department of Medicine\u2014Center for Biomedical Informatics Research, Clinical Excellence Research Center, Stanford University , Stanford, CA 94305,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vincent X","family":"Liu","sequence":"additional","affiliation":[{"name":"Division of Research, Kaiser Permanente , Oakland, CA 94611,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8823-0614","authenticated-orcid":false,"given":"Eric","family":"Horvitz","sequence":"additional","affiliation":[{"name":"Office of the Chief Scientific Officer, Microsoft , Redmond, WA 14820,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jenna","family":"Wiens","sequence":"additional","affiliation":[{"name":"Division of Computer Science and Engineering, Department of Electrical Engineering and Computer Science, University of Michigan , Ann Arbor, MI 48109,","place":["United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2025,3,24]]},"reference":[{"key":"2026032321000241900_ocaf036-B1","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1377\/hlthaff.2014.0041","article-title":"Big data in health care: using analytics to identify and manage high-risk and high-cost patients","volume":"33","author":"Bates","year":"2014","journal-title":"Health Aff (Millwood)"},{"key":"2026032321000241900_ocaf036-B2","first-page":"467","author":"Wiens"},{"key":"2026032321000241900_ocaf036-B3","first-page":"1","author":"Wiens","year":"2016"},{"key":"2026032321000241900_ocaf036-B4","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1017\/ice.2018.16","article-title":"A generalizable, data-driven approach to predict daily risk of Clostridium difficile infection at two large academic health centers","volume":"39","author":"Oh","year":"2018","journal-title":"Infect Control Hosp Epidemiol"},{"key":"2026032321000241900_ocaf036-B5","doi-asserted-by":"publisher","first-page":"e1155","DOI":"10.1542\/peds.2010-3464","article-title":"Estimating the probability of neonatal early-onset infection on the basis of maternal risk factors","volume":"128","author":"Puopolo","year":"2011","journal-title":"Pediatrics"},{"key":"2026032321000241900_ocaf036-B6","first-page":"1","article-title":"Developing implementable risk prediction models with electronic health records data","author":"Goldstein","year":"2014","journal-title":"Wiley StatsRef: Statistics Reference Online"},{"key":"2026032321000241900_ocaf036-B7","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1136\/amiajnl-2013-001854","article-title":"Medical decision support using machine learning for early detection of late-onset neonatal sepsis","volume":"21","author":"Mani","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2026032321000241900_ocaf036-B8","first-page":"1306","author":"Weiss","year":"2015"},{"key":"2026032321000241900_ocaf036-B9","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1016\/j.cjca.2014.01.001","article-title":"Risk stratification in acute heart failure","volume":"30","author":"Lee","year":"2014","journal-title":"Can J Cardiol"},{"key":"2026032321000241900_ocaf036-B10","doi-asserted-by":"publisher","first-page":"1077","DOI":"10.1086\/606166","article-title":"Developing a risk stratification model for surgical site infection after abdominal hysterectomy","volume":"30","author":"Olsen","year":"2009","journal-title":"Infect Control Hosp Epidemiol"},{"key":"2026032321000241900_ocaf036-B11","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1016\/J.JCRC.2009.09.001","article-title":"The effect of comorbidity and age on hospital mortality and length of stay in patients with sepsis","volume":"25","author":"Yang","year":"2010","journal-title":"J Crit Care"},{"key":"2026032321000241900_ocaf036-B12","doi-asserted-by":"publisher","author":"Winters","year":"2010","DOI":"10.1097\/CCM.0b013e3181d8cc1d"},{"key":"2026032321000241900_ocaf036-B13","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1186\/S13054-019-2372-2\/FIGURES\/2","article-title":"Heterogeneity in sepsis: new biological evidence with clinical applications","volume":"23","author":"Leligdowicz","year":"2019","journal-title":"Crit Care"},{"key":"2026032321000241900_ocaf036-B14","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1093\/JAMIA\/OCZ211","article-title":"On classifying sepsis heterogeneity in the ICU: insight using machine learning","volume":"27","author":"Ibrahim","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2026032321000241900_ocaf036-B15","first-page":"1","article-title":"Early recognition of sepsis with Gaussian process temporal convolutional networks and dynamic time warping","volume":"106","author":"Moor","year":"2019","journal-title":"Proc Mach Learn Res"},{"key":"2026032321000241900_ocaf036-B16","doi-asserted-by":"publisher","author":"Christ","DOI":"10.3238\/arztebl.2010.0892"},{"key":"2026032321000241900_ocaf036-B17","author":"Kahn","year":"2020"},{"key":"2026032321000241900_ocaf036-B18","article-title":"Mayo Clinic\u2019s multidisciplinary approach to Covid-19 vaccine allocation and distribution","volume":"2","author":"Swift","year":"2021","journal-title":"NEJM Catal Innov Care Deliv"},{"key":"2026032321000241900_ocaf036-B19","doi-asserted-by":"crossref","first-page":"1657","DOI":"10.15585\/mmwr.mm695152e2","article-title":"The Advisory Committee on Immunization Practices\u2019 updated interim recommendation for allocation of COVID-19 vaccine\u2014United States, December 2020","volume":"69","author":"Dooling","year":"2021","journal-title":"MMWR Morb Mortal Wkly Rep"},{"key":"2026032321000241900_ocaf036-B20","doi-asserted-by":"publisher","first-page":"426","DOI":"10.1513\/ANNALSATS.201809-646PS","article-title":"Improving sepsis treatment by embracing diagnostic uncertainty","volume":"16","author":"Prescott","year":"2019","journal-title":"Ann Am Thorac Soc"},{"key":"2026032321000241900_ocaf036-B21","doi-asserted-by":"publisher","first-page":"299ra122","DOI":"10.1126\/SCITRANSLMED.AAB3719\/SUPPL_FILE\/7-299RA122_SM.PDF","article-title":"A targeted real-time early warning score (TREWScore) for septic shock","volume":"7","author":"Henry","year":"2015","journal-title":"Sci Transl Med"},{"key":"2026032321000241900_ocaf036-B22","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1001\/JAMAINTERNMED.2021.2626","article-title":"External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients","volume":"181","author":"Wong","year":"2021","journal-title":"JAMA Intern Med"},{"key":"2026032321000241900_ocaf036-B23","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1016\/J.ANNEMERGMED.2018.11.036","article-title":"Development and evaluation of a machine learning model for the early identification of patients at risk for sepsis","volume":"73","author":"Delahanty","year":"2019","journal-title":"Ann Emerg Med"},{"key":"2026032321000241900_ocaf036-B24","doi-asserted-by":"publisher","first-page":"586","DOI":"10.1016\/j.chest.2016.10.057","article-title":"Systemic inflammatory response syndrome, quick sequential organ function assessment, and organ dysfunction: insights from a prospective database of ED patients with infection","volume":"151","author":"Williams","year":"2017","journal-title":"Chest"},{"key":"2026032321000241900_ocaf036-B25","doi-asserted-by":"publisher","first-page":"104689","DOI":"10.1016\/j.ijmedinf.2022.104689","article-title":"Machine learning algorithms for early sepsis detection in the emergency department: a retrospective study","volume":"160","author":"Kijpaisalratana","year":"2022","journal-title":"Int J Med Inform"},{"key":"2026032321000241900_ocaf036-B26","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1093\/JAMIA\/OCX084","article-title":"The MIMIC Code Repository: enabling reproducibility in critical care research","volume":"25","author":"Johnson","year":"2018","journal-title":"J Am Med Inform Assoc"},{"key":"2026032321000241900_ocaf036-B27","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1136\/BMJQS-2018-008331","article-title":"Using objective clinical data to track progress on preventing and treating sepsis: CDC\u2019s new \u2018Adult Sepsis Event\u2019 surveillance strategy","volume":"28","author":"Rhee","year":"2019","journal-title":"BMJ Qual Saf"},{"key":"2026032321000241900_ocaf036-B28","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1097\/CCM.0000000000003521","article-title":"Sepsis surveillance using adult sepsis events simplified eSOFA criteria versus sepsis-3 SOFA criteria","volume":"47","author":"Rhee","year":"2019","journal-title":"Crit Care Med"},{"key":"2026032321000241900_ocaf036-B29","doi-asserted-by":"publisher","first-page":"951","DOI":"10.5811\/WESTJEM.2017.4.32795","article-title":"Sepsis definitions: the search for gold and what CMS got wrong","volume":"18","author":"Kalantari","year":"2017","journal-title":"West J Emerg Med"},{"key":"2026032321000241900_ocaf036-B30","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/J.ANNEMERGMED.2017.06.032","article-title":"Preliminary performance on the new CMS sepsis-1 national quality measure: early insights from the emergency quality network (E-QUAL)","volume":"71","author":"Venkatesh","year":"2018","journal-title":"Ann Emerg Med"},{"key":"2026032321000241900_ocaf036-B31","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1097\/CCM.0000000000002965","article-title":"A comparative analysis of sepsis identification methods in an electronic database","volume":"46","author":"Johnson","year":"2018","journal-title":"Crit Care Med"},{"key":"2026032321000241900_ocaf036-B32","doi-asserted-by":"publisher","first-page":"1921","DOI":"10.1093\/JAMIA\/OCAA139","article-title":"Democratizing EHR analyses with FIDDLE: a flexible data-driven preprocessing pipeline for structured clinical data","volume":"27","author":"Tang","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2026032321000241900_ocaf036-B33","doi-asserted-by":"publisher","first-page":"e005010","DOI":"10.1161\/CIRCOUTCOMES.118.005010","article-title":"Clinical value of predicting individual treatment effects for intensive blood pressure therapy: a machine learning experiment to estimate treatment effects from randomized trial data","volume":"12","author":"Duan","year":"2019","journal-title":"Circ Cardiovasc Qual Outcomes"},{"key":"2026032321000241900_ocaf036-B34","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1111\/1475-6773.13586","article-title":"Predicting preventable hospital readmissions with causal machine learning","volume":"55","author":"Marafino","year":"2020","journal-title":"Health Serv Res"},{"key":"2026032321000241900_ocaf036-B35","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1093\/IJE\/DYAD037","article-title":"Machine-learning-based high-benefit approach versus conventional high-risk approach in blood pressure management","volume":"52","author":"Inoue","year":"2023","journal-title":"Int J Epidemiol"},{"key":"2026032321000241900_ocaf036-B36","doi-asserted-by":"publisher","first-page":"e068576","DOI":"10.1136\/BMJ-2021-068576","article-title":"Early identification of patients admitted to hospital for covid-19 at risk of clinical deterioration: model development and multisite external validation study","volume":"376","author":"Kamran","year":"2022","journal-title":"BMJ"},{"key":"2026032321000241900_ocaf036-B37","author":"Zabihi","year":"2019"},{"key":"2026032321000241900_ocaf036-B38","doi-asserted-by":"publisher","author":"Yang","DOI":"10.22489\/CinC.2019.020"},{"key":"2026032321000241900_ocaf036-B39","doi-asserted-by":"crossref","first-page":"4156","DOI":"10.1073\/pnas.1804597116","article-title":"Metalearners for estimating heterogeneous treatment effects using machine learning","volume":"116","author":"K\u00fcnzel","year":"2019","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2026032321000241900_ocaf036-B40","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1201\/9781003102670-21","article-title":"Treatment heterogeneity for survival outcomes","author":"Xu","year":"2022","journal-title":"Handbook of Matching and Weighting Adjustments for Causal Inference"},{"key":"2026032321000241900_ocaf036-B41","doi-asserted-by":"publisher","first-page":"104420","DOI":"10.1016\/J.JBI.2023.104420","article-title":"Principled estimation and evaluation of treatment effect heterogeneity: a case study application to dabigatran for patients with atrial fibrillation","volume":"143","author":"Xu","year":"2023","journal-title":"J Biomed Inform"},{"key":"2026032321000241900_ocaf036-B42","author":"Saeed"},{"key":"2026032321000241900_ocaf036-B43","doi-asserted-by":"publisher","first-page":"105608","DOI":"10.1016\/J.CMPB.2020.105608","article-title":"Explainable deep learning for pulmonary disease and coronavirus COVID-19 detection from X-rays","volume":"196","author":"Brunese","year":"2020","journal-title":"Comput Methods Programs Biomed"},{"key":"2026032321000241900_ocaf036-B44","doi-asserted-by":"publisher","first-page":"2052","DOI":"10.1001\/JAMA.2020.6775","article-title":"Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York City area","volume":"323","author":"Richardson","year":"2020","journal-title":"JAMA"},{"key":"2026032321000241900_ocaf036-B45","doi-asserted-by":"publisher","first-page":"e0247461","DOI":"10.1371\/JOURNAL.PONE.0247461","article-title":"Population risk factors for severe disease and mortality in COVID-19: a global systematic review and meta-analysis","volume":"16","author":"Booth","year":"2021","journal-title":"PLoS One"},{"key":"2026032321000241900_ocaf036-B46","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1007\/s11606-020-05739-9","article-title":"Preventing hospital readmissions: healthcare providers\u2019 perspectives on \u201cimpactibility\u201d beyond EHR 30-day readmission risk prediction","volume":"35","author":"Flaks-Manov","year":"2020","journal-title":"J Gen Intern Med"},{"key":"2026032321000241900_ocaf036-B47","doi-asserted-by":"publisher","first-page":"n2713","DOI":"10.1136\/BMJ.N2713","article-title":"Covid-19: Pfizer\u2019s Paxlovid is 89% effective in patients at risk of serious illness, company reports","volume":"375","author":"Mahase","year":"2021","journal-title":"BMJ"},{"key":"2026032321000241900_ocaf036-B48","author":"Kamran","year":"2023."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/32\/5\/905\/62575154\/ocaf036.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/32\/5\/905\/62575154\/ocaf036.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T01:00:12Z","timestamp":1774314012000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/32\/5\/905\/8092602"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,24]]},"references-count":48,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,3,24]]},"published-print":{"date-parts":[[2025,5,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaf036","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,5]]},"published":{"date-parts":[[2025,3,24]]}}}