{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T08:10:22Z","timestamp":1778227822095,"version":"3.51.4"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T00:00:00Z","timestamp":1650412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1914792"],"award-info":[{"award-number":["IIS-1914792"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1664644"],"award-info":[{"award-number":["DMS-1664644"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS-1645681"],"award-info":[{"award-number":["CNS-1645681"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-19-1-2571"],"award-info":[{"award-number":["N00014-19-1-2571"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 GM135930"],"award-info":[{"award-number":["R01 GM135930"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Boston University Clinical and Translational Science Award","award":["NIH\/NCATS"],"award-info":[{"award-number":["NIH\/NCATS"]}]},{"name":"Boston University Clinical and Translational Science Award","award":["UL54 TR004130"],"award-info":[{"award-number":["UL54 TR004130"]}]},{"name":"Boston University Rafik B. Hariri Institute for Computing and Computational Science and Engineering"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,6,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To develop predictive models of coronavirus disease 2019 (COVID-19) outcomes, elucidate the influence of socioeconomic factors, and assess algorithmic racial fairness using a racially diverse patient population with high social needs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Data included 7,102 patients with positive (RT-PCR) severe acute respiratory syndrome coronavirus 2 test at a safety-net system in Massachusetts. Linear and nonlinear classification methods were applied. A score based on a recurrent neural network and a transformer architecture was developed to capture the dynamic evolution of vital signs. Combined with patient characteristics, clinical variables, and hospital occupancy measures, this dynamic vital score was used to train predictive models.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Hospitalizations can be predicted with an area under the receiver-operating characteristic curve (AUC) of 92% using symptoms, hospital occupancy, and patient characteristics, including social determinants of health. Parsimonious models to predict intensive care, mechanical ventilation, and mortality that used the most recent labs and vitals exhibited AUCs of 92.7%, 91.2%, and 94%, respectively. Early predictive models, using labs and vital signs closer to admission had AUCs of 81.1%, 84.9%, and 92%, respectively.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>The most accurate models exhibit racial bias, being more likely to falsely predict that Black patients will be hospitalized. Models that are only based on the dynamic vital score exhibited accuracies close to the best parsimonious models, although the latter also used laboratories.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>This large study demonstrates that COVID-19 severity may accurately be predicted using a score that accounts for the dynamic evolution of vital signs. Further, race, social determinants of health, and hospital occupancy play an important role.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocac062","type":"journal-article","created":{"date-parts":[[2022,4,15]],"date-time":"2022-04-15T03:59:49Z","timestamp":1649995189000},"page":"1253-1262","source":"Crossref","is-referenced-by-count":17,"title":["Development and validation of predictive models for COVID-19 outcomes in a safety-net hospital population"],"prefix":"10.1093","volume":"29","author":[{"given":"Boran","family":"Hao","sequence":"first","affiliation":[{"name":"Center for Information and Systems Engineering, Boston University , Boston, Massachusetts, USA"},{"name":"Department of Electrical and Computer Engineering, Boston University , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Hu","sequence":"additional","affiliation":[{"name":"Center for Information and Systems Engineering, Boston University , Boston, Massachusetts, USA"},{"name":"Department of Electrical and Computer Engineering, Boston University , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shahabeddin","family":"Sotudian","sequence":"additional","affiliation":[{"name":"Center for Information and Systems Engineering, Boston University , Boston, Massachusetts, USA"},{"name":"Division of Systems Engineering, Boston University , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zahra","family":"Zad","sequence":"additional","affiliation":[{"name":"Center for Information and Systems Engineering, Boston University , Boston, Massachusetts, USA"},{"name":"Division of Systems Engineering, Boston University , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William G","family":"Adams","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Boston Medical Center and Boston University School of Medicine , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sabrina A","family":"Assoumou","sequence":"additional","affiliation":[{"name":"Department of Medicine, Boston Medical Center and Boston University School of Medicine , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heather","family":"Hsu","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Boston Medical Center and Boston University School of Medicine , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca G","family":"Mishuris","sequence":"additional","affiliation":[{"name":"Department of Medicine, Boston Medical Center and Boston University School of Medicine , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ioannis C","family":"Paschalidis","sequence":"additional","affiliation":[{"name":"Center for Information and Systems Engineering, Boston University , Boston, Massachusetts, USA"},{"name":"Department of Electrical and Computer Engineering, Boston University , Boston, Massachusetts, USA"},{"name":"Division of Systems Engineering, Boston University , Boston, Massachusetts, USA"},{"name":"Department of Biomedical Engineering, Boston University , Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,5,9]]},"reference":[{"key":"2023050900332652200_ocac062-B1","author":"Holder","year":"2021"},{"key":"2023050900332652200_ocac062-B2","doi-asserted-by":"publisher","first-page":"759","DOI":"10.15585\/mmwr.mm7020e3","article-title":"Disparities in COVID-19 vaccination coverage between urban and rural counties \u2013 United States, December 14, 2020\u2013April 10, 2021","volume":"70","author":"Murthy","year":"2021","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"6","key":"2023050900332652200_ocac062-B3","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1016\/j.cmi.2020.04.002","article-title":"Challenges and issues about organizing a hospital to respond to the COVID-19 outbreak: experience from a French reference centre","volume":"26","author":"Peiffer-Smadja","year":"2020","journal-title":"Clin Microbiol Infect"},{"issue":"1","key":"2023050900332652200_ocac062-B4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-020-0249-z","article-title":"Personalized predictions of patient outcomes during and after hospitalization using artificial intelligence","volume":"3","author":"Hilton","year":"2020","journal-title":"NPJ Digit Med"},{"issue":"8","key":"2023050900332652200_ocac062-B5","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1001\/jamainternmed.2020.2033","article-title":"Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19","volume":"180","author":"Liang","year":"2020","journal-title":"JAMA Intern Med"},{"key":"2023050900332652200_ocac062-B6","first-page":"e60519","article-title":"Early prediction of level-of-care requirements in patients with COVID-19","volume-title":"eLife","author":"Hao","year":"2020"},{"issue":"5","key":"2023050900332652200_ocac062-B7","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1038\/s42256-020-0180-7","article-title":"An interpretable mortality prediction model for COVID-19 patients","volume":"2","author":"Yan","year":"2020","journal-title":"Nat Mach Intell"},{"key":"2023050900332652200_ocac062-B8","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1093\/cid\/ciaa414","article-title":"Prediction for progression risk in patients with COVID-19 pneumonia: the CALL Score","author":"Ji","year":"2020","journal-title":"Clin Infect Dis"},{"issue":"16","key":"2023050900332652200_ocac062-B9","doi-asserted-by":"crossref","first-page":"2079","DOI":"10.1093\/cid\/ciaa538","article-title":"Clinical and laboratory predictors of in-hospital mortality in patients with coronavirus disease-2019: a cohort study in Wuhan, China","volume":"71","author":"Wang","year":"2020","journal-title":"Clin Infect Dis"},{"key":"2023050900332652200_ocac062-B10","doi-asserted-by":"publisher","DOI":"10.1093\/cid\/ciaa443","article-title":"A tool for early prediction of severe coronavirus disease 2019 (COVID-19): a multicenter study using the risk Nomogram in Wuhan and Guangdong, China","author":"Gong","year":"2020","journal-title":"Clin Infect Dis"},{"key":"2023050900332652200_ocac062-B11","doi-asserted-by":"crossref","first-page":"1962","DOI":"10.1093\/cid\/ciaa674","article-title":"Predictors for severe COVID-19 infection","author":"Bhargava","year":"2020","journal-title":"Clin Infect Dis"},{"issue":"10","key":"2023050900332652200_ocac062-B12","doi-asserted-by":"crossref","first-page":"e1003402","DOI":"10.1371\/journal.pmed.1003402","article-title":"Variation in racial\/ethnic disparities in COVID-19 mortality by age in the United States: a cross-sectional study","volume":"17","author":"Bassett","year":"2020","journal-title":"PLoS Med"},{"issue":"10","key":"2023050900332652200_ocac062-B13","doi-asserted-by":"crossref","first-page":"e0240346","DOI":"10.1371\/journal.pone.0240346","article-title":"Physiological and socioeconomic characteristics predict COVID-19 mortality and resource utilization in Brazil","volume":"15","author":"Wollenstein-Betech","year":"2020","journal-title":"PLoS One"},{"issue":"3","key":"2023050900332652200_ocac062-B14","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1056\/NEJMp2012910","article-title":"Racial health disparities and Covid-19\u2014caution and context","volume":"383","author":"Chowkwanyun","year":"2020","journal-title":"N Engl J Med"},{"key":"2023050900332652200_ocac062-B15","doi-asserted-by":"crossref","first-page":"m1328","DOI":"10.1136\/bmj.m1328","article-title":"Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal","author":"Wynants","year":"2020","journal-title":"BMJ"},{"issue":"8","key":"2023050900332652200_ocac062-B16","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"2023050900332652200_ocac062-B17","first-page":"1","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv Neural Inf Process Syst"},{"key":"2023050900332652200_ocac062-B18","year":"2021"},{"issue":"Suppl 2","key":"2023050900332652200_ocac062-B19","doi-asserted-by":"crossref","first-page":"S133","DOI":"10.1097\/MLR.0000000000001029","article-title":"Implementing an EHR-based screening and referral system to address social determinants of health in primary care","volume":"57","author":"de la Vega","year":"2019","journal-title":"Med Care"},{"issue":"7","key":"2023050900332652200_ocac062-B20","doi-asserted-by":"crossref","first-page":"2376","DOI":"10.1109\/JBHI.2021.3074893","article-title":"COVID-19 automatic diagnosis with radiographic imaging: explainable attention transfer deep neural networks","volume":"25","author":"Shi","year":"2021","journal-title":"IEEE J Biomed Health Inform"},{"issue":"3","key":"2023050900332652200_ocac062-B21","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach Learn"},{"key":"2023050900332652200_ocac062-B22","author":"Chen","year":"2016"},{"issue":"1","key":"2023050900332652200_ocac062-B23","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"issue":"1\u20132","key":"2023050900332652200_ocac062-B24","first-page":"1","article-title":"Distributionally robust learning","volume":"4","author":"Chen","year":"2020","journal-title":"Found Trends Optim"},{"key":"2023050900332652200_ocac062-B25","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.ejro.2019.04.007","article-title":"Detection of unwarranted CT radiation exposure from patient and imaging protocol meta-data using regularized regression","volume":"6","author":"Chen","year":"2019","journal-title":"Eur J Radiol Open"},{"issue":"3","key":"2023050900332652200_ocac062-B26","doi-asserted-by":"crossref","first-page":"260","DOI":"10.7861\/clinmedicine.19-3-260","article-title":"The national early warning score 2 (NEWS2)","volume":"19","author":"Smith","year":"2019","journal-title":"Clin Med"},{"issue":"8","key":"2023050900332652200_ocac062-B27","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1001\/jama.2016.0288","article-title":"Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)","volume":"315","author":"Seymour","year":"2016","journal-title":"Jama"},{"key":"2023050900332652200_ocac062-B28","doi-asserted-by":"publisher","author":"Caton","year":"2020","DOI":"10.48550\/arXiv.2010.04053"},{"key":"2023050900332652200_ocac062-B29","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocab029","article-title":"Development and validation of prediction models for mechanical ventilation, renal replacement therapy, and readmission in COVID-19 patients","author":"Rodriguez","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2023050900332652200_ocac062-B30","first-page":"65","article-title":"Mortality and clinical outcomes among patients with COVID-19 and diabetes","volume":"9","author":"Kantroo","year":"2021","journal-title":"Med Sci"},{"key":"2023050900332652200_ocac062-B31","doi-asserted-by":"crossref","first-page":"1753466620937175","DOI":"10.1177\/1753466620937175","article-title":"C-reactive protein, procalcitonin, D-dimer, and ferritin in severe coronavirus disease-2019: a meta-analysis","volume":"14","author":"Huang","year":"2020","journal-title":"Ther Adv Respir Dis"},{"issue":"9","key":"2023050900332652200_ocac062-B32","doi-asserted-by":"crossref","first-page":"1722","DOI":"10.1016\/j.ajem.2020.05.073","article-title":"Lactate dehydrogenase levels predict coronavirus disease 2019 (COVID-19) severity and mortality: a pooled analysis","volume":"38","author":"Henry","year":"2020","journal-title":"Am J Emerg Med"},{"issue":"4","key":"2023050900332652200_ocac062-B33","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1177\/0739986311422880","article-title":"Issues in the assessment of \u201crace\u201d among Latinos: implications for research and policy","volume":"33","author":"Allen","year":"2011","journal-title":"Hisp J Behav Sci"},{"issue":"7","key":"2023050900332652200_ocac062-B34","doi-asserted-by":"crossref","first-page":"e21","DOI":"10.1136\/jech.2009.103879","article-title":"Are black Hispanics black or Hispanic? Exploring disparities at the intersection of race and ethnicity","volume":"66","author":"LaVeist-Ramos","year":"2012","journal-title":"J Epidemiol Community Health"},{"key":"2023050900332652200_ocac062-B35"},{"issue":"6464","key":"2023050900332652200_ocac062-B36","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"issue":"9","key":"2023050900332652200_ocac062-B37","doi-asserted-by":"crossref","first-page":"e2019933","DOI":"10.1001\/jamanetworkopen.2020.19933","article-title":"Racism, not race, drives inequity across the COVID-19 continuum","volume":"3","author":"Khazanchi","year":"2020","journal-title":"JAMA Netw Open"},{"issue":"5","key":"2023050900332652200_ocac062-B38","doi-asserted-by":"crossref","first-page":"410","DOI":"10.5811\/westjem.2011.11.6820","article-title":"Factors influencing emergency department preference for access to healthcare","volume":"13","author":"Brown","year":"2011","journal-title":"West J Emerg Med"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocac062\/43400152\/ocac062.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/7\/1253\/44062199\/ocac062.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/7\/1253\/44062199\/ocac062.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T00:34:01Z","timestamp":1683592441000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/7\/1253\/6571151"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,9]]},"references-count":38,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,5,9]]},"published-print":{"date-parts":[[2022,6,14]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac062","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,7,1]]},"published":{"date-parts":[[2022,5,9]]}}}