{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:06:25Z","timestamp":1781103985803,"version":"3.54.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"S2","license":[{"start":{"date-parts":[[2022,6,16]],"date-time":"2022-06-16T00:00:00Z","timestamp":1655337600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,16]],"date-time":"2022-06-16T00:00:00Z","timestamp":1655337600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 LM013337"],"award-info":[{"award-number":["R01 LM013337"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["UL1 TR001422"],"award-info":[{"award-number":["UL1 TR001422"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 NS110779"],"award-info":[{"award-number":["R01 NS110779"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U01 NS110772"],"award-info":[{"award-number":["U01 NS110772"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Sepsis is one of the most life-threatening circumstances for critically ill patients in the United States, while diagnosis of sepsis is challenging as a standardized criteria for sepsis identification is still under development. Disparities in social determinants of sepsis patients can interfere with the risk prediction performances using machine learning.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We analyzed a cohort of critical care patients from the Medical Information Mart for Intensive Care (MIMIC)-III database. Disparities in social determinants, including race, sex, marital status, insurance types and languages, among patients identified by six available sepsis criteria were revealed by forest plots with 95% confidence intervals. Sepsis patients were then identified by the Sepsis-3 criteria. Sixteen machine learning classifiers were trained to predict in-hospital mortality for sepsis patients on a training set constructed by random selection. The performance was measured by area under the receiver operating characteristic curve (AUC). The performance of the trained model was tested on the entire randomly conducted test set and each sub-population built based on each of the following social determinants: race, sex, marital status, insurance type, and language. The fluctuations in performances were further examined by permutation tests.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We analyzed a total of 11,791 critical care patients from the MIMIC-III database. Within the population identified by each sepsis identification method, significant differences were observed among sub-populations regarding race, marital status, insurance type, and language. On the 5783 sepsis patients identified by the Sepsis-3 criteria statistically significant performance decreases for mortality prediction were observed when applying the trained machine learning model on Asian and Hispanic patients, as well as the Spanish-speaking patients. With pairwise comparison, we detected performance discrepancies in mortality prediction between Asian and White patients, Asians and patients of other races, as well as English-speaking and Spanish-speaking patients.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Disparities in proportions of patients identified by various sepsis criteria were detected among the different social determinant groups. The performances of mortality prediction for sepsis patients can be compromised when applying a universally trained model for each subpopulation. To achieve accurate diagnosis, a versatile diagnostic system for sepsis is needed to overcome the social determinant disparities of patients.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-022-01871-0","type":"journal-article","created":{"date-parts":[[2022,6,16]],"date-time":"2022-06-16T15:51:46Z","timestamp":1655394706000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Comparison between machine learning methods for mortality prediction for sepsis patients with different social determinants"],"prefix":"10.1186","volume":"22","author":[{"given":"Hanyin","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yikuan","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Naidech","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0195-7456","authenticated-orcid":false,"given":"Yuan","family":"Luo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,6,16]]},"reference":[{"issue":"2","key":"1871_CR1","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1056\/NEJMra021333","volume":"348","author":"RS Hotchkiss","year":"2003","unstructured":"Hotchkiss RS, Karl IE. The pathophysiology and treatment of sepsis. N Engl J Med. 2003;348(2):138\u201350.","journal-title":"N Engl J Med"},{"issue":"16","key":"1871_CR2","doi-asserted-by":"publisher","first-page":"1699","DOI":"10.1056\/NEJMra043632","volume":"355","author":"JA Russell","year":"2006","unstructured":"Russell JA. Management of sepsis. N Engl J Med. 2006;355(16):1699\u2013713.","journal-title":"N Engl J Med"},{"issue":"33","key":"1871_CR3","doi-asserted-by":"publisher","first-page":"864","DOI":"10.15585\/mmwr.mm6533e1","volume":"65","author":"SA Novosad","year":"2016","unstructured":"Novosad SA, Sapiano MR, Grigg C, Lake J, Robyn M, Dumyati G, Felsen C, Blog D, Dufort E, Zansky S. Vital signs: epidemiology of sepsis: prevalence of health care factors and opportunities for prevention. Morb Mortal Wkly Rep. 2016;65(33):864\u20139.","journal-title":"Morb Mortal Wkly Rep"},{"issue":"4","key":"1871_CR4","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1097\/CCM.0000000000002965","volume":"46","author":"AE Johnson","year":"2018","unstructured":"Johnson AE, Aboab J, Raffa JD, Pollard TJ, Deliberato RO, Celi LA, Stone DJ. A comparative analysis of sepsis identification methods in an electronic database. Crit Care Med. 2018;46(4):494.","journal-title":"Crit Care Med"},{"issue":"5","key":"1871_CR5","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1002\/msj.21336","volume":"79","author":"JA Kent","year":"2012","unstructured":"Kent JA, Patel V, Varela NA. Gender disparities in health care. Mount Sinai J Med: J Transl Personal Med. 2012;79(5):555\u20139.","journal-title":"Mount Sinai J Med: J Transl Personal Med"},{"key":"1871_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssmph.2018.100331","volume":"7","author":"M Orlovic","year":"2019","unstructured":"Orlovic M, Smith K, Mossialos E. Racial and ethnic differences in end-of-life care in the United States: Evidence from the Health and Retirement Study (HRS). SSM-Popul Health. 2019;7: 100331.","journal-title":"SSM-Popul Health"},{"issue":"4","key":"1871_CR7","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1007\/s16024-013-0171-2","volume":"4","author":"K Quindemil","year":"2013","unstructured":"Quindemil K, Nagl-Cupal M, Anderson KH, Mayer H. Migrant and minority family members in the intensive care unit. A review of the literature. HeilberufeSCIENCE. 2013;4(4):128\u201335.","journal-title":"HeilberufeSCIENCE"},{"issue":"12","key":"1871_CR8","doi-asserted-by":"publisher","first-page":"2784","DOI":"10.1097\/CCM.0b013e3182a84a43","volume":"41","author":"GJ Soto","year":"2013","unstructured":"Soto GJ, Martin GS, Gong MN. Healthcare disparities in critical illness. Crit Care Med. 2013;41(12):2784.","journal-title":"Crit Care Med"},{"issue":"6464","key":"1871_CR9","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","volume":"366","author":"Z Obermeyer","year":"2019","unstructured":"Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447\u201353.","journal-title":"Science"},{"issue":"1","key":"1871_CR10","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/s41591-019-0726-6","volume":"26","author":"J Wiens","year":"2020","unstructured":"Wiens J, Price WN, Sjoding MW. Diagnosing bias in data-driven algorithms for healthcare. Nat Med. 2020;26(1):25\u20136.","journal-title":"Nat Med"},{"key":"1871_CR11","doi-asserted-by":"crossref","unstructured":"Ahmad MA, Patel A, Eckert C, Kumar V, Teredesai A. Fairness in machine learning for healthcare. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining: 2020; 2020: 3529\u20133530.","DOI":"10.1145\/3394486.3406461"},{"issue":"2","key":"1871_CR12","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1001\/amajethics.2019.167","volume":"21","author":"IY Chen","year":"2019","unstructured":"Chen IY, Szolovits P, Ghassemi M. Can AI help reduce disparities in general medical and mental health care? AMA J Ethics. 2019;21(2):167\u201379.","journal-title":"AMA J Ethics"},{"issue":"3","key":"1871_CR13","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1136\/medethics-2019-105586","volume":"46","author":"T Grote","year":"2020","unstructured":"Grote T, Berens P. On the ethics of algorithmic decision-making in healthcare. J Med Ethics. 2020;46(3):205\u201311.","journal-title":"J Med Ethics"},{"key":"1871_CR14","first-page":"433","volume":"264","author":"H Wang","year":"2019","unstructured":"Wang H, Li Y, Ning H, Wilkins J, Lloyd-Jones D, Luo Y. Using machine learning to integrate sociobehavioral factors in predicting cardiovascular-related mortality risk. Stud Health Technol Inform. 2019;264:433\u20137.","journal-title":"Stud Health Technol Inform"},{"issue":"10","key":"1871_CR15","doi-asserted-by":"publisher","first-page":"1224","DOI":"10.1164\/rccm.202106-1453LE","volume":"204","author":"SV Bhavani","year":"2021","unstructured":"Bhavani SV, Luo Y, Miller WD, Sanchez-Pinto LN, Han X, Mao C, Sand\u0131k\u00e7\u0131 B, Peek ME, Coopersmith CM, Michelson KN. Simulation of ventilator allocation in critically ill patients with COVID-19. Am J Respir Crit Care Med. 2021;204(10):1224\u20137.","journal-title":"Am J Respir Crit Care Med"},{"key":"1871_CR16","doi-asserted-by":"crossref","unstructured":"Ahmad MA, Eckert C, Teredesai A. Interpretable machine learning in healthcare. In: Proceedings of the 2018 ACM international conference on bioinformatics, computational biology, and health informatics: 2018; 2018: 559\u2013560.","DOI":"10.1145\/3233547.3233667"},{"key":"1871_CR17","doi-asserted-by":"crossref","unstructured":"Callahan A, Shah NH. Machine learning in healthcare. In: Key advances in clinical informatics. Elsevier; 2017: 279\u2013291.","DOI":"10.1016\/B978-0-12-809523-2.00019-4"},{"key":"1871_CR18","doi-asserted-by":"publisher","first-page":"8869","DOI":"10.1109\/ACCESS.2017.2694446","volume":"5","author":"M Chen","year":"2017","unstructured":"Chen M, Hao Y, Hwang K, Wang L, Wang L. Disease prediction by machine learning over big data from healthcare communities. IEEE Access. 2017;5:8869\u201379.","journal-title":"IEEE Access"},{"key":"1871_CR19","doi-asserted-by":"crossref","unstructured":"Luo Y, Xin Y, Joshi R, Celi L, Szolovits P. Predicting ICU mortality risk by grouping temporal trends from a multivariate panel of physiologic measurements. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence: 2016; 2016: 42\u201350.","DOI":"10.1609\/aaai.v30i1.9998"},{"issue":"8","key":"1871_CR20","doi-asserted-by":"publisher","first-page":"e209271","DOI":"10.1001\/jamanetworkopen.2020.9271","volume":"3","author":"N Sanchez-Pinto","year":"2020","unstructured":"Sanchez-Pinto N, Stroup E, Pendergrast T, Pinto N, Luo Y. Derivation and validation of novel phenotypes of multiple organ dysfunction syndrome in critically ill children. JAMA Netw Open. 2020;3(8):e209271\u2013e209271.","journal-title":"JAMA Netw Open"},{"issue":"11","key":"1871_CR21","doi-asserted-by":"publisher","first-page":"1307","DOI":"10.1111\/acem.13009","volume":"23","author":"H Scott","year":"2016","unstructured":"Scott H, Colborn K. Machine learning for predicting sepsis in-hospital mortality: an important start. Acad Emerg Med. 2016;23(11):1307\u20131307.","journal-title":"Acad Emerg Med"},{"issue":"3","key":"1871_CR22","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1111\/acem.12876","volume":"23","author":"RA Taylor","year":"2016","unstructured":"Taylor RA, Pare JR, Venkatesh AK, Mowafi H, Melnick ER, Fleischman W, Hall MK. Prediction of in-hospital mortality in emergency department patients with sepsis: a local big data\u2013driven, machine learning approach. Acad Emerg Med. 2016;23(3):269\u201378.","journal-title":"Acad Emerg Med"},{"issue":"1","key":"1871_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01271-2","volume":"20","author":"G Kong","year":"2020","unstructured":"Kong G, Lin K, Hu Y. Using machine learning methods to predict in-hospital mortality of sepsis patients in the ICU. BMC Med Inform Decis Mak. 2020;20(1):1\u201310.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"5","key":"1871_CR24","first-page":"1","volume":"21","author":"M Ding","year":"2021","unstructured":"Ding M, Luo Y. Unsupervised phenotyping of sepsis using nonnegative matrix factorization of temporal trends from a multivariate panel of physiological measurements. BMC Med Inform Decis Mak. 2021;21(5):1\u201315.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"1871_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.35","volume":"3","author":"AE Johnson","year":"2016","unstructured":"Johnson AE, Pollard TJ, Shen L, Li-Wei HL, Feng M, Ghassemi M, Moody B, Szolovits P, Celi LA, Mark RG. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3(1):1\u20139.","journal-title":"Sci Data"},{"key":"1871_CR26","doi-asserted-by":"crossref","unstructured":"Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Read Online: Crit Care Med|Soc Crit Care Med. 2001, 29(7):1303\u20131310.","DOI":"10.1097\/00003246-200107000-00002"},{"issue":"16","key":"1871_CR27","doi-asserted-by":"publisher","first-page":"1546","DOI":"10.1056\/NEJMoa022139","volume":"348","author":"GS Martin","year":"2003","unstructured":"Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003;348(16):1546\u201354.","journal-title":"N Engl J Med"},{"key":"1871_CR28","unstructured":"Medicare Cf, Services M. Implementation of severe sepsis and septic shock: management bundle measure (NQF# 0500). In: National Quality Forum: 2012; 2012."},{"issue":"3","key":"1871_CR29","doi-asserted-by":"publisher","DOI":"10.1097\/CCM.0000000000001724","volume":"44","author":"CW Seymour","year":"2016","unstructured":"Seymour CW, Coopersmith CM, Deutschman CS, Gesten F, Klompas M, Levy M, Martin GS, Osborn TM, Rhee C, Warren D. Application of a framework to assess the usefulness of alternative sepsis criteria. Crit Care Med. 2016;44(3): e122.","journal-title":"Crit Care Med"},{"issue":"8","key":"1871_CR30","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1001\/jama.2016.0288","volume":"315","author":"CW Seymour","year":"2016","unstructured":"Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, Rubenfeld G, Kahn JM, Shankar-Hari M, Singer M. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315(8):762\u201374.","journal-title":"JAMA"},{"key":"1871_CR31","doi-asserted-by":"publisher","DOI":"10.1007\/BF01709751","volume-title":"The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction\/failure","author":"J-L Vincent","year":"1996","unstructured":"Vincent J-L, Moreno R, Takala J, Willatts S, De Mendon\u00e7a A, Bruining H, Reinhart C, Suter P, Thijs LG. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction\/failure. New York.: Springer-Verlag; 1996."},{"issue":"2","key":"1871_CR32","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1001\/jama.1995.03520260039030","volume":"273","author":"MS Rangel-Frausto","year":"1995","unstructured":"Rangel-Frausto MS, Pittet D, Costigan M, Hwang T, Davis CS, Wenzel RP. The natural history of the systemic inflammatory response syndrome (SIRS): a prospective study. JAMA. 1995;273(2):117\u201323.","journal-title":"JAMA"},{"key":"1871_CR33","doi-asserted-by":"crossref","unstructured":"Luo Y: Evaluating the state of the art in missing data imputation for clinical data. Brief Bioinform. 2022; 23(1):bbab489.","DOI":"10.1093\/bib\/bbab489"},{"issue":"6","key":"1871_CR34","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1093\/jamia\/ocx133","volume":"25","author":"Y Luo","year":"2017","unstructured":"Luo Y, Szolovits P, Dighe AS, Baron JM. 3D-MICE: integration of cross-sectional and longitudinal imputation for multi-analyte longitudinal clinical data. J Am Med Inform Assoc (JAMIA). 2017;25(6):645\u201353.","journal-title":"J Am Med Inform Assoc (JAMIA)"},{"key":"1871_CR35","unstructured":"Cao W, Wang D, Li J, Zhou H, Li L, Li Y: Brits: Bidirectional recurrent imputation for time series. arXiv preprint arXiv:180510572 2018."},{"issue":"12","key":"1871_CR36","doi-asserted-by":"publisher","first-page":"e1209","DOI":"10.1097\/CCM.0000000000002699","volume":"45","author":"JM Jones","year":"2017","unstructured":"Jones JM, Fingar KR, Miller MA, Coffey R, Barrett M, Flottemesch T, Heslin KC, Gray DT, Moy E. Racial disparities in sepsis-related in-hospital mortality: using a broad case capture method and multivariate controls for clinical and hospital variables, 2004\u20132013. Crit Care Med. 2017;45(12):e1209\u201317.","journal-title":"Crit Care Med"},{"issue":"3","key":"1871_CR37","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1007\/s40615-018-00553-w","volume":"6","author":"F Ogundipe","year":"2019","unstructured":"Ogundipe F, Kodadhala V, Ogundipe T, Mehari A, Gillum R. Disparities in sepsis mortality by region, urbanization, and race in the USA: a multiple cause of death analysis. J Racial Ethn Health Disparities. 2019;6(3):546\u201351.","journal-title":"J Racial Ethn Health Disparities"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01871-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01871-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01871-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,6]],"date-time":"2022-07-06T11:43:58Z","timestamp":1657107838000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01871-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,16]]},"references-count":37,"journal-issue":{"issue":"S2","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1871"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01871-0","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,16]]},"assertion":[{"value":"18 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 June 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Authors have no competing interests except for receiving funding from NIH.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"156"}}