{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T15:03:27Z","timestamp":1772809407681,"version":"3.50.1"},"reference-count":32,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000062","name":"National Institute of Diabetes and Digestive and Kidney Diseases","doi-asserted-by":"publisher","award":["RO1-DK123062"],"award-info":[{"award-number":["RO1-DK123062"]}],"id":[{"id":"10.13039\/100000062","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000065","name":"National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["R61-NS120246"],"award-info":[{"award-number":["R61-NS120246"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,13]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Electronic health records have incomplete capture of patient outcomes. We consider the case when observability is differential across a predictor. Including such a predictor (sensitive variable) can lead to algorithmic bias, potentially exacerbating health inequities.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We define bias for a clinical prediction model (CPM) as the difference between the true and estimated risk, and differential bias as bias that differs across a sensitive variable. We illustrate the genesis of differential bias via a 2-stage process, where conditional on having the outcome of interest, the outcome is differentially observed. We use simulations and a real-data example to demonstrate the possible impact of including a sensitive variable in a CPM.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>If there is differential observability based on a sensitive variable, including it in a CPM can induce differential bias. However, if the sensitive variable impacts the outcome but not observability, it is better to include it. When a sensitive variable impacts both observability and the outcome no simple recommendation can be provided. We show that one cannot use observed data to detect differential bias.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>Our study furthers the literature on observability, showing that differential observability can lead to algorithmic bias. This highlights the importance of considering whether to include sensitive variables in CPMs.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Including a sensitive variable in a CPM depends on whether it truly affects the outcome or just the observability of the outcome. Since this cannot be distinguished with observed data, observability is an implicit assumption of CPMs.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocac019","type":"journal-article","created":{"date-parts":[[2022,2,1]],"date-time":"2022-02-01T20:11:58Z","timestamp":1643746318000},"page":"937-943","source":"Crossref","is-referenced-by-count":13,"title":["Observability and its impact on differential bias for clinical prediction models"],"prefix":"10.1093","volume":"29","author":[{"given":"Mengying","family":"Yan","sequence":"first","affiliation":[{"name":"Department of Biostatistics & Bioinformatics, Duke University, Durham, North Carolina, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael J","family":"Pencina","sequence":"additional","affiliation":[{"name":"Department of Biostatistics & Bioinformatics, Duke University, Durham, North Carolina, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"L Ebony","family":"Boulware","sequence":"additional","affiliation":[{"name":"Department of Medicine, Duke University, Durham, North Carolina, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin A","family":"Goldstein","sequence":"additional","affiliation":[{"name":"Department of Biostatistics & Bioinformatics, Duke University, Durham, North Carolina, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"issue":"1","key":"2022041311590348200_ocac019-B1","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1093\/jamia\/ocw042","article-title":"Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review","volume":"24","author":"Goldstein","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"11","key":"2022041311590348200_ocac019-B2","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1093\/aje\/kww112","article-title":"Controlling for informed presence bias due to the number of health encounters in an electronic health record","volume":"184","author":"Goldstein","year":"2016","journal-title":"Am J Epidemiol"},{"issue":"1","key":"2022041311590348200_ocac019-B3","first-page":"22","article-title":"Illustrating informed presence bias in electronic health records data: how patient interactions with a health system can impact inference","volume":"5","author":"Phelan","year":"2017","journal-title":"EGEMS (Wash DC)"},{"issue":"1","key":"2022041311590348200_ocac019-B4","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1093\/jamia\/ocaa242","article-title":"Informative presence and observation in routine health data: a review of methodology for clinical risk prediction","volume":"28","author":"Sisk","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2022041311590348200_ocac019-B5","doi-asserted-by":"crossref","first-page":"9","DOI":"10.9781\/ijimai.2021.02.007","article-title":"Achieving fair inference using error-prone outcomes","volume":"6","author":"Boeschoten","year":"2021","journal-title":"IJIMAI"},{"issue":"2","key":"2022041311590348200_ocac019-B6","doi-asserted-by":"crossref","first-page":"205395171774353","DOI":"10.1177\/2053951717743530","article-title":"Fairer machine learning in the real world: mitigating discrimination without collecting sensitive data","volume":"4","author":"Veale","year":"2017","journal-title":"Big Data & Society"},{"issue":"1","key":"2022041311590348200_ocac019-B7","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1146\/annurev-statistics-042720-125902","article-title":"Algorithmic fairness: choices, assumptions, and definitions","volume":"8","author":"Mitchell","year":"2021","journal-title":"Annu Rev Stat Appl"},{"key":"2022041311590348200_ocac019-B8","author":"Galhotra","year":"2020"},{"key":"2022041311590348200_ocac019-B9","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-77244-8","volume-title":"Clinical Prediction Models","author":"Steyerberg","year":"2009"},{"issue":"6464","key":"2022041311590348200_ocac019-B10","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"issue":"5","key":"2022041311590348200_ocac019-B11","doi-asserted-by":"crossref","first-page":"410","DOI":"10.5811\/westjem.2011.11.6820","article-title":"Factors influencing emergency department preference for access to healthcare","volume":"13","author":"Brown","year":"2011","journal-title":"WestJEM"},{"issue":"4","key":"2022041311590348200_ocac019-B12","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1016\/j.emc.2006.06.009","article-title":"Racial and ethnic disparities in the emergency department: a public health perspective","volume":"24","author":"Heron","year":"2006","journal-title":"Emerg Med Clin North Am"},{"issue":"12","key":"2022041311590348200_ocac019-B13","doi-asserted-by":"crossref","first-page":"1664","DOI":"10.1176\/ps.2009.60.12.1664","article-title":"Disproportionate use of psychiatric emergency services by African Americans","volume":"60","author":"Snowden","year":"2009","journal-title":"Psychiatr Serv"},{"key":"2022041311590348200_ocac019-B14","doi-asserted-by":"crossref","first-page":"g7873","DOI":"10.1136\/bmj.g7873","article-title":"High sensitivity cardiac troponin and the under-diagnosis of myocardial infarction in women: prospective cohort study","volume":"350","author":"Shah","year":"2015","journal-title":"BMJ"},{"issue":"9","key":"2022041311590348200_ocac019-B15","doi-asserted-by":"crossref","first-page":"e1910816","DOI":"10.1001\/jamanetworkopen.2019.10816","article-title":"Association of race\/ethnicity with emergency department destination of emergency medical services transport","volume":"2","author":"Hanchate","year":"2019","journal-title":"JAMA Netw Open"},{"issue":"25","key":"2022041311590348200_ocac019-B16","doi-asserted-by":"crossref","first-page":"2477","DOI":"10.1056\/NEJMc2029240","article-title":"Racial bias in pulse oximetry measurement","volume":"383","author":"Sjoding","year":"2020","journal-title":"N Engl J Med"},{"issue":"1","key":"2022041311590348200_ocac019-B17","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s10549-016-4090-7","article-title":"Volumetric breast density affects performance of digital screening mammography","volume":"162","author":"Wanders","year":"2017","journal-title":"Breast Cancer Res Treat"},{"issue":"5","key":"2022041311590348200_ocac019-B18","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1093\/ije\/30.5.959","article-title":"Ethnic differences in mammographic densities","volume":"30","author":"Maskarinec","year":"2001","journal-title":"Int J Epidemiol"},{"issue":"9","key":"2022041311590348200_ocac019-B19","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1056\/NEJMms2004740","article-title":"Hidden in plain sight\u2014reconsidering the use of race correction in clinical algorithms","volume":"383","author":"Vyas","year":"2020","journal-title":"N Engl J Med"},{"issue":"9","key":"2022041311590348200_ocac019-B20","doi-asserted-by":"crossref","first-page":"1429","DOI":"10.1007\/s11606-018-4475-x","article-title":"Effects of race are rarely included in clinical prediction models for cardiovascular disease","volume":"33","author":"Paulus","year":"2018","journal-title":"J Gen Intern Med"},{"issue":"2","key":"2022041311590348200_ocac019-B21","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/S2213-2600(20)30571-3","article-title":"Could routine race-adjustment of spirometers exacerbate racial disparities in COVID-19 recovery?","volume":"9","author":"Anderson","year":"2021","journal-title":"Lancet Respir Med"},{"issue":"3","key":"2022041311590348200_ocac019-B22","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1093\/jamia\/ocaa283","article-title":"Addressing bias in prediction models by improving subpopulation calibration","volume":"28","author":"Barda","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2022041311590348200_ocac019-B23","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.ijid.2020.06.052","article-title":"Asymptomatic patients as a source of COVID-19 infections: a systematic review and meta-analysis","volume":"98","author":"Kronbichler","year":"2020","journal-title":"Int J Infect Dis"},{"key":"2022041311590348200_ocac019-B24","doi-asserted-by":"publisher","year":"2020","DOI":"10.1377\/hblog20200630.939347"},{"key":"2022041311590348200_ocac019-B25","author":"H\u00e9bert-Johnson","year":"2018"},{"issue":"3","key":"2022041311590348200_ocac019-B26","first-page":"1035","article-title":"Strategies for handling missing data in electronic health record derived data","volume":"1","author":"Wells","year":"2013","journal-title":"EGEMS (Wash DC)"},{"issue":"3","key":"2022041311590348200_ocac019-B27","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1086\/368276","article-title":"Informative missingness in genetic association studies: case-parent designs","volume":"72","author":"Allen","year":"2003","journal-title":"Am J Hum Genet"},{"issue":"12","key":"2022041311590348200_ocac019-B28","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1093\/aje\/kwr458","article-title":"Results on differential and dependent measurement error of the exposure and the outcome using signed directed acyclic graphs","volume":"175","author":"VanderWeele","year":"2012","journal-title":"Am J Epidemiol"},{"issue":"10","key":"2022041311590348200_ocac019-B29","doi-asserted-by":"crossref","first-page":"1823","DOI":"10.1093\/aje\/kwz133","article-title":"Simple sensitivity analysis for differential measurement error","volume":"188","author":"VanderWeele","year":"2019","journal-title":"Am J Epidemiol"},{"issue":"5","key":"2022041311590348200_ocac019-B30","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1093\/oxfordjournals.aje.a112408","article-title":"Bias due to misclassification in the estimation of relative risk","volume":"105","author":"Copeland","year":"1977","journal-title":"Am J Epidemiol"},{"issue":"21","key":"2022041311590348200_ocac019-B31","doi-asserted-by":"crossref","first-page":"3261","DOI":"10.1002\/sim.1252","article-title":"On the potential of measurement error to induce differential bias on odds ratio estimates: an example from radon epidemiology","volume":"21","author":"Heid","year":"2002","journal-title":"Stat Med"},{"issue":"1","key":"2022041311590348200_ocac019-B32","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1097\/EDE.0000000000001432","article-title":"On the nature of informative presence bias in analyses of electronic health records","volume":"33","author":"McGee","year":"2022","journal-title":"Epidemiology"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/5\/937\/43372479\/ocac019.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/5\/937\/43372479\/ocac019.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,13]],"date-time":"2022-04-13T12:20:45Z","timestamp":1649852445000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/5\/937\/6535920"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":32,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,2,25]]},"published-print":{"date-parts":[[2022,4,13]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac019","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,5,1]]},"published":{"date-parts":[[2022,2,25]]}}}