{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T11:48:29Z","timestamp":1775216909823,"version":"3.50.1"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2024,3,26]],"date-time":"2024-03-26T00:00:00Z","timestamp":1711411200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Center for Transportation, Environment, and Community Health New Research Initiatives Fund"},{"name":"National Institutes of Health Small Business Technology Transfer Fund","award":["5R41MH124581-02"],"award-info":[{"award-number":["5R41MH124581-02"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,5,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>We developed and externally validated a machine-learning model to predict postpartum depression (PPD) using data from electronic health records (EHRs). Effort is under way to implement the PPD prediction model within the EHR system for clinical decision support. We describe the pre-implementation evaluation process that considered model performance, fairness, and clinical appropriateness.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We used EHR data from an academic medical center (AMC) and a clinical research network database from 2014 to 2020 to evaluate the predictive performance and net benefit of the PPD risk model. We used area under the curve and sensitivity as predictive performance and conducted a decision curve analysis. In assessing model fairness, we employed metrics such as disparate impact, equal opportunity, and predictive parity with the White race being the privileged value. The model was also reviewed by multidisciplinary experts for clinical appropriateness. Lastly, we debiased the model by comparing 5 different debiasing approaches of fairness through blindness and reweighing.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We determined the classification threshold through a performance evaluation that prioritized sensitivity and decision curve analysis. The baseline PPD model exhibited some unfairness in the AMC data but had a fair performance in the clinical research network data. We revised the model by fairness through blindness, a debiasing approach that yielded the best overall performance and fairness, while considering clinical appropriateness suggested by the expert reviewers.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion and Conclusion<\/jats:title>\n                  <jats:p>The findings emphasize the need for a thorough evaluation of intervention-specific models, considering predictive performance, fairness, and appropriateness before clinical implementation.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae056","type":"journal-article","created":{"date-parts":[[2024,3,27]],"date-time":"2024-03-27T02:23:02Z","timestamp":1711506182000},"page":"1258-1267","source":"Crossref","is-referenced-by-count":16,"title":["Preparing for the bedside\u2014optimizing a postpartum depression risk prediction model for clinical implementation in a health system"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1785-4614","authenticated-orcid":false,"given":"Yifan","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Population Health Sciences, Weill Cornell Medicine , New York, NY 10065, United States"}]},{"given":"Rochelle","family":"Joly","sequence":"additional","affiliation":[{"name":"Department of Obstetrics and Gynecology, Weill Cornell Medicine , New York, NY 10065, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6264-6320","authenticated-orcid":false,"given":"Meghan","family":"Reading Turchioe","sequence":"additional","affiliation":[{"name":"Columbia University School of Nursing , New York, NY, United States"}]},{"given":"Natalie","family":"Benda","sequence":"additional","affiliation":[{"name":"Columbia University School of Nursing , New York, NY, United States"}]},{"given":"Alison","family":"Hermann","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Weill Cornell Medicine , New York, NY 10065, United States"}]},{"given":"Ashley","family":"Beecy","sequence":"additional","affiliation":[{"name":"Department of Medicine, Weill Cornell Medicine , New York, NY 10065, United States"},{"name":"NewYork-Presbyterian Hospital , New York, NY 10065, United States"}]},{"given":"Jyotishman","family":"Pathak","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, Weill Cornell Medicine , New York, NY 10065, United States"},{"name":"Department of Psychiatry, Weill Cornell Medicine , New York, NY 10065, United States"}]},{"given":"Yiye","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, Weill Cornell Medicine , New York, NY 10065, United States"},{"name":"NewYork-Presbyterian Hospital , New York, NY 10065, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,3,26]]},"reference":[{"key":"2024052019461301600_ocae056-B1","author":"Mughal","year":"2022"},{"issue":"136","key":"2024052019461301600_ocae056-B2","first-page":"1","article-title":"Pregnancy rates for U.S. women continue to drop","author":"Curtin","year":"2013","journal-title":"NCHS Data Brief"},{"issue":"1","key":"2024052019461301600_ocae056-B3","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s00737-014-0475-y","article-title":"Preventing postpartum depression: review and recommendations","volume":"18","author":"Werner","year":"2015","journal-title":"Arch Womens Ment Health"},{"issue":"9","key":"2024052019461301600_ocae056-B4","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.4088\/JCP.15r10174","article-title":"The perinatal depression treatment cascade: baby steps toward improving outcomes","volume":"77","author":"Cox","year":"2016","journal-title":"J Clin Psychiatry"},{"key":"2024052019461301600_ocae056-B5","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1016\/j.jad.2020.06.048","article-title":"Effectiveness of peer support intervention on perinatal depression: A systematic review and meta-analysis","volume":"276","author":"Huang","year":"2020","journal-title":"J Affect Disord"},{"issue":"2","key":"2024052019461301600_ocae056-B6","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1097\/YCO.0b013e3283503680","article-title":"Anxiety, depression and stress in pregnancy: implications for mothers, children, research, and practice","volume":"25","author":"Dunkel Schetter","year":"2012","journal-title":"Curr Opin Psychiatry"},{"issue":"4","key":"2024052019461301600_ocae056-B7","doi-asserted-by":"crossref","first-page":"517.e1","DOI":"10.1016\/j.ajog.2016.05.024","article-title":"Implementation of universal screening for depression during pregnancy: feasibility and impact on obstetric care","volume":"215","author":"Venkatesh","year":"2016","journal-title":"Am J Obstet Gynecol"},{"issue":"6","key":"2024052019461301600_ocae056-B8","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1001\/jama.2018.20865","article-title":"Interventions to prevent perinatal depression: evidence report and systematic review for the US preventive services task force","volume":"321","author":"O\u2019Connor","year":"2019","journal-title":"JAMA"},{"key":"2024052019461301600_ocae056-B9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jad.2020.09.113","article-title":"Development and validation of a machine learning algorithm for predicting the risk of postpartum depression among pregnant women","volume":"279","author":"Yiye","year":"2021","journal-title":"J Affect Disord"},{"issue":"3","key":"2024052019461301600_ocae056-B10","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1136\/bmjqs-2018-008370","article-title":"Artificial intelligence, bias and clinical safety","volume":"28","author":"Challen","year":"2019","journal-title":"BMJ Qual Saf"},{"issue":"6","key":"2024052019461301600_ocae056-B11","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1176\/ps.62.6.pss6206_0619","article-title":"Racial and ethnic disparities in postpartum depression care among low-income women","volume":"62","author":"Kozhimannil","year":"2011","journal-title":"Psychiatr Serv"},{"issue":"6","key":"2024052019461301600_ocae056-B12","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1177\/0272989X06295361","article-title":"Decision curve analysis: a novel method for evaluating prediction models","volume":"26","author":"Vickers","year":"2006","journal-title":"Med Decis Making"},{"issue":"6","key":"2024052019461301600_ocae056-B13","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1016\/j.eururo.2018.08.038","article-title":"Reporting and interpreting decision curve analysis: a guide for investigators","volume":"74","author":"Van Calster","year":"2018","journal-title":"Eur Urol"},{"issue":"4","key":"2024052019461301600_ocae056-B14","doi-asserted-by":"crossref","first-page":"e213909","DOI":"10.1001\/jamanetworkopen.2021.3909","article-title":"Comparison of methods to reduce bias from clinical prediction models of postpartum depression","volume":"4","author":"Park","year":"2021","journal-title":"JAMA Netw Open"},{"key":"2024052019461301600_ocae056-B15","first-page":"1","author":"Verma"},{"key":"2024052019461301600_ocae056-B16","author":"Calmon","year":"2017"},{"key":"2024052019461301600_ocae056-B17","first-page":"259","author":"Feldman"},{"issue":"1","key":"2024052019461301600_ocae056-B18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10115-011-0463-8","article-title":"Data preprocessing techniques for classification without discrimination","volume":"33","author":"Kamiran","year":"2012","journal-title":"Knowl Inf Syst"},{"issue":"2","key":"2024052019461301600_ocae056-B19","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1089\/big.2016.0048","article-title":"Conscientious classification: a data scientist\u2019s guide to discrimination-aware classification","volume":"5","author":"d\u2019Alessandro","year":"2017","journal-title":"Big Data"},{"issue":"5","key":"2024052019461301600_ocae056-B20","doi-asserted-by":"crossref","first-page":"e36388","DOI":"10.2196\/36388","article-title":"Evaluation and mitigation of racial bias in clinical machine learning models: scoping review","volume":"10","author":"Huang","year":"2022","journal-title":"JMIR Med Inform"},{"issue":"6464","key":"2024052019461301600_ocae056-B21","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"issue":"9","key":"2024052019461301600_ocae056-B22","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1056\/NEJMms2004740","article-title":"Hidden in plain sight\u2014reconsidering the use of race correction in clinical algorithms","volume":"383","author":"Vyas","year":"2020","journal-title":"N Engl J Med"},{"key":"2024052019461301600_ocae056-B23","doi-asserted-by":"crossref","first-page":"104294","DOI":"10.1016\/j.jbi.2023.104294","article-title":"Evaluating and mitigating bias in machine learning models for cardiovascular disease prediction","volume":"138","author":"Li","year":"2023","journal-title":"J Biomed Inform"},{"issue":"4","key":"2024052019461301600_ocae056-B24","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1001\/jama.2022.24683","article-title":"Predictive accuracy of stroke risk prediction models across Black and White race, sex, and age groups","volume":"329","author":"Hong","year":"2023","journal-title":"JAMA"},{"issue":"11","key":"2024052019461301600_ocae056-B25","doi-asserted-by":"crossref","first-page":"2393","DOI":"10.1093\/jamia\/ocab148","article-title":"Bias and fairness assessment of a natural language processing opioid misuse classifier: detection and mitigation of electronic health record data disadvantages across racial subgroups","volume":"28","author":"Thompson","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2024052019461301600_ocae056-B26","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1136\/amiajnl-2011-000116","article-title":"Normalized names for clinical drugs: RxNorm at 6 years","volume":"18","author":"Nelson","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2024052019461301600_ocae056-B27","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1001\/jama.2015.37","article-title":"Decision curve analysis","volume":"313","author":"Fitzgerald","year":"2015","journal-title":"JAMA"},{"issue":"4","key":"2024052019461301600_ocae056-B28","doi-asserted-by":"crossref","first-page":"e38879","DOI":"10.2196\/38879","article-title":"Assessing the racial and socioeconomic disparities in postpartum depression using population-level hospital discharge data: longitudinal retrospective study","volume":"5","author":"Liu","year":"2022","journal-title":"JMIR Pediatr Parent"},{"issue":"7","key":"2024052019461301600_ocae056-B29","doi-asserted-by":"crossref","first-page":"e0287398","DOI":"10.1371\/journal.pone.0287398","article-title":"Continuous and early prediction of future moderate and severe Acute Kidney Injury in critically ill patients: development and multi-centric, multi-national external validation of a machine-learning model","volume":"18","author":"Alfieri","year":"2023","journal-title":"PLoS One"},{"issue":"6","key":"2024052019461301600_ocae056-B30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3585006","article-title":"Fair enough: searching for sufficient measures of fairness","volume":"32","author":"Majumder","year":"2023","journal-title":"ACM Trans Softw Eng Methodol"},{"key":"2024052019461301600_ocae056-B31","author":"Bellamy","year":"2018"},{"key":"2024052019461301600_ocae056-B32","year":"2009"},{"key":"2024052019461301600_ocae056-B33","doi-asserted-by":"crossref","first-page":"248","DOI":"10.3389\/fpsyt.2017.00248","article-title":"Economic and health predictors of national postpartum depression prevalence: a systematic review, meta-analysis, and meta-regression of 291 studies from 56 countries","volume":"8","author":"Hahn-Holbrook","year":"2017","journal-title":"Front Psychiatry"},{"issue":"5","key":"2024052019461301600_ocae056-B34","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1093\/qjmed\/hcaa110","article-title":"Mental health in the COVID-19 pandemic","volume":"113","author":"Cullen","year":"2020","journal-title":"QJM"},{"issue":"Suppl 2","key":"2024052019461301600_ocae056-B35","doi-asserted-by":"crossref","first-page":"S112","DOI":"10.5213\/inj.1632722.361","article-title":"Racial Differences in the Diagnosis and Treatment of Prostate Cancer","volume":"20","author":"Pietro","year":"2016","journal-title":"Int Neurourol J"},{"key":"2024052019461301600_ocae056-B36","author":"Movva","year":"2023"},{"issue":"12","key":"2024052019461301600_ocae056-B37","doi-asserted-by":"crossref","first-page":"e2345022","DOI":"10.1001\/jamanetworkopen.2023.45022","article-title":"Proactive algorithm monitoring to ensure health equity","volume":"6","author":"Sendak","year":"2023","journal-title":"JAMA Netw Open"},{"issue":"12","key":"2024052019461301600_ocae056-B38","doi-asserted-by":"crossref","first-page":"e2345050","DOI":"10.1001\/jamanetworkopen.2023.45050","article-title":"Guiding principles to address the impact of algorithm bias on racial and ethnic disparities in health and health care","volume":"6","author":"Chin","year":"2023","journal-title":"JAMA Netw Open"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/6\/1258\/57768940\/ocae056.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/6\/1258\/57768940\/ocae056.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T19:46:43Z","timestamp":1716234403000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/6\/1258\/7635382"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,26]]},"references-count":38,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,3,26]]},"published-print":{"date-parts":[[2024,5,20]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae056","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,6,1]]},"published":{"date-parts":[[2024,3,26]]}}}