{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:37:10Z","timestamp":1790703430728,"version":"4.1.0"},"reference-count":33,"publisher":"Public Library of Science (PLoS)","issue":"2","license":[{"start":{"date-parts":[[2021,2,3]],"date-time":"2021-02-03T00:00:00Z","timestamp":1612310400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:sec id=\"sec001\">\n<jats:title>Introduction<\/jats:title>\n<jats:p>Postpartum hemorrhage remains a leading cause of maternal morbidity and mortality worldwide. Therefore, cumulative incidence of postpartum hemorrhage and severe postpartum hemorrhage are commonly monitored within and compared across maternity hospitals or countries for obstetrical safety improvement. These indicators are usually based on hospital discharge data though their accuracy is seldom assessed. We aimed to measure postpartum hemorrhage and severe postpartum hemorrhage using electronic health records and hospital discharge data separately and compare the detection accuracy of these methods to manual chart review, and to examine the temporal trends in cumulative incidence of these potentially avoidable adverse outcomes.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec002\">\n<jats:title>Materials and methods<\/jats:title>\n<jats:p>We analyzed routinely collected data of 7904 singleton deliveries from a large Swiss university hospital for a three year period (2014\u20132016). We identified postpartum hemorrhage and severe postpartum hemorrhage in electronic health records by text mining discharge letters and operative reports and calculating drop in hemoglobin from laboratory tests. Diagnostic and procedure codes were used to identify cases in hospital discharge data. A sample of 334 charts was reviewed manually to provide a reference-standard and evaluate the accuracy of the other detection methods.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec003\">\n<jats:title>Results<\/jats:title>\n<jats:p>Sensitivities of detection algorithms based on electronic health records and hospital discharge data were 95.2% (95% CI: 92.6% 97.8%) and 38.2% (33.3% to 43.0%), respectively for postpartum hemorrhage, and 87.5% (85.2% to 89.8%) and 36.2% (26.3% to 46.1%) for severe postpartum hemorrhage. Postpartum hemorrhage cumulative incidence based on electronic health records decreased from 15.6% (13.1% to 18.2%) to 8.5% (6.7% to 10.5%) from the beginning of 2014 to the end of 2016, with an average of 12.5% (11.8% to 13.3%). The cumulative incidence of severe postpartum hemorrhage remained at approximately 4% (3.5% to 4.4%). Hospital discharge data-based algorithms provided significantly underestimated incidences.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec004\">\n<jats:title>Conclusions<\/jats:title>\n<jats:p>Hospital discharge data is not accurate enough to assess the incidence of postpartum hemorrhage at hospital or national level. Instead, automated algorithms based on structured and textual data from electronic health records should be considered, as they provide accurate and timely estimates for monitoring and improvement in obstetrical safety. Furthermore, they have the potential to better code for postpartum hemorrhage thus improving hospital reimbursement.<\/jats:p>\n<\/jats:sec>","DOI":"10.1371\/journal.pone.0246119","type":"journal-article","created":{"date-parts":[[2021,2,3]],"date-time":"2021-02-03T19:14:15Z","timestamp":1612379655000},"page":"e0246119","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":16,"title":["Hospital discharge data is not accurate enough to monitor the incidence of postpartum hemorrhage"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8526-8425","authenticated-orcid":true,"given":"Diana","family":"Walther","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patricia","family":"Halfon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4965-0237","authenticated-orcid":true,"given":"Romain","family":"Tanzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5678-6044","authenticated-orcid":true,"given":"Bernard","family":"Burnand","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Moira","family":"Robertson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yvan","family":"Vial","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1308-7750","authenticated-orcid":true,"given":"David","family":"Desseauve","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1672-3644","authenticated-orcid":true,"given":"Marie-Annick","family":"Le Pogam","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2021,2,3]]},"reference":[{"issue":"6","key":"pone.0246119.ref001","doi-asserted-by":"crossref","first-page":"e323","DOI":"10.1016\/S2214-109X(14)70227-X","article-title":"Global causes of maternal death: a WHO systematic analysis","volume":"2","author":"L Say","year":"2014","journal-title":"Lancet Glob Health"},{"key":"pone.0246119.ref002","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1186\/s12884-016-1054-1","article-title":"The prevalence of women's emotional and physical health problems following a postpartum haemorrhage: a systematic review","volume":"16","author":"M Carroll","year":"2016","journal-title":"BMC Pregnancy Childbirth"},{"issue":"4","key":"pone.0246119.ref003","doi-asserted-by":"crossref","first-page":"e168","DOI":"10.1097\/AOG.0000000000002351","article-title":"Practice Bulletin No. 183: Postpartum Hemorrhage","volume":"130","author":"Committee on Practice B-O","year":"2017","journal-title":"Obstet Gynecol"},{"issue":"6","key":"pone.0246119.ref004","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1053\/j.semperi.2017.07.007","article-title":"Epidemiology of maternal morbidity and mortality","volume":"41","author":"A Hirshberg","year":"2017","journal-title":"Semin Perinatol"},{"key":"pone.0246119.ref005","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.ejogrb.2018.03.032","article-title":"Major obstetric hemorrhage: Patients' perspective on the quality of care","volume":"224","author":"SM de Visser","year":"2018","journal-title":"Eur J Obstet Gynecol Reprod Biol"},{"issue":"3","key":"pone.0246119.ref006","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1067\/mob.2002.125765","article-title":"Length of hospital stay, obstetric conditions at childbirth, and maternal readmission: A population-based cohort study","volume":"187","author":"S Liu","year":"2002","journal-title":"American Journal of Obstetrics and Gynecology"},{"issue":"3","key":"pone.0246119.ref007","doi-asserted-by":"crossref","first-page":"344 e1","DOI":"10.1016\/j.ajog.2017.05.004","article-title":"The impact of postpartum hemorrhage on hospital length of stay and inpatient mortality: a National Inpatient Sample-based analysis","volume":"217","author":"AL Marshall","year":"2017","journal-title":"Am J Obstet Gynecol"},{"issue":"6","key":"pone.0246119.ref008","doi-asserted-by":"crossref","first-page":"999","DOI":"10.1016\/j.bpobgyn.2008.08.004","article-title":"Epidemiology of postpartum haemorrhage: a systematic review","volume":"22","author":"G Carroli","year":"2008","journal-title":"Best Pract Res Clin Obstet Gynaecol"},{"issue":"5","key":"pone.0246119.ref009","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1053\/j.semperi.2017.04.002","article-title":"Improving hospital quality to reduce disparities in severe maternal morbidity and mortality","volume":"41","author":"EA Howell","year":"2017","journal-title":"Semin Perinatol"},{"issue":"4","key":"pone.0246119.ref010","doi-asserted-by":"crossref","first-page":"509 e1","DOI":"10.1016\/j.ajog.2016.05.022","article-title":"Opportunities for improvement in care among women with severe maternal morbidity","volume":"215","author":"JA Ozimek","year":"2016","journal-title":"Am J Obstet Gynecol"},{"issue":"11","key":"pone.0246119.ref011","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1080\/17474086.2016.1245135","article-title":"Postpartum haemorrhage: prevention and treatment","volume":"9","author":"L Sentilhes","year":"2016","journal-title":"Expert Rev Hematol"},{"key":"pone.0246119.ref012","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1111\/1471-0528.12636","article-title":"Postpartum haemorrhage management, risks, and maternal outcomes: findings from the World Health Organization Multicountry Survey on Maternal and Newborn Health","volume":"1211","author":"WR Sheldon","year":"2014","journal-title":"BJOG"},{"key":"pone.0246119.ref013","article-title":"Developing a set of consensus indicators to support maternity service quality improvement: using Core Outcome Set methodology including a Delphi process","author":"KJ Bunch","year":"2018","journal-title":"BJOG"},{"key":"pone.0246119.ref014","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1186\/1471-2393-9-55","article-title":"Trends in postpartum hemorrhage in high resource countries: a review and recommendations from the International Postpartum Hemorrhage Collaborative Group","volume":"9","author":"M Knight","year":"2009","journal-title":"BMC Pregnancy Childbirth"},{"issue":"4","key":"pone.0246119.ref015","doi-asserted-by":"crossref","first-page":"353 e1","DOI":"10.1016\/j.ajog.2010.01.011","article-title":"Trends in postpartum hemorrhage: United States, 1994\u20132006","volume":"202","author":"WM Callaghan","year":"2010","journal-title":"Am J Obstet Gynecol"},{"key":"pone.0246119.ref016","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1186\/s12884-015-0788-5","article-title":"Trends and outcomes of postpartum haemorrhage, 2003\u20132011","volume":"15","author":"JB Ford","year":"2015","journal-title":"BMC Pregnancy Childbirth"},{"issue":"5","key":"pone.0246119.ref017","doi-asserted-by":"crossref","first-page":"449 e1","DOI":"10.1016\/j.ajog.2013.07.007","article-title":"Incidence, risk factors, and temporal trends in severe postpartum hemorrhage","volume":"209","author":"MS Kramer","year":"2013","journal-title":"Am J Obstet Gynecol"},{"issue":"3","key":"pone.0246119.ref018","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1111\/j.1471-0528.2011.03198.x","article-title":"Increasing trends in atonic postpartum haemorrhage in Ireland: an 11-year population-based cohort study","volume":"119","author":"JE Lutomski","year":"2012","journal-title":"BJOG"},{"key":"pone.0246119.ref019","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1186\/1471-2393-12-108","article-title":"Trends in postpartum hemorrhage from 2000 to 2009: a population-based study","volume":"12","author":"A Mehrabadi","year":"2012","journal-title":"BMC Pregnancy Childbirth"},{"key":"pone.0246119.ref020","first-page":"w14551","article-title":"Temporal trends of postpartum haemorrhage in Switzerland: a 22-year retrospective population-based cohort study","volume":"147","author":"A Kaelin Agten","year":"2017","journal-title":"Swiss Med Wkly"},{"issue":"9415","key":"pone.0246119.ref021","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1016\/S0140-6736(04)15901-1","article-title":"Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma","volume":"363","author":"R Lilford","year":"2004","journal-title":"Lancet"},{"key":"pone.0246119.ref022","volume-title":"Risk Adjustment for Measuring Health Care Outcomes","author":"LI Iezzoni","year":"2013"},{"issue":"1","key":"pone.0246119.ref023","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1080\/14767058.2016.1274302","article-title":"The more you lose the more you miss: accuracy of postpartum blood loss visual estimation. A systematic review of the literature","volume":"31","author":"M Natrella","year":"2018","journal-title":"J Matern Fetal Neonatal Med"},{"issue":"5","key":"pone.0246119.ref024","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1111\/j.1600-0412.2011.01107.x","article-title":"Postpartum hemorrhage\u2014update on problems of definitions and diagnosis","volume":"90","author":"WH Rath","year":"2011","journal-title":"Acta Obstet Gynecol Scand"},{"key":"pone.0246119.ref025","article-title":"Postpartum hemorrhage: new insights for definition and diagnosis","author":"A Borovac-Pinheiro","year":"2018","journal-title":"Am J Obstet Gynecol"},{"issue":"4","key":"pone.0246119.ref026","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1111\/trf.14498","article-title":"Accuracy of international classification of diseases, ninth revision, codes for postpartum hemorrhage among women undergoing cesarean delivery","volume":"58","author":"AJ Butwick","year":"2018","journal-title":"Transfusion"},{"issue":"4","key":"pone.0246119.ref027","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.jogoh.2018.01.005","article-title":"Can hospital discharge data be used for monitoring indicators associated with postpartum hemorrhages? The HERA multicenter observational study","volume":"47","author":"C Crenn-Hebert","year":"2018","journal-title":"J Gynecol Obstet Hum Reprod"},{"issue":"5","key":"pone.0246119.ref028","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1111\/j.1479-828X.2008.00910.x","article-title":"How accurate is the reporting of obstetric haemorrhage in hospital discharge data? A validation study","volume":"48","author":"SJ Lain","year":"2008","journal-title":"Aust N Z J Obstet Gynaecol"},{"issue":"4","key":"pone.0246119.ref029","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1093\/biostatistics\/3.4.477","article-title":"Prospective studies of diagnostic test accuracy when disease prevalence is low","volume":"3","author":"NA Obuchowski","year":"2002","journal-title":"Biostatistics"},{"issue":"1","key":"pone.0246119.ref030","doi-asserted-by":"crossref","first-page":"149","DOI":"10.2307\/2533205","article-title":"Stratification in nonparametric ROC studies","volume":"50","author":"S Sukhatme","year":"1994","journal-title":"Biometrics"},{"issue":"4","key":"pone.0246119.ref031","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.ajog.2015.10.011","article-title":"Triggers, bundles, protocols, and checklists\u2014what every maternal care provider needs to know","volume":"214","author":"KS Arora","year":"2016","journal-title":"Am J Obstet Gynecol"},{"issue":"3","key":"pone.0246119.ref032","doi-asserted-by":"crossref","first-page":"E617","DOI":"10.9778\/cmajo.20170036","article-title":"Coder perspectives on physician-related barriers to producing high-quality administrative data: a qualitative study","volume":"5","author":"KL Tang","year":"2017","journal-title":"CMAJ Open"},{"issue":"4","key":"pone.0246119.ref033","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1159\/000320336","article-title":"Pictorial blood loss assessment chart in the evaluation of heavy menstrual bleeding: diagnostic accuracy compared to alkaline hematin","volume":"71","author":"MS Zakherah","year":"2011","journal-title":"Gynecol Obstet Invest"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0246119","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,3]],"date-time":"2021-02-03T19:14:30Z","timestamp":1612379670000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0246119"}},"subtitle":[],"editor":[{"given":"Roza","family":"Chaireti","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,2,3]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2,3]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0246119","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,3]]}}}