{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T05:53:58Z","timestamp":1782971638144,"version":"3.54.5"},"reference-count":37,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T00:00:00Z","timestamp":1630454400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T00:00:00Z","timestamp":1630454400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Women's Health Reports"],"published-print":{"date-parts":[[2021,9,1]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>A comorbidity summary score may support early and systematic identification of women at high risk for adverse obstetric outcomes. The objective of this study was to conduct the initial development and validation of an obstetrics comorbidity risk score for automated implementation in the electronic health record (EHR) for clinical use.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>\n                      The score was developed and validated using EHR data for a retrospective cohort of pregnancies with delivery between 2010 and 2018 at Kaiser Permanente Northern California, an integrated health care system. The outcome used for model development consisted of adverse obstetric events from delivery hospitalization (\n                      <jats:italic toggle=\"yes\">e.g.<\/jats:italic>\n                      , eclampsia, hemorrhage, death). Candidate predictors included maternal age, parity, multiple gestation, and any maternal diagnoses assigned in health care encounters in the 12 months before admission for delivery. We used penalized regression for variable selection, logistic regression to fit the model, and internal validation for model evaluation. We also evaluated prenatal model performance at 18 weeks of pregnancy.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      The development cohort (\n                      <jats:italic toggle=\"yes\">n<\/jats:italic>\n                      \u2009=\u2009227,405 pregnancies) had an outcome rate of 3.8% and the validation cohort (\n                      <jats:italic toggle=\"yes\">n<\/jats:italic>\n                      \u2009=\u200941,683) had an outcome rate of 2.9%. Of 276 candidate predictors, 37 were included in the final model. The final model had a validation c-statistic of 0.72 (95% confidence interval [CI] 0.70\u20130.73). When evaluated at 18 weeks of pregnancy, discrimination was modestly diminished (c-statistic 0.68 [95% CI 0.67\u20130.70]).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>The obstetric comorbidity score demonstrated good discrimination for adverse obstetric outcomes. After additional appropriate validation, the score can be automated in the EHR to support early identification of high-risk women and assist efforts to ensure risk-appropriate maternal care.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1089\/whr.2021.0046","type":"journal-article","created":{"date-parts":[[2021,11,2]],"date-time":"2021-11-02T14:43:43Z","timestamp":1635864223000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":7,"title":["Development and Validation of an Obstetric Comorbidity Risk Score for Clinical Use"],"prefix":"10.1177","volume":"2","author":[{"given":"Halley","family":"Ruppel","sequence":"first","affiliation":[{"name":"Kaiser Permanente Northern California Division of Research, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vincent X.","family":"Liu","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northern California Division of Research, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patricia","family":"Kipnis","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northern California Division of Research, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Monique M.","family":"Hedderson","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northern California Division of Research, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mara","family":"Greenberg","sequence":"additional","affiliation":[{"name":"East Bay Department of Obstetrics and Gynecology, Kaiser Permanente Northern California, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heather","family":"Forquer","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northern California Division of Research, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Lawson","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northern California Division of Research, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriel J.","family":"Escobar","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Northern California Division of Research, Oakland, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2021,11,2]]},"reference":[{"key":"e_1_3_5_2_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12884-018-2169-3"},{"key":"e_1_3_5_3_2","doi-asserted-by":"publisher","DOI":"10.5888\/pcd15.170397"},{"key":"e_1_3_5_4_2","doi-asserted-by":"publisher","DOI":"10.1097\/AOG.0b013e3182a06f4e"},{"key":"e_1_3_5_5_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0182343"},{"key":"e_1_3_5_6_2","doi-asserted-by":"publisher","DOI":"10.1161\/HYPERTENSIONAHA.119.12968"},{"key":"e_1_3_5_7_2","doi-asserted-by":"publisher","DOI":"10.1097\/AOG.0000000000001556"},{"key":"e_1_3_5_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/1471-0528.14029"},{"key":"e_1_3_5_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2015.06.013"},{"key":"e_1_3_5_10_2","doi-asserted-by":"publisher","DOI":"10.1111\/aogs.13749"},{"key":"e_1_3_5_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2019.06.025"},{"key":"e_1_3_5_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9681(87)90171-8"},{"key":"e_1_3_5_13_2","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-199801000-00004"},{"key":"e_1_3_5_14_2","doi-asserted-by":"publisher","DOI":"10.1097\/AOG.0b013e3182a603bb"},{"key":"e_1_3_5_15_2","doi-asserted-by":"publisher","DOI":"10.1097\/AOG.0000000000003383"},{"key":"e_1_3_5_16_2","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e3182881c8e"},{"key":"e_1_3_5_17_2","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e3181589bb6"},{"key":"e_1_3_5_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2016.09.013"},{"key":"e_1_3_5_19_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMsa2001090"},{"key":"e_1_3_5_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2019.01.208"},{"key":"e_1_3_5_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2020.10.030"},{"key":"e_1_3_5_22_2","unstructured":"HCUP Clinical Classifications Software (CCS) for ICD-9-CM. Healthcare Cost and Utilization Project (HCUP). Rockville MD: Agency for Healthcare Research and Quality. Available at: https:\/\/www.hcup-us.ahrq.gov\/toolssoftware\/ccs\/ccs.jsp Accessed May16 2017."},{"key":"e_1_3_5_23_2","unstructured":"HCUP Clinical Classifications Software (CCS) for ICD-10-CM beta. Healthcare Cost and Utilization Project (HCUP). Rockville MD: Agency for Healthcare Research and Quality. Available at: https:\/\/www.hcup-us.ahrq.gov\/toolssoftware\/ccsr\/ccsr_archive.jsp#ccsbeta Accessed May16 2017."},{"key":"e_1_3_5_24_2","doi-asserted-by":"crossref","unstructured":"James G Witten D Hastie T Tibshirani R. An introduction to statistical learning vol. 112. New York: Springer 2013.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"e_1_3_5_25_2","doi-asserted-by":"crossref","unstructured":"Hastie T Tibshirani R Friedman J. The elements of statistical learning: data mining inference and prediction 2nd ed. New York: Springer Science & Business Media 2009.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"e_1_3_5_26_2","doi-asserted-by":"crossref","unstructured":"Steyerberg EW. Clinical prediction models: a practical approach to development validation and updating 2nd ed. New York: Springer 2019.","DOI":"10.1007\/978-3-030-16399-0"},{"key":"e_1_3_5_27_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz088"},{"key":"e_1_3_5_28_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-015-0999-1"},{"key":"e_1_3_5_29_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2044.2011.06896.x"},{"key":"e_1_3_5_30_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0217864"},{"key":"e_1_3_5_31_2","first-page":"527","article-title":"Use of Maternal Early Warning Trigger tool reduces maternal morbidity","volume":"214","author":"Shields LE","year":"2016","unstructured":"Shields LE, , Wiesner S, , Klein C, , Pelletreau B, , Hedriana HL. Use of Maternal Early Warning Trigger tool reduces maternal morbidity. Am J Obstet Gynecol, 2016; 214:527.","journal-title":"Am J Obstet Gynecol"},{"key":"e_1_3_5_32_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0208563"},{"key":"e_1_3_5_33_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0215173"},{"key":"e_1_3_5_34_2","doi-asserted-by":"publisher","DOI":"10.1097\/AOG.0000000000004022"},{"key":"e_1_3_5_35_2","doi-asserted-by":"publisher","DOI":"10.1111\/1471-0528.13254"},{"key":"e_1_3_5_36_2","doi-asserted-by":"publisher","DOI":"10.1097\/AOG.0000000000000746"},{"key":"e_1_3_5_37_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.AOG.0000187894.71913.e8"},{"key":"e_1_3_5_38_2","doi-asserted-by":"publisher","DOI":"10.1111\/1471-0528.13859"}],"updated-by":[{"DOI":"10.1089\/whr.2021.0046.correx","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2021,12,15]],"date-time":"2021-12-15T00:00:00Z","timestamp":1639526400000}}],"container-title":["Women's Health Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1089\/whr.2021.0046","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/whr.2021.0046","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/whr.2021.0046","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T16:15:35Z","timestamp":1773245735000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1089\/whr.2021.0046"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,1]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,9,1]]}},"alternative-id":["10.1089\/whr.2021.0046"],"URL":"https:\/\/doi.org\/10.1089\/whr.2021.0046","relation":{},"ISSN":["2688-4844","2688-4844"],"issn-type":[{"value":"2688-4844","type":"print"},{"value":"2688-4844","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,1]]},"article-number":"whr.2021.0046"}}