{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T15:00:04Z","timestamp":1776351604371,"version":"3.51.2"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T00:00:00Z","timestamp":1633478400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T00:00:00Z","timestamp":1633478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Pregnancy Childbirth"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Improvement in the prediction and prevention of severe maternal morbidity (SMM) - a range of life-threatening conditions during pregnancy, at delivery or within 42\u2009days postpartum - is a public health priority. Reduction of SMM at a population level would be facilitated by early identification and prediction. We sought to develop and internally validate a model to predict maternal end-organ injury or death using variables routinely collected during pre-pregnancy and the early pregnancy period.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We performed a population-based cohort study using linked administrative health data in Ontario, Canada, from April 1, 2006 to March 31, 2014. We included women aged 18\u201360\u2009years with a livebirth or stillbirth, of which one birth was randomly selected per woman. We constructed a clinical prediction model for the primary composite outcome of any maternal end-organ injury or death, arising between 20\u2009weeks\u2019 gestation and 42\u2009days after the birth hospital discharge date. Our model included variables collected from 12\u2009months before estimated conception until 19\u2009weeks\u2019 gestation. We developed a separate model for parous women to allow for the inclusion of factors from previous pregnancy(ies).<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Of 634,290 women, 1969 experienced the primary composite outcome (3.1 per 1000). Predictive factors in the main model included maternal world region of origin, chronic medical conditions, parity, and obstetrical\/perinatal issues \u2013 with moderate model discrimination (C-statistic 0.68, 95% CI 0.66\u20130.69). Among 333,435 parous women, the C-statistic was 0.71 (0.69\u20130.73) in the model using variables from the current (index) pregnancy as well as pre-pregnancy predictors and variables from any previous pregnancy.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>A combination of factors ascertained early in pregnancy through a basic medical history help to identify women at risk for severe morbidity, who may benefit from targeted preventive and surveillance strategies including appropriate specialty-based antenatal care pathways. Further refinement and external validation of this model are warranted and can support evidence-based improvements in clinical practice.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12884-021-04132-6","type":"journal-article","created":{"date-parts":[[2021,10,7]],"date-time":"2021-10-07T08:40:39Z","timestamp":1633596039000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Development and internal validation of a model predicting severe maternal morbidity using pre-conception and early pregnancy variables: a population-based study in Ontario, Canada"],"prefix":"10.1186","volume":"21","author":[{"given":"Natalie","family":"Dayan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel D.","family":"Shapiro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Luo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Guan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Deshayne B.","family":"Fell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carl A.","family":"Laskin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olga","family":"Basso","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alison L.","family":"Park","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joel G.","family":"Ray","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,6]]},"reference":[{"issue":"7","key":"4132_CR1","doi-asserted-by":"publisher","first-page":"e184571","DOI":"10.1001\/jamanetworkopen.2018.4571","volume":"1","author":"JG Ray","year":"2018","unstructured":"Ray JG, Park AL, Dzakpasu S, et al. Prevalence of SMM and factors associated with maternal mortality in Ontario, Canada. JAMA Netw Open. 2018;1(7):e184571.","journal-title":"JAMA Netw Open"},{"issue":"6","key":"4132_CR2","doi-asserted-by":"publisher","first-page":"e002742","DOI":"10.1136\/bmjopen-2013-002742","volume":"3","author":"A Lindquist","year":"2013","unstructured":"Lindquist A, Knight M, Kurinczuk JJ. Variation in SMM according to socioeconomic position: a UK national case-control study. BMJ Open. 2013;3(6):e002742.","journal-title":"BMJ Open"},{"issue":"8","key":"4132_CR3","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.1093\/humrep\/dey224","volume":"33","author":"N Dayan","year":"2018","unstructured":"Dayan N, Fell DB, Guo Y, et al. SMM in women with high BMI in IVF and unassisted singleton pregnancies. Hum Reprod. 2018;33(8):1548\u201356.","journal-title":"Hum Reprod"},{"issue":"6","key":"4132_CR4","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1016\/j.ajog.2012.11.041","volume":"208","author":"ME D'Alton","year":"2013","unstructured":"D'Alton ME, Bonanno CA, Berkowitz RL, et al. Putting the \u201cM\u201d back in maternal-fetal medicine. Am J Obstet Gynecol. 2013;208(6):442\u20138.","journal-title":"Am J Obstet Gynecol"},{"issue":"3","key":"4132_CR5","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1016\/j.bpobgyn.2009.01.004","volume":"23","author":"J van Roosmalen","year":"2009","unstructured":"van Roosmalen J, Zwart J. Severe acute maternal morbidity in high-income countries. Best Pract Res Clin Obstet Gynaecol. 2009;23(3):297\u2013304.","journal-title":"Best Pract Res Clin Obstet Gynaecol"},{"issue":"10","key":"4132_CR6","doi-asserted-by":"publisher","first-page":"794","DOI":"10.2471\/BLT.13.117564","volume":"91","author":"T Firoz","year":"2013","unstructured":"Firoz T, Chou D, von Dadelszen P, et al. Measuring maternal health: focus on maternal morbidity. Bull World Health Organ. 2013;91(10):794\u20136.","journal-title":"Bull World Health Organ"},{"key":"4132_CR7","doi-asserted-by":"crossref","unstructured":"Malhame I, Danilack VA, Raker CA, et al. Cardiovascular SMM in pregnant and postpartum women: development and internal validation of risk prediction models. BJOG. 2021;128(5):922\u201332.","DOI":"10.1111\/1471-0528.16512"},{"issue":"8","key":"4132_CR8","doi-asserted-by":"publisher","first-page":"e199875","DOI":"10.1001\/jamanetworkopen.2019.9875","volume":"2","author":"K Aoyama","year":"2019","unstructured":"Aoyama K, Pinto R, Ray JG, et al. Association of maternal age with SMM and mortality in Canada. JAMA Netw Open. 2019;2(8):e199875.","journal-title":"JAMA Netw Open"},{"issue":"5","key":"4132_CR9","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1097\/AOG.0b013e3182a603bb","volume":"122","author":"BT Bateman","year":"2013","unstructured":"Bateman BT, Mhyre JM, Hernandez-Diaz S, et al. Development of a comorbidity index for use in obstetric patients. Obstet Gynecol. 2013;122(5):957\u201365.","journal-title":"Obstet Gynecol"},{"key":"4132_CR10","doi-asserted-by":"publisher","first-page":"1748","DOI":"10.1111\/1471-0528.13254","volume":"122","author":"A Metcalfe","year":"2015","unstructured":"Metcalfe A, Lix LM, Johnson J-A, Currie G, Lyon AW, Bernier F, et al. Validation of an obstetric comorbidity index in an external population. BJOG. 2015;122:1748\u201355.","journal-title":"BJOG"},{"issue":"12","key":"4132_CR11","doi-asserted-by":"publisher","first-page":"e0208563","DOI":"10.1371\/journal.pone.0208563","volume":"13","author":"K Aoyama","year":"2018","unstructured":"Aoyama K, D'Souza R, Pinto R, et al. Risk prediction models for maternal mortality: a systematic review and meta-analysis. PLoS One. 2018;13(12):e0208563.","journal-title":"PLoS One"},{"issue":"2","key":"4132_CR12","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1097\/AOG.0000000000003347","volume":"134","author":"MK Menard","year":"2019","unstructured":"Menard MK. Toward achieving risk-appropriate maternity care: maternal morbidity prediction. Obstet Gynecol. 2019;134(2):213\u20135.","journal-title":"Obstet Gynecol"},{"issue":"5","key":"4132_CR13","doi-asserted-by":"publisher","first-page":"945","DOI":"10.1097\/01.AOG.0000435079.10951.5f","volume":"122","author":"GA Macones","year":"2013","unstructured":"Macones GA. Understanding and reducing serious maternal morbidity: a step in the right direction. Obstet Gynecol. 2013;122(5):945\u20136.","journal-title":"Obstet Gynecol"},{"issue":"5","key":"4132_CR14","doi-asserted-by":"publisher","first-page":"E118","DOI":"10.1503\/cmaj.181124","volume":"191","author":"N Dayan","year":"2019","unstructured":"Dayan N, Joseph KS, Fell DB, et al. Infertility treatment and risk of SMM: a propensity score-matched cohort study. CMAJ. 2019;191(5):E118\u201327.","journal-title":"CMAJ"},{"key":"4132_CR15","doi-asserted-by":"publisher","first-page":"g7594","DOI":"10.1136\/bmj.g7594","volume":"350","author":"GS Collins","year":"2015","unstructured":"Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350:g7594.","journal-title":"BMJ"},{"key":"4132_CR16","volume-title":"Legacy data elements","author":"BORN Ontario","year":"2019","unstructured":"BORN Ontario. Legacy data elements. 2019. https:\/\/www.bornontario.ca\/en\/data\/legacy-data-elements.aspx. Accessed 13 Sept 2019."},{"issue":"1","key":"4132_CR17","doi-asserted-by":"publisher","first-page":"1001","DOI":"10.1186\/s12913-019-4825-3","volume":"19","author":"S Dunn","year":"2019","unstructured":"Dunn S, Lanes A, Sprague AE, et al. Data accuracy in the Ontario birth registry: a chart re-abstraction study. BMC Health Serv Res. 2019;19(1):1001.","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"4132_CR18","doi-asserted-by":"crossref","first-page":"32","DOI":"10.24095\/hpcdp.32.1.05","volume":"32","author":"S Dunn","year":"2011","unstructured":"Dunn S, Bottomley J, Ali A, Walker M. 2008 Niday Perinatal Database quality audit: report of a quality assurance project. Chronic Dis Inj Can. 2011;32(1):32\u201342.","journal-title":"Chronic Dis Inj Can"},{"issue":"9","key":"4132_CR19","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1016\/S1701-2163(16)34655-2","volume":"32","author":"KS Joseph","year":"2010","unstructured":"Joseph KS, Liu S, Rouleau J, Kirby RS, Kramer MS, Sauve R, et al. SMM in Canada, 2003 to 2007: surveillance using routine hospitalization data and ICD-10CA codes. J Obstet Gynaecol Can. 2010;32(9):837\u201346.","journal-title":"J Obstet Gynaecol Can"},{"issue":"5","key":"4132_CR20","doi-asserted-by":"publisher","first-page":"643.e641","DOI":"10.1016\/j.ajog.2015.11.004","volume":"214","author":"EK Main","year":"2016","unstructured":"Main EK, Abreo A, McNulty J, et al. Measuring SMM: validation of potential measures. Am J Obstet Gynecol. 2016;214(5):643.e641\u201310.","journal-title":"Am J Obstet Gynecol"},{"issue":"8","key":"4132_CR21","doi-asserted-by":"publisher","first-page":"786","DOI":"10.1097\/MLR.0b013e318178eae4","volume":"46","author":"CL Roberts","year":"2008","unstructured":"Roberts CL, Cameron CA, Bell JC, Algert CS, Morris JM. Measuring maternal morbidity in routinely collected health data: development and validation of a maternal morbidity outcome indicator. Med Care. 2008;46(8):786\u201394.","journal-title":"Med Care"},{"issue":"34","key":"4132_CR22","doi-asserted-by":"publisher","first-page":"E1085","DOI":"10.1503\/cmaj.170088","volume":"189","author":"S Grigoriadis","year":"2017","unstructured":"Grigoriadis S, Wilton AS, Kurdyak PA, et al. Perinatal suicide in Ontario, Canada: a 15-year population-based study. CMAJ. 2017;189(34):E1085\u201392.","journal-title":"CMAJ"},{"issue":"3","key":"4132_CR23","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1016\/j.ajog.2018.05.025","volume":"219","author":"JG Ray","year":"2018","unstructured":"Ray JG, Zipursky J, Park AL. Injury-related maternal mortality. Am J Obstet Gynecol. 2018;219(3):307\u20138.","journal-title":"Am J Obstet Gynecol"},{"key":"4132_CR24","volume-title":"Multivariate data analysis","author":"JF Hair","year":"2006","unstructured":"Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Multivariate data analysis. Upper Saddle River: Pearson Prentice Hall; 2006."},{"key":"4132_CR25","unstructured":"Steyerberg EW. Clinical prediction models: A practical approach to development, validation, and updating. New York: Springer; 2009."},{"issue":"6","key":"4132_CR26","doi-asserted-by":"publisher","first-page":"1228","DOI":"10.1080\/03610910902859574","volume":"38","author":"PC Austin","year":"2009","unstructured":"Austin PC. Using the standardized difference to compare the prevalence of a binary variable between two groups in observational research. Commun Stat Simul Comput. 2009;38(6):1228\u201334.","journal-title":"Commun Stat Simul Comput"},{"issue":"1","key":"4132_CR27","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","volume":"143","author":"JA Hanley","year":"1982","unstructured":"Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29.","journal-title":"Radiology"},{"key":"4132_CR28","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-77244-8","volume-title":"Mathematics and statistics. Clinical prediction models: a practical approach to development, validation, and updating","author":"EW Steyerberg","year":"2009","unstructured":"Steyerberg EW. Mathematics and statistics. Clinical prediction models: a practical approach to development, validation, and updating. New York: Springer; 2009."},{"issue":"8","key":"4132_CR29","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1016\/S0895-4356(01)00341-9","volume":"54","author":"EW Steyerberg","year":"2001","unstructured":"Steyerberg EW, Harrell FE Jr, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001;54(8):774\u201381.","journal-title":"J Clin Epidemiol"},{"issue":"4","key":"4132_CR30","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","volume":"15","author":"FE Harrell Jr","year":"1996","unstructured":"Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361\u201387.","journal-title":"Stat Med"},{"key":"4132_CR31","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","volume":"21","author":"EW Steyerberg","year":"2010","unstructured":"Steyerberg EW, Vickerrs AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology. 2010;21:128\u201338.","journal-title":"Epidemiology"},{"issue":"7458","key":"4132_CR32","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1136\/bmj.329.7458.168","volume":"329","author":"JJ Deeks","year":"2004","unstructured":"Deeks JJ, Altman DG. Diagnostic tests 4: likelihood ratios. Br Med J. 2004;329(7458):168\u20139.","journal-title":"Br Med J"},{"issue":"8","key":"4132_CR33","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1046\/j.1525-1497.2002.10750.x","volume":"17","author":"S McGee","year":"2002","unstructured":"McGee S. Simplfying likelihood ratios. J Gen Intern Med. 2002;17(8):647\u201350.","journal-title":"J Gen Intern Med"},{"issue":"1","key":"4132_CR34","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1159\/000341264","volume":"33","author":"R Akolekar","year":"2013","unstructured":"Akolekar R, Syngelaki A, Poon L, Wright D, Nicolaides KH. Competing risks model in early screening for preeclampsia by biophysical and biochemical markers. Fetal Diagn Ther. 2013;33(1):8\u201315.","journal-title":"Fetal Diagn Ther"},{"issue":"14","key":"4132_CR35","doi-asserted-by":"publisher","first-page":"1377","DOI":"10.1001\/jama.2017.12126","volume":"318","author":"AC Alba","year":"2017","unstructured":"Alba AC, Agoritsas T, Walsh M, et al. Discrimination and calibration of clinical prediction models: users\u2019 guides to the medical literature. JAMA. 2017;318(14):1377\u201384.","journal-title":"JAMA"},{"key":"4132_CR36","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1186\/s13054-015-0999-1","volume":"19","author":"S Romero-Brufau","year":"2015","unstructured":"Romero-Brufau S, Huddleston JM, Escobar GJ, Liebow M. Why the C-statistic is not informative to evaluate early warning scores and what metrics to use. Crit Care (London, England). 2015;19:285.","journal-title":"Crit Care (London, England)"},{"issue":"3","key":"4132_CR37","doi-asserted-by":"publisher","first-page":"B17","DOI":"10.1016\/j.ajog.2016.07.050","volume":"215","author":"SK Kilpatrick","year":"2016","unstructured":"American College of O, Gynecologists, the Society for Maternal-Fetal M, Kilpatrick SK, Ecker JL. SMM: screening and review. Am J Obstet Gynecol. 2016;215(3):B17\u201322.","journal-title":"Am J Obstet Gynecol"},{"issue":"3","key":"4132_CR38","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1177\/1753495X19872880","volume":"12","author":"AJ Davidson","year":"2019","unstructured":"Davidson AJ, Park AL, Ray JG. Navigating SMM using big data: green, yellow, and red flags for researchers. Obstet Med. 2019;12(3):105\u20136.","journal-title":"Obstet Med"}],"container-title":["BMC Pregnancy and Childbirth"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12884-021-04132-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12884-021-04132-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12884-021-04132-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T08:19:58Z","timestamp":1673425198000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcpregnancychildbirth.biomedcentral.com\/articles\/10.1186\/s12884-021-04132-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,6]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["4132"],"URL":"https:\/\/doi.org\/10.1186\/s12884-021-04132-6","relation":{},"ISSN":["1471-2393"],"issn-type":[{"value":"1471-2393","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,6]]},"assertion":[{"value":"18 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 September 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The use of data in this project was authorized under section 45 of Ontario\u2019s Personal Health Information Protection Act, which does not require review by a Research Ethics Board, or individual patient consent. ICES approved the study and all analyses of raw data were conducted at ICES. No other administrative permissions were required.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare they have no conflicts of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"679"}}