{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,14]],"date-time":"2026-11-14T09:39:22Z","timestamp":1794649162118,"version":"4.9.1"},"reference-count":32,"publisher":"BMJ","issue":"1","license":[{"start":{"date-parts":[[2023,12,28]],"date-time":"2023-12-28T00:00:00Z","timestamp":1703721600000},"content-version":"unspecified","delay-in-days":27,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open Resp Res"],"accepted":{"date-parts":[[2023,12,1]]},"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Existing models have performed poorly when predicting mortality for patients undergoing venovenous extracorporeal membrane oxygenation (VV-ECMO). This study aimed to develop and validate a machine learning (ML)-based prediction model to predict 90-day mortality in patients undergoing VV-ECMO.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>This study included 368 patients with acute respiratory failure undergoing VV-ECMO from 16 tertiary hospitals across South Korea between 2012 and 2015. The primary outcome was the 90-day mortality after ECMO initiation. The inputs included all available features (n=51) and those from the electronic health record (EHR) systems without preprocessing (n=40). The discriminatory strengths of ML models were evaluated in both internal and external validation sets. The models were compared with conventional models, such as respiratory ECMO survival prediction (RESP) and predicting death for severe acute respiratory distress syndrome on VV-ECMO (PRESERVE).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Extreme gradient boosting (XGB) (areas under the receiver operating characteristic curve, AUROC 0.82, 95% CI (0.73 to 0.89)) and light gradient boosting (AUROC 0.81 (95% CI 0.71 to 0.88)) models achieved the highest performance using EHR\u2019s and all other available features. The developed models had higher AUROCs (95% CI 0.76 to 0.82) than those of RESP (AUROC 0.66 (95% CI 0.56 to 0.76)) and PRESERVE (AUROC 0.71 (95% CI 0.61 to 0.81)). Additionally, we achieved an AUROC (0.75) for 90-day mortality in external validation in the case of the XGB model, which was higher than that of RESP (0.70) and PRESERVE (0.67) in the same validation dataset.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>ML prediction models outperformed previous mortality risk models. This model may be used to identify patients who are unlikely to benefit from VV-ECMO therapy during patient selection.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/bmjresp-2023-002025","type":"journal-article","created":{"date-parts":[[2023,12,28]],"date-time":"2023-12-28T12:10:43Z","timestamp":1703765443000},"page":"e002025","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":11,"title":["Supervised machine learning model to predict mortality in patients undergoing venovenous extracorporeal membrane oxygenation from a nationwide multicentre registry"],"prefix":"10.1136","volume":"10","author":[{"given":"Haeun","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Digital Healthcare, Seoul National University Bundang Hospital, Seongnam, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Myung Jin","family":"Song","sequence":"additional","affiliation":[{"name":"Devision of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Young-Jae","family":"Cho","sequence":"additional","affiliation":[{"name":"Devision of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong Jung","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Cardiovascular and Thoracic Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sang-Bum","family":"Hong","sequence":"additional","affiliation":[{"name":"Department of Pulmonary and Critical Care Medicine, Asan Medical Center, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Se Young","family":"Jung","sequence":"additional","affiliation":[{"name":"Department of Digital Healthcare, Seoul National University Bundang Hospital, Seongnam, Republic of Korea"},{"name":"Department of Family Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3161-8711","authenticated-orcid":false,"given":"Sung Yoon","family":"Lim","sequence":"additional","affiliation":[{"name":"Devision of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2023,12,28]]},"reference":[{"key":"2025083111130470000_10.1.e002025.1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2016.0291"},{"key":"2025083111130470000_10.1.e002025.2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra1608077"},{"key":"2025083111130470000_10.1.e002025.3","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1800385"},{"key":"2025083111130470000_10.1.e002025.4","doi-asserted-by":"crossref","DOI":"10.3389\/fmed.2021.716086","article-title":"Delayed initiation of ECMO is associated with poor outcomes in patients with severe COVID-19: A multicenter retrospective cohort study","volume":"8","author":"Li","year":"2021","journal-title":"Front Med (Lausanne)"},{"key":"2025083111130470000_10.1.e002025.5","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1097\/MAT.0000000000001432","article-title":"Management of adult patients supported with Venovenous Extracorporeal membrane oxygenation (VV ECMO): guideline from the Extracorporeal life support Organization (ELSO)","volume":"67","author":"Tonna","year":"2021","journal-title":"ASAIO J"},{"key":"2025083111130470000_10.1.e002025.6","doi-asserted-by":"publisher","DOI":"10.1097\/MAT.0000000000001422"},{"key":"2025083111130470000_10.1.e002025.7","doi-asserted-by":"crossref","unstructured":"Harnisch LO , Moerer O . n.d. Contraindications to the initiation of veno-venous ECMO for severe acute respiratory failure in adults: A systematic review and practical approach based on the current literature. Membranes;11:584. doi:10.3390\/membranes11080584","DOI":"10.3390\/membranes11080584"},{"key":"2025083111130470000_10.1.e002025.8","doi-asserted-by":"crossref","DOI":"10.1186\/s13054-018-2162-2","article-title":"When to initiate ECMO with low likelihood of success","volume":"22","author":"MacLaren","year":"2018","journal-title":"Crit Care"},{"key":"2025083111130470000_10.1.e002025.9","doi-asserted-by":"publisher","DOI":"10.1007\/s00134-020-06331-9"},{"key":"2025083111130470000_10.1.e002025.10","doi-asserted-by":"crossref","first-page":"1983","DOI":"10.1016\/j.athoracsur.2020.12.050","article-title":"Mortality risk assessment in COVID-19 Venovenous Extracorporeal membrane oxygenation","volume":"112","author":"Tabatabai","year":"2021","journal-title":"Ann Thorac Surg"},{"key":"2025083111130470000_10.1.e002025.11","doi-asserted-by":"crossref","DOI":"10.1186\/cc13824","article-title":"Prediction of mortality in adult patients with severe acute lung failure receiving veno-venous Extracorporeal membrane oxygenation: a prospective observational study","volume":"18","author":"Enger","year":"2014","journal-title":"Crit Care"},{"key":"2025083111130470000_10.1.e002025.12","doi-asserted-by":"publisher","DOI":"10.1007\/s00134-013-3037-2"},{"key":"2025083111130470000_10.1.e002025.13","doi-asserted-by":"publisher","DOI":"10.1164\/rccm.201311-2023OC"},{"key":"2025083111130470000_10.1.e002025.14","doi-asserted-by":"crossref","DOI":"10.1186\/s13054-017-1888-6","article-title":"Comparison of mortality prediction models in acute respiratory distress syndrome undergoing Extracorporeal membrane oxygenation and development of a novel prediction score","volume":"21","author":"Hilder","year":"2017","journal-title":"Crit Care"},{"key":"2025083111130470000_10.1.e002025.15","doi-asserted-by":"crossref","first-page":"e78","DOI":"10.1016\/S2589-7500(19)30024-X","article-title":"Survival prediction in intensive-care units based on aggregation of long-term disease history and acute physiology: a retrospective study of the Danish national patient Registry and electronic patient records","volume":"1","author":"Nielsen","year":"2019","journal-title":"Lancet Digit Health"},{"key":"2025083111130470000_10.1.e002025.16","doi-asserted-by":"crossref","DOI":"10.1186\/s13054-018-2293-5","article-title":"Improvement in the survival rates of Extracorporeal membrane oxygenation-supported respiratory failure patients: a multicenter retrospective study in Korean patients","volume":"23","author":"Baek","year":"2019","journal-title":"Crit Care"},{"key":"2025083111130470000_10.1.e002025.17","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.21037\/jtd.2018.03.71","article-title":"Age is major factor for predicting survival in patients with acute respiratory failure on Extracorporeal membrane oxygenation: a Korean multicenter study","volume":"10","author":"Baek","year":"2018","journal-title":"J Thorac Dis"},{"key":"2025083111130470000_10.1.e002025.18","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1016\/j.athoracsur.2020.03.128","article-title":"Predicting survival after Extracorporeal membrane oxygenation by using machine learning","volume":"110","author":"Ayers","year":"2020","journal-title":"Ann Thorac Surg"},{"key":"2025083111130470000_10.1.e002025.19","unstructured":"Lundberg SM , Lee S-I . A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017;30."},{"key":"2025083111130470000_10.1.e002025.20","doi-asserted-by":"crossref","unstructured":"Chen T , Guestrin C . Xgboost: A Scalable tree boosting system. Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining; 2016 doi:10.1145\/2939672.2939785","DOI":"10.1145\/2939672.2939785"},{"key":"2025083111130470000_10.1.e002025.21","unstructured":"Ke G , Meng Q , Finley T , et al . Lightgbm: A highly efficient gradient boosting decision tree. Adv Neural Inf Process Syst 2017;30."},{"key":"2025083111130470000_10.1.e002025.22","unstructured":"Waskom M , Botvinnik O , O\u2019Kane D , et al . Mwaskom\/Seaborn: V0. 8.1 (September 2017). Zenodo. 2017."},{"key":"2025083111130470000_10.1.e002025.23","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0686-2"},{"key":"2025083111130470000_10.1.e002025.24","unstructured":"Van G . The python library reference, release 3.8. 2. Python Software Foundation 2020;16."},{"key":"2025083111130470000_10.1.e002025.25","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2007.55"},{"key":"2025083111130470000_10.1.e002025.26","unstructured":"Reback J , McKinney W , Van Den Bossche J , et al . Pandas-Dev\/Pandas: Pandas 1.0. 5. Zenodo. 2020."},{"key":"2025083111130470000_10.1.e002025.27","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2649-2"},{"key":"2025083111130470000_10.1.e002025.28","unstructured":"Team RC . R: A language and environment for statistical computing. 2013."},{"key":"2025083111130470000_10.1.e002025.29","doi-asserted-by":"crossref","DOI":"10.1186\/s13054-022-03915-3","article-title":"Artificial intelligence in critical care medicine","volume":"26","author":"Yoon","year":"2022","journal-title":"Crit Care"},{"key":"2025083111130470000_10.1.e002025.30","doi-asserted-by":"crossref","DOI":"10.1186\/s13054-020-2752-7","article-title":"Machine learning algorithm to predict mortality in patients undergoing continuous renal replacement therapy","volume":"24","author":"Kang","year":"2020","journal-title":"Crit Care"},{"key":"2025083111130470000_10.1.e002025.31","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2015.02.010"},{"key":"2025083111130470000_10.1.e002025.32","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2015.37"}],"container-title":["BMJ Open Respiratory Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjresp-2023-002025","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,31]],"date-time":"2025-08-31T18:13:15Z","timestamp":1756663995000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopenrespres.bmj.com\/lookup\/doi\/10.1136\/bmjresp-2023-002025"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12,28]]},"published-print":{"date-parts":[[2023,12]]}},"alternative-id":["10.1136\/bmjresp-2023-002025"],"URL":"https:\/\/doi.org\/10.1136\/bmjresp-2023-002025","relation":{},"ISSN":["2052-4439"],"issn-type":[{"value":"2052-4439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12]]}}}