{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T15:43:15Z","timestamp":1785426195985,"version":"3.56.0"},"reference-count":30,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T00:00:00Z","timestamp":1784937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institute of Health","award":["K23HL168212"],"award-info":[{"award-number":["K23HL168212"]}]},{"name":"National Institute of Health","award":["1R61HL177037"],"award-info":[{"award-number":["1R61HL177037"]}]},{"award":["K23HL168212"],"award-info":[{"award-number":["K23HL168212"]}],"id":[{"id":"https:\/\/ror.org\/01cwqze88","id-type":"ROR","asserted-by":"publisher"}]},{"award":["1R61HL177037"],"award-info":[{"award-number":["1R61HL177037"]}],"id":[{"id":"https:\/\/ror.org\/01cwqze88","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Infect. Dis. Rep.","Infectious Disease Reports"],"abstract":"<jats:p>Background\/Objective: To externally validate our previously published machine learning model for identifying hospitalized patients with community-acquired pneumonia (CAP) at low risk of respiratory deterioration or death using the Medical Information Mart for Intensive Care IV (MIMIC-IV) database. Methods: This is a retrospective cohort study of adult patients (\u226518 years) who were admitted with CAP and acute hypoxemic respiratory failure using the publicly available MIMIC-IV critical care dataset (Beth Israel Deaconess Medical Center, Boston, MA). We conducted an external validation study of a previously developed gradient boosting machine (GBM) model without recalibration using data available within the first 6 h of hospital admission. Results: For the primary composite outcome (need for advanced respiratory support [high flow nasal cannula (HFNC), non-invasive mechanical ventilation (NIMV), invasive mechanical ventilation (IMV)] or in-hospital death), the gradient boosting model demonstrated comparable performance in the derivation and external validation cohorts. The area under the receiver operating characteristic curve (AUC) was 0.713 in the Mayo cohort (n = 4379) and 0.689 in the MIMIC-IV cohort. Accuracy was 0.612 (95% confidence interval [CI], 0.595\u20130.628) versus 0.606 (95% CI 0.600\u20130.611), specificity 0.574 versus 0.523, sensitivity 0.723 versus 0.754, NPV 0.860 versus 0.842, and PPV 0.364 versus 0.401, respectively. For secondary outcomes, model discrimination was comparable between cohorts. The AUC for in-hospital mortality was 0.727 in the Mayo Cohort versus 0.733 in MIMIC-IV; for IMV, 0.736 versus 0.724; and for NIMV, 0.732 versus 0.708. Conclusions: Our machine learning algorithm demonstrated good discrimination and a high negative predictive value for identifying low-risk hospitalized CAP patients for respiratory deterioration or death in the external MIMIC-IV dataset, supporting its potential utility for prognostic enrichment in pneumonia clinical trials.<\/jats:p>","DOI":"10.3390\/idr18040077","type":"journal-article","created":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T14:08:14Z","timestamp":1785161294000},"page":"77","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Early Machine Learning-Based Identification of Hospitalized Patients at Low Risk of Respiratory Deterioration or Mortality in Community-Acquired Pneumonia: External Validation of a Multivariable Model"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-3158-8630","authenticated-orcid":false,"given":"Claudia","family":"Gyimah","sequence":"first","affiliation":[{"name":"Division of Pulmonary and Critical Care Medicine, Mayo Clinic, 200 First Street SW, Rochester, MN 55905, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Prasamsa","family":"Pudasaini","sequence":"additional","affiliation":[{"name":"Division of Pulmonary and Critical Care Medicine, Mayo Clinic, 200 First Street SW, Rochester, MN 55905, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1554-795X","authenticated-orcid":false,"given":"Allison","family":"LeMahieu","sequence":"additional","affiliation":[{"name":"Division of Clinical Trials and Biostatistics, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phillip","family":"Schulte","sequence":"additional","affiliation":[{"name":"Division of Clinical Trials and Biostatistics, Mayo Clinic, Rochester, MN 55905, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4446-198X","authenticated-orcid":false,"given":"Yewande E.","family":"Odeyemi","sequence":"additional","affiliation":[{"name":"Division of Pulmonary and Critical Care Medicine, Mayo Clinic, 200 First Street SW, Rochester, MN 55905, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,7,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1056\/NEJMoa1500245","article-title":"Community-acquired pneumonia requiring hospitalization among U.S. adults","volume":"373","author":"Jain","year":"2015","journal-title":"N. Engl. J. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1619","DOI":"10.1056\/NEJMra1312885","article-title":"Community-acquired pneumonia","volume":"371","author":"Musher","year":"2014","journal-title":"N. Engl. J. Med."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sialer, S., Difrancesco, L.F., Fabregas, T.F., and Torres, A. (2014). Community-acquired pneumonia. Metabolism of Human Diseases, Springer.","DOI":"10.1007\/978-3-7091-0715-7_34"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1007\/s12325-020-01248-7","article-title":"Burden of community-acquired pneumonia and unmet clinical needs","volume":"37","author":"Sarda","year":"2020","journal-title":"Adv. Ther."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1159\/000479089","article-title":"Risk factors for community-acquired pneumonia in adults: A systematic review of observational studies","volume":"94","author":"Almirall","year":"2017","journal-title":"Respiration"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1056\/NEJMcp2303286","article-title":"Community-acquired pneumonia","volume":"389","author":"File","year":"2023","journal-title":"N. Engl. J. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1282","DOI":"10.1001\/jama.2024.14796","article-title":"Community-acquired pneumonia: A review","volume":"332","author":"Vaughn","year":"2024","journal-title":"JAMA"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2185","DOI":"10.1056\/NEJMoa1503326","article-title":"High-flow oxygen through nasal cannula in acute hypoxemic respiratory failure","volume":"372","author":"Frat","year":"2015","journal-title":"N. Engl. J. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1602426","DOI":"10.1183\/13993003.02426-2016","article-title":"Official ERS\/ATS clinical practice guidelines: Noninvasive ventilation for acute respiratory failure","volume":"50","author":"Rochwerg","year":"2017","journal-title":"Eur. Respir. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2371","DOI":"10.1016\/S0140-6736(25)01493-X","article-title":"Community-acquired pneumonia","volume":"406","author":"Reyes","year":"2025","journal-title":"Lancet"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1702215","DOI":"10.1183\/13993003.02215-2017","article-title":"Acute respiratory distress syndrome in mechanically ventilated patients with community-acquired pneumonia","volume":"51","author":"Cilloniz","year":"2018","journal-title":"Eur. Respir. J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1378\/chest.08-0334","article-title":"Incidence, etiology, timing, and risk factors for clinical failure in hospitalized patients with community-acquired pneumonia","volume":"134","author":"Aliberti","year":"2008","journal-title":"Chest"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1136\/thorax.58.5.377","article-title":"Defining community-acquired pneumonia severity on presentation to hospital: An international derivation and validation study","volume":"58","author":"Lim","year":"2003","journal-title":"Thorax"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1056\/NEJM199701233360402","article-title":"A prediction rule to identify low-risk patients with community-acquired pneumonia","volume":"336","author":"Fine","year":"1997","journal-title":"N. Engl. J. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e45","DOI":"10.1164\/rccm.201908-1581ST","article-title":"Diagnosis and treatment of adults with community-acquired pneumonia. An official clinical practice guideline of the American Thoracic Society and Infectious Diseases Society of America","volume":"200","author":"Metlay","year":"2019","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1097\/CCM.0000000000007089","article-title":"Surviving Sepsis Campaign: International guidelines for management of sepsis and septic shock 2026","volume":"54","author":"Prescott","year":"2026","journal-title":"Crit. Care Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1007\/s00134-015-3693-5","article-title":"Failure of high-flow nasal cannula therapy may delay intubation and increase mortality","volume":"41","author":"Kang","year":"2015","journal-title":"Intensiv. Care Med."},{"key":"ref_18","unstructured":"U.S. Food and Drug Administration (2019). Enrichment Strategies for Clinical Trials to Support Determination of Effectiveness of Human Drugs and Biological Products: Guidance for Industry."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"104778","DOI":"10.1016\/j.ijmedinf.2022.104778","article-title":"The pneumonia severity index: Assessment and comparison to popular machine learning classifiers","volume":"163","author":"Wang","year":"2022","journal-title":"Int. J. Med. Inform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e48320","DOI":"10.2196\/48320","article-title":"The use of deep learning and machine learning on longitudinal electronic health records for the early detection and prevention of diseases: Scoping review","volume":"26","author":"Swinckels","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1566","DOI":"10.1038\/s41598-025-85951-x","article-title":"Prediction of mortality risk in patients with severe community-acquired pneumonia in the intensive care unit using machine learning","volume":"15","author":"Pan","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1186\/s12931-025-03348-w","article-title":"Development and multi-database validation of interpretable machine learning models for predicting in-hospital mortality in pneumonia patients: A comprehensive analysis across four healthcare systems","volume":"26","author":"Chen","year":"2025","journal-title":"Respir. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"337","DOI":"10.17305\/bb.2023.9754","article-title":"Early machine learning prediction of hospitalized patients at low risk of respiratory deterioration or mortality in community-acquired pneumonia: Derivation and validation of a multivariable model","volume":"24","author":"Odeyemi","year":"2024","journal-title":"Biomol. Biomed."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41597-022-01899-x","article-title":"MIMIC-IV, a freely accessible electronic health record dataset","volume":"10","author":"Johnson","year":"2023","journal-title":"Sci. Data"},{"key":"ref_25","unstructured":"Johnson, A., Bulgarelli, L., Pollard, T., Horng, S., Celi, L.A., and Mark, R. (MIMIC-IV, 2023). MIMIC-IV, RRID:SCR_007345."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Steyerberg, E.W. (2019). Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating, Springer. [2nd ed.].","DOI":"10.1007\/978-3-030-16399-0"},{"key":"ref_27","first-page":"e1067","article-title":"External validation of prognostic models in critical care: A cautionary tale from COVID-19 pneumonitis","volume":"6","author":"Bate","year":"2024","journal-title":"Crit. Care Explor."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"m1328","DOI":"10.1136\/bmj.m1328","article-title":"Prediction models for diagnosis and prognosis of COVID-19: Systematic review and critical appraisal","volume":"369","author":"Wynants","year":"2020","journal-title":"BMJ"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1038\/clpt.2010.233","article-title":"Enrichment of clinical study populations","volume":"88","author":"Temple","year":"2010","journal-title":"Clin. Pharmacol. Ther."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1136\/thx.2007.086785","article-title":"Markers of treatment failure in hospitalised community acquired pneumonia","volume":"63","author":"Menendez","year":"2008","journal-title":"Thorax"}],"container-title":["Infectious Disease Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2036-7449\/18\/4\/77\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T14:39:24Z","timestamp":1785163164000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2036-7449\/18\/4\/77"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,25]]},"references-count":30,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["idr18040077"],"URL":"https:\/\/doi.org\/10.3390\/idr18040077","relation":{},"ISSN":["2036-7449"],"issn-type":[{"value":"2036-7449","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,25]]}}}