{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T12:37:41Z","timestamp":1765888661580,"version":"3.37.0"},"reference-count":42,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"7","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:sec>\n            <jats:title>OBJECTIVES:<\/jats:title>\n            <jats:p>We sought to validate prognostic scores in coronavirus disease 2019 including National Early Warning Score, Modified Early Warning Score, and age-based modifications, and define their performance characteristics.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>DESIGN:<\/jats:title>\n            <jats:p>We analyzed prospectively collected data from the Adaptive COVID-19 Treatment Trial. National Early Warning Score was collected daily during the trial, Modified Early Warning Score was calculated, and age applied to both scores. We assessed prognostic value for the end points of recovery, mechanical ventilation, and death for score at enrollment, average, and slope of score over the first 48 hours.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>SETTING:<\/jats:title>\n            <jats:p>A multisite international inpatient trial.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>PATIENTS:<\/jats:title>\n            <jats:p>A total of 1,062 adult nonpregnant inpatients with severe coronavirus disease 2019 pneumonia.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>INTERVENTIONS:<\/jats:title>\n            <jats:p>Adaptive COVID-19 Treatment Trial 1 randomized participants to receive remdesivir or placebo. The prognostic value of predictive scores was evaluated in both groups separately to assess for differential performance in the setting of remdesivir treatment.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>MEASUREMENTS AND MAIN RESULTS:<\/jats:title>\n            <jats:p>For mortality, baseline National Early Warning Score and Modified Early Warning Score were weakly to moderately prognostic (c-index, 0.60\u20130.68), and improved with addition of age (c-index, 0.66\u20130.74). For recovery, baseline National Early Warning Score and Modified Early Warning Score demonstrated somewhat better prognostic ability (c-index, 0.65\u20130.69); however, National Early Warning Score+age and Modified Early Warning Score+age further improved performance (c-index, 0.68\u20130.71). For deterioration, baseline National Early Warning Score and Modified Early Warning Score were weakly to moderately prognostic (c-index, 0.59\u20130.69) and improved with addition of age (c-index, 0.63\u20130.70). All prognostic performance improvements due to addition of age were significant (<jats:italic toggle=\"yes\">p<\/jats:italic> &lt; 0.05).<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>CONCLUSIONS:<\/jats:title>\n            <jats:p>In the Adaptive COVID-19 Treatment Trial 1 cohort, National Early Warning Score and Modified Early Warning Score demonstrated moderate prognostic performance in patients with severe coronavirus disease 2019, with improvement in predictive ability for National Early Warning Score+age and Modified Early Warning Score+age. Area under receiver operating curve for National Early Warning Score and Modified Early Warning Score improved in patients receiving remdesivir versus placebo early in the pandemic for recovery and mortality. Although these scores are simple and readily obtainable in myriad settings, in our data set, they were insufficiently predictive to completely replace clinical judgment in coronavirus disease 2019 and may serve best as an adjunct to triage, disposition, and resourcing decisions.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/cce.0000000000000474","type":"journal-article","created":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T20:02:12Z","timestamp":1626206532000},"page":"e0474","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":16,"title":["Performance Analysis of the National Early Warning Score and Modified Early Warning Score in the Adaptive COVID-19 Treatment Trial Cohort"],"prefix":"10.1097","volume":"3","author":[{"given":"Christopher J.","family":"Colombo","sequence":"first","affiliation":[{"name":"Madigan Army Medical Center, Tacoma, WA."},{"name":"Infectious Disease Clinical Research Program, Uniformed Services University of the Health Sciences, Bethesda, MD."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rhonda E.","family":"Colombo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ryan C.","family":"Maves","sequence":"additional","affiliation":[{"name":"Infectious Disease Clinical Research Program, Uniformed Services University of the Health Sciences, Bethesda, MD."},{"name":"Naval Medical Center, San Diego, CA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angela R.","family":"Branche","sequence":"additional","affiliation":[{"name":"University of Rochester Medical Center, Rochester, NY."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stuart H.","family":"Cohen","sequence":"additional","affiliation":[{"name":"University of California Davis, Sacramento, CA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marie-Carmelle","family":"Elie","sequence":"additional","affiliation":[{"name":"University of Florida Gaineseville, Gaineseville, FL."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah L.","family":"George","sequence":"additional","affiliation":[{"name":"Saint Louis University and St. Louis VA Medical Center, Saint Louis, MO."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hannah J.","family":"Jang","sequence":"additional","affiliation":[{"name":"Department of Community Health Systems, School of Nursing and Center for Nursing Excellence and Innovation, University of California San Francisco, San Francisco, CA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andre C.","family":"Kalil","sequence":"additional","affiliation":[{"name":"University of Nebraska Medical Center, Omaha, NE."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David A.","family":"Lindholm","sequence":"additional","affiliation":[{"name":"Infectious Disease Clinical Research Program, Uniformed Services University of the Health Sciences, Bethesda, MD."},{"name":"Brooke Army Medical Center, San Antonio, TX."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard A.","family":"Mularski","sequence":"additional","affiliation":[{"name":"The Center for Health Research, Kaiser Permanente Northwest, Portland, OR."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justin R.","family":"Ortiz","sequence":"additional","affiliation":[{"name":"University of Maryland School of Medicine, Baltimore, MD."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Victor","family":"Tapson","sequence":"additional","affiliation":[{"name":"Cedars-Sinai Medical Center, Los Angeles, CA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C. Jason","family":"Liang","sequence":"additional","affiliation":[{"name":"Biostatistics Research Branch, National Institute of Allergy and Infectious Diseases, Bethesda, MD."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"276","published-online":{"date-parts":[[2021,7,13]]},"reference":[{"key":"R1-20250207","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1016\/S0140-6736(20)30566-3","article-title":"Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: A retrospective cohort study.","volume":"395","author":"Zhou","year":"2020","journal-title":"Lancet"},{"key":"R2-20250207","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1080\/23744235.2020.1784457","article-title":"Predictive value of National Early Warning Score 2 (NEWS2) for intensive care unit admission in patients with SARS-CoV-2 infection.","volume":"52","author":"Gidari","year":"2020","journal-title":"Infect Dis (Lond)"},{"key":"R3-20250207","doi-asserted-by":"crossref","first-page":"e043721","DOI":"10.1136\/bmjopen-2020-043721","article-title":"Use of the first National Early Warning Score recorded within 24 hours of admission to estimate the risk of in-hospital mortality in unplanned COVID-19 patients: A retrospective cohort study.","volume":"11","author":"Richardson","year":"2021","journal-title":"BMJ Open"},{"key":"R4-20250207","doi-asserted-by":"crossref","first-page":"e1010","DOI":"10.1093\/cid\/ciaa1780","article-title":"Estimated incidence of COVID-19 illness and hospitalization \u2013 United States, February-September, 2020.","volume":"72","author":"Reese","year":"2021","journal-title":"Clin Infect Dis"},{"key":"R5-20250207","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1016\/j.jinf.2020.05.064","article-title":"A clinical risk score to identify patients with COVID-19 at high risk of critical care admission or death: An observational cohort study.","volume":"81","author":"Galloway","year":"2020","journal-title":"J Infect"},{"key":"R6-20250207","doi-asserted-by":"crossref","first-page":"e2029058","DOI":"10.1001\/jamanetworkopen.2020.29058","article-title":"Risk factors associated with in-hospital mortality in a US national sample of patients with COVID-19.","volume":"3","author":"Rosenthal","year":"2020","journal-title":"JAMA Netw Open"},{"key":"R7-20250207","doi-asserted-by":"crossref","first-page":"782","DOI":"10.7326\/M20-3214","article-title":"Body mass index and risk for intubation or death in SARS-CoV-2 infection: A retrospective cohort study.","volume":"173","author":"Anderson","year":"2020","journal-title":"Ann Intern Med"},{"key":"R8-20250207","doi-asserted-by":"crossref","first-page":"e0241955","DOI":"10.1371\/journal.pone.0241955","article-title":"Prognostic factors for severity and mortality in patients infected with COVID-19: A systematic review.","volume":"15","author":"Izcovich","year":"2020","journal-title":"PLoS One"},{"key":"R9-20250207","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1016\/j.jiac.2019.05.014","article-title":"The SOFA score could predict the severity and prognosis of infective endocarditis.","volume":"25","author":"Asai","year":"2019","journal-title":"J Infect Chemother"},{"key":"R10-20250207","doi-asserted-by":"crossref","first-page":"e0196022","DOI":"10.1371\/journal.pone.0196022","article-title":"Prognostic score to predict mortality during TB treatment in TB\/HIV co-infected patients.","volume":"13","author":"Nguyen","year":"2018","journal-title":"PLoS One"},{"key":"R11-20250207","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1001\/jama.2016.20328","article-title":"Prognostic accuracy of the SOFA score, SIRS criteria, and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit.","volume":"317","author":"Raith","year":"2017","journal-title":"JAMA"},{"key":"R12-20250207","first-page":"1","article-title":"Predictive value of 5 early warning scores for critical COVID-19 patients.","volume":"9","author":"Hu","year":"2020","journal-title":"Disaster Med Public Health Prep"},{"key":"R13-20250207","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1016\/j.accpm.2020.07.008","article-title":"No added value of the modified NEWS score to predict clinical deterioration in COVID-19 patients.","volume":"39","author":"Volff","year":"2020","journal-title":"Anaesth Crit Care Pain Med"},{"key":"R14-20250207","doi-asserted-by":"crossref","first-page":"e234","DOI":"10.3346\/jkms.2020.35.e234","article-title":"Prognostic accuracy of the SIRS, qSOFA, and NEWS for early detection of clinical deterioration in SARS-CoV-2 infected patients.","volume":"35","author":"Jang","year":"2020","journal-title":"J Korean Med Sci"},{"key":"R15-20250207","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1001\/jamainternmed.2020.2033","article-title":"Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19.","volume":"180","author":"Liang","year":"2020","journal-title":"JAMA Int Med"},{"journal-title":"medRxiv","article-title":"Development and validation of an early warning score (EWAS) for predicting clinical deterioration in patients with coronavirus disease 2019.","author":"Guo","key":"R16-20250207"},{"key":"R17-20250207","doi-asserted-by":"crossref","first-page":"m3339","DOI":"10.1136\/bmj.m3339","article-title":"Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: Development and validation of the 4C Mortality Score.","volume":"370","author":"Knight","year":"2020","journal-title":"BMJ"},{"key":"R18-20250207","article-title":"Identifying patients with symptoms suspicious for COVID-19 at elevated risk of adverse events: The COVAS Score.","author":"Sharp","year":"2020","journal-title":"Am J Emerg Med"},{"key":"R19-20250207","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.annemergmed.2020.07.022","article-title":"Development and validation of the quick COVID-19 severity index: A prognostic tool for early clinical decompensation.","volume":"76","author":"Haimovich","year":"2020","journal-title":"Ann Emerg Med"},{"key":"R20-20250207","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1111\/jgs.16956","article-title":"Predicting in-hospital mortality in COVID-19 older patients with specifically developed scores.","volume":"69","author":"Covino","year":"2021","journal-title":"J Am Geriatr Soc"},{"key":"R21-20250207","doi-asserted-by":"crossref","first-page":"m1328","DOI":"10.1136\/bmj.m1328","article-title":"Prediction models for diagnosis and prognosis of covid-19 infection: Systematic review and critical appraisal.","volume":"369","author":"Wynants","year":"2020","journal-title":"BMJ"},{"key":"R24-20250207","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1186\/s13049-020-00764-3","article-title":"National Early Warning Score 2 (NEWS2) on admission predicts severe disease and in-hospital mortality from Covid-19 - a prospective cohort study.","volume":"28","author":"Myrstad","year":"2020","journal-title":"Scand J Trauma Resusc Emerg Med"},{"key":"R25-20250207","doi-asserted-by":"crossref","first-page":"2003498","DOI":"10.1183\/13993003.03498-2020","article-title":"Systematic evaluation and external validation of 22 prognostic models among hospitalized adults with COVID-19: An observational cohort study.","volume":"56","author":"Gupta","year":"2020","journal-title":"Eur Respir J"},{"key":"R26-20250207","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.resuscitation.2020.10.039","article-title":"The performance of the National Early Warning Score and National Early Warning Score 2 in hospitalised patients infected by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2).","volume":"159","author":"Kostakis","year":"2021","journal-title":"Resuscitation"},{"key":"R27-20250207","article-title":"COVID-19: Symptoms, course of illness and use of clinical scoring systems for the first 42 patients admitted to a Norwegian local hospital.","volume":"140","author":"Ihle-Hansen","year":"2020","journal-title":"Tidsskr Nor Laegeforen"},{"key":"R28-20250207","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.1001\/jama.2020.2648","article-title":"Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: Summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention.","volume":"323","author":"Wu","year":"2020","journal-title":"JAMA"},{"key":"R29-20250207","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/s00134-020-05954-2","article-title":"Novel coronavirus infection during the 2019-2020 epidemic: Preparing intensive care units-the experience in Sichuan Province, China.","volume":"46","author":"Liao","year":"2020","journal-title":"Intensive Care Med"},{"journal-title":"medRxiv","article-title":"Evaluation and improvement of the National Early Warning Score (NEWS2) for COVID-19: A multi-hospital study.","author":"Carr","key":"R30-20250207"},{"key":"R31-20250207","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1093\/qjmed\/94.10.521","article-title":"Validation of a modified Early Warning Score in medical admissions.","volume":"94","author":"Subbe","year":"2001","journal-title":"QJM"},{"key":"R32-20250207","doi-asserted-by":"crossref","first-page":"103949","DOI":"10.1016\/j.compbiomed.2020.103949","article-title":"Prediction of respiratory decompensation in Covid-19 patients using machine learning: The READY trial.","volume":"124","author":"Burdick","year":"2020","journal-title":"Comput Biol Med"},{"key":"R33-20250207","doi-asserted-by":"crossref","first-page":"1813","DOI":"10.1056\/NEJMoa2007764","article-title":"Remdesivir for the treatment of Covid-19 - final report.","volume":"383","author":"Beigel","year":"2020","journal-title":"N Engl J Med"},{"key":"R34-20250207","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","article-title":"Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors.","volume":"15","author":"Harrell","year":"1996","journal-title":"Stat Med"},{"key":"R35-20250207","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1111\/j.0006-341X.2000.00337.x","article-title":"Time-dependent ROC curves for censored survival data and a diagnostic marker.","volume":"56","author":"Heagerty","year":"2000","journal-title":"Biometrics"},{"key":"R36-20250207","doi-asserted-by":"crossref","first-page":"m1501","DOI":"10.1136\/bmj.m1501","article-title":"Early warning scores for detecting deterioration in adult hospital patients: Systematic review and critical appraisal of methodology.","volume":"369","author":"Gerry","year":"2020","journal-title":"BMJ"},{"key":"R37-20250207","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1513\/AnnalsATS.201911-828OC","article-title":"Accuracy of clinicians\u2019 ability to predict the need for intensive care unit readmission.","volume":"17","author":"Rojas","year":"2020","journal-title":"Ann Am Thorac Soc"},{"key":"R38-20250207","doi-asserted-by":"crossref","first-page":"e032187","DOI":"10.1136\/bmjopen-2019-032187","article-title":"Comparing the predictive ability of a commercial artificial intelligence early warning system with physician judgement for clinical deterioration in hospitalised general internal medicine patients: A prospective observational study.","volume":"9","author":"Arnold","year":"2019","journal-title":"BMJ Open"},{"key":"R39-20250207","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1186\/s13049-016-0273-9","article-title":"National Early Warning Score (NEWS) as an emergency department predictor of disease severity and 90-day survival in the acutely dyspneic patient \u2013 a prospective observational study.","volume":"24","author":"Bilben","year":"2016","journal-title":"Scand J Trauma Resus Emerg Med"},{"key":"R40-20250207","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.resuscitation.2019.04.002","article-title":"The effect of fractional inspired oxygen concentration on early warning score performance: A database analysis.","volume":"139","author":"Malycha","year":"2019","journal-title":"Resuscitation"},{"key":"R41-20250207","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1097\/CCM.0000000000003359","article-title":"A comparison of the quick Sequential (sepsis-related) Organ Failure Assessment score and the National Early Warning Score in Non-ICU patients with\/without infection.","volume":"46","author":"Redfern","year":"2018","journal-title":"Crit Care Med"},{"key":"R42-20250207","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.resuscitation.2018.09.026","article-title":"A comparison of the ability of the National Early Warning Score and the National Early Warning Score 2 to identify patients at risk of in-hospital mortality: A multi-centre database study.","volume":"134","author":"Pimentel","year":"2019","journal-title":"Resuscitation"},{"key":"R43-20250207","doi-asserted-by":"crossref","first-page":"816","DOI":"10.1016\/j.jinf.2020.05.047","article-title":"An Early Warning Score to predict ICU admission in COVID-19 positive patients.","volume":"81","author":"Meylan","year":"2020","journal-title":"J Infect"},{"key":"R44-20250207","doi-asserted-by":"crossref","first-page":"e1004","DOI":"10.1097\/CCM.0000000000004549","article-title":"Evaluation of the risk prediction tools for patients with coronavirus disease 2019 in Wuhan, China: A single-centered, retrospective, observational study.","volume":"48","author":"Liu","year":"2020","journal-title":"Crit Care Med"}],"container-title":["Critical Care Explorations"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000000474","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T16:08:45Z","timestamp":1738944525000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/CCE.0000000000000474"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7]]},"references-count":42,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021]]}},"URL":"https:\/\/doi.org\/10.1097\/cce.0000000000000474","relation":{},"ISSN":["2639-8028"],"issn-type":[{"type":"electronic","value":"2639-8028"}],"subject":[],"published":{"date-parts":[[2021,7]]}}}