{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T02:36:44Z","timestamp":1781231804115,"version":"3.54.1"},"reference-count":32,"publisher":"Public Library of Science (PLoS)","issue":"4","license":[{"start":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T00:00:00Z","timestamp":1648771200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Chonnam National University Hospital Biomedical Research Institute","award":["BCRI21040"],"award-info":[{"award-number":["BCRI21040"]}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>We evaluated the performance of cardiac arrest-specific prognostication scores developed for outcome prediction in the early hours after out-of-hospital cardiac arrest (OHCA) in predicting long-term outcomes using independent data. The following scores were calculated for 1,163 OHCA patients who were treated with targeted temperature management (TTM) at 21 hospitals in South Korea: OHCA, cardiac arrest hospital prognosis (CAHP), C-GRApH (named on the basis of its variables), TTM risk, 5-R, NULL-PLEASE (named on the basis of its variables), Serbian quality of life long-term (SR-QOLl), cardiac arrest survival, revised post-cardiac arrest syndrome for therapeutic hypothermia (rCAST), Polish hypothermia registry (PHR) risk, and PROgnostication using LOGistic regression model for Unselected adult cardiac arrest patients in the Early stages (PROLOGUE) scores and prediction score by Aschauer et al. Their accuracies in predicting poor outcome at 6 months after OHCA were determined using the area under the receiver operating characteristic curve (AUC) and calibration belt. In the complete-case analyses, the PROLOGUE score showed the highest AUC (0.923; 95% confidence interval [CI], 0.904\u20130.941), whereas the SR-QOLl score had the lowest AUC (0.749; 95% CI, 0.711\u20130.786). The discrimination performances were similar in the analyses after multiple imputation. The PROLOGUE, TTM risk, CAHP, NULL-PLEASE, 5-R, and cardiac arrest survival scores were well calibrated. The rCAST and PHR risk scores showed acceptable overall calibration, although they showed miscalibration under the 80% CI level at extreme prediction values. The OHCA score, C-GRApH score, prediction score by Aschauer et al., and SR-QOLl score showed significant miscalibration in both complete-case (P = 0.026, 0.013, 0.005, and &lt; 0.001, respectively) and multiple-imputation analyses (P = 0.007, 0.018, &lt; 0.001, and &lt; 0.001, respectively). In conclusion, the discrimination performances of the prognostication scores were all acceptable, but some showed significant miscalibration.<\/jats:p>","DOI":"10.1371\/journal.pone.0265275","type":"journal-article","created":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T17:26:11Z","timestamp":1648833971000},"page":"e0265275","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":23,"title":["External validation of cardiac arrest-specific prognostication scores developed for early prognosis estimation after out-of-hospital cardiac arrest in a Korean multicenter cohort"],"prefix":"10.1371","volume":"17","author":[{"given":"Wan Young","family":"Heo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong Hun","family":"Jung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyoung Youn","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3478-6967","authenticated-orcid":true,"given":"Kyung Woon","family":"Jeung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Byung Kook","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chun Song","family":"Youn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seung Pill","family":"Choi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyu Nam","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong Il","family":"Min","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"on behalf of the Korean Hypothermia Network Investigators","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2022,4,1]]},"reference":[{"key":"pone.0265275.ref001","first-page":"188","article-title":"EuReCa ONE-27 Nations, ONE Europe, ONE Registry: A prospective one month analysis of out-of-hospital cardiac arrest outcomes in 27 countries in Europe","volume":"105","author":"JT Gr\u00e4sner","year":"2016","journal-title":"Resuscitation"},{"key":"pone.0265275.ref002","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.resuscitation.2015.07.026","article-title":"Outcomes for out-of-hospital cardiac arrests across 7 countries in Asia: The Pan Asian Resuscitation Outcomes Study (PAROS)","volume":"96","author":"ME Ong","year":"2015","journal-title":"Resuscitation"},{"key":"pone.0265275.ref003","doi-asserted-by":"crossref","first-page":"250","DOI":"10.15441\/ceem.20.035","article-title":"Outcome and status of postcardiac arrest care in Korea: results from the Korean Hypothermia Network prospective registry","volume":"7","author":"SH Kim","year":"2020","journal-title":"Clin Exp Emerg Med"},{"key":"pone.0265275.ref004","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.resuscitation.2021.02.012","article-title":"European Resuscitation Council and European Society of Intensive Care Medicine Guidelines 2021: Post-resuscitation care","volume":"161","author":"JP Nolan","year":"2021","journal-title":"Resuscitation"},{"key":"pone.0265275.ref005","doi-asserted-by":"crossref","first-page":"2840","DOI":"10.1093\/eurheartj\/ehl335","article-title":"Predicting survival with good neurological recovery at hospital admission after successful resuscitation of out-of-hospital cardiac arrest: the OHCA score","volume":"27","author":"C Adrie","year":"2006","journal-title":"Eur Heart J"},{"key":"pone.0265275.ref006","doi-asserted-by":"crossref","first-page":"3222","DOI":"10.1093\/eurheartj\/ehv556","article-title":"The CAHP (Cardiac Arrest Hospital Prognosis) score: a tool for risk stratification after out-of-hospital cardiac arrest","volume":"37","author":"C Maupain","year":"2016","journal-title":"Eur Heart J"},{"key":"pone.0265275.ref007","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.resuscitation.2020.12.022","article-title":"PROLOGUE (PROgnostication using LOGistic regression model for Unselected adult cardiac arrest patients in the Early stages): Development and validation of a scoring system for early prognostication in unselected adult cardiac arrest patients","volume":"159","author":"DH Bae","year":"2021","journal-title":"Resuscitation"},{"key":"pone.0265275.ref008","doi-asserted-by":"crossref","first-page":"e003821","DOI":"10.1161\/JAHA.116.003821","article-title":"C-GRApH: A Validated Scoring System for Early Stratification of Neurologic Outcome After Out-of-Hospital Cardiac Arrest Treated With Targeted Temperature Management","volume":"6","author":"EL Kiehl","year":"2017","journal-title":"J Am Heart Assoc"},{"key":"pone.0265275.ref009","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1186\/s13054-017-1677-2","article-title":"Early predictors of poor outcome after out-of-hospital cardiac arrest","volume":"21","author":"L Martinell","year":"2017","journal-title":"Crit Care"},{"key":"pone.0265275.ref010","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1016\/j.resuscitation.2014.06.007","article-title":"A prediction tool for initial out-of-hospital cardiac arrest survivors","volume":"85","author":"S Aschauer","year":"2014","journal-title":"Resuscitation"},{"key":"pone.0265275.ref011","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1016\/j.resuscitation.2011.12.036","article-title":"Prediction protocol for neurological outcome for survivors of out-of-hospital cardiac arrest treated with targeted temperature management","volume":"83","author":"K Okada","year":"2012","journal-title":"Resuscitation"},{"key":"pone.0265275.ref012","doi-asserted-by":"crossref","first-page":"e83","DOI":"10.1016\/j.resuscitation.2016.07.201","article-title":"NULL-PLEASE: a new \u2018Futility score\u2019 in the management of survivors of out-of-hospital cardiac arrest","volume":"106","author":"R Ahmad","year":"2016","journal-title":"Resuscitation"},{"key":"pone.0265275.ref013","doi-asserted-by":"crossref","first-page":"223. e11","DOI":"10.1016\/j.jcrc.2010.06.001","article-title":"A prediction survival model for out-of-hospital cardiopulmonary resuscitations","volume":"26","author":"A. Sladjana","year":"2011","journal-title":"J Crit Care"},{"key":"pone.0265275.ref014","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.resuscitation.2019.09.009","article-title":"The cardiac arrest survival score: A predictive algorithm for in-hospital mortality after out-of-hospital cardiac arrest","volume":"144","author":"P Balan","year":"2019","journal-title":"Resuscitation"},{"key":"pone.0265275.ref015","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.resuscitation.2019.05.028","article-title":"External validation of a risk classification at the emergency department of post-cardiac arrest syndrome patients undergoing targeted temperature management","volume":"140","author":"M Nishikimi","year":"2019","journal-title":"Resuscitation"},{"key":"pone.0265275.ref016","doi-asserted-by":"crossref","first-page":"95","DOI":"10.5603\/CJ.a2019.0035","article-title":"Predicting survival in out-of-hospital cardiac arrest patients undergoing targeted temperature management: The Polish Hypothermia Registry Risk Score","volume":"28","author":"\u0141 Ko\u0142towski","year":"2021","journal-title":"Cardiol J"},{"key":"pone.0265275.ref017","doi-asserted-by":"crossref","first-page":"1328","DOI":"10.1016\/j.amjmed.2020.03.046","article-title":"Usefulness of the NULL-PLEASE Score to Predict Survival in Out-of-Hospital Cardiac Arrest","volume":"133","author":"YX Gue","year":"2020","journal-title":"Am J Med"},{"key":"pone.0265275.ref018","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.resuscitation.2019.07.003","article-title":"Neuron-specific enolase (NSE) improves clinical risk scores for prediction of neurological outcome and death in cardiac arrest patients: Results from a prospective trial","volume":"142","author":"T Luescher","year":"2019","journal-title":"Resuscitation"},{"key":"pone.0265275.ref019","doi-asserted-by":"crossref","first-page":"4508","DOI":"10.1093\/eurheartj\/ehaa570","article-title":"A practical risk score for early prediction of neurological outcome after out-of-hospital cardiac arrest: MIRACLE2","volume":"41","author":"N Pareek","year":"2020","journal-title":"Eur Heart J"},{"key":"pone.0265275.ref020","doi-asserted-by":"crossref","first-page":"1825","DOI":"10.3390\/jcm10091825","article-title":"Using Out-of-Hospital Cardiac Arrest (OHCA) and Cardiac Arrest Hospital Prognosis (CAHP) Scores with Modified Objective Data to Improve Neurological Prognostic Performance for Out-of-Hospital Cardiac Arrest Survivors","volume":"10","author":"HG Song","year":"2021","journal-title":"J Clin Med"},{"key":"pone.0265275.ref021","doi-asserted-by":"crossref","first-page":"e0232227","DOI":"10.1371\/journal.pone.0232227","article-title":"Prognostic value of OHCA, C-GRApH and CAHP scores with initial neurologic examinations to predict neurologic outcomes in cardiac arrest patients treated with targeted temperature management","volume":"15","author":"HS Kim","year":"2020","journal-title":"PLoS One"},{"key":"pone.0265275.ref022","doi-asserted-by":"crossref","first-page":"1670","DOI":"10.1097\/CCM.0b013e318218a05b","article-title":"International validation of the out-of-hospital cardiac arrest score in the United States","volume":"39","author":"S Hunziker","year":"2011","journal-title":"Crit Care Med"},{"key":"pone.0265275.ref023","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/j.resuscitation.2014.11.002","article-title":"Cardiac Arrest and Cardiopulmonary Resuscitation Outcome Reports: Update of the Utstein Resuscitation Registry Templates for Out-of-Hospital Cardiac Arrest: A Statement for Healthcare Professionals From a Task Force of the International Liaison Committee on Resuscitation (American Heart Association, European Resuscitation Council, Australian and New Zealand Council on Resuscitation, Heart and Stroke Foundation of Canada, InterAmerican Heart Foundation, Resuscitation Council of Southern Africa, Resuscitation Council of Asia); and the American Heart Association Emergency Cardiovascular Care Committee and the Council on Cardiopulmonary, Critical Care, Perioperative and Resuscitation","volume":"96","author":"GD Perkins","year":"2015","journal-title":"Resuscitation"},{"key":"pone.0265275.ref024","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1161\/CIRCULATIONAHA.114.014508","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement","volume":"131","author":"TRIPOD Group","year":"2015","journal-title":"The TRIPOD Group. Circulation"},{"key":"pone.0265275.ref025","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/j.jclinepi.2004.06.017","article-title":"Substantial effective sample sizes were required for external validation studies of predictive logistic regression models","volume":"58","author":"Y Vergouwe","year":"2005","journal-title":"J Clin Epidemiol"},{"key":"pone.0265275.ref026","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1002\/sim.6787","article-title":"Sample size considerations for the external validation of a multivariable prognostic model: a resampling study","volume":"35","author":"GS Collins","year":"2016","journal-title":"Stat Med"},{"key":"pone.0265275.ref027","doi-asserted-by":"crossref","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach","volume":"44","author":"ER DeLong","year":"1988","journal-title":"Biometrics"},{"key":"pone.0265275.ref028","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1002\/sim.6744","article-title":"A new test and graphical tool to assess the goodness of fit of logistic regression models","volume":"35","author":"G Nattino","year":"2016","journal-title":"Stat Med"},{"key":"pone.0265275.ref029","doi-asserted-by":"crossref","first-page":"e16110","DOI":"10.1371\/journal.pone.0016110","article-title":"Calibration belt for quality-of-care assessment based on dichotomous outcomes","volume":"6","author":"S Finazzi","year":"2011","journal-title":"PLoS One"},{"key":"pone.0265275.ref030","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1186\/s13049-018-0558-2","article-title":"A prediction model for good neurological outcome in successfully resuscitated out-of-hospital cardiac arrest patients","volume":"26","author":"W Eertmans","year":"2018","journal-title":"Scand J Trauma Resusc Emerg Med"},{"key":"pone.0265275.ref031","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1002\/ams2.96","article-title":"Development of a prompt model for predicting neurological outcomes in patients with return of spontaneous circulation from out-of-hospital cardiac arrest","volume":"2","author":"K Kumagai","year":"2014","journal-title":"Acute Med Surg"},{"key":"pone.0265275.ref032","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1016\/j.resuscitation.2011.02.045","article-title":"Prognostic indicators and outcome prediction model for patients with return of spontaneous circulation from cardiopulmonary arrest: the Utstein Osaka Project","volume":"82","author":"K Hayakawa","year":"2011","journal-title":"Resuscitation"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0265275","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,1]],"date-time":"2022-04-01T17:26:39Z","timestamp":1648833999000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0265275"}},"subtitle":[],"editor":[{"given":"Muhammad Tarek","family":"Abdel Ghafar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2022,4,1]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,4,1]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0265275","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,1]]}}}