{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T05:03:07Z","timestamp":1793250187005,"version":"4.5.0"},"reference-count":23,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"2","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:sec>\n            <jats:title>BACKGROUND:<\/jats:title>\n            <jats:p>The American College of Surgeons NSQIP surgical risk calculator provides an estimation of 30-day postoperative adverse outcomes. It is useful in the identification of high-risk patients needing clinical optimization and supports the informed consent process. The purpose of this study is to validate its predictive value in the Italian emergency setting.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>STUDY DESIGN:<\/jats:title>\n            <jats:p>Six Italian institutions were included. Inclusion diagnoses were acute cholecystitis, appendicitis, gastrointestinal perforation or obstruction. Areas under the receiving operating characteristic curves, Brier score, Hosmer-Lemeshow index, and observed-to-expected event ratio were measured to assess both discrimination and calibration. Effect of the Surgeon Adjustment Score on calibration was then tested. A patient\u2019s personal risk ratio was obtained, and a cutoff was chosen to predict mortality with a high negative predicted value.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>RESULTS:<\/jats:title>\n            <jats:p>A total of 2,749 emergency procedures were considered for the analysis. The areas under the receiving operating characteristic curve were 0.932 for death (0.921 to 0.941, p &lt; 0.0001; Brier 0.041) and 0.918 for discharge to nursing or rehabilitation facility (0.907 to 0.929, p &lt; 0.0001; 0.070). Discrimination was also strong (area under the receiving operating characteristic curve &gt;0.8) for renal failure, cardiac complication, pneumonia, venous thromboembolism, serious complication, and any complication. Brier score was informative (&lt;0.25) for all the presented variables. The observed-to-expected event ratios were 1.0 for death and 0.8 for discharge to facility. For almost all other variables, there was a general risk underestimation, but the use of the Surgeon Adjustment Score permitted a better calibration of the model. A risk ratio &gt;3.00 predicted the onset of death with sensitivity = 86%, specificity = 77%, and negative predicted value = 99%.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>CONCLUSIONS:<\/jats:title>\n            <jats:p>The American College of Surgeons NSQIP surgical risk calculator has proved to be a reliable predictor of adverse postoperative outcomes also in Italian emergency settings, with particular regard to mortality. We therefore recommend the use of the surgical risk calculator in the multidisciplinary care of patients undergoing emergency abdominal surgery.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/xcs.0000000000000445","type":"journal-article","created":{"date-parts":[[2022,10,3]],"date-time":"2022-10-03T08:00:23Z","timestamp":1664784023000},"page":"387-398","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":8,"title":["Can the American College of Surgeons NSQIP Surgical Risk Calculator Accurately Predict Adverse Postoperative Outcomes in Emergency Abdominal Surgery? An Italian Multicenter Analysis"],"prefix":"10.1097","volume":"236","author":[{"given":"Giovanni","family":"Scotton","sequence":"first","affiliation":[{"name":"From the Department of General Surgery, ASUITS, Cattinara Hospital, Trieste, Italy (Scotton, de Manzini, Biloslavo)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonio","family":"La Greca","sequence":"additional","affiliation":[{"name":"Emergency and Trauma Surgery, Fondazione Policlinico Universitario A. Gemelli IRCCS Roma \u2013 Universit\u00e0 Cattolica del Sacro Cuore, Italy (La Greca)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chiara","family":"Lirusso","sequence":"additional","affiliation":[{"name":"Division of General Surgery, Department of Surgery, Santa Maria della Misericordia (ASUFC) University Hospital, Udine, Italy (Lirusso)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Mariani","sequence":"additional","affiliation":[{"name":"Department of Emergency General Surgery, Legnano Hospital, ASST Ovest Milanese, Legnano, MI, Italy (Mariani)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mauro","family":"Zago","sequence":"additional","affiliation":[{"name":"General and Emergency Surgery Department, A. Manzoni Hospital, Lecco, Italy (Zago)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Massimo","family":"Chiarugi","sequence":"additional","affiliation":[{"name":"General, Emergency and Trauma Surgery, Pisa University Hospital, Pisa, Italy (Chiarugi, Tartaglia)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dario","family":"Tartaglia","sequence":"additional","affiliation":[{"name":"General, Emergency and Trauma Surgery, Pisa University Hospital, Pisa, Italy (Chiarugi, Tartaglia)."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicol\u00f2","family":"de Manzini","sequence":"additional","affiliation":[{"name":"From the Department of General Surgery, ASUITS, Cattinara Hospital, Trieste, Italy (Scotton, de Manzini, Biloslavo)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alan","family":"Biloslavo","sequence":"additional","affiliation":[{"name":"From the Department of General Surgery, ASUITS, Cattinara Hospital, Trieste, Italy (Scotton, de Manzini, Biloslavo)"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"for the Emergency Surgery Collaborative","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2022,10,3]]},"reference":[{"key":"R1-20250821","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1097\/TA.0000000000001015","article-title":"Perioperative risk factors impact outcomes in emergency versus nonemergency surgery differently: time to separate our national risk-adjustment models?","volume":"81","author":"Bohnen","year":"2016","journal-title":"J Trauma Acute Care Surg"},{"key":"R2-20250821","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1097\/TA.0000000000000517","article-title":"The excess morbidity and mortality of emergency general surgery.","volume":"78","author":"Havens","year":"2015","journal-title":"J Trauma Acute Care Surg"},{"key":"R3-20250821","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.jamcollsurg.2010.09.026","article-title":"Comparison of hospital performance in emergency versus elective general surgery operations at 198 hospitals.","volume":"212","author":"Ingraham","year":"2011","journal-title":"J Am Coll Surg"},{"key":"R4-20250821","first-page":"547","article-title":"Who is a high-risk surgical patient?","volume":"24","author":"Bose","year":"2018","journal-title":"Curr Opin Crit Care"},{"key":"R5-20250821","doi-asserted-by":"crossref","first-page":"616","DOI":"10.12968\/hmed.2017.78.11.616","article-title":"Perioperative risk.","volume":"78","author":"Lacey","year":"2017","journal-title":"Br J Hosp Med (Lond)"},{"key":"R6-20250821","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1016\/j.amjsurg.2017.09.015","article-title":"Informed consent-it\u2019s more than a signature on a piece of paper.","volume":"214","author":"Cocanour","year":"2017","journal-title":"Am J Surg"},{"key":"R7-20250821","doi-asserted-by":"crossref","first-page":"e000160","DOI":"10.1136\/tsaco-2017-000160","article-title":"Risk stratification tools in emergency general surgery.","volume":"3","author":"Havens","year":"2018","journal-title":"Trauma Surg Acute Care Open"},{"key":"R8-20250821","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1097\/TA.0000000000001015","article-title":"Perioperative risk factors impact outcomes in emergency versus nonemergency surgery differently: time to separate our national risk-adjustment models?","volume":"81","author":"Bohnen","year":"2016","journal-title":"J Trauma Acute Care Surg"},{"key":"R9-20250821","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/j.jamcollsurg.2013.07.385","article-title":"Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons.","volume":"217","author":"Bilimoria","year":"2013","journal-title":"J Am Coll Surg"},{"key":"R10-20250821","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1007\/s11605-019-04174-4","article-title":"Evaluation of the ACS NSQIP surgical risk calculator in elderly patients undergoing hepatectomy for hepatocellular carcinoma.","volume":"24","author":"Sahara","year":"2020","journal-title":"J Gastrointest Surg"},{"key":"R11-20250821","doi-asserted-by":"crossref","first-page":"942","DOI":"10.3171\/2016.11.JNS161377","article-title":"Predictive performance of the american college of surgeons universal risk calculator in neurosurgical patients.","volume":"128","author":"Vaziri","year":"2018","journal-title":"J Neurosurg"},{"key":"R12-20250821","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1002\/jso.24357","article-title":"Can the ACS-NSQIP surgical risk calculator predict post-operative complications in patients undergoing flap reconstruction following soft tissue sarcoma resection?","volume":"114","author":"Slump","year":"2016","journal-title":"J Surg Oncol"},{"key":"R13-20250821","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.1007\/s11999-016-4717-3","article-title":"The ACS NSQIP risk calculator is a fair predictor of acute periprosthetic joint infection.","volume":"474","author":"Wingert","year":"2016","journal-title":"Clin Orthop Relat Res"},{"key":"R14-20250821","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.jmig.2016.10.005","article-title":"Evaluation of the American College of Surgeons National Surgical Quality Improvement Program surgical risk calculator in gynecologic oncology patients undergoing minimally invasive surgery.","volume":"24","author":"Teoh","year":"2017","journal-title":"J Minim Invasive Gynecol"},{"key":"R15-20250821","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1089\/end.2019.0093","article-title":"Accuracy of American College of Surgeons National Surgical Quality Improvement Program universal surgical risk calculator in predicting complications following robot-assisted radical cystectomy at a national comprehensive cancer center.","volume":"33","author":"Lone","year":"2019","journal-title":"J Endourol"},{"key":"R16-20250821","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1016\/j.amjsurg.2018.07.015","article-title":"Are we taking a risk with risk assessment tools? evaluating the relationship between NSQIP and the ACS risk calculator in colorectal surgery.","volume":"216","author":"Keller","year":"2018","journal-title":"Am J Surg"},{"key":"R17-20250821","doi-asserted-by":"crossref","first-page":"3710","DOI":"10.1007\/s00268-020-05705-w","article-title":"Is the ACS-NSQIP risk calculator accurate in predicting adverse postoperative outcomes in the emergency setting? an Italian single-center preliminary study.","volume":"44","author":"Scotton","year":"2020","journal-title":"World J Surg"},{"key":"R18-20250821","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","article-title":"Assessing the performance of prediction models: a framework for traditional and novel measures.","volume":"21","author":"Steyerberg","year":"2010","journal-title":"Epidemiology"},{"key":"R19-20250821","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1097\/SLA.0000000000001558","article-title":"Risk prediction accuracy differs for emergency versus elective cases in the ACS-NSQIP.","volume":"264","author":"Hyder","year":"2016","journal-title":"Ann Surg"},{"key":"R20-20250821","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.jss.2021.07.009","article-title":"What is the accuracy of the ACS-NSQIP surgical risk calculator in emergency abdominal surgery? A meta-analysis.","volume":"268","author":"Parkin","year":"2021","journal-title":"J Surg Res"},{"key":"R21-20250821","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1177\/000313481908500421","article-title":"Predicting postoperative complications after acute care surgery: how accurate is the ACS NSQIP surgical risk calculator?","volume":"85","author":"Golden","year":"2019","journal-title":"Am Surg"},{"key":"R22-20250821","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1016\/j.jamcollsurg.2016.12.057","article-title":"An examination of American College of Surgeons NSQIP surgical risk calculator accuracy.","volume":"224","author":"Cohen","year":"2017","journal-title":"J Am Coll Surg"},{"key":"R23-20250821","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.jamcollsurg.2016.03.040","article-title":"Evaluation and enhancement of calibration in the American College of Surgeons NSQIP surgical risk calculator.","volume":"223","author":"Liu","year":"2016","journal-title":"J Am Coll Surg"}],"container-title":["Journal of the American College of Surgeons"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/XCS.0000000000000445","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T20:01:25Z","timestamp":1755806485000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/XCS.0000000000000445"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,3]]},"references-count":23,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023]]}},"URL":"https:\/\/doi.org\/10.1097\/xcs.0000000000000445","relation":{},"ISSN":["1072-7515"],"issn-type":[{"value":"1072-7515","type":"print"}],"subject":[],"published":{"date-parts":[[2022,10,3]]}}}