{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T11:12:05Z","timestamp":1778584325019,"version":"3.51.4"},"reference-count":45,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"2","license":[{"start":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T00:00:00Z","timestamp":1765238400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>Spinal metastases frequently cause debilitating symptoms and require complex surgical management, with postoperative intensive care unit (ICU) admissions representing a major concern. This multicenter study aimed to develop and validate machine learning (ML) models to predict 30-day unplanned ICU admission following metastatic spinal tumor surgery.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>\n                      A total of 642 patients with metastatic spinal disease were enrolled, and 525 from 2 major institutions were randomly split into derivation (80%) and internal validation (20%) cohorts. External validation was performed using an independent cohort (\n                      <jats:italic toggle=\"yes\">n<\/jats:italic>\n                      =\u00a0117) from a third medical institution. Six ML algorithms were trained on 11 clinically significant features selected after multicollinearity analysis.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      In the model development cohort, significant differences were observed between ICU (\n                      <jats:italic toggle=\"yes\">n<\/jats:italic>\n                      =\u00a0101, 19.2%) and non-ICU groups, with ICU patients demonstrating higher comorbidity burdens, elevated inflammatory markers, and impaired renal function. Among six machine learning models evaluated, the KNN algorithm demonstrated superior predictive performance with the highest discriminative power [Area Under the Curve (AUC): 0.884], accuracy (82.1%), recall (96.4%), and favorable calibration (Brier score: 0.149). The ANN also performed well, achieving the second-highest AUC (0.847), precision (0.808), and F1 score (0.778), as well as a competitive log loss (0.491). The composite scoring system confirmed KNN and ANN as top performers (total scores: 42 each), but, in the external validation cohort, the KNN model demonstrated significantly superior discriminative ability compared to the ANN model, with an AUC of 0.834 (95% CI: 0.773\u20130.894) versus 0.741 (95% CI: 0.665\u20130.816) respectively (Delong test,\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt;\u00a00.001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>This study presents validated ML models specifically designed for ICU admission prediction following spinal metastasis surgery, with the KNN model performing satisfactory performance and demonstrating strong potential for clinical implementation.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/js9.0000000000004416","type":"journal-article","created":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T09:00:26Z","timestamp":1765443626000},"page":"3560-3575","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":0,"title":["Enhancing preoperative risk stratification: an interpretable machine learning model for ICU admission in spinal metastasis surgery"],"prefix":"10.1097","volume":"112","author":[{"given":"Hanbin","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Orthopedic Surgery, Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, The Fifth Medical Center of PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Nephrology, The Fifth Medical Center of PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuyong","family":"Cao","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, The Fifth Medical Center of PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuncen","family":"Cao","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, The Fifth Medical Center of PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haikuan","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, National Clinical Research Center for Orthopedics, Sports Medicine & Rehabilitation, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiongwei","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, The Fifth Medical Center of PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingxing","family":"Lei","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, National Clinical Research Center for Orthopedics, Sports Medicine & Rehabilitation, Beijing, China"},{"name":"Department of Nursing, The First Medical Center of Chinese PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, Hainan Hospital of PLA General Hospital, Sanya, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Desheng","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Senior Department of Neurosurgery, The First Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Neurosurgery, The Fifth Medical Center of PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bing","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, The First Medical Center of Chinese PLA General Hospital, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaosheng","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, The Fifth Medical Center of PLA General Hospital, Beijing, China"},{"name":"Department of Orthopedic Surgery, National Clinical Research Center for Orthopedics, Sports Medicine & Rehabilitation, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"276","published-online":{"date-parts":[[2025,12,9]]},"reference":[{"key":"R1-20260512","doi-asserted-by":"crossref","first-page":"E11","DOI":"10.3171\/foc.2003.15.5.11","article-title":"Evidence-based review of the surgical management of vertebral column metastatic disease","volume":"15","author":"Ryken","year":"2003","journal-title":"Neurosurg Focus"},{"key":"R2-20260512","doi-asserted-by":"crossref","first-page":"61\u201371","DOI":"10.1200\/JCO.2018.78.1211","article-title":"Assessment and management of patients with metastatic spinal cord compression: a multidisciplinary review","volume":"37","author":"Lawton","year":"2019","journal-title":"J Clin Oncol"},{"key":"R3-20260512","doi-asserted-by":"crossref","first-page":"1796","DOI":"10.3390\/cancers15061796","article-title":"Multidisciplinary approach to spinal metastases and metastatic spinal cord compression-a new integrative flowchart for patient management","volume":"15","author":"Esperan\u00e7a-Martins","year":"2023","journal-title":"Cancers (Basel)"},{"key":"R4-20260512","doi-asserted-by":"crossref","first-page":"296\u2013306","DOI":"10.1097\/BSD.0000000000001031","article-title":"Scoring algorithms for predicting survival prognosis in patients with metastatic spinal disease: the current status and future directions","volume":"33","author":"Cui","year":"2020","journal-title":"Clin Spine Surg"},{"key":"R5-20260512","doi-asserted-by":"crossref","first-page":"e10","DOI":"10.3171\/foc.2001.11.6.11","article-title":"Evaluation and treatment of spinal metastases: an overview","volume":"11","author":"Jacobs","year":"2001","journal-title":"Neurosurg Focus"},{"key":"R6-20260512","doi-asserted-by":"crossref","DOI":"10.1093\/oncolo\/oyae359","article-title":"Radiotherapy and surgery: can this combination be further optimized for patients with metastatic spine disease?","volume":"30","author":"Amelink","year":"2025","journal-title":"Oncologist"},{"key":"R7-20260512","doi-asserted-by":"crossref","first-page":"19\u201329","DOI":"10.1016\/j.critrevonc.2018.02.017","article-title":"Treatment of spinal metastases in renal cell carcinoma: a critical review","volume":"125","author":"Teyssonneau","year":"2018","journal-title":"Crit Rev Oncol Hematol"},{"key":"R8-20260512","doi-asserted-by":"crossref","DOI":"10.1186\/s40537-025-01155-0","article-title":"An artificial intelligence platform for predicting postoperative complications in metastatic spinal surgery: development and validation study","volume":"12","author":"Jiang","year":"2025","journal-title":"J Big Data"},{"key":"R9-20260512","doi-asserted-by":"crossref","first-page":"304\u201310","DOI":"10.21037\/jss.2018.05.14","article-title":"Thirty-day complication and readmission rates associated with resection of metastatic spinal tumors: a single institutional experience","volume":"4","author":"Elsamadicy","year":"2018","journal-title":"J Spine Surg"},{"key":"R10-20260512","doi-asserted-by":"crossref","first-page":"467\u201375","DOI":"10.3340\/jkns.2018.0199","article-title":"Minimally invasive surgery without decompression for hepatocellular carcinoma spinal metastasis with epidural spinal cord compression grade 2","volume":"62","author":"Jung","year":"2019","journal-title":"J Korean Neurosurg Soc"},{"key":"R11-20260512","doi-asserted-by":"crossref","first-page":"e151","DOI":"10.1016\/j.wneu.2020.02.048","article-title":"Outcomes for vertebrectomy for malignancy and correlation to the Spine Instability Neoplastic Score (SINS): a 10-year single-center perspective","volume":"138","author":"Donnellan","year":"2020","journal-title":"World Neurosurg"},{"key":"R12-20260512","doi-asserted-by":"crossref","first-page":"e308","DOI":"10.1016\/j.wneu.2020.03.202","article-title":"Rates, risk factors, and complications of red blood cell transfusion in metastatic spinal tumor surgery: an analysis of a prospective multicenter surgical database","volume":"139","author":"De la Garza Ramos","year":"2020","journal-title":"World Neurosurg"},{"key":"R13-20260512","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1007\/s00701-024-06288-4","article-title":"Effects of sarcopenia and nutritional status on surgical outcomes for metastatic spinal tumors: in the perspective of peri-operative complications and performance improvement","volume":"166","author":"Bang","year":"2024","journal-title":"Acta Neurochir (Wien)"},{"key":"R14-20260512","doi-asserted-by":"crossref","first-page":"325\u201335","DOI":"10.31616\/asj.2023.0314","article-title":"Development and internal validation of machine-learning models for predicting survival in patients who underwent surgery for spinal metastases","volume":"18","author":"Santipas","year":"2024","journal-title":"Asian Spine J"},{"key":"R15-20260512","doi-asserted-by":"crossref","first-page":"E83","DOI":"10.1093\/neuros\/nyy469","article-title":"Development of machine learning algorithms for prediction of 30-day mortality after surgery for spinal metastasis","volume":"85","author":"Karhade","year":"2019","journal-title":"Neurosurgery"},{"key":"R16-20260512","doi-asserted-by":"crossref","first-page":"2738\u201356","DOI":"10.1097\/JS9.0000000000001169","article-title":"Establishment and validation of an interactive artificial intelligence platform to predict postoperative ambulatory status for patients with metastatic spinal disease: a multicenter analysis","volume":"110","author":"Cui","year":"2024","journal-title":"Int J Surg"},{"key":"R18-20260512","doi-asserted-by":"crossref","first-page":"1670\u201378","DOI":"10.1016\/j.spinee.2021.01.027","article-title":"International external validation of the SORG machine learning algorithms for predicting 90-day and one-year survival of patients with spine metastases using a taiwanese cohort","volume":"21","author":"Yang","year":"2021","journal-title":"Spine J"},{"key":"R19-20260512","doi-asserted-by":"crossref","first-page":"5434\u201341","DOI":"10.1007\/s00330-020-07534-w","article-title":"Machine learning combining CT findings and clinical parameters improves prediction of length of stay and ICU admission in torso trauma","volume":"31","author":"Staziaki","year":"2021","journal-title":"Eur Radiol"},{"key":"R20-20260512","first-page":"173\u201377","article-title":"Development of a machine learning model predicting an ICU admission for patients with elective surgery and its prospective validation in clinical practice","volume":"264","author":"Jauk","year":"2019","journal-title":"Stud Health Technol Inform"},{"key":"R21-20260512","doi-asserted-by":"crossref","first-page":"1469\u201376","DOI":"10.1097\/BRS.0000000000001538","article-title":"Who are the best candidates for decompressive surgery and spine stabilization in patients with metastatic spinal cord compression?: a new scoring system","volume":"41","author":"Lei","year":"2016","journal-title":"Spine (Phila Pa 1976)"},{"key":"R22-20260512","doi-asserted-by":"crossref","first-page":"3151\u201365","DOI":"10.1097\/JS9.0000000000001268","article-title":"The STROCSS 2024 guideline: strengthening the reporting of cohort, cross-sectional, and case\u2013control studies in surgery","volume":"110","author":"Rashid","year":"2024","journal-title":"Int J Surg"},{"key":"R23-20260512","first-page":"100081","article-title":"Revised strengthening the reporting of cohort, cross-sectional and case-control studies in surgery (STROCSS) guideline: an update for the age of Artificial Intelligence","volume":"10","author":"Agha","year":"2025","journal-title":"Prem J Sci"},{"key":"R24-20260512","first-page":"735\u201336","article-title":"Transparent reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD)","volume":"162","author":"Collins","year":"2015","journal-title":"Ann Intern Med"},{"key":"R25-20260512","doi-asserted-by":"crossref","first-page":"146\u201360","DOI":"10.1016\/j.spinee.2023.09.001","article-title":"Development and validation of a web-based artificial intelligence prediction model to assess massive intraoperative blood loss for metastatic spinal disease using machine learning techniques","volume":"24","author":"Shi","year":"2024","journal-title":"Spine J"},{"key":"R26-20260512","article-title":"Prediction of sepsis among patients with major trauma using artificial intelligence: a multicenter validated cohort study","author":"Sun","journal-title":"Int J Surg"},{"key":"R27-20260512","first-page":"191\u201399","article-title":"Decision tree and ensemble learning algorithms with their applications in bioinformatics","volume":"696","author":"Che","year":"2011","journal-title":"Software Tools and Algorithms for Biological Systems"},{"key":"R28-20260512","doi-asserted-by":"crossref","first-page":"174\u201388","DOI":"10.1007\/s41666-020-00069-1","article-title":"A combined interpolation and weighted K-nearest neighbours approach for the imputation of longitudinal ICU laboratory data","volume":"4","author":"Daberdaku","year":"2020","journal-title":"J Healthc Inform Res"},{"key":"R29-20260512","doi-asserted-by":"crossref","DOI":"10.1093\/bib\/bbad002","article-title":"A review on longitudinal data analysis with random forest","volume":"24","author":"Hu","year":"2023","journal-title":"Brief Bioinform"},{"key":"R30-20260512","doi-asserted-by":"crossref","first-page":"217\u201330","DOI":"10.2147\/CIA.S507138","article-title":"Machine learning-based prediction of postoperative pneumonia among super-aged patients with hip fracture","volume":"20","author":"Tang","year":"2025","journal-title":"Clin Interv Aging"},{"key":"R31-20260512","doi-asserted-by":"crossref","first-page":"R231","DOI":"10.1016\/j.cub.2019.02.034","article-title":"Neural network models and deep learning","volume":"29","author":"Kriegeskorte","year":"2019","journal-title":"Curr Biol"},{"key":"R32-20260512","doi-asserted-by":"crossref","first-page":"754\u201357","DOI":"10.1016\/j.ajodo.2023.08.003","article-title":"Support vector machines","volume":"164","author":"Valkenborg","year":"2023","journal-title":"Am J Orthod Dentofacial Orthop"},{"key":"R33-20260512","doi-asserted-by":"crossref","first-page":"e46854","DOI":"10.2196\/46854","article-title":"Prediction of medical disputes between health care workers and patients in terms of hospital legal construction using machine learning techniques: externally validated cross-sectional study","volume":"25","author":"Yi","year":"2023","journal-title":"J Med Internet Res"},{"key":"R34-20260512","first-page":"1\u201313","article-title":"A robust and parsimonious machine learning method to predict ICU admission of COVID-19 patients","author":"Famiglini","year":"2022","journal-title":"Med Biol Eng Comput"},{"key":"R35-20260512","first-page":"1\u201329","article-title":"Using machine learning in prediction of ICU admission, mortality, and length of stay in the early stage of admission of COVID-19 patients","author":"Saadatmand","year":"2022","journal-title":"Ann Oper Res"},{"key":"R36-20260512","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1186\/s12931-024-02874-3","article-title":"An explainable machine learning-based model to predict intensive care unit admission among patients with community-acquired pneumonia and connective tissue disease","volume":"25","author":"Huang","year":"2024","journal-title":"Respir Res"},{"key":"R37-20260512","doi-asserted-by":"crossref","first-page":"290\u2013302","DOI":"10.1016\/j.annemergmed.2021.02.029","article-title":"Development and validation of machine learning models to predict admission from emergency department to inpatient and intensive care units","volume":"78","author":"Fenn","year":"2021","journal-title":"Ann Emerg Med"},{"key":"R38-20260512","doi-asserted-by":"crossref","first-page":"E81","DOI":"10.1097\/BSD.0000000000001659","article-title":"Developmental and validation of machine learning model for prediction complication after cervical spine metastases surgery","volume":"38","author":"Santipas","year":"2025","journal-title":"Clin Spine Surg"},{"key":"R39-20260512","doi-asserted-by":"crossref","first-page":"1255\u201369","DOI":"10.1016\/j.spinee.2023.05.009","article-title":"Machine learning-based algorithms to predict severe psychological distress among cancer patients with spinal metastatic disease","volume":"23","author":"Gao","year":"2023","journal-title":"Spine J"},{"key":"R40-20260512","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/s12021-025-09727-4","article-title":"Mathematical and dynamic modeling of the anatomical localization of the insula in the brain","volume":"23","author":"Ogut","year":"2025","journal-title":"Neuroinformatics"},{"key":"R41-20260512","doi-asserted-by":"crossref","first-page":"1133\u201339","DOI":"10.1097\/SLA.0000000000003297","article-title":"Utilizing machine learning methods for preoperative prediction of postsurgical mortality and intensive care unit admission","volume":"272","author":"Chiew","year":"2020","journal-title":"Ann Surg"},{"key":"R42-20260512","first-page":"660\u201364","article-title":"Using data-driven machine learning to predict unplanned ICU transfers with critical deterioration from electronic health records","volume":"290","author":"Shi","year":"2022","journal-title":"Stud Health Technol Inform"},{"key":"R43-20260512","doi-asserted-by":"crossref","first-page":"514\u201323","DOI":"10.1097\/PCC.0000000000002965","article-title":"Development and external validation of a machine learning model for prediction of potential transfer to the PICU","volume":"23","author":"Mayampurath","year":"2022","journal-title":"Pediatr Crit Care Med"},{"key":"R44-20260512","doi-asserted-by":"crossref","first-page":"216\u201321","DOI":"10.5125\/jkaoms.2024.50.4.216","article-title":"Prediction of intensive care unit admission using machine learning in patients with odontogenic infection","volume":"50","author":"Yoon","year":"2024","journal-title":"J Korean Assoc Oral Maxillofac Surg"},{"key":"R45-20260512","doi-asserted-by":"crossref","first-page":"136\u201367","DOI":"10.1007\/s10729-024-09673-8","article-title":"A machine learning framework for interpretable predictions in patient pathways: the case of predicting ICU admission for patients with symptoms of sepsis","volume":"27","author":"Zilker","year":"2024","journal-title":"Health Care Manag Sci"},{"key":"R46-20260512","doi-asserted-by":"crossref","first-page":"291\u2013300","DOI":"10.1097\/CCM.0000000000005758","article-title":"Predicting readmission or death after discharge from the ICU: external validation and retraining of a machine learning model","volume":"51","author":"de Hond","year":"2023","journal-title":"Crit Care Med"}],"container-title":["International Journal of Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/JS9.0000000000004416","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T10:26:26Z","timestamp":1778581586000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/JS9.0000000000004416"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,9]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.1097\/js9.0000000000004416","relation":{},"ISSN":["1743-9159"],"issn-type":[{"value":"1743-9159","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,9]]},"assertion":[{"value":"2025-09-15","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-18","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}