{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,11]],"date-time":"2026-10-11T20:24:26Z","timestamp":1791750266974,"version":"4.3.4"},"reference-count":49,"publisher":"SAGE Publications","issue":"9-10","license":[{"start":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T00:00:00Z","timestamp":1761696000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T00:00:00Z","timestamp":1761696000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"Wings for Life Foundation","award":["2024_301"],"award-info":[{"award-number":["2024_301"]}]},{"DOI":"10.13039\/501100001708","name":"International Foundation for Research in Paraplegia","doi-asserted-by":"crossref","award":["P192"],"award-info":[{"award-number":["P192"]}],"id":[{"id":"10.13039\/501100001708","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100022242","name":"Botnar Research Centre for Child Health, University of Basel","doi-asserted-by":"crossref","award":["PEP-2021-1008"],"award-info":[{"award-number":["PEP-2021-1008"]}],"id":[{"id":"10.13039\/501100022242","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"crossref","award":["IZLIZ3_200275"],"award-info":[{"award-number":["IZLIZ3_200275"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"crossref","award":["PZ00P3_186101"],"award-info":[{"award-number":["PZ00P3_186101"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Neurotrauma"],"published-print":{"date-parts":[[2026,5,1]]},"abstract":"<jats:p>In light of growing biomedical data, machine learning (ML) models offer tremendous potential for personalized prediction in medicine. However, the additional value provided by these computational tools should always be critically evaluated. Using the example of predicting walking ability after spinal cord injury (SCI), we highlight a popular scenario in which data-driven predictions are feasible but not clinically meaningful, as the task can be performed equally well by humans. We asked 11 human observers from diverse backgrounds (five researchers without clinical training but proven knowledge of SCI and the International Standards for Neurological Classification of SCI [ISNCSCI], and six neurologists experienced in SCI) to predict walking ability following SCI based on acute phase neurological status assessed by the ISNCSCI motor and sensory scores (\u226440 days after injury [DAI]). Following an established clinical prediction rule, walking ability was defined by a binary label derived from the indoor walking ability subitem of the Spinal Cord Independence Measure. We compared the performance of human observers with extreme gradient boosting and logistic regression-based models, which represent popular approaches in clinical literature on SCI. Using 794 patients from the European Multicenter Study about SCI, we show that all approaches provide similar, excellent performance at population level (area under the receiver operating characteristic 0.93\u20130.95; accuracy 0.88\u20130.90). Importantly, predictions combined from multiple neurologists (accuracy: 0.89) were comparable with model-based predictions (accuracy: 0.88\u20130.90), whereas individual neurologists (accuracy: 0.79 [0.01]; mean [standard deviation]) were marginally outperformed by computational approaches (accuracy: 0.88\u20130.90), particularly for more heterogeneous incomplete injuries. Individual SCI researchers performed equally well compared with neurologists (accuracy: 0.78 [0.02]). Our results show that prediction of walking function following SCI, if described through a binary label, does not benefit from ML, as ensembles of clinical experts and researchers each achieve performance similar to a range of ML models and an established clinical prediction rule. This highlights two key considerations in clinical applications of data-driven prediction models in SCI: first, the importance of carefully choosing clinical outcome measures to target in a prediction task to achieve a true benefit, and second, the necessity of benchmarking human performance on specific tasks to determine whether meaningful differences are present.<\/jats:p>","DOI":"10.1177\/08977151251386008","type":"journal-article","created":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T10:44:03Z","timestamp":1761734643000},"page":"749-761","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Reassessing the Role of Machine Learning in Clinical Prediction: A Benchmark of Predicting Walking Function after Spinal Cord Injury"],"prefix":"10.1177","volume":"43","author":[{"given":"Julia","family":"Bugajska","sequence":"first","affiliation":[{"name":"Department of Health Sciences and Technology (D-HEST), ETH Zurich, Z\u00fcrich, Switzerland."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Louis P.","family":"Lukas","sequence":"additional","affiliation":[{"name":"Department of Health Sciences and Technology (D-HEST), ETH Zurich, Z\u00fcrich, Switzerland."},{"name":"Swiss Institute of Bioinformatics (SIB), Lausanne, Switzerland."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"R\u00fcdiger","family":"Rupp","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center, Heidelberg University Hospital, Heidelberg, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Norbert","family":"Weidner","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center, Heidelberg University Hospital, Heidelberg, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Schubert","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center, University Hospital Balgrist, University of Zurich, Z\u00fcrich, Switzerland."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frank","family":"R\u00f6hrich","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center, BG Klinikum Bergmannstrost Halle, Halle, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Josina","family":"Waldmann","sequence":"additional","affiliation":[{"name":"Zentrum f\u00fcr Tetra-und Paraplegie, Orthop\u00e4dische Klinik Hessisch Lichtenau, Hessisch Lichtenau, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yorck B.","family":"Kalke","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center Orthopaedic Department, Ulm University, Ulm, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rainer","family":"Abel","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center, Klinikum Bayreuth, Bayreuth, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Doris","family":"Maier","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center, Trauma Center Murnau, Murnau, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harvinder S.","family":"Chhabra","sequence":"additional","affiliation":[{"name":"Department of Spine &amp; Rehabilitation Centre, Sri Balaji Action Medical Institute, Paschim Vihar, New Delhi, India."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Liebscher","sequence":"additional","affiliation":[{"name":"Treatment Centre for Spinal Cord Injuries, Trauma Hospital Berlin, Berlin, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Armin","family":"Curt","sequence":"additional","affiliation":[{"name":"Spinal Cord Injury Center, University Hospital Balgrist, University of Zurich, Z\u00fcrich, Switzerland."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Br\u00fcningk","sequence":"additional","affiliation":[{"name":"Department of Health Sciences and Technology (D-HEST), ETH Zurich, Z\u00fcrich, Switzerland."},{"name":"Swiss Institute of Bioinformatics (SIB), Lausanne, Switzerland."},{"name":"Department of Radiation Oncology, Inselspital, Bern University Hospital and University of Bern, Bern, Switzerland."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catherine R.","family":"Jutzeler","sequence":"additional","affiliation":[{"name":"Department of Health Sciences and Technology (D-HEST), ETH Zurich, Z\u00fcrich, Switzerland."},{"name":"Swiss Institute of Bioinformatics (SIB), Lausanne, Switzerland."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,10,29]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-48054-z"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0274276"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01120-w"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1042\/etls20210246"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1002\/sim.8787"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/rbme.2020.3007816"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00426-3"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aao5580"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41698-024-00553-6"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1097\/00007632-200112151-00023"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2004.21.1371"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1101\/2024.05.03.24306807"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apmr.2016.04.014"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1097\/phm.0000000000001812"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/15459683231166937"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apmr.2021.02.029"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/s0140-6736(10)62276-3"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1038\/sj.sc.3101960"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2020.05.551"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2019.09.007"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1038\/sc.2015.201"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41393-021-00632-6"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.46292\/sci2702-1"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-022-02395-0"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2009.0888"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.apmr.2004.03.015"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1038\/sc.2009.44"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","unstructured":"Chen T Guestrin C. XGBoost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD \u201816. Association for Computing Machinery: New York NY USA; 2016; pp. 785\u2013794; doi: 10.1145\/2939672.2939785","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.2307\/2531595"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/lsp.2014.2337313"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1961.10482090"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_3_34_2","first-page":"4765","article-title":"A unified approach to interpreting model predictions","author":"Lundberg SM","year":"2017","unstructured":"Lundberg SM, , Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst, 2017:4765\u20134774.","journal-title":"Adv Neural Inf Process Syst"},{"key":"e_1_3_3_35_2","volume-title":"Wiley Series in Probability and Statistics","author":"Hosmer DW","year":"2013","unstructured":"Hosmer DW, , Lemeshow S, , Sturdivant RX. Applied logistic regression: Hosmer\/Applied logistic regression. 3rd ed. Wiley Series in Probability and Statistics. Wiley-Blackwell: Hoboken, NJ; 2013.","edition":"3"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41393-018-0097-8"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.3233\/nre-131000"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00382.2010"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12984-023-01178-9"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1093\/gigascience\/giad057"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.15252\/msb.202211407"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.xcrp.2022.101149"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1038\/sc.2010.180"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1038\/sc.2009.140"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00797-9"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0265254"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2007.0468"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1097\/brs.0000000000004053"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/bs.irn.2019.08.003"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41416-022-01937-w"}],"container-title":["Journal of Neurotrauma"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/08977151251386008","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/08977151251386008","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/08977151251386008","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,27]],"date-time":"2026-07-27T05:49:26Z","timestamp":1785131366000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/08977151251386008"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,29]]},"references-count":49,"journal-issue":{"issue":"9-10","published-print":{"date-parts":[[2026,5,1]]}},"alternative-id":["10.1177\/08977151251386008"],"URL":"https:\/\/doi.org\/10.1177\/08977151251386008","relation":{},"ISSN":["0897-7151","1557-9042"],"issn-type":[{"value":"0897-7151","type":"print"},{"value":"1557-9042","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,29]]}}}