{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T18:25:31Z","timestamp":1786559131762,"version":"3.56.0"},"reference-count":66,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,11,25]],"date-time":"2021-11-25T00:00:00Z","timestamp":1637798400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,25]],"date-time":"2021-11-25T00:00:00Z","timestamp":1637798400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"crossref","award":["688857 (SoftPro)"],"award-info":[{"award-number":["688857 (SoftPro)"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100007352","name":"Staatssekretariat f\u00fcr Bildung, Forschung und Innovation","doi-asserted-by":"publisher","award":["15.0283-1"],"award-info":[{"award-number":["15.0283-1"]}],"id":[{"id":"10.13039\/501100007352","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001381","name":"National Research Foundation Singapore","doi-asserted-by":"publisher","award":["CREATE"],"award-info":[{"award-number":["CREATE"]}],"id":[{"id":"10.13039\/501100001381","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Swiss Federal Institute of Technology Zurich"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Med Biol Eng Comput"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Predicting upper limb neurorehabilitation outcomes in persons with multiple sclerosis (pwMS) is essential to optimize therapy allocation. Previous research identified population-level predictors through linear models and clinical data. This work explores the feasibility of predicting individual neurorehabilitation outcomes using machine learning, clinical data, and digital health metrics. Machine learning models were trained on clinical data and digital health metrics recorded pre-intervention in 11 pwMS. The dependent variables indicated whether pwMS considerably improved across the intervention, as defined by the Action Research Arm Test (ARAT), Box and Block Test (BBT), or Nine Hole Peg Test (NHPT). Improvements in ARAT or BBT could be accurately predicted (88% and 83% accuracy) using only patient master data. Improvements in NHPT could be predicted with moderate accuracy (73%) and required knowledge about sensorimotor impairments. Assessing these with digital health metrics over clinical scales increased accuracy by 10%. Non-linear models improved accuracy for the BBT (+\u20099%), but not for the ARAT (-1%) and NHPT (-2%). This work demonstrates the feasibility of predicting upper limb neurorehabilitation outcomes in pwMS, which justifies the development of more representative prediction models in the future. Digital health metrics improved the prediction of changes in hand control, thereby underlining their advanced sensitivity.<\/jats:p>","DOI":"10.1007\/s11517-021-02467-y","type":"journal-article","created":{"date-parts":[[2021,11,25]],"date-time":"2021-11-25T09:03:47Z","timestamp":1637831027000},"page":"249-261","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Personalized prediction of rehabilitation outcomes in multiple sclerosis: a proof-of-concept using clinical data, digital health metrics, and machine learning"],"prefix":"10.1007","volume":"60","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1214-8347","authenticated-orcid":false,"given":"Christoph M.","family":"Kanzler","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilse","family":"Lamers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Feys","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roger","family":"Gassert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivier","family":"Lambercy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,11,25]]},"reference":[{"key":"2467_CR1","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/S1474-4422(18)30443-5","volume":"18","author":"MT Wallin","year":"2019","unstructured":"Wallin MT, Culpepper WJ, Nichols E, Bhutta ZA, Gebrehiwot TT, Hay SI, Khalil IA, Krohn KJ, Liang X, Naghavi M, Mokdad AH, Nixon MR, Reiner RC, Sartorius B, Smith M, Topor-Madry R, Werdecker A, Vos T, Feigin VL, Murray CJ (2019) Global, regional, and national burden of multiple sclerosis 1990\u20132016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Neurol 18:269\u2013285","journal-title":"Lancet Neurol"},{"issue":"11","key":"2467_CR2","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1212\/WNL.0000000000000768","volume":"83","author":"P Browne","year":"2014","unstructured":"Browne P, Chandraratna D, Angood C, Tremlett H, Baker C, Taylor BV, Thompson AJ (2014) Atlas of Multiple Sclerosis 2013: A growing global problem with widespread inequity. Neurology 83 (11):1022\u20131024","journal-title":"Neurology"},{"issue":"1-2","key":"2467_CR3","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.jns.2006.02.018","volume":"246","author":"N Yozbatiran","year":"2006","unstructured":"Yozbatiran N, Baskurt F, Baskurt Z, Ozakbas S, Idiman E (2006) Motor assessment of upper extremity function and its relation with fatigue, cognitive function and quality of life in multiple sclerosis patients. J Neurol Sci 246(1-2):117\u2013122","journal-title":"J Neurol Sci"},{"key":"2467_CR4","doi-asserted-by":"crossref","unstructured":"Khan F, Turner-Stokes L, Ng L, Kilpatrick T, Amatya B (2007) Multidisciplinary rehabilitation for adults with multiple sclerosis. Cochrane Database Syst Rev (2)","DOI":"10.1002\/14651858.CD006036.pub2"},{"issue":"9","key":"2467_CR5","doi-asserted-by":"crossref","first-page":"1994","DOI":"10.1007\/s00415-012-6577-4","volume":"259","author":"S Beer","year":"2012","unstructured":"Beer S, Khan F, Kesselring J (2012) Rehabilitation interventions in multiple sclerosis: An overview. J Neurol 259(9):1994\u20132008","journal-title":"J Neurol"},{"key":"2467_CR6","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.msard.2019.06.014","volume":"34","author":"I Lamers","year":"2019","unstructured":"Lamers I, Raats J, Spaas J, Meuleman M, Kerkhofs L, Schouteden S, Feys P (2019) Intensity-dependent clinical effects of an individualized technology-supported task-oriented upper limb training program in Multiple sclerosis: A pilot randomized controlled trial. Mult Scler Relat Disord 34:119\u2013127","journal-title":"Mult Scler Relat Disord"},{"key":"2467_CR7","unstructured":"World Health Organization (2001) International classification of functioning, disability and health: ICF"},{"issue":"2","key":"2467_CR8","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.apmr.2016.04.016","volume":"98","author":"F Khan","year":"2017","unstructured":"Khan F, Amatya B (2017) Rehabilitation in multiple sclerosis: a systematic review of systematic reviews. Arch Phys Med Rehabil 98(2):353\u2013367","journal-title":"Arch Phys Med Rehabil"},{"issue":"1","key":"2467_CR9","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/s12984-016-0148-3","volume":"13","author":"DJ Reinkensmeyer","year":"2016","unstructured":"Reinkensmeyer DJ, Burdet E, Casadio M, Krakauer JW, Kwakkel G, Lang CE, Swinnen SP, Ward NS, Schweighofer N (2016) Computational neurorehabilitation: modeling plasticity and learning to predict recovery. J NeuroEng Rehab 13(1):42","journal-title":"J NeuroEng Rehab"},{"issue":"12","key":"2467_CR10","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.1016\/S1474-4422(10)70247-7","volume":"9","author":"C Stinear","year":"2010","unstructured":"Stinear C (2010) Prediction of recovery of motor function after stroke. Lancet Neurol 9 (12):1228\u20131232","journal-title":"Lancet Neurol"},{"issue":"4","key":"2467_CR11","first-page":"528","volume":"6","author":"I Lipp","year":"2015","unstructured":"Lipp I, Tomassini V (2015) Neuroplasticity and motor rehabilitation in multiple Sclerosis. Front Neurol 6(4):528\u2013536","journal-title":"Front Neurol"},{"issue":"11","key":"2467_CR12","doi-asserted-by":"crossref","first-page":"3314","DOI":"10.1161\/STROKEAHA.119.025696","volume":"50","author":"CM Stinear","year":"2019","unstructured":"Stinear CM, Smith MC, Byblow WD (2019) Prediction tools for stroke rehabilitation. Stroke 50(11):3314\u20133322","journal-title":"Stroke"},{"issue":"2","key":"2467_CR13","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/0003-9993(94)90385-9","volume":"75","author":"AW Heinemann","year":"1994","unstructured":"Heinemann AW, Linacre JM, Wright BD, Hamilton BB, Granger C (1994) Prediction of rehabilitation outcomes with disability measures. Arch Phys Med Rehabil 75(2):133\u2013143","journal-title":"Arch Phys Med Rehabil"},{"issue":"2","key":"2467_CR14","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1177\/135245859900500205","volume":"5","author":"DW Langdon","year":"1999","unstructured":"Langdon DW, Thompson AJ (1999) Multiple sclerosis: A preliminary study of selected variables affecting rehabilitation outcome. Mult Scler 5(2):94\u2013100","journal-title":"Mult Scler"},{"issue":"6","key":"2467_CR15","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1191\/1352458505ms1226oa","volume":"11","author":"MG Grasso","year":"2005","unstructured":"Grasso MG, Troisi E, Rizzi F, Morelli D, Paolucci S (2005) Prognostic factors in multidisciplinary rehabilitation treatment in multiple sclerosis: An outcome study. Mult Scler 11(6):719\u2013724","journal-title":"Mult Scler"},{"issue":"6","key":"2467_CR16","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.1016\/j.apmr.2014.02.023","volume":"95","author":"I Lamers","year":"2014","unstructured":"Lamers I, Kelchtermans S, Baert I, Feys P (2014) Upper limb assessment in multiple sclerosis: A systematic review of outcome measures and their psychometric properties. Arch Phys Med Rehabil 95 (6):1184\u20131200","journal-title":"Arch Phys Med Rehabil"},{"key":"2467_CR17","first-page":"1","volume":"110","author":"J Burridge","year":"2019","unstructured":"Burridge J, Alt Murphy M, Buurke J, Feys P, Keller T, Klamroth-Marganska V, Lamers I, McNicholas L, Prange G, Tarkka I, Timmermans A, Hughes A-M (2019) A systematic review of international clinical guidelines for rehabilitation of people with neurological conditions: what recommendations are made for upper limb assessment?. Front Neurol 110:1\u201314","journal-title":"Front Neurol"},{"issue":"13","key":"2467_CR18","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1056\/NEJMp1606181","volume":"375","author":"Z Obermeyer","year":"2016","unstructured":"Obermeyer Z, Emanuel EJ (2016) Predicting the future \u2014 big data, machine learning, and clinical medicine. New England J Med 375(13):1216\u20131219","journal-title":"New England J Med"},{"issue":"14","key":"2467_CR19","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1056\/NEJMra1814259","volume":"380","author":"A Rajkomar","year":"2019","unstructured":"Rajkomar A, Dean J, Kohane I (2019) Machine learning in medicine. N Engl J Med 380 (14):1347\u20131358","journal-title":"N Engl J Med"},{"issue":"3","key":"2467_CR20","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1161\/STROKEAHA.118.023531","volume":"50","author":"A Schwarz","year":"2019","unstructured":"Schwarz A, Kanzler CM, Lambercy O, Luft AR, Veerbeek JM (2019) Systematic review on kinematic assessments of upper limb movements after stroke. Stroke 50(3):718\u2013727. [Online]. Available: https:\/\/www.ahajournals.org\/doi\/10.1161\/STROKEAHA.118.023531https:\/\/www.ahajournals.org\/doi\/10.1161\/STROKEAHA.118.023531","journal-title":"Stroke"},{"issue":"3","key":"2467_CR21","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1109\/3516.951363","volume":"6","author":"A Bardorfer","year":"2001","unstructured":"Bardorfer A, Munih M, Zupan A, Primo\u017ei\u010d A (2001) Upper limb motion analysis using haptic interface. IEEE\/ASME Trans Mechatron 6(3):253\u2013260","journal-title":"IEEE\/ASME Trans Mechatron"},{"issue":"1","key":"2467_CR22","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1186\/1743-0003-7-37","volume":"7","author":"E Vergaro","year":"2010","unstructured":"Vergaro E, Squeri V, Brichetto G, Casadio M, Morasso P, Solaro C, Sanguineti V (2010) Adaptive robot training for the treatment of incoordination in Multiple Sclerosis. J NeuroEng Rehab 7(1):37","journal-title":"J NeuroEng Rehab"},{"issue":"3","key":"2467_CR23","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1109\/TNSRE.2012.2187462","volume":"20","author":"I Carpinella","year":"2012","unstructured":"Carpinella I, Cattaneo D, Bertoni R, Ferrarin M (2012) Robot training of upper limb in multiple sclerosis: comparing protocols with or withoutmanipulative task components. IEEE Trans Neural Sys Rehab Eng 20(3):351\u2013360","journal-title":"IEEE Trans Neural Sys Rehab Eng"},{"key":"2467_CR24","doi-asserted-by":"crossref","unstructured":"Lambercy O, Fluet M-C, Lamers I, Kerkhofs L, Feys P, Gassert R (2013) Assessment of upper limb motor function in patients with multiple sclerosis using the virtual peg insertion test: A pilot study. In: Proceedings of the international conference on rehabilitation robotics (ICORR), pp 1\u20136","DOI":"10.1109\/ICORR.2013.6650494"},{"issue":"1","key":"2467_CR25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/17483107.2016.1278467","volume":"13","author":"A Maris","year":"2018","unstructured":"Maris A, Coninx K, Seelen H, Truyens V, De Weyer T, Geers R, Lemmens M, Coolen J, Stupar S, Lamers I, Feys P (2018) The impact of robot-mediated adaptive I-TRAVLE training on impaired upper limb function in chronic stroke and multiple sclerosis. Disab Rehab Assist Technol 13(1):1\u20139","journal-title":"Disab Rehab Assist Technol"},{"issue":"1","key":"2467_CR26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1743-0003-11-67","volume":"11","author":"I Carpinella","year":"2014","unstructured":"Carpinella I, Cattaneo D, Ferrarin M (2014) Quantitative assessment of upper limb motor function in multiple sclerosis using an instrumented action research arm test. J NeuroEng Rehab 11(1):1\u201316. [Online]. Available: Journalof NeuroEngineeringandRehabilitation","journal-title":"J NeuroEng Rehab"},{"issue":"1","key":"2467_CR27","doi-asserted-by":"crossref","first-page":"2110","DOI":"10.1038\/s41598-018-20343-y","volume":"8","author":"L Pellegrino","year":"2018","unstructured":"Pellegrino L, Coscia M, Muller M, Solaro C, Casadio M (2018) Evaluating upper limb impairments in multiple sclerosis by exposure to different mechanical environments. Scient Rep 8(1):2110","journal-title":"Scient Rep"},{"issue":"1","key":"2467_CR28","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1038\/s41746-020-0286-7","volume":"3","author":"CM Kanzler","year":"2020","unstructured":"Kanzler CM, Rinderknecht MD, Schwarz A, Lamers I, Gagnon C, Held J, Feys P, Luft AR, Gassert R, Lambercy O (2020) A data-driven framework for the selection and validation of digital health metrics:, use-case in neurological sensorimotor impairments. npj Digit Med 3(1):80","journal-title":"npj Digit Med"},{"key":"2467_CR29","doi-asserted-by":"crossref","unstructured":"Simmatis LE, Jin AY, Taylor SW, Bisson EJ, Scott SH, Baharnoori M (2020) The feasibility of assessing cognitive and motor function in multiple sclerosis patients using robotics. Mult Scler J Exper Transl Clin 6(4)","DOI":"10.1177\/2055217320964940"},{"key":"2467_CR30","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1186\/s12984-020-00748-5","volume":"17","author":"CM Kanzler","year":"2020","unstructured":"Kanzler CM, Schwarz A, Held J, Luft AR, Gassert R, Lambercy O (2020) Technology-aided assessment of functionally relevant sensorimotor impairments in arm and hand of post-stroke individuals. J NeuroEng Rehab 17:128","journal-title":"J NeuroEng Rehab"},{"issue":"1","key":"2467_CR31","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/S0363-5023(87)80189-2","volume":"12","author":"J Bell-Krotoski","year":"1987","unstructured":"Bell-Krotoski J, Tomancik E (1987) The repeatability of testing with Semmes-Weinstein monofilaments. J Hand Surg 12(1):155\u2013161","journal-title":"J Hand Surg"},{"issue":"6","key":"2467_CR32","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1159\/000115178","volume":"19","author":"G Demeurisse","year":"1980","unstructured":"Demeurisse G, Demol O, Robaye E (1980) Motor evaluation in vascular hemiplegia. Eur Neurol 19(6):382\u2013389. [Online]. Available: https:\/\/www.karger.com\/Article\/FullText\/115178","journal-title":"Eur Neurol"},{"key":"2467_CR33","first-page":"271","volume":"2","author":"S Fahn","year":"1993","unstructured":"Fahn S, Tolosa E, Mar\u00edn C (1993) Clinical rating scale for tremor. Park Dis Mov Disord 2:271\u2013280","journal-title":"Park Dis Mov Disord"},{"issue":"7","key":"2467_CR34","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1191\/0269215504cr780oa","volume":"18","author":"J Surakka","year":"2004","unstructured":"Surakka J, Romberg A, Ruutiainen J, Aunola S, Virtanen A, Karppi S-L, M\u00e4entaka K (2004) Effects of aerobic and strength exercise on motor fatigue in men and women with multiple sclerosis: a randomized controlled trial. Clin Rehab 18(7):737\u2013746","journal-title":"Clin Rehab"},{"issue":"5","key":"2467_CR35","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1177\/1352458517690821","volume":"23","author":"RH Benedict","year":"2017","unstructured":"Benedict RH, DeLuca J, Phillips G, LaRocca N, Hudson LD, Rudick R (2017) Validity of the symbol digit modalities test as a cognition performance outcome measure for multiple sclerosis. Mult Scler J 23(5):721\u2013733","journal-title":"Mult Scler J"},{"issue":"11","key":"2467_CR36","doi-asserted-by":"crossref","first-page":"1444","DOI":"10.1212\/WNL.33.11.1444","volume":"33","author":"JF Kurtzke","year":"1983","unstructured":"Kurtzke JF (1983) Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (edss). Neurology 33(11):1444\u20131444","journal-title":"Neurology"},{"issue":"4","key":"2467_CR37","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1191\/0269215505cr832oa","volume":"19","author":"T Platz","year":"2005","unstructured":"Platz T, Pinkowski C, van Wijck F, Kim I-H, di Bella P, Johnson G (2005) Reliability and validity of arm function assessment with standardized guidelines for the fugl-meyer test, action research arm test and box and block test: a multicentre study. Clin Rehab 19(4):404\u2013411","journal-title":"Clin Rehab"},{"issue":"1","key":"2467_CR38","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1177\/153944928500500102","volume":"5","author":"V Mathiowetz","year":"1985","unstructured":"Mathiowetz V, Weber K, Kashman N, Volland G (1985) Adult norms for the nine hole peg test of finger dexterity. Occupat Therapy J Res 5(1):24\u201338","journal-title":"Occupat Therapy J Res"},{"issue":"5","key":"2467_CR39","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1177\/1352458517690824","volume":"23","author":"P Feys","year":"2017","unstructured":"Feys P, Lamers I, Francis G, Benedict R, Phillips G, Larocca N, Hudson LD, Rudick R (2017) The nine-hole peg test as a manual dexterity performance measure for multiple sclerosis. Mult Scler J 23(5):711\u2013720","journal-title":"Mult Scler J"},{"issue":"6","key":"2467_CR40","doi-asserted-by":"crossref","first-page":"386","DOI":"10.5014\/ajot.39.6.386","volume":"39","author":"V Mathiowetz","year":"1985","unstructured":"Mathiowetz V, Volland G, Kashman N, Weber K (1985) Adult norms for the box and block test of manual dexterity. Amer J Occupat Therapy 39(6):386\u2013391","journal-title":"Amer J Occupat Therapy"},{"key":"2467_CR41","doi-asserted-by":"crossref","unstructured":"Mitchell A, Le V, Muniz S, Vogel KA, Vollmer MA, Oxford Grice K (2010) Adult norms for a commercially available nine hole peg test for finger dexterity. Am J Occup Ther 57(5):570\u2013573","DOI":"10.5014\/ajot.57.5.570"},{"key":"2467_CR42","doi-asserted-by":"crossref","unstructured":"Fluet M, Lambercy O, Gassert R (2011) Upper limb assessment using a virtual peg insertion test. In: IEEE international conference on rehabilitation robotics, pp 1\u20136","DOI":"10.1109\/ICORR.2011.5975348"},{"issue":"6","key":"2467_CR43","doi-asserted-by":"crossref","first-page":"529","DOI":"10.3200\/35-09-004-RC","volume":"41","author":"N Hogan","year":"2009","unstructured":"Hogan N, Sternad D (2009) Sensitivity of smoothness measures to movement duration, amplitude, and arrests. J Motor Behav 41(6):529\u2013534. [Online]. Available: http:\/\/www.tandfonline.com\/doi\/abs\/10.3200\/35-09-004-RC","journal-title":"J Motor Behav"},{"issue":"1","key":"2467_CR44","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1186\/s12984-015-0090-9","volume":"12","author":"S Balasubramanian","year":"2015","unstructured":"Balasubramanian S, Melendez-Calderon A, Roby-Brami A, Burdet E (2015) On the analysis of movement smoothness. J Neuroeng Rehab 12(1):112","journal-title":"J Neuroeng Rehab"},{"key":"2467_CR45","volume-title":"The elements of statistical learning, ser. Springer Series in Statistics, no. 1","author":"T Hastie","year":"2009","unstructured":"Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning, ser. Springer Series in Statistics, no. 1. Springer, New York"},{"issue":"2","key":"2467_CR46","first-page":"85","volume":"26","author":"P Schuck","year":"2003","unstructured":"Schuck P, Zwingmann C (2003) The \u2019smallest real difference\u2019 as a measure of sensitivity to change: A critical analysis. Int J Rehabil Res 26(2):85\u201391","journal-title":"Int J Rehabil Res"},{"issue":"10","key":"2467_CR47","doi-asserted-by":"crossref","first-page":"2648","DOI":"10.1093\/brain\/awl223","volume":"129","author":"V De Groot","year":"2006","unstructured":"De Groot V, Beckerman H, Uitdehaag BM, De Vet HC, Lankhorst GJ, Polman CH, Bouter LM (2006) The usefulness of evaluative outcome measures in patients with multiple sclerosis. Brain 129 (10):2648\u20132659","journal-title":"Brain"},{"issue":"2","key":"2467_CR48","doi-asserted-by":"crossref","first-page":"176","DOI":"10.2522\/ptj.20070064","volume":"88","author":"J Paltamaa","year":"2008","unstructured":"Paltamaa J, Sarasoja T, Leskinen E, Wikstrom J, Malkia E (2008) Measuring deterioration in international classification of functioning domains of people with multiple sclerosis who are ambulatory. Phys Therapy 88(2):176\u2013190","journal-title":"Phys Therapy"},{"issue":"7","key":"2467_CR49","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1177\/1545968309335975","volume":"23","author":"SL Fritz","year":"2009","unstructured":"Fritz SL, Blanton S, Uswatte G, Taub E, Wolf SL (2009) Minimal detectable change scores for the wolf motor function test. Neurorehab Neural Repair 23(7):662\u2013667","journal-title":"Neurorehab Neural Repair"},{"key":"2467_CR50","doi-asserted-by":"crossref","unstructured":"Brodersen KH, Ong CS, Stephan KE, Buhmann JM (2010) The balanced accuracy and its posterior distribution. Proc Int Conf Patt Recogn: 3121\u20133124","DOI":"10.1109\/ICPR.2010.764"},{"key":"2467_CR51","doi-asserted-by":"crossref","unstructured":"Breiman L (2017) Classification and regression trees","DOI":"10.1201\/9781315139470"},{"issue":"10","key":"2467_CR52","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1007\/BF00920623","volume":"241","author":"B Runmarker","year":"1994","unstructured":"Runmarker B, Andersson C, Od\u00e9n A, Andersen O (1994) Prediction of outcome in multiple sclerosis based on multivariate models. J Neurol 241(10):597\u2013604","journal-title":"J Neurol"},{"key":"2467_CR53","unstructured":"Fiorini S, Verri A, Barla A, Tacchino A, Brichetto G (2017) Temporal prediction of multiple sclerosis evolution from patient-centered outcomes. In: Proceedings of the 2nd Machine Learning for Healthcare Conference, ser. Proceedings of Machine Learning Research, vol 68, pp 112\u2013125"},{"issue":"4","key":"2467_CR54","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1136\/practneurol-2018-002000","volume":"19","author":"D Castle","year":"2019","unstructured":"Castle D, Wynford-Thomas R, Loveless S, Bentley E, Howell OW, Tallantyre EC (2019) Using biomarkers to predict clinical outcomes in multiple sclerosis. Pract Neurol 19(4):342\u2013349","journal-title":"Pract Neurol"},{"key":"2467_CR55","doi-asserted-by":"crossref","unstructured":"Law MT, Traboulsee AL, Li DK, Carruthers RL, Freedman MS, Kolind SH, Tam R (2019) Machine learning in secondary progressive multiple sclerosis: an improved predictive model for short-term disability progression. Mult Scler J Exper Translat Clin 5(4)","DOI":"10.1177\/2055217319885983"},{"key":"2467_CR56","first-page":"483","volume":"102","author":"A Tousignant","year":"2019","unstructured":"Tousignant A, Paul Lemaitre M, Doina Precup C, Arnold DL (2019) Prediction of disease progression in multiple sclerosis patients using deep learning analysis of MRI data tal arbel 3. Proc Machine Learn Res 102:483\u2013492","journal-title":"Proc Machine Learn Res"},{"issue":"2","key":"2467_CR57","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/s10072-019-04093-x","volume":"41","author":"G Brichetto","year":"2020","unstructured":"Brichetto G, Monti Bragadin M, Fiorini S, Battaglia MA, Konrad G, Ponzio M, Pedull\u00e0 L, Verri A, Barla A, Tacchino A (2020) The hidden information in patient-reported outcomes and clinician-assessed outcomes: multiple sclerosis as a proof of concept of a machine learning approach. Neurol Sci 41 (2):459\u2013462","journal-title":"Neurol Sci"},{"key":"2467_CR58","first-page":"189","volume":"257","author":"IC Jeong","year":"2019","unstructured":"Jeong IC, Liu J, Finkelstein J (2019) Factors affecting adherence with telerehabilitation in patients with multiple sclerosis. Stud Health Technol Inform 257:189\u2013193","journal-title":"Stud Health Technol Inform"},{"issue":"9","key":"2467_CR59","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1302\/2046-3758.49.2000571","volume":"4","author":"DF Hamilton","year":"2015","unstructured":"Hamilton DF, Ghert M, Simpson AHRW (2015) Interpreting regression models in clinical outcome studies. Bone Joint Res 4(9):152\u2013153","journal-title":"Bone Joint Res"},{"key":"2467_CR60","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.chemolab.2016.01.008","volume":"152","author":"K Roy","year":"2016","unstructured":"Roy K, Das RN, Ambure P, Aher RB (2016) Be aware of error measures. Further studies on validation of predictive QSAR models. Chemometr Intell Lab Syst 152:18\u201333","journal-title":"Chemometr Intell Lab Syst"},{"key":"2467_CR61","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep learning"},{"issue":"11","key":"2467_CR62","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1038\/nrneurol.2012.179","volume":"8","author":"V Tomassini","year":"2012","unstructured":"Tomassini V, Matthews PM, Thompson AJ, Fugl\u00f8 D, Geurts JJ, Johansen-Berg H, Jones DK, Rocca MA, Wise RG, Barkhof F, Palace J (2012) Neuroplasticity and functional recovery in multiple sclerosis. Nat Rev Neurol 8(11):635\u2013646","journal-title":"Nat Rev Neurol"},{"issue":"3","key":"2467_CR63","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1177\/1545968317753073","volume":"32","author":"A Barghi","year":"2018","unstructured":"Barghi A, Allendorfer JB, Taub E, Womble B, Hicks JM, Uswatte G, Szaflarski JP, Mark VW (2018) Phase II randomized controlled trial of Constraint-Induced movement therapy in multiple sclerosis. Part 2: effect on white matter integrity. Neurorehabil Neural Repair 32(3):233\u2013241","journal-title":"Neurorehabil Neural Repair"},{"issue":"1","key":"2467_CR64","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1093\/brain\/awl333","volume":"130","author":"CM Stinear","year":"2007","unstructured":"Stinear CM, Barber PA, Smale PR, Coxon JP, Fleming MK, Byblow WD (2007) Functional potential in chronic stroke patients depends on corticospinal tract integrity. Brain 130(1):170\u2013 180","journal-title":"Brain"},{"issue":"8","key":"2467_CR65","doi-asserted-by":"crossref","first-page":"2527","DOI":"10.1093\/brain\/aws146","volume":"135","author":"CM Stinear","year":"2012","unstructured":"Stinear CM, Barber PA, Petoe M, Anwar S, Byblow WD (2012) The PREP algorithm predicts potential for upper limb recovery after stroke. Brain 135(8):2527\u20132535","journal-title":"Brain"},{"key":"2467_CR66","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.bbr.2015.10.015","volume":"297","author":"JL Neva","year":"2016","unstructured":"Neva JL, Lakhani B, Brown KE, Wadden KP, Mang CS, Ledwell NH, Borich MR, Vavasour IM, Laule C, Traboulsee AL, MacKay AL, Boyd LA (2016) Multiple measures of corticospinal excitability are associated with clinical features of multiple sclerosis. Behav Brain Res 297:187\u2013195","journal-title":"Behav Brain Res"}],"container-title":["Medical &amp; Biological Engineering &amp; Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11517-021-02467-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11517-021-02467-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11517-021-02467-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,3]],"date-time":"2022-01-03T12:50:49Z","timestamp":1641214249000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11517-021-02467-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,25]]},"references-count":66,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["2467"],"URL":"https:\/\/doi.org\/10.1007\/s11517-021-02467-y","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.03.26.010264","asserted-by":"object"}]},"ISSN":["0140-0118","1741-0444"],"issn-type":[{"value":"0140-0118","type":"print"},{"value":"1741-0444","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,25]]},"assertion":[{"value":"31 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 November 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study was registered at clinicaltrials.gov (NCT02688231) and approved by the responsible Ethical Committees (University of Leuven, Hasselt University, and Mariaziekenhuis Noord-Limburg).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of interest"}}]}}