{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T05:32:06Z","timestamp":1793338326530,"version":"4.5.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T00:00:00Z","timestamp":1722038400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T00:00:00Z","timestamp":1722038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100015833","name":"Singapore-ETH Centre","doi-asserted-by":"publisher","award":["Future Health Technologies"],"award-info":[{"award-number":["Future Health Technologies"]}],"id":[{"id":"10.13039\/501100015833","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001381","name":"National Research Foundation Singapore","doi-asserted-by":"publisher","award":["CREATE"],"award-info":[{"award-number":["CREATE"]}],"id":[{"id":"10.13039\/501100001381","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008486","name":"Schweizerische Multiple Sklerose Gesellschaft","doi-asserted-by":"publisher","award":["2021-06"],"award-info":[{"award-number":["2021-06"]}],"id":[{"id":"10.13039\/501100008486","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Swiss Federal Institute of Technology Zurich"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J NeuroEngineering Rehabil"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Technology-based assessments using 2D virtual reality (VR) environments and goal-directed instrumented tasks can deliver digital health metrics describing upper limb sensorimotor function that are expected to provide sensitive endpoints for clinical studies. Open questions remain about the influence of the VR environment and task complexity on such metrics and their clinimetric properties.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We aim to investigate the influence of VR and task complexity on the clinimetric properties of digital health metrics describing upper limb function. We relied on the Virtual Peg Insertion Test (VPIT), a haptic VR-based assessment with a virtual manipulation task. To evaluate the influence of VR and task complexity, we designed two novel tasks derived from the VPIT, the VPIT-2H (VR environment with reduced task complexity) and the PPIT (physical task with reduced task complexity). These were administered in an observational longitudinal study with 27 able-bodied participants and 31 participants with multiple sclerosis (pwMS, VPIT and PPIT only) and the value of kinematic and kinetic metrics, their clinimetric properties, and the usability of the assessment tasks were compared.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Intra-participant variability strongly increased with increasing task complexity (coefficient of variation\u2009+\u200956%) and was higher in the VR compared to the physical environment (+\u200927%). Surprisingly, this did not translate into significant differences in the metrics\u2019 measurement error and test\u2013retest reliability across task conditions (p\u2009&gt;\u20090.05). Responsiveness to longitudinal changes in pwMS was even significantly higher (effect size\u2009+\u20090.35, p\u2009&lt;\u20090.05) for the VR task with high task complexity compared to the physical instrumented task with low task complexity. Increased inter-participant variability might have compensated for the increased intra-participant variability to maintain good clinimetric properties. No significant influence of task condition on concurrent validity was present in pwMS. Lastly, pwMS rated the PPIT with higher usability than the VPIT (System Usability Scale\u2009+\u20097.5, p\u2009&lt;\u20090.05).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The metrics of both the VR haptic- and physical task-based instrumented assessments showed adequate clinimetric properties. The VR haptic-based assessment may be superior when longitudinally assessing pwMS due to its increased responsiveness. The physical instrumented task may be advantageous for regular clinical use due to its higher usability. These findings highlight that both assessments should be further validated for their ideal use-cases.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12984-024-01413-x","type":"journal-article","created":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T04:02:03Z","timestamp":1722052923000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Influence of virtual reality and task complexity on digital health metrics assessing upper limb function"],"prefix":"10.1186","volume":"21","author":[{"given":"Christoph M.","family":"Kanzler","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Armand","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leonardo","family":"Simovic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ramona","family":"Sylvester","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nadine","family":"Domnik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonia M.","family":"Eilfort","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carola","family":"Rohner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roger","family":"Gassert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roman","family":"Gonzenbach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivier","family":"Lambercy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,27]]},"reference":[{"key":"1413_CR1","doi-asserted-by":"publisher","first-page":"1994","DOI":"10.1007\/s00415-012-6577-4","volume":"259","author":"S Beer","year":"2012","unstructured":"Beer S, Khan F, Kesselring J. Rehabilitation interventions in multiple sclerosis: an overview. J Neurol. 2012;259:1994\u20132008.","journal-title":"J Neurol"},{"issue":"6","key":"1413_CR2","doi-asserted-by":"publisher","first-page":"1184","DOI":"10.1016\/j.apmr.2014.02.023","volume":"95","author":"I Lamers","year":"2014","unstructured":"Lamers I, Kelchtermans S, Baert I, Feys P. Upper limb assessment in multiple sclerosis: a systematic review of outcome measures and their psychometric properties. Arch Phys Med Rehabil. 2014;95(6):1184\u2013200. https:\/\/doi.org\/10.1016\/j.apmr.2014.02.023.","journal-title":"Arch Phys Med Rehabil"},{"issue":"7","key":"1413_CR3","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1177\/1352458514525677","volume":"20","author":"I Lamers","year":"2014","unstructured":"Lamers I, Feys P. Assessing upper limb function in multiple sclerosis. Mult Scler J. 2014;20(7):775\u201384. https:\/\/doi.org\/10.1177\/1352458514525677.","journal-title":"Mult Scler J"},{"issue":"3","key":"1413_CR4","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1177\/154596802401105171","volume":"16","author":"DJ Gladstone","year":"2002","unstructured":"Gladstone DJ, Danells CJ, Black SE. The Fugl-Meyer assessment of motor recovery after stroke: a critical review of its measurement properties. Neurorehabil Neural Repair. 2002;16(3):232\u201340. https:\/\/doi.org\/10.1177\/154596802401105171.","journal-title":"Neurorehabil Neural Repair"},{"issue":"11","key":"1413_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/brainsci11111519","volume":"11","author":"A Dillenseger","year":"2021","unstructured":"Dillenseger A, Weidemann ML, Trentzsch K, Inojosa H, Haase R, Schriefer D, Voigt I, Scholz M, Akg\u00fcn K, Ziemssen T. Digital biomarkers in multiple sclerosis. Brain Sci. 2021;11(11):1\u201326. https:\/\/doi.org\/10.3390\/brainsci11111519.","journal-title":"Brain Sci"},{"issue":"8","key":"1413_CR6","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1177\/1747493019873519","volume":"14","author":"G Kwakkel","year":"2019","unstructured":"Kwakkel G, Van Wegen EEH, Burridge JH, Winstein CJ, van Dokkum LEH, Alt Murphy M, Levin MF, Krakauer JW. Standardized measurement of quality of upper limb movement after stroke: consensus-based core recommendations from the second stroke recovery and rehabilitation roundtable. Int J Stroke. 2019;14(8):783\u201391. https:\/\/doi.org\/10.1177\/1747493019873519.","journal-title":"Int J Stroke"},{"issue":"3","key":"1413_CR7","doi-asserted-by":"publisher","first-page":"718","DOI":"10.1161\/STROKEAHA.118.023531","volume":"50","author":"A Schwarz","year":"2019","unstructured":"Schwarz A, Kanzler CM, Lambercy O, Luft AR, Veerbeek JM. Systematic review on kinematic assessments of upper limb movements after stroke. Stroke. 2019;50(3):718\u201327. https:\/\/doi.org\/10.1161\/STROKEAHA.118.023531.","journal-title":"Stroke"},{"issue":"4","key":"1413_CR8","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1682\/jrrd.2010.04.0057","volume":"48","author":"SH Scott","year":"2011","unstructured":"Scott SH, Dukelow SP. Potential of robots as next-generation technology for clinical assessment of neurological disorders and upper-limb therapy. J Rehabil Res Dev. 2011;48(4):335. https:\/\/doi.org\/10.1682\/jrrd.2010.04.0057.","journal-title":"J Rehabil Res Dev"},{"key":"1413_CR9","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1101\/544601","volume":"17","author":"CM Kanzler","year":"2020","unstructured":"Kanzler CM, Schwarz A, Held J, Luft AR, Gassert R, Lambercy O. Technology-aided assessment of functionally relevant sensorimotor impairments in arm and hand of post-stroke individuals. J NeuroEng Rehabil. 2020;17:128. https:\/\/doi.org\/10.1101\/544601.","journal-title":"J NeuroEng Rehabil"},{"issue":"1","key":"1413_CR10","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1038\/s41746-020-0286-7","volume":"3","author":"CM Kanzler","year":"2020","unstructured":"Kanzler CM, Rinderknecht MD, Schwarz A, Lamers I, Gagnon C, Held JPO, Feys P, Luft AR, Gassert R, Lambercy O. A data-driven framework for selecting and validating digital health metrics: use-case in neurological sensorimotor impairments. Npj Digit Med. 2020;3(1):80. https:\/\/doi.org\/10.1038\/s41746-020-0286-7.","journal-title":"Npj Digit Med"},{"key":"1413_CR11","doi-asserted-by":"publisher","DOI":"10.1186\/s12984-020-00759-2","author":"N Brihmat","year":"2020","unstructured":"Brihmat N, Loubinoux I, Lacanal EC, Marque P, Gasq D. Kinematic parameters obtained with the armeospring for upper - limb assessment after stroke: a reliability and learning effect study for guiding parameter use. J NeuroEng Rehabil. 2020. https:\/\/doi.org\/10.1186\/s12984-020-00759-2.","journal-title":"J NeuroEng Rehabil"},{"issue":"1","key":"1413_CR12","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1161\/Strokeaha.113.002296\/-\/DC1","volume":"45","author":"HI Krebs","year":"2014","unstructured":"Krebs HI, Krams M, Agrafiotis DK, Di Bernardo A, Chavez JC, Littman GS, Yang E, et al. Robotic measurement of arm movements after stroke establishes biomarkers of motor recovery. Stroke. 2014;45(1):200\u20134. https:\/\/doi.org\/10.1161\/Strokeaha.113.002296\/-\/DC1.","journal-title":"Stroke"},{"issue":"1","key":"1413_CR13","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1186\/s12984-016-0163-4","volume":"13","author":"M Longhi","year":"2016","unstructured":"Longhi M, Merlo A, Prati P, Giacobbi M, Mazzoli D. Instrumental indices for upper limb function assessment in stroke patients: a validation study. J Neuroeng Rehabil. 2016;13(1):52. https:\/\/doi.org\/10.1186\/s12984-016-0163-4.","journal-title":"J Neuroeng Rehabil"},{"issue":"7","key":"1413_CR14","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1177\/1545968311431966","volume":"26","author":"A Panarese","year":"2012","unstructured":"Panarese A, Colombo R, Sterpi I, Pisano F, Micera S. Tracking motor improvement at the subtask level during robot-aided neurorehabilitation of stroke patients. Neurorehabil Neural Repair. 2012;26(7):822\u201333. https:\/\/doi.org\/10.1177\/1545968311431966.","journal-title":"Neurorehabil Neural Repair"},{"key":"1413_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1743-0003-1-11","volume":"1","author":"A Viau","year":"2004","unstructured":"Viau A, Feldman AG, McFadyen BJ, Levin MF. Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis. J Neuroeng Rehabil. 2004;1:1\u20137. https:\/\/doi.org\/10.1186\/1743-0003-1-11.","journal-title":"J Neuroeng Rehabil"},{"issue":"1","key":"1413_CR16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0189275","volume":"13","author":"N Gerig","year":"2018","unstructured":"Gerig N, Mayo J, Baur K, Wittmann F, Riener R, et al. Missing depth cues in virtual reality limit performance and quality of three dimensional reaching movements. PLoS ONE. 2018;13(1): e0189275.","journal-title":"PLoS ONE"},{"issue":"October","key":"1413_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/frobt.2019.00100","volume":"6","author":"E Schiza","year":"2019","unstructured":"Schiza E, Matsangidou M, Neokleous K, Pattichis CS. Virtual reality applications for neurological disease: a review. Front Robot AI. 2019;6(October):1\u201314. https:\/\/doi.org\/10.3389\/frobt.2019.00100.","journal-title":"Front Robot AI"},{"key":"1413_CR18","doi-asserted-by":"publisher","unstructured":"Bowler M, Amirabdollahian F, Dautenhahn K. 2011. Using an embedded reality approach to improve test reliability for NHPT tasks. In 2011 IEEE International Conference on Rehabilitation Robotics, 1\u20137. IEEE. https:\/\/doi.org\/10.1109\/ICORR.2011.5975343.","DOI":"10.1109\/ICORR.2011.5975343"},{"issue":"1","key":"1413_CR19","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1186\/1743-0003-9-73","volume":"9","author":"W van den Hoogen","year":"2012","unstructured":"van den Hoogen W, Feys P, Lamers I, Coninx K, Notelaers S, Kerkhofs L, Ijsselsteijn W. Visualizing the third dimension in virtual training environments for neurologically impaired persons: beneficial or disruptive? J NeuroEng Rehabil. 2012;9(1):73. https:\/\/doi.org\/10.1186\/1743-0003-9-73.","journal-title":"J NeuroEng Rehabil"},{"issue":"5","key":"1413_CR20","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1016\/j.apmr.2008.10.030","volume":"90","author":"LA Knaut","year":"2009","unstructured":"Knaut LA, Subramanian SK, McFadyen BJ, Bourbonnais D, Levin MF. Kinematics of pointing movements made in a virtual versus a physical 3-dimensional environment in healthy and stroke subjects. Arch Phys Med Rehabil. 2009;90(5):793\u2013802. https:\/\/doi.org\/10.1016\/j.apmr.2008.10.030.","journal-title":"Arch Phys Med Rehabil"},{"issue":"6","key":"1413_CR21","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.1109\/TNSRE.2014.2387412","volume":"23","author":"MF Levin","year":"2015","unstructured":"Levin MF, Magdalon EC, Michaelsen SM, Quevedo AAFF. Quality of grasping and the role of haptics in a 3-D immersive virtual reality environment in individuals with stroke. IEEE Trans Neural Syst Rehabil Eng. 2015;23(6):1047\u201355. https:\/\/doi.org\/10.1109\/TNSRE.2014.2387412.","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"issue":"2","key":"1413_CR22","doi-asserted-by":"publisher","first-page":"150","DOI":"10.5014\/ajot.58.2.150","volume":"58","author":"H-I Ma","year":"2004","unstructured":"Ma H-I, Trombly CA. Effects of task complexity on reaction time and movement kinematics in elderly people. Am J Occup Ther. 2004;58(2):150\u20138. https:\/\/doi.org\/10.5014\/ajot.58.2.150.","journal-title":"Am J Occup Ther"},{"issue":"1","key":"1413_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13063-016-1555-2","volume":"17","author":"CAC Prinsen","year":"2016","unstructured":"Prinsen CAC, Vohra S, Rose MR, Boers M, Tugwell P, Clarke M, Williamson PR, Terwee CB. How to select outcome measurement instruments for outcomes included in a \u2018core outcome set\u2019 - a practical guideline. Trials. 2016;17(1):1\u201310. https:\/\/doi.org\/10.1186\/s13063-016-1555-2.","journal-title":"Trials"},{"key":"1413_CR24","doi-asserted-by":"publisher","unstructured":"Fluet MC, Lambercy O, Gassert R. Upper limb assessment using a virtual peg insertion test. IEEE International Conference on Rehabilitation Robotics. 2011.https:\/\/doi.org\/10.1109\/ICORR.2011.5975348","DOI":"10.1109\/ICORR.2011.5975348"},{"key":"1413_CR25","doi-asserted-by":"publisher","DOI":"10.1002\/acn3.51493","author":"CM Kanzler","year":"2022","unstructured":"Kanzler CM, Lessard I, Gassert R, Brais B, Gagnon C, Lambercy O. Reliability and validity of digital health metrics for assessing arm and hand impairments in an ataxic disorder. Ann Clin Transl Neurol. 2022. https:\/\/doi.org\/10.1002\/acn3.51493.","journal-title":"Ann Clin Transl Neurol"},{"key":"1413_CR26","doi-asserted-by":"publisher","first-page":"12","DOI":"10.3758\/s13414-018-1634-4","volume":"81","author":"SL Gorniak","year":"2019","unstructured":"Gorniak SL. The relationship between task difficulty and motor performance complexity. Atten Percept Psychophys. 2019;81:12\u20139.","journal-title":"Atten Percept Psychophys"},{"issue":"1","key":"1413_CR27","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/0749-5978(86)90044-0","volume":"37","author":"RE Wood","year":"1986","unstructured":"Wood RE. Task complexity: definition of the construct. Org Behav Hum Decis Process. 1986;37(1):60\u201382.","journal-title":"Org Behav Hum Decis Process"},{"issue":"1","key":"1413_CR28","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1007\/s11517-021-02467-y","volume":"60","author":"CM Kanzler","year":"2022","unstructured":"Kanzler CM, Lamers I, Feys P, Gassert R, Lambercy O. Personalized prediction of rehabilitation outcomes in multiple sclerosis: a proof-of-concept using clinical data, digital health metrics, and machine learning. Med Biol Eng Compu. 2022;60(1):249\u201361. https:\/\/doi.org\/10.1007\/s11517-021-02467-y.","journal-title":"Med Biol Eng Compu"},{"issue":"1","key":"1413_CR29","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1186\/s12984-015-0090-9","volume":"12","author":"S Balasubramanian","year":"2015","unstructured":"Balasubramanian S, Melendez-Calderon A, Roby-Brami A, Burdet E. On the analysis of movement smoothness. J Neuroeng Rehabil. 2015;12(1):112. https:\/\/doi.org\/10.1186\/s12984-015-0090-9.","journal-title":"J Neuroeng Rehabil"},{"issue":"5","key":"1413_CR30","doi-asserted-by":"publisher","first-page":"940","DOI":"10.1093\/brain\/123.5.940","volume":"123","author":"MC Cirstea","year":"2000","unstructured":"Cirstea MC, Levin MF. Compensatory strategies for reaching in stroke. Brain. 2000;123(5):940\u201353. https:\/\/doi.org\/10.1093\/brain\/123.5.940.","journal-title":"Brain"},{"issue":"8","key":"1413_CR31","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1177\/1545968309338194","volume":"23","author":"V Iyengar","year":"2009","unstructured":"Iyengar V, Santos MJ, Ko M, Aruin AS. Grip force control in individuals with multiple sclerosis. Neurorehabil Neural Repair. 2009;23(8):855\u201361. https:\/\/doi.org\/10.1177\/1545968309338194.","journal-title":"Neurorehabil Neural Repair"},{"issue":"6","key":"1413_CR32","doi-asserted-by":"publisher","first-page":"386","DOI":"10.5014\/ajot.39.6.386","volume":"39","author":"V Mathiowetz","year":"1985","unstructured":"Mathiowetz V, Volland G, Kashman N, Weber K. Adult norms for the box and block test of manual dexterity. Am J Occup Ther. 1985;39(6):386\u201391. https:\/\/doi.org\/10.5014\/ajot.39.6.386.","journal-title":"Am J Occup Ther"},{"issue":"1","key":"1413_CR33","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1177\/153944928500500102","volume":"5","author":"V Mathiowetz","year":"1985","unstructured":"Mathiowetz V, Weber K, Kashman N, Volland G. Adult norms for the nine hole peg test of finger dexterity. Occup Ther J Res. 1985;5(1):24\u201338. https:\/\/doi.org\/10.1177\/153944928500500102.","journal-title":"Occup Ther J Res"},{"key":"1413_CR34","doi-asserted-by":"publisher","DOI":"10.1177\/1352458517690824","author":"P Feys","year":"2017","unstructured":"Feys P, Lamers I, Francis G, Benedict R, Phillips G, Larocca N, Hudson LD, Rudick R. The nine-hole peg test as a manual dexterity performance measure for multiple sclerosis. Mult Scler. 2017. https:\/\/doi.org\/10.1177\/1352458517690824.","journal-title":"Mult Scler"},{"issue":"11","key":"1413_CR35","doi-asserted-by":"publisher","first-page":"1444","DOI":"10.1212\/WNL.33.11.1444","volume":"33","author":"JF Kurtzke","year":"1983","unstructured":"Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33(11):1444\u201352. https:\/\/doi.org\/10.1212\/WNL.33.11.1444.","journal-title":"Neurology"},{"issue":"3","key":"1413_CR36","first-page":"114","volume":"4","author":"A Bangor","year":"2009","unstructured":"Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean; adding an adjective rating. J Usability Stud. 2009;4(3):114\u201323.","journal-title":"J Usability Stud"},{"issue":"7","key":"1413_CR37","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1023\/A:1013138911638","volume":"10","author":"H Beckerman","year":"2001","unstructured":"Beckerman H, Roebroeck ME, Lankhorst GJ, Becher JG, Bezemer PD, Verbeek ALM. Smallest real difference, a link between reproducibility and responsiveness. Qual Life Res. 2001;10(7):571\u20138. https:\/\/doi.org\/10.1023\/A:1013138911638.","journal-title":"Qual Life Res"},{"issue":"1","key":"1413_CR38","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1519\/15184.1","volume":"19","author":"JP Weir","year":"2005","unstructured":"Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the Sem. J Strength Cond Res. 2005;19(1):231\u201340. https:\/\/doi.org\/10.1519\/15184.1.","journal-title":"J Strength Cond Res"},{"key":"1413_CR39","doi-asserted-by":"publisher","DOI":"10.5334\/ijic.65","author":"B Middel","year":"2002","unstructured":"Middel B, Van Sonderen E. Statistical significant change versus relevant or important change in (Quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. Int J Integr Care. 2002. https:\/\/doi.org\/10.5334\/ijic.65.","journal-title":"Int J Integr Care"},{"issue":"1","key":"1413_CR40","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1186\/s12984-018-0428-1","volume":"15","author":"N Schweighofer","year":"2018","unstructured":"Schweighofer N, Wang C, Mottet D, Laffont I, Bakthi K, Reinkensmeyer DJ, R\u00e9my-N\u00e9ris O. Dissociating motor learning from recovery in exoskeleton training post-stroke. J Neuroeng Rehabil. 2018;15(1):89. https:\/\/doi.org\/10.1186\/s12984-018-0428-1.","journal-title":"J Neuroeng Rehabil"},{"key":"1413_CR41","doi-asserted-by":"crossref","unstructured":"Fluet MC, Lambercy O, Gassert R. Effects of 2D\/3D visual feedback and visuomotor collocation on motor performance in a Virtual Peg Insertion Test. 2012. Annu Int Conf IEEE Eng Med Biol Soc. 4776.","DOI":"10.1109\/EMBC.2012.6347035"},{"issue":"1","key":"1413_CR42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12984-019-0525-9","volume":"16","author":"MP Furmanek","year":"2019","unstructured":"Furmanek MP, Schettino LF, Yarossi M, Kirkman S, Adamovich SV, Tunik E. Coordination of reach-to-grasp in physical and haptic-free virtual environments. J Neuroeng Rehabil. 2019;16(1):1\u201314. https:\/\/doi.org\/10.1186\/s12984-019-0525-9.","journal-title":"J Neuroeng Rehabil"},{"issue":"AUG","key":"1413_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fnagi.2016.00205","volume":"8","author":"LD Lled\u00f3","year":"2016","unstructured":"Lled\u00f3 LD, D\u00edez JA, Bertomeu-Motos A, Ezquerro S, Badesa FJ, Sabater-Navarro JM, Aracil NG. A comparative analysis of 2D and 3D tasks for virtual reality therapies based on robotic-assisted neurorehabilitation for post-stroke patients. Front Aging Neurosci. 2016;8(AUG):1\u201316. https:\/\/doi.org\/10.3389\/fnagi.2016.00205.","journal-title":"Front Aging Neurosci"},{"key":"1413_CR44","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.ijpsycho.2020.11.008","volume":"159","author":"E Mussini","year":"2021","unstructured":"Mussini E, Berchicci M, Bianco V, Perri RL, Quinzi F, Di Russo F. Effect of task complexity on motor and cognitive preparatory brain activities. Int J Psychophysiol. 2021;159:11\u20136. https:\/\/doi.org\/10.1016\/j.ijpsycho.2020.11.008.","journal-title":"Int J Psychophysiol"},{"issue":"6","key":"1413_CR45","doi-asserted-by":"publisher","first-page":"528","DOI":"10.1177\/1545968309356091","volume":"24","author":"AM Coderre","year":"2010","unstructured":"Coderre AM, Zeid AA, Dukelow SP, Demmer MJ, Moore KD, Demers MJ, Bretzke H, et al. Assessment of upper-limb sensorimotor function of subacute stroke patients using visually guided reaching. Neurorehabil Neural Repair. 2010;24(6):528\u201341. https:\/\/doi.org\/10.1177\/1545968309356091.","journal-title":"Neurorehabil Neural Repair"}],"container-title":["Journal of NeuroEngineering and Rehabilitation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12984-024-01413-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12984-024-01413-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12984-024-01413-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T16:05:57Z","timestamp":1722096357000},"score":1,"resource":{"primary":{"URL":"https:\/\/jneuroengrehab.biomedcentral.com\/articles\/10.1186\/s12984-024-01413-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,27]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1413"],"URL":"https:\/\/doi.org\/10.1186\/s12984-024-01413-x","relation":{},"ISSN":["1743-0003"],"issn-type":[{"value":"1743-0003","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,27]]},"assertion":[{"value":"11 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All study procedure were approved by the respective ethics commissions (Ethikkommission Ostschweiz und Ethikkommission Zurich EKOS 21\/045). Participants provided consent to participate before joining the study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Participants provided informed consent for publication of their data prior to the study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"OL is a member of the Editorial Board of\u00a0Journal of NeuroEngineering and Rehabilitation. OL was not involved in the journal\u2019s peer review process of, or decisions related to, this manuscript. The authors do not have any other competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"125"}}