{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T11:01:41Z","timestamp":1791284501452,"version":"4.1.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2025,5,29]],"date-time":"2025-05-29T00:00:00Z","timestamp":1748476800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,29]],"date-time":"2025-05-29T00:00:00Z","timestamp":1748476800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Spinal Cord"],"published-print":{"date-parts":[[2025,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Functional electrical stimulation and exoskeletons provide direct functional ability but may also have therapeutic effects that improve function when they are turned off or removed.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Objective<\/jats:title>\n            <jats:p>This integrative review aimed to identify functional clinical outcome assessments used to assess therapeutic effects in rehabilitation technologies for persons with spinal cord injuries, to examine the National Institute of Neurological Disorders and Stroke Common Data Elements recommendation level for SCI for each COA, and determine which COAs distinguish between recovery of function and function from compensation.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>A literature search identified interventional SCI studies using FES and exoskeletons (<jats:italic>n<\/jats:italic>\u2009=\u20091006). Text screens resulted in a sample (<jats:italic>n<\/jats:italic>\u2009=\u200956) organized by level of evidence, COAs with their measurement properties, type of intervention with involved limbs, the NINDS CDE recommendation level, and if the COAs distinguished recovery from compensation.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>56 articles met inclusion criteria. 31 studies involved exoskeletons, 23 studies involved FES, and 2 studies involved both FES and exoskeleton. Within those 56 articles, 38 COAs were identified across all studies, including different versions of the same COA as separate measures. Of these 38 COAs, 24 were PerfOs and 7 were PROs. The most used COAs did not differentiate recovery from compensation. However, 3 COAs were identified as able to discriminate recovery from compensation.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>Studies on FES and exoskeletons in SCI have precedent to examine therapeutic effects using a variety of functional COAs. Clinical trials in SCI would benefit from COAs with interval scales that assess therapeutic effects that differentiate between recovery and compensation.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1038\/s41393-025-01085-x","type":"journal-article","created":{"date-parts":[[2025,5,29]],"date-time":"2025-05-29T18:11:24Z","timestamp":1748542284000},"page":"323-332","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Evaluating therapeutic effects of exoskeletons and FES in SCI: integrative review of the literature"],"prefix":"10.1038","volume":"63","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6068-4967","authenticated-orcid":false,"given":"Rachel Y.","family":"Kim","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9832-1838","authenticated-orcid":false,"given":"Olivia M.","family":"Biller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M. J.","family":"Mulcahey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,5,29]]},"reference":[{"key":"1085_CR1","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1186\/1743-0003-9-36","volume":"9","author":"A Frisoli","year":"2012","unstructured":"Frisoli A, Procopio C, Chisari C, Creatini I, Bonfiglio L, Bergamasco M, et al. Positive effects of robotic exoskeleton training of upper limb reaching movements after stroke. J Neuroeng Rehabil. 2012;9:36 https:\/\/doi.org\/10.1186\/1743-0003-9-36.","journal-title":"J Neuroeng Rehabil"},{"key":"1085_CR2","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1080\/10790268.2003.11753711","volume":"26","author":"TE Johnston","year":"2003","unstructured":"Johnston TE, Finson RL, Smith BT, Bonaroti DM, Betz RR, Mulcahey MJ. Functional electrical stimulation for augmented walking in adolescents with incomplete spinal cord injury. J Spinal Cord Med. 2003;26:390\u2013400. https:\/\/doi.org\/10.1080\/10790268.2003.11753711.","journal-title":"J Spinal Cord Med"},{"key":"1085_CR3","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1097\/NPT.0b013e3181a33624","volume":"33","author":"Y Laufer","year":"2009","unstructured":"Laufer Y, Ring H, Sprecher E, Hausdorff JM. Gait in individuals with chronic hemiparesis: one-year follow-up of the effects of a neuroprosthesis that ameliorates foot drop. J Neurol Phys Ther. 2009;33:104\u201310. https:\/\/doi.org\/10.1097\/NPT.0b013e3181a33624.","journal-title":"J Neurol Phys Ther"},{"key":"1085_CR4","doi-asserted-by":"publisher","first-page":"628","DOI":"10.1038\/s41393-018-0097-8","volume":"56","author":"M Bolliger","year":"2018","unstructured":"Bolliger M, Blight AR, Field-Fote EC, Musselman K, Rossignol S, Barth\u00e9lemy D, et al. Lower extremity outcome measures: considerations for clinical trials in spinal cord injury. Spinal Cord. 2018;56:628\u201342. https:\/\/doi.org\/10.1038\/s41393-018-0097-8.","journal-title":"Spinal Cord"},{"key":"1085_CR5","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1038\/s41393-017-0015-5","volume":"56","author":"LAT Jones","year":"2018","unstructured":"Jones LAT, Bryden A, Wheeler TL, Tansey KE, Anderson KD, Beattie MS, et al. Considerations and recommendations for selection and utilization of upper extremity clinical outcome assessments in human spinal cord injury trials. Spinal Cord. 2018;56:414\u201325. https:\/\/doi.org\/10.1038\/s41393-017-0015-5.","journal-title":"Spinal Cord"},{"key":"1085_CR6","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1038\/s41393-019-0276-2","volume":"57","author":"AR Blight","year":"2019","unstructured":"Blight AR, Hsieh J, Curt A, Fawcett JW, Guest JD, Kleitman N, et al. The challenge of recruitment for neurotherapeutic clinical trials in spinal cord injury. Spinal Cord. 2019;57:348\u201359. https:\/\/doi.org\/10.1038\/s41393-019-0276-2.","journal-title":"Spinal Cord"},{"key":"1085_CR7","first-page":"857","volume":"70","author":"BD Wright","year":"1989","unstructured":"Wright BD, Linacre JM. Observations are always ordinal: measurements, however, must be interval. Arch Phys Med Rehabil. 1989;70:857\u201360.","journal-title":"Arch Phys Med Rehabil"},{"key":"1085_CR8","doi-asserted-by":"publisher","first-page":"582","DOI":"10.1038\/sc.2009.18","volume":"47","author":"MS Alexander","year":"2009","unstructured":"Alexander MS, Anderson KD, Biering-Sorensen F, Blight AR, Brannon R, Bryce TN, et al. Outcome measures in spinal cord injury: recent assessments and recommendations for future directions. Spinal Cord. 2009;47:582\u201391. https:\/\/doi.org\/10.1038\/sc.2009.18.","journal-title":"Spinal Cord"},{"key":"1085_CR9","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1016\/S1474-4422(07)70290-9","volume":"6","author":"JC Hobart","year":"2007","unstructured":"Hobart JC, Cano SJ, Zajicek JP, Thompson AJ. Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007;6:1094\u2013105. https:\/\/doi.org\/10.1016\/S1474-4422(07)70290-9.","journal-title":"Lancet Neurol"},{"key":"1085_CR10","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1590\/S1679-45082010RW1134","volume":"8","author":"MTD Souza","year":"2010","unstructured":"Souza MTD, Silva MDD, Carvalho RD. Integrative review: what is it? How to do it? Einstein. 2010;8:102\u20136. https:\/\/doi.org\/10.1590\/S1679-45082010RW1134.","journal-title":"Einstein"},{"key":"1085_CR11","doi-asserted-by":"publisher","first-page":"662","DOI":"10.1111\/scs.12327","volume":"30","author":"H Hopia","year":"2016","unstructured":"Hopia H, Latvala E, Liimatainen L. Reviewing the methodology of an integrative review. Scand J Caring Sci. 2016;30:662\u20139. https:\/\/doi.org\/10.1111\/scs.12327.","journal-title":"Scand J Caring Sci"},{"key":"1085_CR12","unstructured":"OCEBM Levels of Evidence Working Group. The Oxford 2011 levels of evidence [Internet]. Centre for Evidence-Based Medicine. http:\/\/www.cebm.net\/index.aspx?o=5653. [Accessed November 17, 2023]."},{"key":"1085_CR13","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1177\/2168479018772569","volume":"53","author":"E Richardson","year":"2019","unstructured":"Richardson E, Burnell J, Adams HR, Bohannon RW, Bush EN, Campbell M, et al. Developing and implementing performance outcome assessments: evidentiary, methodologic, and operational considerations. Ther Innov Regul Sci. 2019;53:146\u201353. https:\/\/doi.org\/10.1177\/2168479018772569.","journal-title":"Ther Innov Regul Sci"},{"key":"1085_CR14","unstructured":"Shirley Ryan AbilityLab. Rehabilitation measures database. https:\/\/www.sralab.org\/rehabilitation-measures. [Accessed November 17, 2023]."},{"key":"1085_CR15","unstructured":"Physiopedia. Outcome measures. https:\/\/www.physio-pedia.com\/Outcome_Measures#:~:text=Rehabilitation%20measures%20database%3A%20developed%20to,records%20with%20keyword%20search%20capability. [Accessed November 17, 2023]."},{"key":"1085_CR16","doi-asserted-by":"publisher","first-page":"e110216","DOI":"10.1371\/journal.pone.0110216","volume":"9","author":"M Calvert","year":"2014","unstructured":"Calvert M, Kyte D, Duffy H, Gheorghe A, Mercieca-Bebber R, Ives J, et al. Patient-reported outcome (PRO) assessment in clinical trials: a systematic review of guidance for trial protocol writers. PLoS ONE. 2014;9:e110216 https:\/\/doi.org\/10.1371\/journal.pone.0110216.","journal-title":"PLoS ONE"},{"key":"1085_CR17","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1136\/bmjebm-2020-111573","volume":"27","author":"S Kluzek","year":"2022","unstructured":"Kluzek S, Dean B, Wartolowska KA. Patient-reported outcome measures (PROMs) as proof of treatment efficacy. BMJ Evid Based Med. 2022;27:153\u20135. https:\/\/doi.org\/10.1136\/bmjebm-2020-111573.","journal-title":"BMJ Evid Based Med"},{"key":"1085_CR18","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1080\/10790268.2008.11760704","volume":"31","author":"K Anderson","year":"2008","unstructured":"Anderson K, Aito S, Atkins M, Biering-Sorenson F, Charlifue S, Curt A, et al. Functional recovery measures for spinal cord injury: an evidence-based review for clinical practice and research. J Spinal Cord Med. 2008;31:133\u201344. https:\/\/doi.org\/10.1080\/10790268.2008.11760704.","journal-title":"J Spinal Cord Med"},{"key":"1085_CR19","doi-asserted-by":"crossref","unstructured":"MacDermid JC, Law M, Michlovitz SL Outcome measurement in evidence-based rehabilitation. In: Law M, MacDermid JC, eds. Evidence-based rehabilitation: a guide to practice. 3rd ed. Thorofare, NJ: Slack Incorporated; 2014:65\u2013104.","DOI":"10.4324\/9781003524106-4"},{"key":"1085_CR20","doi-asserted-by":"publisher","first-page":"980","DOI":"10.1038\/s41393-018-0160-5","volume":"56","author":"H Saberi","year":"2018","unstructured":"Saberi H, Vosoughi F, Derakhshanrad N, Yekaninejad M, Khan ZH, Kohan AH, et al. Development of persian version of the spinal cord independence measure III assessed by interview: a psychometric study. Spinal Cord. 2018;56:980\u20136. https:\/\/doi.org\/10.1038\/s41393-018-0160-5.","journal-title":"Spinal Cord"},{"key":"1085_CR21","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1038\/sc.2017.97","volume":"56","author":"M Itzkovich","year":"2018","unstructured":"Itzkovich M, Shefler H, Front L, Gur-Pollack R, Elkayam K, Bluvshtein V, et al. SCIM III (spinal cord independence measure version III): reliability of assessment by interview and comparison with assessment by observation. Spinal Cord. 2018;56:46\u201351. https:\/\/doi.org\/10.1038\/sc.2017.97.","journal-title":"Spinal Cord"},{"key":"1085_CR22","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1038\/s41393-017-0036-0","volume":"56","author":"MJ Mulcahey","year":"2018","unstructured":"Mulcahey MJ, Thielen C, Sadowsky C, Silvestri JL, Martin R, White L, et al. Despite limitations, the SCIM-III is reproducible and a valid indicator of physical function in youths with spinal cord injury. Spinal Cord. 2018;56:332\u201340. https:\/\/doi.org\/10.1038\/s41393-017-0036-0.","journal-title":"Spinal Cord"},{"key":"1085_CR23","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1038\/s41393-018-0064-4","volume":"56","author":"J Steeves","year":"2018","unstructured":"Steeves J, Curt A, Mehra M, Rupp R, Blight A, Maier D, et al. The spinal cord ability ruler (SCAR) complements the spinal cord independence measure (SCIM). Spinal Cord. 2018;56:525\u20136. https:\/\/doi.org\/10.1038\/s41393-018-0064-4.","journal-title":"Spinal Cord"},{"key":"1085_CR24","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1089\/neu.2007.0468","volume":"25","author":"A Curt","year":"2008","unstructured":"Curt A, Van Hedel HJ, Klaus D, Dietz V, EM-SCI Study Group. Recovery from spinal cord injury: significance of compensation, neural plasticity and repair. J Neurotrauma. 2008;25:677\u201385. https:\/\/doi.org\/10.1089\/neu.2007.0468.","journal-title":"J Neurotrauma"},{"key":"1085_CR25","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1038\/s41393-023-00891-5","volume":"61","author":"RY Kim","year":"2023","unstructured":"Kim RY, Calhoun Thielen CC, Heydeman G, Mulcahey MJ. Standardized administration and scoring guidelines for the spinal cord independence measure version 3.0 (SCIM-III). Spinal Cord. 2023;61:296\u2013306. https:\/\/doi.org\/10.1038\/s41393-023-00891-5.","journal-title":"Spinal Cord"},{"key":"1085_CR26","unstructured":"Thomas Jefferson University. Rehabilitation sciences department. measures & assessments. Spinal cord independence measure (SCIM) version 3. https:\/\/www.jefferson.edu\/academics\/colleges-schools-institutes\/rehabilitation-sciences\/departments\/outcomes-measurement\/measures-assessments\/spinal-corde-independence-measure-v3.html. [Accessed November 17, 2023]."},{"key":"1085_CR27","doi-asserted-by":"publisher","first-page":"7125057","DOI":"10.1155\/2017\/7125057","volume":"2017","author":"MJ Hylin","year":"2017","unstructured":"Hylin MJ, Kerr AL, Holden R. Understanding the mechanisms of recovery and\/or compensation following injury. Neural Plast. 2017;2017:7125057 https:\/\/doi.org\/10.1155\/2017\/7125057.","journal-title":"Neural Plast"},{"key":"1085_CR28","doi-asserted-by":"publisher","first-page":"711388","DOI":"10.3389\/frobt.2021.711388","volume":"8","author":"V Molazadeh","year":"2021","unstructured":"Molazadeh V, Zhang Q, Bao X, Dicianno BE, Sharma N. Shared control of a powered exoskeleton and functional electrical stimulation using iterative learning. Front Robot AI. 2021;8:711388 https:\/\/doi.org\/10.3389\/frobt.2021.711388.","journal-title":"Front Robot AI"},{"key":"1085_CR29","doi-asserted-by":"publisher","first-page":"680","DOI":"10.3389\/fneur.2020.00680","volume":"11","author":"DJ Houston","year":"2020","unstructured":"Houston DJ, Lee JW, Unger J, Masani K, Musselman KE. Functional electrical stimulation plus visual feedback balance training for standing balance performance among individuals with incomplete spinal cord injury: a case series. Front Neurol. 2020;11:680 https:\/\/doi.org\/10.3389\/fneur.2020.00680.","journal-title":"Front Neurol"},{"key":"1085_CR30","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1111\/j.1471-1842.2009.00848.x","volume":"26","author":"MJ Grant","year":"2009","unstructured":"Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26:91\u2013108. https:\/\/doi.org\/10.1111\/j.1471-1842.2009.00848.x.","journal-title":"Health Info Libr J"},{"key":"1085_CR31","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1111\/j.1365-2648.2005.03621.x","volume":"52","author":"R Whittemore","year":"2005","unstructured":"Whittemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005;52:546\u201353. https:\/\/doi.org\/10.1111\/j.1365-2648.2005.03621.x.","journal-title":"J Adv Nurs"},{"key":"1085_CR32","doi-asserted-by":"publisher","first-page":"1518","DOI":"10.1016\/j.apmr.2011.04.027","volume":"93","author":"AL Behrman","year":"2012","unstructured":"Behrman AL, Ardolino E, Vanhiel LR, Kern M, Atkinson D, Lorenz DJ, et al. Assessment of functional improvement without compensation reduces variability of outcome measures after human spinal cord injury. Arch Phys Med Rehabil. 2012;93:1518\u201329. https:\/\/doi.org\/10.1016\/j.apmr.2011.04.027.","journal-title":"Arch Phys Med Rehabil"}],"container-title":["Spinal Cord"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41393-025-01085-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41393-025-01085-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41393-025-01085-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,8]],"date-time":"2025-07-08T09:26:44Z","timestamp":1751966804000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41393-025-01085-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,29]]},"references-count":32,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,7]]}},"alternative-id":["1085"],"URL":"https:\/\/doi.org\/10.1038\/s41393-025-01085-x","relation":{},"ISSN":["1362-4393","1476-5624"],"issn-type":[{"value":"1362-4393","type":"print"},{"value":"1476-5624","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,29]]},"assertion":[{"value":"9 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 March 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 May 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}