{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T14:59:07Z","timestamp":1782572347490,"version":"3.54.5"},"reference-count":48,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,1,26]],"date-time":"2021-01-26T00:00:00Z","timestamp":1611619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007707","name":"Istituto Nazionale per l'Assicurazione Contro Gli Infortuni sul Lavoro","doi-asserted-by":"publisher","award":["PR19-RR-P5"],"award-info":[{"award-number":["PR19-RR-P5"]}],"id":[{"id":"10.13039\/501100007707","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>While the research interest for exoskeletons has been rising in the last decades, missing standards for their rigorous evaluation are potentially limiting their adoption in the industrial field. In this context, exoskeletons for worker support have the aim to reduce the physical effort required by humans, with dramatic social and economic impact. Indeed, exoskeletons can reduce the occurrence and the entity of work-related musculoskeletal disorders that often cause absence from work, resulting in an eventual productivity loss. This very urgent and multifaceted issue is starting to be acknowledged by researchers. This article provides a systematic review of the state of the art for functional performance evaluation of low-back exoskeletons for industrial workers. We report the state-of-the-art evaluation criteria and metrics used for such a purpose, highlighting the lack of a standard for this practice. Very few studies carried out a rigorous evaluation of the assistance provided by the device. To address also this topic, the article ends with a proposed framework for the functional validation of low-back exoskeletons for the industry, with the aim to pave the way for the definition of rigorous industrial standards.<\/jats:p>","DOI":"10.3390\/s21030808","type":"journal-article","created":{"date-parts":[[2021,1,26]],"date-time":"2021-01-26T08:29:16Z","timestamp":1611649756000},"page":"808","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":87,"title":["Towards a Functional Performance Validation Standard for Industrial Low-Back Exoskeletons: State of the Art Review"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0505-4361","authenticated-orcid":false,"given":"Mattia","family":"Pesenti","sequence":"first","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0388-6321","authenticated-orcid":false,"given":"Alberto","family":"Antonietti","sequence":"additional","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marta","family":"Gandolla","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Politecnico di Milano, 20156 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alessandra","family":"Pedrocchi","sequence":"additional","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,26]]},"reference":[{"key":"ref_1","first-page":"588","article-title":"Handyman to hardiman","volume":"76","author":"Mosher","year":"1968","journal-title":"Sae Trans."},{"key":"ref_2","first-page":"269","article-title":"Lesion-induced and training-induced brain reorganization","volume":"22","author":"Liepert","year":"2004","journal-title":"Restor. Neurol. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"976","DOI":"10.2340\/16501977-0403","article-title":"Robot-mediated therapy for paretic upper limb of chronic patients following neurological injury","volume":"41","author":"Posteraro","year":"2009","journal-title":"J. Rehabil. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1016\/j.neuron.2020.01.039","article-title":"Advanced Neurotechnologies for the Restoration of Motor Function","volume":"105","author":"Micera","year":"2020","journal-title":"Neuron"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1046\/j.1525-1403.2003.03017.x","article-title":"Robotic orthosis lokomat: A rehabilitation and research tool","volume":"6","author":"Jezernik","year":"2003","journal-title":"Neuromodul. Technol. Neural Interface"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1179\/2045772312Y.0000000003","article-title":"Safety and tolerance of the ReWalk\u2122 exoskeleton suit for ambulation by people with complete spinal cord injury: A pilot study","volume":"35","author":"Zeilig","year":"2012","journal-title":"J. Spinal Cord Med."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bogue, R. (2009). Exoskeletons and robotic prosthetics: A review of recent developments. Ind. Robot. Int. J., 36.","DOI":"10.1108\/01439910910980141"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1109\/TNSRE.2016.2521160","article-title":"State of the art and future directions for lower limb robotic exoskeletons","volume":"25","author":"Young","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_9","unstructured":"Parent-Thirion, A., Biletta, I., Cabrita, J., Vargas, O., Vermeylen, G., Wilczynska, A., and Wilkens, M. Eurofound (2017), Sixth European Working Conditions Survey\u2014Overview Report (2017 Update); Publications Office of the European Union: Luxembourg, Available online: https:\/\/www.eurofound.europa.eu\/publications\/report\/2016\/working-conditions\/sixth-european-working-conditions-survey-overview-report."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fox, S., Aranko, O., Heilala, J., and Vahala, P. (2019). Exoskeletons: Comprehensive, comparative and critical analyses of their potential to improve manufacturing performance. J. Manuf. Technol. Manag., 31.","DOI":"10.1108\/JMTM-01-2019-0023"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bogue, R. (2018). Exoskeletons\u2014A review of industrial applications. Ind. Robot. Int. J., 45.","DOI":"10.1108\/IR-05-2018-0109"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1080\/00140139.2015.1081988","article-title":"Exoskeletons for industrial application and their potential effects on physical work load","volume":"59","author":"Bosch","year":"2016","journal-title":"Ergonomics"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kneller, R., Mongeon, M., Cope, J., Garner, C., and Ternouth, P. (2014). Industry-university collaborations in Canada, Japan, the UK and USA\u2013With emphasis on publication freedom and managing the intellectual property lock-up problem. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0090302"},{"key":"ref_14","unstructured":"Pratt, G.A., and Williamson, M.M. (1995, January 5\u20139). Series elastic actuators. Proceedings of the 1995 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Human Robot Interaction and Cooperative Robots, Pittsburgh, PA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"72","DOI":"10.3389\/frobt.2018.00072","article-title":"Passive back support exoskeleton improves range of motion using flexible beams","volume":"5","author":"Koopman","year":"2018","journal-title":"Front. Robot. AI"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1825","DOI":"10.1007\/s12541-019-00183-0","article-title":"Design and Control of a Lifting Assist Device for Preventing Lower Back Injuries in Industrial Athletes","volume":"20","author":"Lee","year":"2019","journal-title":"Int. J. Precis. Eng. Manuf."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"102272","DOI":"10.1016\/j.mechatronics.2019.102272","article-title":"Design and control of a wearable lower-body exoskeleton for squatting and walking assistance in manual handling works","volume":"63","author":"Sado","year":"2019","journal-title":"Mechatronics"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.apergo.2015.12.003","article-title":"The effects of a passive exoskeleton on muscle activity, discomfort and endurance time in forward bending work","volume":"54","author":"Bosch","year":"2016","journal-title":"Appl. Ergon."},{"key":"ref_19","unstructured":"CYBERDYNE (2020, July 15). HAL Lumbar Type for Labor Support. Available online: https:\/\/www.cyberdyne.jp\/english\/products\/Lumbar_LaborSupport.html."},{"key":"ref_20","unstructured":"SuitX (2020, July 15). BackX. Available online: https:\/\/www.suitx.com\/backx."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Stadler, K.S., Altenburger, R., Schmidhauser, E., Scherly, D., Ortiz, J., Toxiri, S., Mateos, L., and Masood, J. (2017). Robo-mate an exoskeleton for industrial use\u2014Concept and mechanical design. Advances in Cooperative Robotics, World Scientific.","DOI":"10.1142\/9789813149137_0094"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.robot.2014.08.015","article-title":"A light-weight active orthosis for hip movement assistance","volume":"73","author":"Giovacchini","year":"2015","journal-title":"Robot. Auton. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.apergo.2017.11.004","article-title":"Assessment of an active industrial exoskeleton to aid dynamic lifting and lowering manual handling tasks","volume":"68","author":"Huysamen","year":"2018","journal-title":"Appl. Ergon."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wei, W., Zha, S., Xia, Y., Gu, J., and Lin, X. (2020). A Hip Active Assisted Exoskeleton That Assists the Semi-Squat Lifting. Appl. Sci., 10.","DOI":"10.3390\/app10072424"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"011002","DOI":"10.1115\/1.4031798","article-title":"Design and preliminary evaluation of a passive spine exoskeleton","volume":"10","author":"Zhang","year":"2016","journal-title":"J. Med Devices"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wehner, M., Rempel, D., and Kazerooni, H. (2009, January 12\u201314). Lower extremity exoskeleton reduces back forces in lifting. Proceedings of the Dynamic Systems and Control Conference, Hollywood, CA, USA.","DOI":"10.1115\/DSCC2009-2644"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Baltrusch, S., Houdijk, H., van Die\u00ebn, J., and Kruif, J. (2020). Passive Trunk Exoskeleton Acceptability and Effects on Self-efficacy in Employees with Low-Back Pain: A Mixed Method Approach. J. Occup. Rehabil.","DOI":"10.1007\/s10926-020-09891-1"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/s00421-019-04284-6","article-title":"SPEXOR passive spinal exoskeleton decreases metabolic cost during symmetric repetitive lifting","volume":"120","author":"Baltrusch","year":"2020","journal-title":"Eur. J. Appl. Physiol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"109486","DOI":"10.1016\/j.jbiomech.2019.109486","article-title":"Effects of a passive back exoskeleton on the mechanical loading of the low-back during symmetric lifting","volume":"102","author":"Koopman","year":"2020","journal-title":"J. Biomech."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"109795","DOI":"10.1016\/j.jbiomech.2020.109795","article-title":"Biomechanical evaluation of a new passive back support exoskeleton","volume":"105","author":"Koopman","year":"2020","journal-title":"J. Biomech."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kozinc, \u017d., Baltrusch, S., Houdijk, H., and \u0160arabon, N. (2020). Short-Term Effects of a Passive Spinal Exoskeleton on Functional Performance, Discomfort and User Satisfaction in Patients with Low Back Pain. J. Occup. Rehabil., 1\u201311.","DOI":"10.1007\/s10926-020-09899-7"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103117","DOI":"10.1016\/j.apergo.2020.103117","article-title":"Reliability of a battery of tests for functional evaluation of trunk exoskeletons","volume":"86","author":"Kozinc","year":"2020","journal-title":"Appl. Ergon."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1177\/0018720819890966","article-title":"Biomechanical evaluation of passive back-support exoskeletons in a precision manual assembly task: \u201cExpected\u201d effects on trunk muscle activity, perceived exertion, and task performance","volume":"62","author":"Madinei","year":"2020","journal-title":"Hum. Factors"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1080\/00140139.2019.1602288","article-title":"The effect of a passive trunk exoskeleton on metabolic costs during lifting and walking","volume":"62","author":"Baltrusch","year":"2019","journal-title":"Ergonomics"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.jbiomech.2018.11.033","article-title":"Effects of a passive exoskeleton on the mechanical loading of the low back in static holding tasks","volume":"83","author":"Koopman","year":"2019","journal-title":"J. Biomech."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.jbiomech.2019.04.044","article-title":"The effect of control strategies for an active back-support exoskeleton on spine loading and kinematics during lifting","volume":"91","author":"Koopman","year":"2019","journal-title":"J. Biomech."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.jocn.2019.01.038","article-title":"Effectiveness of an on-body lifting aid (HAL\u00ae for care support) to reduce lower back muscle activity during repetitive lifting tasks","volume":"63","author":"Yilmaz","year":"2019","journal-title":"J. Clin. Neurosci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.apergo.2018.04.007","article-title":"The effect of a passive trunk exoskeleton on functional performance in healthy individuals","volume":"72","author":"Baltrusch","year":"2018","journal-title":"Appl. Ergon."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/MRA.2019.2954160","article-title":"Testing an Exoskeleton that Helps Workers with Low-Back Pain: Less Discomfort with the Passive SPEXOR Trunk Device","volume":"27","author":"Baltrusch","year":"2019","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1080\/24725838.2019.1573770","article-title":"Subjective evaluation of a passive industrial exoskeleton for lower-back support: A field study in the automotive sector","volume":"7","author":"Hensel","year":"2019","journal-title":"IISE Trans. Occup. Ergon. Hum. Factors"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.jocn.2018.04.057","article-title":"The hybrid assistive limb (HAL) for Care Support successfully reduced lumbar load in repetitive lifting movements","volume":"53","author":"Miura","year":"2018","journal-title":"J. Clin. Neurosci."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lanotte, F., Grazi, L., Chen, B., Vitiello, N., and Crea, S. (2018, January 26\u201329). A low-back exoskeleton can reduce the erector spinae muscles activity during freestyle symmetrical load lifting tasks. Proceedings of the 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob), Enschede, The Netherlands.","DOI":"10.1109\/BIOROB.2018.8488094"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1111\/j.1748-1716.1976.tb00241.x","article-title":"Effect of strength training on EMG of human skeletal muscle","volume":"98","author":"Thorstensson","year":"1976","journal-title":"Acta Physiol. Scand."},{"key":"ref_44","unstructured":"Hermens, H., and Freriks, B. (1997). The State of the Art on Sensors and Sensor Placement Procedures for sUrface Electromyography: A Proposal for Sensor Placement Procedures, Roessingh Research and Development. Deliverable of the SENIAM Project."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/S0167-9457(96)00034-6","article-title":"Validation of a full body 3-D dynamic linked segment model","volume":"15","author":"Kingma","year":"1996","journal-title":"Hum. Mov. Sci."},{"key":"ref_46","unstructured":"Fleiss, J.L. (2011). Design and Analysis of Clinical Experiments, John Wiley & Sons."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Torricelli, D., and Pons, J.L. (2018). EUROBENCH: Preparing robots for the real world. International Symposium on Wearable Robotics, Springer.","DOI":"10.1007\/978-3-030-01887-0_72"},{"key":"ref_48","unstructured":"Maugliani, N., Caimmi, M., Malosio, M., Airoldi, F., Borro, D., Rosquete, D., Sergio, A., Giusino, D., Fraboni, F., and Ranieri, G. (2020, September 28). Lower-Limbs Exoskeletons Benchmark Exploiting a Stairs-Based Testbed: The STEPbySTEP Project. Available online: https:\/\/www.researchgate.net\/profile\/Loris_Roveda\/publication\/344403172_Lower-Limbs_Exoskeletons_Benchmark_Exploiting_a_Stairs-Based_Testbed_the_STEPbySTEP_Project\/links\/5f71c84692851c14bc9ade0c\/Lower-Limbs-Exoskeletons-Benchmark-Exploiting-a-Stairs-Based-Testbed-the-STEPbySTEP-Project.pdf."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/808\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:15:25Z","timestamp":1760159725000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/808"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,26]]},"references-count":48,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21030808"],"URL":"https:\/\/doi.org\/10.3390\/s21030808","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,26]]}}}