{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T01:10:56Z","timestamp":1776301856986,"version":"3.50.1"},"reference-count":31,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,24]],"date-time":"2021-12-24T00:00:00Z","timestamp":1640304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European project EUROBENCH2020 (eurobench2020.eu)","award":["n779963"],"award-info":[{"award-number":["n779963"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recent advances in the control of overground exoskeletons are being centered on improving balance support and decreasing the reliance on crutches. However, appropriate methods to quantify the stability of these exoskeletons (and their users) are still under development. A reliable and reproducible balance assessment is critical to enrich exoskeletons\u2019 performance and their interaction with humans. In this work, we present the BenchBalance system, which is a benchmarking solution to conduct reproducible balance assessments of exoskeletons and their users. Integrating two key elements, i.e., a hand-held perturbator and a smart garment, BenchBalance is a portable and low-cost system that provides a quantitative assessment related to the reaction and capacity of wearable exoskeletons and their users to respond to controlled external perturbations. A software interface is used to guide the experimenter throughout a predefined protocol of measurable perturbations, taking into account antero-posterior and mediolateral responses. In total, the protocol is composed of sixteen perturbation conditions, which vary in magnitude and location while still controlling their orientation. The data acquired by the interface are classified and saved for a subsequent analysis based on synthetic metrics. In this paper, we present a proof of principle of the BenchBalance system with a healthy user in two scenarios: subject not wearing and subject wearing the H2 lower-limb exoskeleton. After a brief training period, the experimenter was able to provide the manual perturbations of the protocol in a consistent and reproducible way. The balance metrics defined within the BenchBalance framework were able to detect differences in performance depending on the perturbation magnitude, location, and the presence or not of the exoskeleton. The BenchBalance system will be integrated at EUROBENCH facilities to benchmark the balance capabilities of wearable exoskeletons and their users.<\/jats:p>","DOI":"10.3390\/s22010119","type":"journal-article","created":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T01:06:54Z","timestamp":1640567214000},"page":"119","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Development and Evaluation of BenchBalance: A System for Benchmarking Balance Capabilities of Wearable Robots and Their Users"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1825-1265","authenticated-orcid":false,"given":"Cristina","family":"Bay\u00f3n","sequence":"first","affiliation":[{"name":"Department of Biomechanical Engineering, University of Twente, 7522 NB Enschede, The Netherlands"},{"name":"Centro de Autom\u00e1tica y Rob\u00f3tica, Universidad Polit\u00e9cnica de Madrid, 28500 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel","family":"Delgado-Oleas","sequence":"additional","affiliation":[{"name":"Centro de Autom\u00e1tica y Rob\u00f3tica, Universidad Polit\u00e9cnica de Madrid, 28500 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1425-6395","authenticated-orcid":false,"given":"Leticia","family":"Avellar","sequence":"additional","affiliation":[{"name":"Centro de Autom\u00e1tica y Rob\u00f3tica, Universidad Polit\u00e9cnica de Madrid, 28500 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francesca","family":"Bentivoglio","sequence":"additional","affiliation":[{"name":"Universit\u00e0 Campus Bio-Medico di Roma, 00128 Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0086-9075","authenticated-orcid":false,"given":"Francesco","family":"Di Tommaso","sequence":"additional","affiliation":[{"name":"Universit\u00e0 Campus Bio-Medico di Roma, 00128 Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nevio L.","family":"Tagliamonte","sequence":"additional","affiliation":[{"name":"Universit\u00e0 Campus Bio-Medico di Roma, 00128 Rome, Italy"},{"name":"Fondazione Santa Lucia, 00179 Rome, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9618-2176","authenticated-orcid":false,"given":"Eduardo","family":"Rocon","sequence":"additional","affiliation":[{"name":"Centro de Autom\u00e1tica y Rob\u00f3tica, Universidad Polit\u00e9cnica de Madrid, 28500 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1534-2348","authenticated-orcid":false,"given":"Edwin H. F.","family":"van Asseldonk","sequence":"additional","affiliation":[{"name":"Department of Biomechanical Engineering, University of Twente, 7522 NB Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9919","DOI":"10.1109\/ACCESS.2017.2690407","article-title":"First Steps Towards Translating HZD Control of Bipedal Robots to Decentralized Control of Exoskeletons","volume":"5","author":"Agrawal","year":"2017","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"62","DOI":"10.3389\/fnbot.2018.00062","article-title":"Stability of Mina V2 for robot-assisted balance and locomotion","volume":"12","author":"Mummolo","year":"2018","journal-title":"Front. Neurorobot."},{"key":"ref_3","first-page":"79","article-title":"Variable ankle stiffness improves balance control: Experiments on a bipedal exoskeleton","volume":"21","author":"Ugurlu","year":"2016","journal-title":"IEEE Trans. Mechatron."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2015","DOI":"10.1109\/TNSRE.2020.3005455","article-title":"Can Momentum Based Control Predict Human Balance Recovery Strategies?","volume":"28","author":"Bayon","year":"2020","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1109\/TBME.2015.2472533","article-title":"Toward Balance Recovery with Leg Prostheses using Neuromuscular Model Control","volume":"63","author":"Thatte","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.1109\/TNSRE.2019.2929544","article-title":"Bio-Inspired Balance Control Assistance Can Reduce Metabolic Energy Consumption in Human Walking","volume":"27","author":"Zhao","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1152\/jn.00127.2016","article-title":"Mechanical effort predicts the selection of ankle over hip strategies in nonstepping postural responses","volume":"116","author":"Afschrift","year":"2016","journal-title":"J. Neurophysiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2059","DOI":"10.1109\/TNSRE.2019.2936383","article-title":"Heuristic-Based Ankle Exoskeleton Control for Co-Adaptive Assistance of Human Locomotion","volume":"27","author":"Jackson","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"46721","DOI":"10.1038\/srep46721","article-title":"An ecologically-controlled exoskeleton can improve balance recovery after slippage","volume":"7","author":"Monaco","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bay\u00f3n, C., Keemink, A., van Mierlo, M., Rampeltshammer, W., van der Kooij, H., and van Asseldonk, E.H.F. (2021). Cooperative ankle-exoskeleton control can reduce effort to recover balance after unexpected disturbances during walking. J. NeuroEng. Rehabil.","DOI":"10.21203\/rs.3.rs-634479\/v1"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/MRA.2015.2448278","article-title":"A unified scheme for humanoids, wearable robots, and humans","volume":"22","author":"Torricelli","year":"2015","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_12","unstructured":"del P\u00f4bil, A.P. (2006, January 9\u201315). Why do We Need Benchmarks in Robotics Research?. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Beijing, China."},{"key":"ref_13","first-page":"239","article-title":"The relevance of clinical balance assessment tools to differentiate balance deficits","volume":"46","author":"Mancini","year":"2010","journal-title":"Eur. J. Phys. Rehabil. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1186\/s12984-017-0273-7","article-title":"Robot-supported assessment of balance in standing and walking","volume":"14","author":"Shirota","year":"2017","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2424","DOI":"10.1016\/j.clinph.2008.07.220","article-title":"The clinical utility of posturography","volume":"119","author":"Visser","year":"2008","journal-title":"Clin. Neurophysiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1002\/mds.25684","article-title":"Objective biomarkers of balance and gait for Parkinson\u2019s disease using body-worn sensors","volume":"28","author":"Horak","year":"2013","journal-title":"Mov. Disord."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.jbiomech.2017.12.021","article-title":"Reduced center of pressure modulation elicits foot placement adjustments, but no additional trunk motion during anteroposterior-perturbed walking","volume":"68","author":"Vlutters","year":"2018","journal-title":"J. Biomech."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Matja\u010di\u0107, Z., Zadravec, M., Bizovi\u010dar, N., Goljar, N., and Olen\u0161ek, A. (2019). Novel Perturbation-Based Approaches Using Pelvis Exoskeleton Robot in Gait and Balance Training After Stroke. Wearable Robotics: Challenges and Trends, Springer.","DOI":"10.1007\/978-3-030-01887-0_18"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1186\/s12984-020-00710-5","article-title":"Assessment of dynamic balancing responses following perturbations during slow walking in relation to clinical outcome measures for high-functioning post-stroke subjects","volume":"17","author":"Andrej","year":"2020","journal-title":"J. NeuroEng. Rehabil."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Emmens, A., Asseldonk, E.V., Masciullo, M., Arquilla, M., Pisotta, I., Tagliamonte, N.L., Tamburella, F., Molinari, M., and Kooij, H.V.D. (2018, January 26\u201329). Improving the Standing Balance of Paraplegics through the use of a Wearable Exoskeleton. Proceedings of the 7th IEEE RAS\/EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Enschede, The Netherlands.","DOI":"10.1109\/BIOROB.2018.8488066"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/j.optlastec.2017.10.006","article-title":"Sensitive zone parameters and curvature radius evaluation for polymer optical fiber curvature sensors","volume":"100","author":"Frizera","year":"2018","journal-title":"Opt. Laser Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.optlastec.2018.09.044","article-title":"Multiplexing technique for quasi-distributed sensors arrays in polymer optical fiber intensity variation-based sensors","volume":"111","author":"Marques","year":"2019","journal-title":"Opt. Laser Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1186\/1743-0003-10-23","article-title":"Identification of the contribution of the ankle and hip joints to multi-segmental balance control","volume":"10","author":"Boonstra","year":"2013","journal-title":"J. NeuroEng. Rehabil."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.medengphy.2019.10.018","article-title":"Validity of using wearable inertial sensors for assessing the dynamics of standing balance","volume":"77","author":"Noamani","year":"2020","journal-title":"Med. Eng. Phys."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/10.362914","article-title":"An Optimal Control Model for Analyzing Human Postural Balance","volume":"42","author":"Kuo","year":"1995","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_26","unstructured":"EUROBENCH (2021, November 12). Eurobench Framework Documentation. Available online: https:\/\/eurobench.github.io\/sofware_documentation\/latest\/data_format.html#Eurobench%20Data%20Format."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Winter, D. (2009). Anthropometry. Biomechanics and Motor Control of Human Movements, John Wiley & Sons Inc.. [4th ed.].","DOI":"10.1002\/9780470549148.ch4"},{"key":"ref_28","first-page":"1","article-title":"Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors","volume":"3","author":"Roetenberg","year":"2013","journal-title":"Xsens Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1186\/s12984-015-0048-y","article-title":"The H2 robotic exoskeleton for gait rehabilitation after stroke: Early findings from a clinical study","volume":"12","author":"Bortole","year":"2015","journal-title":"J. NeuroEng. Rehabil."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3389\/fnbot.2018.00021","article-title":"Posture control-human-inspired approaches for humanoid robot benchmarking: Conceptualizing tests, protocols and analyses","volume":"12","author":"Mergner","year":"2018","journal-title":"Front. Neurorobotics"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"102546","DOI":"10.1016\/j.humov.2019.102546","article-title":"Review of balance recovery in response to external perturbations during daily activities","volume":"69","author":"Tokur","year":"2020","journal-title":"Hum. Mov. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/119\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:53:09Z","timestamp":1760169189000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,24]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010119"],"URL":"https:\/\/doi.org\/10.3390\/s22010119","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,24]]}}}