{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T10:28:10Z","timestamp":1776680890028,"version":"3.51.2"},"reference-count":48,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,4,29]],"date-time":"2021-04-29T00:00:00Z","timestamp":1619654400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["779966"],"award-info":[{"award-number":["779966"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Human\u2013robot collaboration is currently one of the frontiers of industrial robot implementation. In parallel, the use of robots and robotic devices is increasing in several fields, substituting humans in \u201c4D\u201d\u2014dull, dirty, dangerous, and delicate\u2014tasks, and such a trend is boosted by the recent need for social distancing. New challenges in safety assessment and verification arise, due to both the closer and closer human\u2013robot interaction, common for the different application domains, and the broadening of user audience, which is now very diverse. The present paper discusses a cross-domain approach towards the definition of step-by-step validation procedures for collaborative robotic applications. To outline the context, the standardization framework is analyzed, especially from the perspective of safety testing and assessment. Afterwards, some testing procedures based on safety skills, developed within the framework of the European project COVR, are discussed and exemplary presented.<\/jats:p>","DOI":"10.3390\/robotics10020065","type":"journal-article","created":{"date-parts":[[2021,4,30]],"date-time":"2021-04-30T05:10:55Z","timestamp":1619759455000},"page":"65","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":89,"title":["Validating Safety in Human\u2013Robot Collaboration: Standards and New Perspectives"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4663-9865","authenticated-orcid":false,"given":"Marcello","family":"Valori","sequence":"first","affiliation":[{"name":"Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, 20133 Milan, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1521-2108","authenticated-orcid":false,"given":"Adriano","family":"Scibilia","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, 20133 Milan, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6144-2123","authenticated-orcid":false,"given":"Irene","family":"Fassi","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy, 20133 Milan, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5746-9200","authenticated-orcid":false,"given":"Jos\u00e9","family":"Saenz","sequence":"additional","affiliation":[{"name":"Fraunhofer IFF, 39106 Magdeburg, Germany"}]},{"given":"Roland","family":"Behrens","sequence":"additional","affiliation":[{"name":"Fraunhofer IFF, 39106 Magdeburg, Germany"}]},{"given":"Sebastian","family":"Herbster","sequence":"additional","affiliation":[{"name":"Fraunhofer IFF, 39106 Magdeburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0083-1448","authenticated-orcid":false,"given":"Catherine","family":"Bidard","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris-Saclay, CEA List, F-91120 Palaiseau, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9702-3473","authenticated-orcid":false,"given":"Eric","family":"Lucet","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris-Saclay, CEA List, F-91120 Palaiseau, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9090-2379","authenticated-orcid":false,"given":"Alice","family":"Magisson","sequence":"additional","affiliation":[{"name":"CEA, CEA Tech Grand Est, F-57075 Metz, France"}]},{"given":"Leendert","family":"Schaake","sequence":"additional","affiliation":[{"name":"Roessingh Research and Development, 7522 AH Enschede, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7283-917X","authenticated-orcid":false,"given":"Jule","family":"Bessler","sequence":"additional","affiliation":[{"name":"Roessingh Research and Development, 7522 AH Enschede, The Netherlands"},{"name":"Department of Biomedical Signals and Systems, University of Twente, 7522 NB Enschede, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4304-8365","authenticated-orcid":false,"given":"Gerdienke B.","family":"Prange-Lasonder","sequence":"additional","affiliation":[{"name":"Roessingh Research and Development, 7522 AH Enschede, The Netherlands"},{"name":"Department of Biomechanical Engineering, University of Twente, 7522 NB Enschede, The Netherlands"}]},{"given":"Morten","family":"K\u00fchnrich","sequence":"additional","affiliation":[{"name":"Department of Robot Technology, Danish Technological Institute, 5230 Odense, Denmark"}]},{"given":"Aske B.","family":"Lassen","sequence":"additional","affiliation":[{"name":"Department of Robot Technology, Danish Technological Institute, 5230 Odense, Denmark"}]},{"given":"Kurt","family":"Nielsen","sequence":"additional","affiliation":[{"name":"Department of Robot Technology, Danish Technological Institute, 5230 Odense, Denmark"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.mechatronics.2018.02.009","article-title":"Survey on human\u2013robot collaboration in industrial settings: Safety, intuitive interfaces and applications","volume":"55","author":"Villani","year":"2018","journal-title":"Mechatronics"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1007\/s10514-017-9677-2","article-title":"Progress and prospects of the human\u2013robot collaboration","volume":"42","author":"Ajoudani","year":"2018","journal-title":"Auton. Robot."},{"key":"ref_3","unstructured":"IFR (2021, January 30). World Robotic Report 2020. Available online: https:\/\/ifr.org\/ifr-press-releases\/news\/record-2.7-million-robots-work-in-factories-around-the-globe."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1007\/s00464-018-6079-2","article-title":"Review of emerging surgical robotic technology","volume":"32","author":"Peters","year":"2018","journal-title":"Surg. Endosc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1145\/3127874","article-title":"Healthcare robotics","volume":"60","author":"Riek","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Duckett, T., Pearson, S., Blackmore, S., Grieve, B., Wilson, P., Gill, H., Hunter, A.J., and Georgilas, I. (2018). Agricultural Robotics: The Future of Robotic Agriculture, UK-RAS Network.","DOI":"10.31256\/WP2018.2"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e59","DOI":"10.3802\/jgo.2020.31.e59","article-title":"Robot assisted surgery during the COVID-19 pandemic, especially for gyne-cological cancer: A statement of the Society of European Robotic Gynaecological Surgery (SERGS)","volume":"31","author":"Kimmig","year":"2020","journal-title":"J. Gynecol. Oncol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tavakoli, M., Carriere, J., and Torabi, A. (2020). Robotics, smart wearable technologies, and autonomous intelligent systems for healthcare during the COVID-19 pandemic: An analysis of the state of the art and future vision. Adv. Intell. Syst., 2.","DOI":"10.1002\/aisy.202000071"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1080\/14616688.2020.1762118","article-title":"From high-touch to high-tech: COVID-19 drives robotics adoption","volume":"22","author":"Zeng","year":"2020","journal-title":"Tour. Geogr."},{"key":"ref_10","unstructured":"(2021, January 30). Good Work Charter of the European Robotics Industry. EUnited Robotics. Available online: https:\/\/www.eu-nited.net\/eunited+aisbl\/robotics\/news\/european-charter-for-robots-and-humans-released-by-engineering-association-eunited.html."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vasic, M., and Billard, A. (2013, January 6\u201310). Safety issues in human-robot interactions. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630576"},{"key":"ref_12","unstructured":"Guiochet, J., Do Hoang, Q.A., Ka\u00e2niche, M., and Powell, D. (2012, January 7\u201312). Applying Existing Standards to a Medical Rehabilitation Robot: Limits and Challenges. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"102048","DOI":"10.1016\/j.rcim.2020.102048","article-title":"Safe collaborative assembly on a continuously moving line with large industrial robots","volume":"67","author":"Gopinath","year":"2021","journal-title":"Robot. Comput. Manuf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2313","DOI":"10.1007\/s00170-020-05076-5","article-title":"Methods for considering safety in design of robotics applications featuring human-robot collaboration","volume":"107","author":"Saenz","year":"2020","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"101998","DOI":"10.1016\/j.rcim.2020.101998","article-title":"Emerging research fields in safety and ergonomics in industrial collaborative robotics: A systematic literature review","volume":"67","author":"Gualtieri","year":"2021","journal-title":"Robot. Comput. Manuf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1109\/TSMC.2020.3041231","article-title":"Survey of human\u2013robot collaboration in industrial settings: Awareness, intelligence, and compliance","volume":"51","author":"Kumar","year":"2021","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1109\/TASE.2013.2237904","article-title":"Performance metrics of speed and separation monitoring in shared workspaces","volume":"10","author":"Marvel","year":"2013","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_18","unstructured":"European Parliament (2006). Directive 2006\/42\/EC on Machinery, European Parliament."},{"key":"#cr-split#-ref_19.1","unstructured":"European Parliament (2017). Regulation"},{"key":"#cr-split#-ref_19.2","unstructured":"(EU) 2017\/745 on Medical Devices, European Parliament."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bessler, J., Prange-Lasonder, G.B., Schaake, L., Saenz, J.F., Bidard, C., Fassi, I., Valori, M., Lassen, A.B., and Buurke, J.H. (2021). Safety assessment of rehabilitation robots: A review identifying safety skills and current knowledge gaps. Front. Robot. AI, 8.","DOI":"10.3389\/frobt.2021.602878"},{"key":"ref_21","unstructured":"European Parliament (2001). Directive 2001\/95\/EC on General Product Safety, European Parliament."},{"key":"ref_22","unstructured":"European Parliament (2013). Low Voltage Directive 2014\/13\/EU, European Parliament."},{"key":"ref_23","unstructured":"European Parliament (2014). Directive 2014\/30\/EU on the Harmonization of the Laws of the Member States Relating to Electromagnetic Compatibility, European Parliament."},{"key":"ref_24","unstructured":"European Parliament (2014). Radio Equipment Directive 2014\/53\/EU, European Parliament."},{"key":"ref_25","unstructured":"COVR (2021, January 30). Toolkit. Available online: https:\/\/www.safearoundrobots.com\/home."},{"key":"ref_26","unstructured":"ISO 12100:2010 (2010). Safety of Machinery\u2014General Principles for Design\u2014Risk Assessment and Risk Reduction, International Or-ganization for Standardization."},{"key":"ref_27","unstructured":"ISO 14971:2019 (2019). Medical Devices\u2014Application of Risk Management to Medical Devices, International Organization for Standardization."},{"key":"ref_28","unstructured":"ISO 10218-1:2011 (2011). Robots and Robotic Devices\u2014Safety Requirements for Industrial Robots\u2014Part 1: Robots, International Organization for Standardization."},{"key":"ref_29","unstructured":"ISO 10218-2:2011 (2011). Robots and Robotic Devices\u2014Safety Requirements for Industrial Robots\u2014Part 2: Robot Systems and Inte-gration, International Organization for Standardization."},{"key":"ref_30","unstructured":"ISO\/TS 15066:2016 (2016). Robots and Robotic Devices\u2014Collaborative Robots, International Organization for Standardization."},{"key":"ref_31","unstructured":"ISO 13855:2010 (2010). Safety of Machinery\u2014Positioning of Safeguards with Respect to the Approach Speeds of Parts of the Human Body, International Organization for Standardization."},{"key":"ref_32","unstructured":"ISO 18497:2018 (2018). Agricultural Machinery and Tractors\u2014Safety of Highly Automated Machinery, International Organization for Standardization."},{"key":"ref_33","unstructured":"ISO 13851:2019 (2019). Safety of Machinery\u2014Two-Hand Control Devices\u2014Principles for Design and Selection, International Organi-zation for Standardization."},{"key":"ref_34","unstructured":"ISO 13482:2014 (2014). Robots and Robotic Devices\u2014Safety Requirements for Personal Care Robots, International Organization for Standardization."},{"key":"ref_35","unstructured":"ISO 3691-4:2020 (2020). Industrial Trucks\u2014Safety Requirements and Verification\u2014Part 4: Driverless Industrial Trucks and Their Systems, International Organization for Standardization."},{"key":"ref_36","unstructured":"IEC 80601-2-78:2020 (2020). Medical Electrical Equipment\u2014Part 2-78: Particular Requirements for Basic Safety and Essential Performance of Medical Robots for Rehabilitation, Assessment, Compensation or Alleviation, International Electrotechnical Commission."},{"key":"ref_37","unstructured":"ISO\/TR 23482-1:2020 (2020). Application of ISO 13482\u2014Part 1: Safety-Related Test Methods, International Organization for Stand-ardization."},{"key":"ref_38","unstructured":"ISO\/TR 20218-1:2018 (2018). Robotics\u2014Safety Design for Industrial Robot Systems\u2014Part 1: End-Effectors, International Organization for Standardization."},{"key":"ref_39","unstructured":"ISO\/TR 20218-2:2017 (2017). Robotics\u2014Safety Requirements for Industrial Robots\u2014Part 2: Manual Load\/Unload Stations, International Organization for Standardization."},{"key":"ref_40","unstructured":"ISO\/DIS 10218-2:2020 (2020). Robotics\u2014Safety Requirements for Robot Systems in an Industrial Environment\u2014Part 2: Robot Systems, Robot Applications and Robot Cells Integration, International Organization for Standardization."},{"key":"ref_41","unstructured":"ISO 18646-1:2016 (2016). Robotics\u2014Performance Criteria and Related Test Methods for Service Robots\u2014Part 1: Locomotion for Wheeled Robots, International Organization for Standardization."},{"key":"ref_42","unstructured":"ISO 18646-2:2019 (2019). Robotics\u2014Performance Criteria and Related Test Methods for Service Robots\u2014Part 2: Navigation, International Organization for Standardization."},{"key":"ref_43","unstructured":"Saenz, J., Lassen, A.B., Bidard, C., Burke, J.H., Nielsen, K., Schaake, L., and Vicentini, F. (2018, January 10\u201312). COVR\u2014Towards simplified evaluation and validation of collaborative robotics applications across a wide range of domains using robot safety skills. Proceedings of the 9th International Conference on Safety of Industrial Automated Systems (SIAS), Nancy, France."},{"key":"ref_44","unstructured":"Collaborative robot systems (2017). Design of Systems with \"Power and Force Limiting\" Function, Fachbereich Holz und Metall, German Social Accident Insurance (DGUV)."},{"key":"ref_45","unstructured":"CEN (1997). EN 1525-Safety of Industrial Trucks\u2014Driverless Trucks and Their Systems, European Committee for Standardization."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Herbster, S., Behrens, R., and Elkmann, N. (2021). A New Conversion Method to Evaluate the Hazard Potential of Collaborative Robots in Free Collisions. Experimental Robotics, Springer International Publishing.","DOI":"10.1007\/978-3-030-71151-1_20"},{"key":"ref_47","first-page":"2041669517708205","article-title":"The accuracy and precision of position and orientation tracking in the HTC vive virtual reality system for scientific research","volume":"8","author":"Diederick","year":"2017","journal-title":"I-Perception"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/2\/65\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:55:18Z","timestamp":1760162118000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/2\/65"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,29]]},"references-count":48,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["robotics10020065"],"URL":"https:\/\/doi.org\/10.3390\/robotics10020065","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,29]]}}}