{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T16:58:38Z","timestamp":1780505918072,"version":"3.54.1"},"reference-count":47,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,6,30]],"date-time":"2022-06-30T00:00:00Z","timestamp":1656547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Interreg Grande R\u00e9gion \u201cRobotix Academy\u201d project"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>There has been a rapid increase in the use of collaborative robots in manufacturing industries within the context of Industry 4.0 and smart factories. The existing human\u2013robot interactions, simulations, and robot programming methods do not fit into these fast-paced technological advances as they are time-consuming, require engineering expertise, waste a lot of time in programming and the interaction is not trivial for non-expert operators. To tackle these challenges, we propose a digital twin (DT) approach for human\u2013robot interactions (HRIs) in hybrid teams in this paper. We achieved this using Industry 4.0 enabling technologies, such as mixed reality, the Internet of Things, collaborative robots, and artificial intelligence. We present a use case scenario of the proposed method using Microsoft Hololens 2 and KUKA IIWA collaborative robot. The obtained results indicated that it is possible to achieve efficient human\u2013robot interactions using these advanced technologies, even with operators who have not been trained in programming. The proposed method has further benefits, such as real-time simulation in natural environments and flexible system integration to incorporate new devices (e.g., robots or software capabilities).<\/jats:p>","DOI":"10.3390\/s22134950","type":"journal-article","created":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T01:40:36Z","timestamp":1656639636000},"page":"4950","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":101,"title":["Digital Twin for Human\u2013Robot Interactions by Means of Industry 4.0 Enabling Technologies"],"prefix":"10.3390","volume":"22","author":[{"given":"Abir","family":"Gallala","sequence":"first","affiliation":[{"name":"Department of Engineering, University of Luxembourg, 6, Rue-Kalergi, L-1359 Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atal Anil","family":"Kumar","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Luxembourg, 6, Rue-Kalergi, L-1359 Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bassem","family":"Hichri","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Luxembourg, 6, Rue-Kalergi, L-1359 Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3507-1397","authenticated-orcid":false,"given":"Peter","family":"Plapper","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Luxembourg, 6, Rue-Kalergi, L-1359 Luxembourg, Luxembourg"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Aryania, A., Daniel, B., Thomessen, T., and Sziebig, G. (2012, January 2\u20135). New trends in industrial robot controller user interfaces. Proceedings of the 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), Kosice, Slovakia.","DOI":"10.1109\/CogInfoCom.2012.6422007"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1109\/ETFA46521.2020.9212127","article-title":"Towards safe human robot collaboration-Risk assessment of intelligent automation","volume":"Volume 1","author":"Hanna","year":"2020","journal-title":"Proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA)"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1016\/j.procir.2019.03.172","article-title":"Human centered Lean automation in assembly","volume":"81","author":"Malik","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ostanin, M., Mikhel, S., Evlampiev, A., Skvortsova, V., and Klimchik, A. (August, January 31). Human-robot interaction for robotic manipulator programming in Mixed Reality. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196965"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.promfg.2018.02.034","article-title":"Industry 4.0\u2014A glimpse","volume":"20","author":"Vaidya","year":"2018","journal-title":"Procedia Manuf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1002\/qre.2948","article-title":"The digital twin in Industry 4.0: A wide-angle perspective","volume":"38","author":"Kenett","year":"2022","journal-title":"Qual. Reliab. Eng. Int."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Moiceanu, G., and Paraschiv, G. (2022). Digital Twin and Smart Manufacturing in Industries: A Bibliometric Analysis with a Focus on Industry 4.0. Sensors, 22.","DOI":"10.3390\/s22041388"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Maruyama, T., Ueshiba, T., Tada, M., Toda, H., Endo, Y., Domae, Y., Nakabo, Y., Mori, T., and Suita, K. (2021). Digital Twin-Driven Human Robot Collaboration Using a Digital Human. Sensors, 21.","DOI":"10.3390\/s21248266"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.jmsy.2020.06.017","article-title":"Review of digital twin about concepts, technologies, and industrial applications","volume":"58","author":"Liu","year":"2021","journal-title":"J. Manuf. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"26754","DOI":"10.1109\/ACCESS.2017.2773127","article-title":"Working together: A review on safe human-robot collaboration in industrial environments","volume":"5","author":"Becerra","year":"2017","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.promfg.2018.10.047","article-title":"Digital twins of human robot collaboration in a production setting","volume":"17","author":"Malik","year":"2018","journal-title":"Procedia Manuf."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.promfg.2018.12.020","article-title":"Digital twin for adaptation of robots\u2019 behavior in flexible robotic assembly lines","volume":"28","author":"Kousi","year":"2019","journal-title":"Procedia Manuf."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s43154-020-00005-6","article-title":"Review of interfaces for industrial human-robot interaction","volume":"1","author":"Berg","year":"2020","journal-title":"Curr. Robot. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"012011","DOI":"10.1088\/1757-899X\/1140\/1\/012011","article-title":"User-centered design for Human-Robot Collaboration systems","volume":"1140","author":"Pizzagalli","year":"2021","journal-title":"Proc. Iop Conf. Ser. Mater. Sci. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.rcim.2018.07.006","article-title":"The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans","volume":"55","author":"Oyekan","year":"2019","journal-title":"Robot.-Comput.-Integr. Manuf."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Burghardt, A., Szybicki, D., Gierlak, P., Kurc, K., Pietru\u015b, P., and Cygan, R. (2020). Programming of industrial robots using virtual reality and digital twins. Appl. Sci., 10.","DOI":"10.3390\/app10020486"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"010804","DOI":"10.1115\/1.4039145","article-title":"A Review of Intent Detection, Arbitration, and Communication Aspects of Shared Control for Physical Human\u2013Robot Interaction","volume":"70","author":"Losey","year":"2018","journal-title":"Appl. Mech. Rev."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1089\/cyber.2020.0181","article-title":"Relationship Development with Humanoid Social Robots: Applying Interpersonal Theories to Human-Robot Interaction","volume":"24","author":"Fox","year":"2021","journal-title":"Cyberpsychol. Behav. Soc. Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7989","DOI":"10.1109\/LRA.2021.3100603","article-title":"Autonomy in physical human-robot interaction: A brief survey","volume":"6","author":"Selvaggio","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Heimann, O., and Guhl, J. (2020, January 8\u201311). Industrial Robot Programming Methods: A Scoping Review. Proceedings of the IEEE International Conference on Emerging Technologies and Factory Automation, ETFA, Vienna, Austria.","DOI":"10.1109\/ETFA46521.2020.9211997"},{"key":"ref_21","unstructured":"Gray, S.V., Wilson, J.R., and Syan, C.S. (1992). Human Control of Robot Motion: Orientation, Perception and Compatibility. Human-Robot Interaction, Taylor & Francis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.robot.2008.10.024","article-title":"A survey of robot learning from demonstration","volume":"57","author":"Argall","year":"2009","journal-title":"Robot. Auton. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"896","DOI":"10.1016\/j.robot.2013.02.005","article-title":"Direct off-line robot programming via a common CAD package","volume":"61","author":"Neto","year":"2013","journal-title":"Robot. Auton. Syst."},{"key":"ref_24","unstructured":"Owen-Hill, A. (2022, April 22). What Are the Different Programming Methods for Robots?. Available online: https:\/\/blog.robotiq.com\/what-are-the-different-programming-methods-for-robots."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bolano, G., Roennau, A., Dillmann, R., and Groz, A. (2020, January 22\u201326). Virtual Reality for Offline Programming of Robotic Applications with Online Teaching Methods. Proceedings of the 2020 17th International Conference on Ubiquitous Robots, UR 2020, Kyoto, Japan.","DOI":"10.1109\/UR49135.2020.9144806"},{"key":"ref_26","first-page":"13","article-title":"Robot Programming Using Augmented Reality","volume":"15","author":"Fang","year":"2009","journal-title":"Environment"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.rcim.2011.08.004","article-title":"Recent progress on programming methods for industrial robots","volume":"28","author":"Pan","year":"2012","journal-title":"Robot.-Comput.-Integr. Manuf."},{"key":"ref_28","unstructured":"Fang, H. (2012). Robot Programming Using Augmented Reality. [Ph.D. Thesis, National University of Singapore]."},{"key":"ref_29","first-page":"154798","article-title":"Reengineering aircraft structural life prediction using a digital twin","volume":"2021","author":"Tuegel","year":"2011","journal-title":"Int. J. Aerosp. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Glaessgen, E.H., and Stargel, D.S. (2012, January 23\u201326). The digital twin paradigm for future NASA and U.S. Air force vehicles. Proceedings of the Collection of Technical Papers\u2014AIAA\/ASME\/ASCE\/AHS\/ASC Structures, Structural Dynamics and Materials Conference, Austin, TX, USA.","DOI":"10.2514\/6.2012-1818"},{"key":"ref_31","unstructured":"NASA (2010). DRAFT Modeling, Simulation, information Technology & Processing Roadmap\u2014Technology Area 11."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Warke, V., Kumar, S., Bongale, A., and Kotecha, K. (2021). Sustainable development of smart manufacturing driven by the digital twin framework: A statistical analysis. Sustainability, 13.","DOI":"10.3390\/su131810139"},{"key":"ref_33","unstructured":"Immerman, D. (2019). The Evolution of Digital Twin\u2014And How Emerging Tech Is Driving Adoption, PTC."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kumar, A.A., Moueza, Y., Kolla, S.S.V.K., and Plapper, P. (2022, January 11\u201313). Intuitive human-robot interaction using augmented reality: A simulation study on KUKA IIWA robot. Proceedings of the 12th Conference on Learning Factories (CLF 2022), Singapore.","DOI":"10.2139\/ssrn.4076781"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ramasubramanian, A.K., Mathew, R., Kelly, M., Hargaden, V., and Papakostas, N. (2022). Digital Twin for Human\u2013Robot Collaboration in Manufacturing: Review and Outlook. Appl. Sci., 12.","DOI":"10.3390\/app12104811"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sievers, T.S., Schmitt, B., R\u00fcckert, P., Petersen, M., and Tracht, K. (2020, January 3\u20134). Concept of a mixed-reality learning environment for collaborative robotics. Proceedings of the Procedia Manufacturing, Granfield, UK.","DOI":"10.1016\/j.promfg.2020.04.034"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, X., Liang, C.J., Menassa, C.C., and Kamat, V.R. (2020, January 27\u201328). Real-time process-level digital twin for collaborative human-robot constructionwork. Proceedings of the 37th International Symposium on Automation and Robotics in Construction, ISARC 2020: From Demonstration to Practical Use\u2014To New Stage of Construction Robot, Kitakyushu, Japan.","DOI":"10.22260\/ISARC2020\/0212"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Garg, G., Kuts, V., and Anbarjafari, G. (2021). Digital twin for fanuc robots: Industrial robot programming and simulation using virtual reality. Sustainability, 13.","DOI":"10.3390\/su131810336"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"128","DOI":"10.5604\/01.3001.0013.0464","article-title":"Digital twin based synchronised control and simulation of the industrial robotic cell using virtual reality","volume":"19","author":"Kuts","year":"2019","journal-title":"J. Mach. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"20325","DOI":"10.1109\/ACCESS.2019.2897018","article-title":"Prototyping a Digital Twin for Real Time Remote Control over Mobile Networks: Application of Remote Surgery","volume":"7","author":"Laaki","year":"2019","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"519","DOI":"10.3390\/jcp1030026","article-title":"Augmented Reality and the Digital Twin: State-of-the-Art and Perspectives for Cybersecurity","volume":"1","author":"Dietz","year":"2021","journal-title":"J. Cybersecur. Priv."},{"key":"ref_42","unstructured":"KUKA (2018). LBR Iiwa, KUKA."},{"key":"ref_43","unstructured":"(2022). HoloLens 2\u2014Overview, Features, and Specs, Microsoft HoloLens."},{"key":"ref_44","unstructured":"Vuforia (2022, April 22). SDK Download|Vuforia Developer Portal. Available online: https:\/\/developer.vuforia.com\/downloads\/SDK."},{"key":"ref_45","unstructured":"(2022). MoveIt Motion Planning Framework, Ipswitch, Inc."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., and Abbeel, P. (2017, January 24\u201328). Domain randomization for transferring deep neural networks from simulation to the real world. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8202133"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Gallala, A., Hichri, B., and Plapper, P. (2021, January 9\u201310). Human-Robot Interaction using Mixed Reality. Proceedings of the 2021 International Conference on Electrical, Computer and Energy Technologies (ICECET), Cape Town, South Africa.","DOI":"10.1109\/ICECET52533.2021.9698248"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4950\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:41:23Z","timestamp":1760139683000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4950"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,30]]},"references-count":47,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22134950"],"URL":"https:\/\/doi.org\/10.3390\/s22134950","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,30]]}}}