{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T09:48:12Z","timestamp":1767260892291,"version":"build-2065373602"},"reference-count":17,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T00:00:00Z","timestamp":1630886400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010686","name":"H2020 European Institute of Innovation and Technology","doi-asserted-by":"publisher","award":["KIC MirrorLabs2-21086"],"award-info":[{"award-number":["KIC MirrorLabs2-21086"]}],"id":[{"id":"10.13039\/100010686","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The world is living the fourth industrial revolution, marked by the increasing intelligence and automation of manufacturing systems. Nevertheless, there are types of tasks that are too complex or too expensive to be fully automated, it would be more efficient if the machines were able to work with the human, not only by sharing the same workspace but also as useful collaborators. A possible solution to that problem is on human\u2013robot interaction systems, understanding the applications where they can be helpful to implement and what are the challenges they face. This work proposes the development of an industrial prototype of a human\u2013machine interaction system through Augmented Reality, in which the objective is to enable an industrial operator without any programming experience to program a robot. The system itself is divided into two different parts: the tracking system, which records the operator\u2019s hand movement, and the translator system, which writes the program to be sent to the robot that will execute the task. To demonstrate the concept, the user drew geometric figures, and the robot was able to replicate the operator\u2019s path recorded.<\/jats:p>","DOI":"10.3390\/s21175976","type":"journal-article","created":{"date-parts":[[2021,9,6]],"date-time":"2021-09-06T21:47:38Z","timestamp":1630964858000},"page":"5976","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Programming Robots by Demonstration Using Augmented Reality"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2690-1002","authenticated-orcid":false,"given":"In\u00eas","family":"Soares","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Faculdade de Engenharia da Universidade do Porto, FEUP, 4200-465 Porto, Portugal"},{"name":"INESC TEC\u2014Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7023-8562","authenticated-orcid":false,"given":"Marcelo","family":"Petry","sequence":"additional","affiliation":[{"name":"INESC TEC\u2014Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8573-3147","authenticated-orcid":false,"given":"Ant\u00f3nio Paulo","family":"Moreira","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Faculdade de Engenharia da Universidade do Porto, FEUP, 4200-465 Porto, Portugal"},{"name":"INESC TEC\u2014Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Isma, A., and Brahim, B. (2015, January 25\u201327). Time-dependant trajectory generation for tele-operated mobile manipulator. Proceedings of the 3rd International Conference on Control, Engineering and Information Technology, CEIT 2015, Tlemcen, Algeria.","DOI":"10.1109\/CEIT.2015.7233068"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.rcim.2019.02.003","article-title":"Augmented reality in support of Industry 4.0\u2014Implementation challenges and success factors","volume":"58","author":"Masood","year":"2019","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"106195","DOI":"10.1016\/j.cie.2019.106195","article-title":"Augmented reality in support of intelligent manufacturing\u2014A systematic literature review","volume":"140","author":"Egger","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.procir.2018.02.028","article-title":"Intuitive robot programming using augmented reality","volume":"76","author":"Blankemeyer","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S0921-8890(02)00374-3","article-title":"Anthropomorphism and the social robot","volume":"42","author":"Duffy","year":"2003","journal-title":"Robot. Auton. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.robot.2008.10.024","article-title":"A survey of robot learning from demonstration","volume":"57","author":"Argall","year":"2009","journal-title":"Robot. Auton. Syst."},{"key":"ref_7","first-page":"17","article-title":"Augmented Reality in Industry 4.0","volume":"6","author":"Manuri","year":"2018","journal-title":"Am. J. Comput. Sci. Inf. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1080\/24725854.2018.1493244","article-title":"Augmented reality technology in the manufacturing industry: A review of the last decade","volume":"51","author":"Bottani","year":"2019","journal-title":"IISE Trans."},{"key":"ref_9","unstructured":"Shirer, M. (2021, January 12). Worldwide Spending on Augmented and Virtual Reality Forecast to Deliver Strong Growth through 2024, According to a New IDC Spending Guide. IDC. Available online: https:\/\/www.idc.com\/getdoc.jsp?containerId=prUS47012020."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1007\/s00530-015-0488-z","article-title":"Object interaction and task programming by demonstration in visuo-haptic augmented reality","volume":"22","author":"Aleotti","year":"2016","journal-title":"Multimed. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Araiza-Illan, D., De San Bernabe, A., Hongchao, F., and Shin, L.Y. (2019, January 11\u201314). Augmented Reality for Quick and Intuitive Robotic Packing Re-Programming. Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction, Daegu, Korea.","DOI":"10.1109\/HRI.2019.8673327"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rudorfer, M., Guhl, J., Hoffmann, P., and Kruger, J. (2018, January 4\u20137). Holo Pick\u2019n\u2019Place. Proceedings of the IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Torino, Italy.","DOI":"10.1109\/ETFA.2018.8502527"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Soares, I., Sousa, R., Petry, M.R., and Moreira, A.P. (2021). Accuracy and Repeatability Tests on HoloLens 2 and HTC Vive. Multimodal Technol. Interact., 5.","DOI":"10.20944\/preprints202108.0190.v1"},{"key":"ref_14","unstructured":"(2021, August 18). HoloLens 2 Gestures for Navigating a Guide in Dynamics 365 Guides. Available online: https:\/\/docs.microsoft.com\/en-us\/dynamics365\/mixed-reality\/guides\/operator-gestures-hl2."},{"key":"ref_15","unstructured":"(2021, August 18). ROS# (2021). Available online: https:\/\/github.com\/siemens\/ros-sharp."},{"key":"ref_16","unstructured":"Universal Robots (2021, August 18). The URScript Programming Language. For version 3.10. Available online: https:\/\/www.siemens-pro.ru\/docs\/ur\/scriptManual.pdf."},{"key":"ref_17","unstructured":"ABB Robotics (2010). Technical Reference Manual\u2014RAPID Instructions, Functions and Data Types, ABB Robotics."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/17\/5976\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:57:23Z","timestamp":1760165843000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/17\/5976"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,6]]},"references-count":17,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["s21175976"],"URL":"https:\/\/doi.org\/10.3390\/s21175976","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,9,6]]}}}