{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,3]],"date-time":"2025-12-03T18:14:31Z","timestamp":1764785671865,"version":"3.43.0"},"reference-count":63,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,8,13]],"date-time":"2025-08-13T00:00:00Z","timestamp":1755043200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Supportive robots that can be deployed in our homes will need to be understandable, operable, and teachable by non-expert users. This calls for an intuitive Human-Robot Interaction approach that is also safe and sustainable in the long term. Still, few studies have looked at interactive task learning in repeated, unscripted interactions within loosely supervised settings. In such cases the robot should incrementally learn from the user and consequentially expand its knowledge and abilities, a feature which presents the challenge of designing robots that interact and learn in real time. Here, we present a robotic system capable of continual learning from interaction, generalizing learned skills, and planning task execution based on the received training. We were interested in how interacting with such a system would impact the user experience and understanding. In an exploratory study, we assessed such dynamics with participants free to teach the robot simple tasks in Augmented Reality without supervision. Participants could access AR glasses spontaneously in a shared space and demonstrate physical skills in a virtual kitchen scene. A holographic robot gave feedback on its understanding and, after the demonstration, could ask questions to generalize the acquired task knowledge. The robot learned the semantic effects of the demonstrated actions and, upon request, could reproduce those on observed or novel objects through generalization. The results show that the users found the system engaging, understandable, and trustworthy, but with larger variance on the last two constructs. Participants who explored the scene more were able to expand the robot\u2019s knowledge more effectively, and those who felt they understood the robot better were also more trusting toward it. No significant variation in the user experience or their teaching behavior was found across two interactions, yet the low return rate and free-form comments hint at critical lessons for interactive learning systems.<\/jats:p>","DOI":"10.3389\/frobt.2025.1605652","type":"journal-article","created":{"date-parts":[[2025,8,13]],"date-time":"2025-08-13T08:22:14Z","timestamp":1755073334000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning"],"prefix":"10.3389","volume":"12","author":[{"given":"Anna","family":"Belardinelli","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chao","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Tanneberg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephan","family":"Hasler","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Gienger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,8,13]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"943","DOI":"10.1080\/10447318.2017.1300750","article-title":"Adaptive social robot for sustaining social engagement during long-term children\u2013robot interaction","volume":"33","author":"Ahmad","year":"2017","journal-title":"Int. J. Human\u2013Computer Interact."},{"key":"B2","doi-asserted-by":"publisher","first-page":"12","DOI":"10.4018\/IJACI.2017040102","article-title":"User experience in social human-robot interaction","volume":"8","author":"Alenljung","year":"2017","journal-title":"Int. J. Ambient. Comput. Intell."},{"key":"B3","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1609\/aimag.v35i4.2513","article-title":"Power to the people: the role of humans in interactive machine learning","volume":"35","author":"Amershi","year":"2014","journal-title":"AI Mag."},{"key":"B4","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1016\/j.robot.2008.10.024","article-title":"A survey of robot learning from demonstration","volume":"57","author":"Argall","year":"2009","journal-title":"Robotics Aut. Syst."},{"key":"B5","doi-asserted-by":"publisher","first-page":"104427","DOI":"10.1016\/j.robot.2023.104427","article-title":"Continual learning from demonstration of robotics skills","volume":"165","author":"Auddy","year":"2023","journal-title":"Robotics Aut. Syst."},{"key":"B6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3659110","article-title":"A human-centered view of continual learning: understanding interactions, teaching patterns, and perceptions of human users toward a continual learning robot in repeated interactions","volume":"13","author":"Ayub","year":"2024","journal-title":"ACM Trans. Human-Robot Interact."},{"key":"B7","doi-asserted-by":"publisher","first-page":"101286","DOI":"10.1016\/j.cogsys.2024.101286","article-title":"What you need to know about a learning robot: identifying the enabling architecture of complex systems","volume":"88","author":"Beierling","year":"2024","journal-title":"Cognitive Syst. Res."},{"key":"B8","article-title":"Explainable human-robot interaction for imitation learning in augmented reality","volume-title":"16th international workshop on human-friendly robotics","author":"Belardinelli","year":"2023"},{"key":"B9","first-page":"1995","volume-title":"Learning from humans","author":"Billard","year":"2016"},{"key":"B10","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1016\/j.artint.2014.08.005","article-title":"Eliciting good teaching from humans for machine learners","volume":"217","author":"Cakmak","year":"2014","journal-title":"Artif. Intell."},{"key":"B11","doi-asserted-by":"publisher","first-page":"127","DOI":"10.7551\/mitpress\/11956.003.0013","article-title":"Teaching robots new tasks through natural interaction","volume":"26","author":"Chai","year":"2019","journal-title":"Interact. Task Learn. Humans, Robots, Agents Acquir. New Tasks through Nat. Interact."},{"key":"B12","first-page":"317","article-title":"Transparent active learning for robots","volume-title":"2010 5th ACM\/IEEE international conference on human-robot interaction (HRI) (IEEE)","author":"Chao","year":"2010"},{"key":"B13","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1145\/3568162.3576962","article-title":"People dynamically update trust when interactively teaching robots","volume-title":"Proceedings of the 2023 ACM\/IEEE international conference on human-robot interaction","author":"Chi","year":"2023"},{"key":"B14","doi-asserted-by":"publisher","first-page":"3695","DOI":"10.1109\/lra.2022.3145516","article-title":"Correct me if I am wrong: interactive learning for robotic manipulation","volume":"7","author":"Chisari","year":"2022","journal-title":"IEEE Robotics Automation Lett."},{"key":"B15","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1145\/2909824.3020236","article-title":"Why do they refuse to use my robot? Reasons for non-use derived from a long-term home study","author":"De Graaf","year":"2017","journal-title":"Proc. 2017 ACM\/IEEE Int. Conf. human-robot Interact."},{"key":"B16","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1075\/is.17.3.08deg","article-title":"Long-term evaluation of a social robot in real homes","volume":"17","author":"De Graaf","year":"2016","journal-title":"Interact. Stud."},{"key":"B17","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1007\/978-90-481-8847-5_10","article-title":"Wordnet","volume-title":"Theory and applications of ontology: computer applications","author":"Fellbaum","year":"2010"},{"key":"B18","article-title":"Inquire: interactive querying for user-aware informative reasoning","volume-title":"Conference on robot learning","author":"Fitzgerald","year":"2022"},{"key":"B19","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1080\/10447318.2018.1456150","article-title":"A personal resource for technology interaction: development and validation of the affinity for technology interaction (ati) scale","volume":"35","author":"Franke","year":"2019","journal-title":"Int. J. Human\u2013Computer Interact."},{"key":"B20","article-title":"A review of communicating robot learning during human-robot interaction","author":"Habibian","year":"2023"},{"key":"B21","article-title":"Efficient symbolic planning with views","author":"Hasler","year":"2024"},{"key":"B22","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1075\/is.20023.hin","article-title":"Why robots should be technical: correcting mental models through technical architecture concepts","volume":"22","author":"Hindemith","year":"2021","journal-title":"Interact. Stud."},{"key":"B23","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1177\/0018720814547570","article-title":"Trust in automation: integrating empirical evidence on factors that influence trust","volume":"57","author":"Hoff","year":"2015","journal-title":"Hum. factors"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1278","DOI":"10.1016\/j.chb.2010.05.031","article-title":"Integrating cognitive load theory and concepts of human\u2013computer interaction","volume":"26","author":"Hollender","year":"2010","journal-title":"Comput. Hum. Behav."},{"key":"B25","doi-asserted-by":"publisher","first-page":"100645","DOI":"10.1016\/j.jdmm.2021.100645","article-title":"An improvement or a gimmick? The importance of user perceived values, previous experience, and industry context in human\u2013robot service interaction","volume":"21","author":"Hu","year":"2021","journal-title":"J. Destination Mark. and Manag."},{"key":"B26","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1109\/RO-MAN47096.2020.9223491","article-title":"Using a personalised socially assistive robot for cardiac rehabilitation: a long-term case study","volume-title":"2020 29th IEEE international conference on robot and human interactive communication (RO-MAN)","author":"Irfan","year":"2020"},{"key":"B27","doi-asserted-by":"publisher","first-page":"724","DOI":"10.1145\/3434074.3444881","article-title":"Lifelong learning and personalization in long-term human-robot interaction (Leap-hri)","author":"Irfan","year":"2021","journal-title":"Companion 2021 ACM\/IEEE Int. Conf. human-robot Interact."},{"key":"B28","doi-asserted-by":"publisher","first-page":"8664","DOI":"10.1109\/icra57147.2024.10610434","article-title":"Copal: corrective planning of robot actions with large language models","author":"Joublin","year":"2024","journal-title":"IEEE Int. Conf. Robotics Automation (ICRA)"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3582272","article-title":"A survey on measuring cognitive workload in human-computer interaction","volume":"55","author":"Kosch","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"B30","doi-asserted-by":"publisher","first-page":"e2115730119","DOI":"10.1073\/pnas.2115730119","article-title":"Socially situated artificial intelligence enables learning from human interaction","volume":"119","author":"Krishna","year":"2022","journal-title":"Proc. Natl. Acad. Sci."},{"key":"B31","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1109\/mis.2017.3121552","article-title":"Interactive task learning","volume":"32","author":"Laird","year":"2017","journal-title":"IEEE Intell. Syst."},{"key":"B32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3613904.3641915","article-title":"VAL: interactive task learning with GPT dialog parsing","volume-title":"Proceedings of the CHI conference on human factors in computing systems","author":"Lawley","year":"2024"},{"key":"B33","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s12369-013-0178-y","article-title":"Social robots for long-term interaction: a survey","volume":"5","author":"Leite","year":"2013","journal-title":"Int. J. Soc. Robotics"},{"key":"B34","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.inffus.2019.12.004","article-title":"Continual learning for robotics: definition, framework, learning strategies, opportunities and challenges","volume":"58","author":"Lesort","year":"2020","journal-title":"Inf. fusion"},{"key":"B35","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1109\/tpami.2017.2773081","article-title":"Learning without forgetting","volume":"40","author":"Li","year":"2017","journal-title":"IEEE Trans. pattern analysis Mach. Intell."},{"key":"B36","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1145\/2696454.2696474","article-title":"Interactive hierarchical task learning from a single demonstration","author":"Mohseni-Kabir","year":"2015","journal-title":"Proc. Tenth Annu. ACM\/IEEE Int. Conf. Human-Robot Interact."},{"key":"B37","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1145\/3568162.3576996","article-title":"Impacts of robot learning on user attitude and behavior","volume-title":"Proceedings of the 2023 ACM\/IEEE international conference on human-robot interaction","author":"Moorman","year":"2023"},{"key":"B38","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.ijhcs.2018.01.004","article-title":"A practical approach to measuring user engagement with the refined user engagement scale (ues) and new ues short form","volume":"112","author":"O\u2019Brien","year":"2018","journal-title":"Int. J. Human-Computer Stud."},{"key":"B39","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.neunet.2019.01.012","article-title":"Continual lifelong learning with neural networks: a review","volume":"113","author":"Parisi","year":"2019","journal-title":"Neural Netw."},{"key":"B40","doi-asserted-by":"publisher","first-page":"645956","DOI":"10.3389\/frobt.2021.645956","article-title":"I can see it in your eyes: gaze as an implicit cue of uncanniness and task performance in repeated interactions with robots","volume":"8","author":"Perugia","year":"2021","journal-title":"Front. Robotics AI"},{"key":"B41","first-page":"1173","article-title":"Unpacking human teachers\u2019 intentions for natural interactive task learning","volume-title":"2021 30th IEEE international conference on robot and human interactive communication (RO-MAN)","author":"Ramaraj","year":"2021"},{"key":"B42","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1145\/3369457.3369494","article-title":"Social robots with gamification principles to increase long-term user interaction","volume-title":"Proceedings of the 31st Australian conference on human-computer-interaction","author":"Robinson","year":"2019"},{"key":"B43","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1016\/j.chb.2016.12.033","article-title":"How gamification motivates: an experimental study of the effects of specific game design elements on psychological need satisfaction","volume":"69","author":"Sailer","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"B44","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/978-1-4899-7668-0_10","article-title":"Measuring trust in human robot interactions: development of the \u201ctrust perception scale-hri\u201d","volume-title":"Robust intelligence and trust in autonomous systems","author":"Schaefer","year":"2016"},{"key":"B45","article-title":"Are users in the loop? Development of the subjective information processing awareness scale to assess XAI","volume-title":"Proceedings of the ACM CHI workshop on operationalizing human-centered perspectives in explainable AI (HCXAI 2021)","author":"Schrills","year":"2021"},{"key":"B46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3572784","article-title":"Concerning trends in likert scale usage in human-robot interaction: towards improving best practices","volume":"12","author":"Schrum","year":"2023","journal-title":"ACM Trans. Human-Robot Interact."},{"key":"B47","doi-asserted-by":"publisher","first-page":"1340334","DOI":"10.3389\/frobt.2024.1340334","article-title":"Semantic learning from keyframe demonstration using object attribute constraints","volume":"11","author":"Sen","year":"2024","journal-title":"Front. Robotics AI"},{"key":"B48","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1609\/aaaiss.v3i1.31245","article-title":"How can large language models enable better socially assistive human-robot interaction: a brief survey","volume":"3","author":"Shi","year":"2024","journal-title":"Proc. AAAI Symposium Ser."},{"key":"B49","doi-asserted-by":"publisher","first-page":"1070","DOI":"10.1109\/TCDS.2022.3231731","article-title":"Toward teachable autotelic agents","volume":"15","author":"Sigaud","year":"2022","journal-title":"IEEE Trans. Cognitive Dev. Syst."},{"key":"B50","doi-asserted-by":"publisher","first-page":"11981","DOI":"10.1609\/aaai.v35i13.17423","article-title":"Online action recognition","volume":"35","author":"Su\u00e1rez-Hern\u00e1ndez","year":"2021","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"B51","first-page":"2010","article-title":"Learning type-generalized actions for symbolic planning","author":"Tanneberg","year":"2023"},{"key":"B52","first-page":"9130","article-title":"To help or not to help: llm-Based attentive support for human-robot group interactions","author":"Tanneberg","year":"2024"},{"key":"B53","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3526112","article-title":"Mental state attribution to robots: a systematic review of conceptions, methods, and findings","volume":"11","author":"Thellman","year":"2022","journal-title":"ACM Trans. Human-Robot Interact. (THRI)"},{"key":"B54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3461781","article-title":"The perceptual belief problem: why explainability is a tough challenge in social robotics","volume":"10","author":"Thellman","year":"2021","journal-title":"ACM Trans. Human-Robot Interact."},{"key":"B55","doi-asserted-by":"publisher","first-page":"716","DOI":"10.1016\/j.artint.2007.09.009","article-title":"Teachable robots: understanding human teaching behavior to build more effective robot learners","volume":"172","author":"Thomaz","year":"2008","journal-title":"Artif. Intell."},{"key":"B56","doi-asserted-by":"publisher","first-page":"646002","DOI":"10.3389\/frobt.2021.646002","article-title":"Exploring non-expert robot programming through crowdsourcing","volume":"8","author":"Van Waveren","year":"2021","journal-title":"Front. Robotics AI"},{"key":"B57","doi-asserted-by":"publisher","first-page":"e91349","DOI":"10.1371\/journal.pone.0091349","article-title":"Robots show Us how to teach them: feedback from robots shapes tutoring behavior during action learning","volume":"9","author":"Vollmer","year":"2014","journal-title":"PLoS ONE"},{"key":"B58","doi-asserted-by":"publisher","first-page":"863","DOI":"10.1007\/s13164-017-0353-4","article-title":"On studying human teaching behavior with robots: a review","volume":"9","author":"Vollmer","year":"2018","journal-title":"Rev. Philosophy Psychol."},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2016.00010","article-title":"Pragmatic frames for teaching and learning in human\u2013robot interaction: review and challenges","volume":"10","author":"Vollmer","year":"2016","journal-title":"Front. Neurorobotics"},{"key":"B60","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3173574.3173783","article-title":"Simulator sickness in augmented reality training using the microsoft hololens","volume-title":"Proceedings of the 2018 CHI conference on human factors in computing systems","author":"Vovk","year":"2018"},{"key":"B61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3597623","article-title":"Virtual, augmented, and mixed reality for human-robot interaction: a survey and virtual design element taxonomy","volume":"12","author":"Walker","year":"2023","journal-title":"ACM Trans. Human-Robot Interact."},{"key":"B62","article-title":"Investigating explainable human-robot interaction with augmented reality","volume-title":"5th international workshop on virtual, augmented, and mixed reality for HRI (VAM-HRI)","author":"Wang","year":"2022"},{"key":"B63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3544549.3583889","article-title":"Explainable human-robot training and cooperation with augmented reality","author":"Wang","year":"2023","journal-title":"Ext. Abstr. 2023 CHI Conf. Hum. Factors Comput. Syst."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1605652\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,13]],"date-time":"2025-08-13T08:22:17Z","timestamp":1755073337000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1605652\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,13]]},"references-count":63,"alternative-id":["10.3389\/frobt.2025.1605652"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2025.1605652","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,13]]},"article-number":"1605652"}}