{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T18:02:22Z","timestamp":1791914542877,"version":"4.3.4"},"reference-count":59,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T00:00:00Z","timestamp":1768521600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Gaze is a fundamental aspect of non-verbal communication in human interaction, playing an important role in conveying attention, intentions, and emotions. A key concept in gaze-based human interaction is joint attention, the focus of two individuals on an object in a shared environment. In the context of human\u2013robot interaction (HRI), gaze-following has become a growing research area, as it enables robots to appear more socially intelligent, engaging, and likable. While various technical approaches have been developed to achieve this capability, a comprehensive overview of existing implementations has been lacking. This scoping review addresses this gap by systematically categorizing existing solutions, offering a structured perspective on how gaze-following behavior is technically realized in the field of HRI. A systematic search was conducted across four databases, leading to the identification of 28 studies. To structure the findings, a taxonomy was developed that categorizes technological approaches along three key functional dimensions: (1) environment tracking, which involves recognizing the objects in the robot\u2019s surroundings; (2) gaze tracking, which refers to detecting and interpreting human gaze direction; and (3) gaze\u2013environment mapping, which connects gaze information with objects in the shared environment to enable appropriate robotic responses. Across studies, a distinction emerges between constrained and unconstrained solutions. While constrained approaches, such as predefined object positions, provide high accuracy, they are often limited to controlled settings. In contrast, unconstrained methods offer greater flexibility but pose significant technical challenges. The complexity of the implementations also varies significantly, from simple rule-based approaches to advanced, adaptive systems that integrate multiple data sources. These findings highlight ongoing challenges in achieving robust and real-time gaze-following in robots, particularly in dynamic, real-world environments. Future research should focus on refining unconstrained tracking methods and leveraging advances in machine learning and computer vision to make human\u2013robot interactions more natural and socially intuitive.<\/jats:p>","DOI":"10.3389\/frobt.2025.1723527","type":"journal-article","created":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T13:13:28Z","timestamp":1768569208000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Eyes ahead: a scoping review of technologies enabling humanoid robots to follow human gaze"],"prefix":"10.3389","volume":"12","author":[{"given":"Leana","family":"Neuber","sequence":"first","affiliation":[{"name":"University of Duisburg-Essen, Department of Psychology","place":["Essen, Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wolf","family":"Culemann","sequence":"additional","affiliation":[{"name":"University of Duisburg-Essen, Department of Psychology","place":["Essen, Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruth Maria","family":"Ingendoh","sequence":"additional","affiliation":[{"name":"University of Duisburg-Essen, Department of Psychology","place":["Essen, Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angela","family":"Heine","sequence":"additional","affiliation":[{"name":"University of Duisburg-Essen, Department of Psychology","place":["Essen, Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,1,16]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"25","DOI":"10.5898\/JHRI.6.1.Admoni","article-title":"Social eye gaze in human-robot interaction: a review","volume":"6","author":"Admoni","year":"2017","journal-title":"J. Hum.-Robot Interact."},{"key":"B2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ICEngTechnol.2017.8308186","article-title":"Understanding of a convolutional neural network","volume-title":"2017 international conference on engineering and technology (ICET)","author":"Albawi","year":"2017"},{"key":"B3","doi-asserted-by":"crossref","first-page":"2610","DOI":"10.1109\/CVPR.2012.6247980","article-title":"3D constrained local model for rigid and non-rigid facial tracking","volume-title":"2012 IEEE conference on computer vision and pattern recognition","author":"Baltrusaitis","year":"2012"},{"key":"B4","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1167\/9.3.5","article-title":"Saliency, attention, and visual search: an information theoretic approach","volume":"9","author":"Bruce","year":"2009","journal-title":"J. Vis."},{"key":"B5","doi-asserted-by":"publisher","first-page":"3739","DOI":"10.3390\/s20133739","article-title":"When I look into your eyes: a survey on computer vision contributions for human gaze estimation and tracking","volume":"20","author":"Cazzato","year":"2020","journal-title":"Sensors Basel, Switz."},{"key":"B6","doi-asserted-by":"crossref","first-page":"13581","DOI":"10.1109\/ICRA48506.2021.9561758","article-title":"Fast object segmentation learning with kernel-based methods for robotics","volume-title":"2021 IEEE international conference on robotics and automation (ICRA)","author":"Ceola","year":"2021"},{"key":"B7","doi-asserted-by":"publisher","first-page":"217","DOI":"10.3758\/s13423-019-01689-4","article-title":"Examining joint attention with the use of humanoid robots-A new approach to study fundamental mechanisms of social cognition","volume":"27","author":"Chevalier","year":"2020","journal-title":"Psychonomic Bull. and Rev."},{"key":"B8","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/s10846-011-9624-y","article-title":"Modelling shared attention through relational reinforcement learning","volume":"66","author":"Da Silva","year":"2012","journal-title":"J. Intelligent Robotic Syst. Theory Appl."},{"key":"B9","doi-asserted-by":"publisher","first-page":"7426","DOI":"10.3390\/app11167426","article-title":"Say what you are looking at: an attention-based interactive system for autistic children","volume":"11","author":"Deng","year":"2021","journal-title":"Appl. Sci. Switz."},{"key":"B10","doi-asserted-by":"crossref","first-page":"2406","DOI":"10.1109\/IROS.2015.7353703","article-title":"Multimodal joint visual attention model for natural human-robot interaction in domestic environments","volume-title":"2015 IEEE\/RSJ international conference on intelligent robots and systems (IROS)","author":"Domhof","year":"2015"},{"key":"B11","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1016\/S0149-7634(00)00025-7","article-title":"The eyes have it: the neuroethology, function and evolution of social gaze","volume":"24","author":"Emery","year":"2000","journal-title":"Neurosci. and Biobehav. Rev."},{"key":"B12","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/978-3-642-23123-0_11","article-title":"Real time head pose etimation from consumer depth cameras","volume-title":"Pattern recognition","author":"Fanelli","year":"2011"},{"key":"B13","doi-asserted-by":"crossref","first-page":"3309","DOI":"10.1109\/ICRA.2016.7487504","article-title":"Markerless perspective taking for humanoid robots in unconstrained environments","volume-title":"2016 IEEE international conference on robotics and automation (ICRA)","author":"Fischer","year":"2016"},{"key":"B14","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/978-3-319-44260-0_10","article-title":"Human\u2013robot interaction through robust gaze following","volume-title":"Information technology and computational physics","author":"Grigorescu","year":"2017"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1346714","DOI":"10.3389\/frobt.2024.1346714","article-title":"A pipeline for estimating human attention toward objects with on-board cameras on the iCub humanoid robot","volume":"11","author":"Hanifi","year":"2024","journal-title":"Front. Robotics AI"},{"key":"B16","doi-asserted-by":"publisher","first-page":"2867","DOI":"10.1109\/IROS.2004.1389844","article-title":"Acquisition of human-robot joint attention through real-time natural interaction","volume":"3","author":"Hosada","year":"2004","journal-title":"2004 IEEE\/RSJ Int. Conf. Intelligent Robots Syst. (IROS)"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1254","DOI":"10.1109\/34.730558","article-title":"A model of saliency-based visual attention for rapid scene analysis","volume":"20","author":"Itti","year":"1998","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"B18","doi-asserted-by":"publisher","first-page":"104924","DOI":"10.1016\/j.engappai.2022.104924","article-title":"Depth-aware gaze-following via auxiliary networks for robotics","volume":"113","author":"Jin","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"B19","doi-asserted-by":"publisher","first-page":"226","DOI":"10.3389\/fpsyg.2018.00226","article-title":"The \u201csocial gaze space\u201d: a taxonomy for gaze-based communication in triadic interactions","volume":"9","author":"Jording","year":"2018","journal-title":"Front. Psychol."},{"key":"B20","doi-asserted-by":"crossref","first-page":"2106","DOI":"10.1109\/ICCV.2009.5459462","article-title":"Learning to predict where humans look","volume-title":"2009 IEEE 12th international conference on computer vision","author":"Judd","year":"2009"},{"key":"B21","doi-asserted-by":"publisher","first-page":"5002","DOI":"10.3758\/s13428-023-02237-8","article-title":"Webcam eye tracking close to laboratory standards: comparing a new webcam-based system and the eyelink 1000","volume":"56","author":"Kaduk","year":"2023","journal-title":"Behav. Res. Methods"},{"key":"B22","first-page":"238","volume-title":"A robotic model of the development of gaze following","author":"Kim","year":"2008"},{"key":"B23","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1027\/1618-3169\/a000173","article-title":"Synchronization can influence trust following virtual interaction","volume":"60","author":"Launay","year":"2013","journal-title":"Exp. Psychol."},{"key":"B24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/DEVLRN.2011.6037341","article-title":"Contingency allows the robot to spot the tutor and to learn from interaction","volume-title":"2011 IEEE international conference on development and learning (ICDL)","author":"Lohan","year":"2011"},{"key":"B25","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/Humanoids53995.2022.10000163","article-title":"Icub knows where you look: exploiting social cues for interactive object detection learning","volume-title":"2022 IEEE-RAS 21st international conference on humanoid robots (Humanoids)","author":"Lombardi","year":"2022"},{"key":"B26","doi-asserted-by":"publisher","first-page":"2","DOI":"10.3389\/frobt.2019.00002","article-title":"Ostensive-cue sensitive learning and exclusive evaluation of policies: a solution for measuring contingency of experiences for social developmental robot","volume":"6","author":"Mahzoon","year":"2019","journal-title":"Front. Robot. AI"},{"key":"B27","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1007\/s10514-019-09894-9","article-title":"On-line object detection: a robotics challenge","volume":"44","author":"Maiettini","year":"2020","journal-title":"Aut. Robots"},{"key":"B28","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1109\/ICHR.2009.5379555","article-title":"Towards shared attention through geometric reasoning for human robot interaction","volume-title":"2009 9th IEEE-RAS international conference on humanoid robots","author":"Marin-Urias","year":"2009"},{"key":"B29","first-page":"77","article-title":"Real-time stereo face tracking system for visual human interfaces. In Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems","volume-title":"Conjunction with ICCV\u201999 (Cat. No.PR00378)","author":"Matsumoto","year":"1999"},{"key":"B30","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/AMFG.2003.1240823","article-title":"Pose estimation using 3D view-based eigenspaces","volume-title":"2003 IEEE international SOI conference. Proceedings (Cat. No.03CH37443)","author":"Morency","year":"2003"},{"key":"B31","doi-asserted-by":"crossref","first-page":"2069","DOI":"10.1109\/ROBOT.2005.1570418","article-title":"The role of motion information in learning human-robot joint attention","volume-title":"Proceedings of the 2005 IEEE international conference on robotics and automation","author":"Nagai","year":"2005"},{"key":"B32","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1109\/IROS.2003.1250623","article-title":"Joint attention emerges through bootstrap learning","volume":"1","author":"Nagai","year":"2003","journal-title":"Proc. 2003 IEEE\/RSJ Int. Conf. Intelligent Robots Syst. (IROS 2003) (Cat. No.03CH37453)"},{"key":"B33","doi-asserted-by":"publisher","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"B34","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/HUMANOIDS.2015.7363561","article-title":"Eye gaze tracking for a humanoid robot","volume-title":"2015 IEEE-RAS 15th international conference on humanoid robots (Humanoids)","author":"Palinko","year":"2015"},{"key":"B35","first-page":"5048","volume-title":"Robot reading human gaze: why eye tracking is better than head tracking for human-robot collaboration","author":"Palinko","year":"2016"},{"key":"B36","first-page":"1080","volume-title":"Responsive joint attention in human-robot interaction","author":"Pereira","year":"2019"},{"key":"B37","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1145\/3319502.3374810","article-title":"Effects of different interaction contexts when evaluating gaze models in hri","volume-title":"Proceedings of the 2020 ACM\/IEEE international conference on human-robot interaction","author":"Pereira","year":"2020"},{"key":"B38","doi-asserted-by":"publisher","first-page":"2026","DOI":"10.1109\/TCYB.2022.3222077","article-title":"The gaze dialogue model: nonverbal communication in hhi and hri","volume":"54","author":"Rakovi\u0107","year":"2024","journal-title":"IEEE Trans. Cybern."},{"key":"B39","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1109\/ICARA.2000.4803926","article-title":"Unsupervised approach to acquire robot joint attention","volume-title":"2009 4th international conference on autonomous robots and agents","author":"Ravindra","year":"2009"},{"key":"B40","first-page":"779","article-title":"You only look once: unified, real-time object detection","volume-title":"2016 IEEE conference on computer vision and pattern recognition (CVPR)","author":"Redmon","year":"2015"},{"key":"B41","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/Humanoids58906.2024.10769796","article-title":"Pepper says: \u201ci spy with my little eye\u201d","volume-title":"2024 IEEE-RAS 23rd international conference on humanoid robots (Humanoids)","author":"Samaniego","year":"2024"},{"key":"B42","first-page":"8615","volume-title":"Human gaze following for human-robot interaction","author":"Saran","year":"2018"},{"key":"B43","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1023\/a:1013298507114","article-title":"Theory of mind for a humanoid robot","volume":"12","author":"Scassellati","year":"2002","journal-title":"Aut. Robots"},{"key":"B44","doi-asserted-by":"publisher","first-page":"2704","DOI":"10.1109\/IJCNN.2003.1223995","article-title":"Investigating models of social development using a humanoid robot","volume":"4","author":"Scassellati","year":"2003","journal-title":"Proc. Int. Jt. Conf. Neural Netw."},{"key":"B45","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1109\/CVPR.2015.7298682","article-title":"Facenet: a unified embedding for face recognition and clustering","volume-title":"2015 IEEE conference on computer vision and pattern recognition (CVPR)","author":"Schroff","year":"2015"},{"key":"B46","doi-asserted-by":"crossref","first-page":"2865","DOI":"10.1109\/ROBOT.2005.1570548","article-title":"Probabilistic gaze imitation and saliency learning in a robotic head","volume-title":"Proceedings of the 2005 IEEE international conference on robotics and automation","author":"Shon","year":"2005"},{"key":"B47","volume-title":"Perceiving and recognizing three-dimensional forms","author":"Sinha","year":"1996"},{"key":"B48","doi-asserted-by":"publisher","first-page":"1084000","DOI":"10.3389\/fnbot.2023.1084000","article-title":"Recent advancements in multimodal human\u2013robot interaction","volume":"17","author":"Su","year":"2023","journal-title":"Front. Neurorobotics"},{"key":"B49","doi-asserted-by":"publisher","first-page":"467","DOI":"10.7326\/M18-0850","article-title":"PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation","volume":"169","author":"Tricco","year":"2018","journal-title":"Ann. Intern. Med."},{"key":"B50","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1177\/1059712307078654","article-title":"Emergence of mirror neurons in a model of gaze following","volume":"15","author":"Triesch","year":"2007","journal-title":"Adapt. Behav."},{"key":"B51","doi-asserted-by":"publisher","first-page":"6000","DOI":"10.48550\/arXiv.1706.03762","article-title":"Attention is all you need","author":"Vaswani","year":"2017","journal-title":"Int. Conf. Neural Inf. Process. Syst."},{"key":"B52","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"B53","doi-asserted-by":"publisher","first-page":"20180036","DOI":"10.1098\/rstb.2018.0036","article-title":"In natural interaction with embodied robots, we prefer it when they follow our gaze: a gaze-contingent mobile eyetracking study","volume":"374","author":"Willemse","year":"2019","journal-title":"Philosophical Trans. R. Soc. B Biol. Sci."},{"key":"B54","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1075\/is.14.3.05xu","article-title":"Cooperative gazing behaviors in human multi-robot interaction","volume":"14","author":"Xu","year":"2013","journal-title":"Interact. Stud."},{"key":"B55","doi-asserted-by":"crossref","first-page":"2054","DOI":"10.1109\/SMC53992.2023.10394422","article-title":"A practical, robust, accurate gaze-based intention inference method for everyday human-robot interaction","volume-title":"2023 IEEE international conference on systems, man, and cybernetics (SMC)","author":"Xu","year":"2023"},{"key":"B56","first-page":"457","article-title":"Impression conveyance with responsive robot gaze in a conversational situtation","volume-title":"Roman 2006 - the 15th IEEE international symposium on robot and human interactive communication","author":"Yoshikawa","year":""},{"key":"B57","first-page":"37","article-title":"Responsive robot gaze to interaction partner","volume-title":"Robotics: science and systems","author":"Yoshikawa","year":""},{"key":"B58","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1109\/TSMCB.2012.2216979","article-title":"Joint attention by gaze interpolation and saliency","volume":"43","author":"Y\u00fccel","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"B59","doi-asserted-by":"crossref","first-page":"4951","DOI":"10.24963\/ijcai.2020\/689","article-title":"Human gaze assisted artificial intelligence: a review","volume-title":"Proceedings of the twenty-ninth international joint conference on artificial intelligence","author":"Zhang","year":"2020"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1723527\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T13:13:35Z","timestamp":1768569215000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1723527\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,16]]},"references-count":59,"alternative-id":["10.3389\/frobt.2025.1723527"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2025.1723527","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,16]]},"article-number":"1723527"}}