{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T09:25:15Z","timestamp":1766136315952,"version":"3.41.0"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2012,1,1]],"date-time":"2012-01-01T00:00:00Z","timestamp":1325376000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000169","name":"Division of Behavioral and Cognitive Sciences","doi-asserted-by":"publisher","award":["924248"],"award-info":[{"award-number":["924248"]}],"id":[{"id":"10.13039\/100000169","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000181","name":"Air Force Office of Scientific Research","doi-asserted-by":"publisher","award":["FA9550-09-1-0665"],"award-info":[{"award-number":["FA9550-09-1-0665"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2012,1]]},"abstract":"<jats:p>Efficient collaborations between interacting agents, be they humans, virtual or embodied agents, require mutual recognition of the goal, appropriate sequencing and coordination of each agent's behavior with others, and making predictions from and about the likely behavior of others. Moment-by-moment eye gaze plays an important role in such interaction and collaboration. In light of this, we used a novel experimental paradigm to systematically investigate gaze patterns in both human-human and human-agent interactions. Participants in the study were asked to interact with either another human or an embodied agent in a joint attention task. Fine-grained multimodal behavioral data were recorded including eye movement data, speech, first-person view video, which were then analyzed to discover various behavioral patterns. Those patterns show that human participants are highly sensitive to momentary multimodal behaviors generated by the social partner (either another human or an artificial agent) and they rapidly adapt their gaze behaviors accordingly. Our results from this data-driven approach provide new findings for understanding micro-behaviors in human-human communication which will be critical for the design of artificial agents that can generate human-like gaze behaviors and engage in multimodal interactions with humans.<\/jats:p>","DOI":"10.1145\/2070719.2070726","type":"journal-article","created":{"date-parts":[[2012,6,1]],"date-time":"2012-06-01T15:51:28Z","timestamp":1338565888000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":39,"title":["Adaptive eye gaze patterns in interactions with human and artificial agents"],"prefix":"10.1145","volume":"1","author":[{"given":"Chen","family":"Yu","sequence":"first","affiliation":[{"name":"Indiana University, IN"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Schermerhorn","sequence":"additional","affiliation":[{"name":"Indiana University, IN"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Scheutz","sequence":"additional","affiliation":[{"name":"Tufts University, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,1,13]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_1_1_1","DOI":"10.1006\/jmla.1997.2558"},{"doi-asserted-by":"publisher","key":"e_1_2_1_2_1","DOI":"10.2307\/2786027"},{"doi-asserted-by":"publisher","key":"e_1_2_1_3_1","DOI":"10.1515\/semi.1972.6.1.32"},{"doi-asserted-by":"publisher","key":"e_1_2_1_4_1","DOI":"10.1037\/0012-1649.29.5.832"},{"doi-asserted-by":"publisher","key":"e_1_2_1_5_1","DOI":"10.1017\/S0140525X97001611"},{"doi-asserted-by":"publisher","key":"e_1_2_1_6_1","DOI":"10.1145\/1891903.1891915"},{"volume-title":"Proceedings of the International Conference on Autonomous Agents and Multiagent Systems. 1535--1536","author":"Bee N.","unstructured":"Bee , N. , Wagner , J. , Andre , E. , Vogt , T. , Charles , F. , Pizzi , D. , and Cavazza , M . 2010b. Multimodal interaction with a virtual character in interactive storytelling . In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems. 1535--1536 . Bee, N., Wagner, J., Andre, E., Vogt, T., Charles, F., Pizzi, D., and Cavazza, M. 2010b. Multimodal interaction with a virtual character in interactive storytelling. In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems. 1535--1536.","key":"e_1_2_1_7_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.1177\/105971230000800104"},{"doi-asserted-by":"publisher","key":"e_1_2_1_9_1","DOI":"10.1016\/j.cognition.2007.05.012"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.1145\/1228716.1228752"},{"volume-title":"Joint visual attention in infancy","author":"Butterworth G.","unstructured":"Butterworth , G. 200 I. Joint visual attention in infancy . In Blackwell Handbook of Infant Development 213--240. Butterworth, G. 200 I. Joint visual attention in infancy. In Blackwell Handbook of Infant Development 213--240.","key":"e_1_2_1_11_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.1016\/j.jml.2003.08.004"},{"doi-asserted-by":"publisher","key":"e_1_2_1_13_1","DOI":"10.1145\/1958824.1958892"},{"volume-title":"Why look&quest","author":"Griffin Z.","unstructured":"Griffin , Z. 2004. Why look&quest ; Reasons for eye movements related to language production. In The Interface of Language, Vision, and Action: Eye Movements and the Visual World . 213--247. Griffin, Z. 2004. Why look&quest; Reasons for eye movements related to language production. In The Interface of Language, Vision, and Action: Eye Movements and the Visual World. 213--247.","key":"e_1_2_1_14_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_15_1","DOI":"10.1111\/1467-9280.00255"},{"doi-asserted-by":"publisher","key":"e_1_2_1_16_1","DOI":"10.1007\/11821830_16"},{"doi-asserted-by":"publisher","key":"e_1_2_1_17_1","DOI":"10.1016\/j.jml.2007.01.008"},{"volume-title":"Proceedings of the AAAI Fall Workshop on Dialog with Robots.","author":"Hasegawa D.","unstructured":"Hasegawa , D. , Cassell , J. , and Araki , K . 2010. The role of embodiment and perspective in direction-giving systems . In Proceedings of the AAAI Fall Workshop on Dialog with Robots. Hasegawa, D., Cassell, J., and Araki, K. 2010. The role of embodiment and perspective in direction-giving systems. In Proceedings of the AAAI Fall Workshop on Dialog with Robots.","key":"e_1_2_1_18_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_19_1","DOI":"10.1016\/j.tics.2005.02.009"},{"doi-asserted-by":"publisher","key":"e_1_2_1_20_1","DOI":"10.1167\/3.1.6"},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.1145\/1027933.1027959"},{"doi-asserted-by":"publisher","key":"e_1_2_1_22_1","DOI":"10.1007\/978-3-540-85483-8_19"},{"volume-title":"Proceedings of the International Conference on Intelligent Robots and Systems.","author":"Kramer J.","unstructured":"Kramer , J. and Scheutz , M . 2007. ADE: A framework for robust complex robotic architectures . In Proceedings of the International Conference on Intelligent Robots and Systems. Kramer, J. and Scheutz, M. 2007. ADE: A framework for robust complex robotic architectures. In Proceedings of the International Conference on Intelligent Robots and Systems.","key":"e_1_2_1_23_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_24_1","DOI":"10.1068\/p2935"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.1075\/is.7.3.03mac"},{"doi-asserted-by":"crossref","unstructured":"Meyer A. Sleiderink A. and Levelt W. l998. Viewing and naming objects: Eye movements during noun phrase production. Cognition 66 2 25--33.  Meyer A. Sleiderink A. and Levelt W. l998. Viewing and naming objects: Eye movements during noun phrase production. Cognition 66 2 25--33.","key":"e_1_2_1_26_1","DOI":"10.1016\/S0010-0277(98)00009-2"},{"doi-asserted-by":"publisher","key":"e_1_2_1_27_1","DOI":"10.1145\/1180995.1181051"},{"volume-title":"Proceedings of the 6th IEEE-RAS International Conference on Humanoid Robots. 518--523","author":"Mutlu B.","unstructured":"Mutlu , B. , Forlizzi , J. , and Hodgins , J . 2006. A storytelling robot: modeling and evaluation of human-like gaze behavior . In Proceedings of the 6th IEEE-RAS International Conference on Humanoid Robots. 518--523 . Mutlu, B., Forlizzi, J., and Hodgins, J. 2006. A storytelling robot: modeling and evaluation of human-like gaze behavior. In Proceedings of the 6th IEEE-RAS International Conference on Humanoid Robots. 518--523.","key":"e_1_2_1_28_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_29_1","DOI":"10.3115\/1075096.1075166"},{"doi-asserted-by":"publisher","key":"e_1_2_1_30_1","DOI":"10.1007\/s002210100745"},{"doi-asserted-by":"publisher","key":"e_1_2_1_31_1","DOI":"10.5555\/1861751.1861758"},{"doi-asserted-by":"publisher","key":"e_1_2_1_32_1","DOI":"10.1037\/0033-2909.124.3.372"},{"volume-title":"Proceedings of the 5th International Conference on Intelligent Virtual Agents.","author":"Rehm M.","unstructured":"Rehm , M. and Andre , E . 2005. Where do they look&quest; Gaze behaviors of multiple users interacting with an embodied conversational agent . In Proceedings of the 5th International Conference on Intelligent Virtual Agents. Rehm, M. and Andre, E. 2005. Where do they look&quest; Gaze behaviors of multiple users interacting with an embodied conversational agent. In Proceedings of the 5th International Conference on Intelligent Virtual Agents.","key":"e_1_2_1_33_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_34_1","DOI":"10.1007\/s10514-006-9018-3"},{"doi-asserted-by":"publisher","key":"e_1_2_1_35_1","DOI":"10.1111\/j.1756-8765.2009.01018.x"},{"key":"e_1_2_1_36_1","first-page":"326","article-title":"Mutual interpersonal postural constraints are involved in cooperative conversation","volume":"29","author":"Shockley K.","year":"2003","unstructured":"Shockley , K. , Santana , M. , and Fowler , C. 2003 . Mutual interpersonal postural constraints are involved in cooperative conversation . J. Exper. Psych. 29 , 2, 326 -- 332 . Shockley, K., Santana, M., and Fowler, C. 2003. Mutual interpersonal postural constraints are involved in cooperative conversation. J. Exper. Psych. 29, 2, 326--332.","journal-title":"J. Exper. Psych."},{"doi-asserted-by":"publisher","key":"e_1_2_1_37_1","DOI":"10.1145\/1514095.1514111"},{"doi-asserted-by":"crossref","unstructured":"Tanenhaus M. Spivey-Knowlton M. Eberhard K. and Sedivy J. 1995. Integration of visual and linguistic information in spoken language comprehension. Science 268 5217 1632--1634.  Tanenhaus M. Spivey-Knowlton M. Eberhard K. and Sedivy J. 1995. Integration of visual and linguistic information in spoken language comprehension. Science 268 5217 1632--1634.","key":"e_1_2_1_38_1","DOI":"10.1126\/science.7777863"},{"doi-asserted-by":"publisher","key":"e_1_2_1_39_1","DOI":"10.1109\/TSMCA.2005.850592"},{"doi-asserted-by":"publisher","key":"e_1_2_1_40_1","DOI":"10.1145\/636772.636794"},{"doi-asserted-by":"publisher","key":"e_1_2_1_41_1","DOI":"10.1145\/1357054.1357077"},{"doi-asserted-by":"publisher","key":"e_1_2_1_42_1","DOI":"10.1145\/1008722.1008727"},{"volume-title":"Proceedings of the 5th ACM\/IEEE International Conference on Human-Robot Interaction.","author":"Yu C.","unstructured":"Yu , C. , Scheutz , M. , and Schermerhorn , P . 2010a. Investigating multimodal real-time patterns of joint attention in an hri word learning task . In Proceedings of the 5th ACM\/IEEE International Conference on Human-Robot Interaction. Yu, C., Scheutz, M., and Schermerhorn, P. 2010a. Investigating multimodal real-time patterns of joint attention in an hri word learning task. In Proceedings of the 5th ACM\/IEEE International Conference on Human-Robot Interaction.","key":"e_1_2_1_43_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_44_1","DOI":"10.1109\/TAMD.2009.2031513"},{"doi-asserted-by":"publisher","key":"e_1_2_1_45_1","DOI":"10.1007\/978-3-642-13062-5_22"},{"doi-asserted-by":"publisher","key":"e_1_2_1_46_1","DOI":"10.1057\/ivs.2008.32"},{"doi-asserted-by":"publisher","key":"e_1_2_1_47_1","DOI":"10.1145\/1891903.1891909"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2070719.2070726","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2070719.2070726","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:06:25Z","timestamp":1750241185000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2070719.2070726"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,1]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,1]]}},"alternative-id":["10.1145\/2070719.2070726"],"URL":"https:\/\/doi.org\/10.1145\/2070719.2070726","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2012,1]]},"assertion":[{"value":"2011-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-01-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}