{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,17]],"date-time":"2026-01-17T03:30:22Z","timestamp":1768620622216,"version":"3.49.0"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1-2","license":[{"start":{"date-parts":[[2011,8,18]],"date-time":"2011-08-18T00:00:00Z","timestamp":1313625600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"published-print":{"date-parts":[[2012,4]]},"DOI":"10.1007\/s10846-011-9624-y","type":"journal-article","created":{"date-parts":[[2011,8,17]],"date-time":"2011-08-17T16:45:06Z","timestamp":1313599506000},"page":"167-182","source":"Crossref","is-referenced-by-count":11,"title":["Modelling Shared Attention Through Relational Reinforcement Learning"],"prefix":"10.1007","volume":"66","author":[{"given":"Renato Ramos","family":"da Silva","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roseli Aparecida Francelin","family":"Romero","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2011,8,18]]},"reference":[{"key":"9624_CR1","unstructured":"Animated Head System With Camera: Servo & Multimedia Controller Board WHA8030, Dr. Robot"},{"key":"9624_CR2","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/S0004-3702(98)00034-4","volume":"101","author":"H Blockeel","year":"1998","unstructured":"Blockeel, H., De Raedt L.: Top-down induction of first-order logical decision trees. Artif. Intell. 101, 285\u2013297 (1998)","journal-title":"Artif. Intell."},{"key":"9624_CR3","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2376.001.0001","volume-title":"Designing Sociable Robots","author":"C Breazeal","year":"2002","unstructured":"Breazeal, C.: Designing Sociable Robots. MIT Press, Cambridge (2002)"},{"key":"9624_CR4","unstructured":"Breazeal, C., Scassellati, B.: A context-dependent attention system for a social robot. In: International Joint Conference on Artificial Intelligence, pp. 1146\u20131153 (1999)"},{"key":"9624_CR5","volume-title":"Learning, Interim","author":"AC Catania","year":"2006","unstructured":"Catania, A.C.: Learning, Interim 4th edn. Sloan, Santa Rosa (2006)","edition":"4"},{"key":"9624_CR6","first-page":"131421131","volume-title":"Applied Behavior Analysis","author":"JO Cooper","year":"2007","unstructured":"Cooper, J.O., Heron, T.E., Heward, W.L.: Applied Behavior Analysis, 2nd edn., 0131421131. Prentice Hall, Englewood Cliffs (2007)","edition":"2"},{"key":"9624_CR7","volume-title":"Relational Reinforcement Learning","author":"K Driessens","year":"2004","unstructured":"Driessens, K.: Relational Reinforcement Learning. Katholieke Universiteit Leuven, Leuven (2004)"},{"key":"9624_CR8","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1177\/105971230200900102","volume":"9","author":"SC Gadanho","year":"2001","unstructured":"Gadanho, S.C., Hallam, J.: Robot learning driven by emotions. Adapt. Behav. 9, 42\u201364 (2001)","journal-title":"Adapt. Behav."},{"key":"9624_CR9","volume-title":"Genetic Algorithms in Search, Optimization and Machine Learning","author":"DE Goldberg","year":"1989","unstructured":"Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Longman, Boston (1989)"},{"key":"9624_CR10","volume-title":"Neural Networks\u2014A Comprehensive Foundation","author":"S Haykin","year":"1999","unstructured":"Haykin, S.: Neural Networks\u2014A Comprehensive Foundation. Prentice Hall, Englewood Cliffs (1999)"},{"key":"9624_CR11","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/34.730558","volume":"20","author":"L Itti","year":"1998","unstructured":"Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1254\u20131259 (1998)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"9624_CR12","first-page":"67","volume":"117","author":"F Kaplan","year":"2004","unstructured":"Kaplan, F., Hafner, V.: The Challenges of Joint Attention. Lund Univ. Cogn. Stud. 117, 67\u201374 (2004)","journal-title":"Lund Univ. Cogn. Stud."},{"key":"9624_CR13","doi-asserted-by":"crossref","unstructured":"Kearns, M., Mansour, Y.: On the boosting ability of top-down decision tree learning algorithms. In: STOC \u201996: Proceedings of the Twenty-Eighth Annual ACM Symposium on Theory of Computing, pp. 459\u2013468 (1996)","DOI":"10.1145\/237814.237994"},{"key":"9624_CR14","doi-asserted-by":"crossref","unstructured":"Kim, H., Jasso, H., Deak, G., Triesch, J.: A robotic model of the development of gaze following. In: 7th IEEE International Conference on Development and Learning (ICDL 2008), pp. 238\u2013243 (2008)","DOI":"10.1109\/DEVLRN.2008.4640836"},{"key":"9624_CR15","unstructured":"Lti Lib: Lti Image Processing Library\u2014Developer\u015b Guide. Lehrstuhl fuer Technische Informatik - Aachen University of Technology (2003)"},{"key":"9624_CR16","unstructured":"Matsuda, G., Omori, T.: Learning of joint visual attention by reinforcement learning. In: Int. Conf. on Cognitive Modeling (ICCM), pp. 157\u2013162 (2001)"},{"key":"9624_CR17","unstructured":"Mccallum, A.K.: Learning visual routines with reinforcement learning. In: AAAI Fall Symposium, pp. 82\u201386 (1996)"},{"key":"9624_CR18","volume-title":"Machine Learning","author":"TM Mitchell","year":"1997","unstructured":"Mitchell, T.M.: Machine Learning. McGraw-Hill, New York (1997)"},{"key":"9624_CR19","doi-asserted-by":"crossref","unstructured":"Morency, L-P., Sundberg, P., Darrel, T.: Pose estimation using 3d view-based eigenspaces. In: Analysis and Modeling of Faces and Gestures (AMFG\u201903), pp. 45\u201352 (2003)","DOI":"10.1109\/AMFG.2003.1240823"},{"key":"9624_CR20","volume-title":"Knowledge Acquisition and Machine Learning: Theory, Methods, and Applications","author":"K Morik","year":"1993","unstructured":"Morik, K., Wrobel, S., Kietz, J-U., Emde, W.: Knowledge Acquisition and Machine Learning: Theory, Methods, and Applications. Academic, San Francisco (1993)"},{"key":"9624_CR21","doi-asserted-by":"crossref","unstructured":"Mutlu, B., Hodgins, J.K., Forlizzi, J.: A storytelling robot: modeling and evaluation of human-like gaze behavior. In: Proceedings of HUMANOIDS\u201906, 2006 IEEE-RAS International Conference on Humanoid Robots, pp. 518\u2013523 (2006)","DOI":"10.1109\/ICHR.2006.321322"},{"key":"9624_CR22","doi-asserted-by":"crossref","unstructured":"Mutlu, B., Shiwa, T., Kanda, T., Ishiguro, H., Hagita, N.: Footing in human-robot conversations: how robots might shape participant roles using gaze cues. In: HRI \u201909: Proceedings of the 4th ACM\/IEEE International Conference on Human Robot Interaction, pp. 61\u201368 (2009)","DOI":"10.1145\/1514095.1514109"},{"key":"9624_CR23","doi-asserted-by":"crossref","unstructured":"Nagai, Y.: The role of motion information in learning human-robot joint attention. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation(ICRA), pp. 2069\u20132074 (2005)","DOI":"10.1109\/ROBOT.2005.1570418"},{"key":"9624_CR24","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1080\/09540090310001655101","volume":"15","author":"Y Nagai","year":"2003","unstructured":"Nagai, Y., Hosoda, A., Asada, M.: A constructive model for the development of joint attention. Connect. Sci. 15, 211\u2013229 (2003)","journal-title":"Connect. Sci."},{"key":"9624_CR25","unstructured":"Nuance: Introduction to the Nuance System. Nuance Communications Inc., South Yarra (2001)"},{"key":"9624_CR26","unstructured":"Otterlo, V.: A Survey of Reinforcement Learning in Relational Domains. CTIT Technical Report, TR-CTIT-05-31 (2005)"},{"key":"9624_CR27","first-page":"805862609","volume-title":"Learning, Interim","author":"WD Pierce","year":"2008","unstructured":"Pierce, W.D., Cheney, C.D.: Learning, Interim 4th edn., 0805862609. Psychology Press, Hove (2008)","edition":"4"},{"key":"9624_CR28","unstructured":"Policastro, C.A.: Arquitetura rob\u00f3tica inspirada na an\u00e1lise do comportamento. PhD thesis, Universidade de S\u00e3o Paulo (2008)"},{"key":"9624_CR29","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.jalgor.2009.04.005","volume":"64","author":"CA Policastro","year":"2009","unstructured":"Policastro, C.A., Romero, R.A.F., Zuliani, G., Pizzolato, E.: Learning of shared attention in sociable robotics. J. Algorithms 64, 139\u2013151 (2009)","journal-title":"J. Algorithms"},{"key":"9624_CR30","unstructured":"Scassellati, B.: Mechanisms of shared attention for a humanoid robot. pp. 102-106 (1996)"},{"key":"9624_CR31","first-page":"176","volume-title":"Imitation and Mechanisms of Joint Attention: A Developmental Structure for Building Social Skills on a Humanoid Robot","author":"B Scassellati","year":"1999","unstructured":"Scassellati, B.: Imitation and Mechanisms of Joint Attention: A Developmental Structure for Building Social Skills on a Humanoid Robot, pp. 176\u2013195. Springer, New York (1999)"},{"key":"9624_CR32","doi-asserted-by":"crossref","unstructured":"Shon, A.P., Grimes, D.B., Baker, C.L., Hoffman, M.W., Zhou, S., Rao, R.P.N.: Probabilistic gaze imitation and saliency learning in a robotic head. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA 2005), pp. 2865\u20132870 (2005)","DOI":"10.1109\/ROBOT.2005.1570548"},{"key":"9624_CR33","doi-asserted-by":"crossref","first-page":"44","DOI":"10.21528\/LNLM-vol6-no1-art4","volume":"6","author":"RR Silva","year":"2008","unstructured":"Silva, R.R., Policastro, C.A., Zuliani, G., Pizzolato, E., Romero, R.A.F.: Concept learning by human tutelage for social robots. Learning and Nonlinear Models 6, 44\u201367 (2008)","journal-title":"Learning and Nonlinear Models"},{"key":"9624_CR34","doi-asserted-by":"crossref","unstructured":"Silva, R.R., Policastro, C.A., Romero, R.A.F.: Relational reinforcement learning applied to shared attention. In: Proceedings of 2009 International Joint Conference on Neural Networks, pp. 2943\u20132949 (2009)","DOI":"10.1109\/IJCNN.2009.5178735"},{"key":"9624_CR35","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/TAMD.2010.2042167","volume":"2","author":"H Sumioka","year":"2010","unstructured":"Sumioka, H., Yoshikawa, Y., Asada, M.: Reproducing interaction contingency toward open-ended development of social actions: case study on joint attention. IEEE Trans. Auton. Mental Develop 2, 40\u201350 (2010)","journal-title":"IEEE Trans. Auton. Mental Develop"},{"key":"9624_CR36","doi-asserted-by":"crossref","unstructured":"Staudte, M., Crocker, M.W.: Visual attention in spoken human-robot interaction. In: HRI \u201909: Proceedings of the 4th ACM\/IEEE International Conference on Human Robot Interaction, pp. 77\u201384 (2009)","DOI":"10.1145\/1514095.1514111"},{"key":"9624_CR37","volume-title":"Introduction to Data Mining","author":"P-N Tan","year":"2005","unstructured":"Tan, P-N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Addison-Wesley Longman, Boston (2005)"},{"key":"9624_CR38","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1111\/j.1467-7687.2006.00470.x","volume":"9","author":"J Triesch","year":"2006","unstructured":"Triesch, J., Teuscher, C., Deak, G.O. Carlson, E.: Gaze following: why (not) learn it?. Dev. Sci. 9, 125\u2013147 (2006)","journal-title":"Dev. Sci."},{"key":"9624_CR39","volume-title":"Learning from Delayed Rewards","author":"CJCH Watkins","year":"1989","unstructured":"Watkins, C.J.C.H.: Learning from Delayed Rewards. University of Cambridge, Cambridge (1989)"},{"key":"9624_CR40","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1111\/1469-7610.00135","volume":"44","author":"C Whalen","year":"2003","unstructured":"Whalen, C., Schreibman, L.: Joint attention training for children with autism using behavior modification procedures. J. Child Psychol. Psychiatry 44, 456\u2013468 (2003)","journal-title":"J. Child Psychol. Psychiatry"},{"key":"9624_CR41","doi-asserted-by":"crossref","unstructured":"Yamazaki, A., Yamazaki, K., Kuno, Y., Burdelski, M., Kawashima, M., Kuzuoka, H.: Precision timing in human-robot interaction: coordination of head movement and utterance. In: CHI \u201908: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, 978-1-60558-011-1, pp. 131\u2013140 (2008)","DOI":"10.1145\/1357054.1357077"},{"key":"9624_CR42","doi-asserted-by":"crossref","unstructured":"Yu, C., Scheutz M., Schermerhorn, P.: Investigating multimodal real-time patterns of joint attention in an HRI word learning task. In: HRI \u201910: Proceeding of the 5th ACM\/IEEE International Conference on Human\u2013Robot interaction, pp. 309\u2013316 (2010)","DOI":"10.1145\/1734454.1734561"}],"container-title":["Journal of Intelligent & Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-011-9624-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10846-011-9624-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-011-9624-y","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,8]],"date-time":"2025-03-08T21:51:53Z","timestamp":1741470713000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10846-011-9624-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,8,18]]},"references-count":42,"journal-issue":{"issue":"1-2","published-print":{"date-parts":[[2012,4]]}},"alternative-id":["9624"],"URL":"https:\/\/doi.org\/10.1007\/s10846-011-9624-y","relation":{},"ISSN":["0921-0296","1573-0409"],"issn-type":[{"value":"0921-0296","type":"print"},{"value":"1573-0409","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,8,18]]}}}