{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T18:21:11Z","timestamp":1766427671485,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,7,23]],"date-time":"2019-07-23T00:00:00Z","timestamp":1563840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"JST, ERATO","award":["JPMJER1401"],"award-info":[{"award-number":["JPMJER1401"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2019,9,30]]},"abstract":"<jats:p>Learning from human interaction data is a promising approach for developing robot interaction logic, but behaviors learned only from offline data simply represent the most frequent interaction patterns in the training data, without any adaptation for individual differences. We developed a robot that incorporates both data-driven and interactive learning. Our robot first learns high-level dialog and spatial behavior patterns from offline examples of human--human interaction. Then, during live interactions, it chooses among appropriate actions according to its curiosity about the customer's expected behavior, continually updating its predictive model to learn and adapt to each individual. In a user study, we found that participants thought the curious robot was significantly more humanlike with respect to repetitiveness and diversity of behavior, more interesting, and better overall in comparison to a non-curious robot.<\/jats:p>","DOI":"10.1145\/3326462","type":"journal-article","created":{"date-parts":[[2019,7,23]],"date-time":"2019-07-23T12:17:41Z","timestamp":1563884261000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Curiosity Did Not Kill the Robot"],"prefix":"10.1145","volume":"8","author":[{"given":"Malcolm","family":"Doering","sequence":"first","affiliation":[{"name":"ATR, Japan and Osaka University, Osaka, Japan"}]},{"given":"Phoebe","family":"Liu","sequence":"additional","affiliation":[{"name":"Figure Eight, San Francisco, CA, USA"}]},{"given":"Dylan F.","family":"Glas","sequence":"additional","affiliation":[{"name":"Futurewei Technologies, San Francisco,CA, USA"}]},{"given":"Takayuki","family":"Kanda","sequence":"additional","affiliation":[{"name":"ATR, Japan and Kyoto University, Sakyo-ku, Kyoto, Japan"}]},{"given":"Dana","family":"Kuli\u0107","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Ontario, Canada"}]},{"given":"Hiroshi","family":"Ishiguro","sequence":"additional","affiliation":[{"name":"ATR, Japan and Osaka University, Osaka, Japan"}]}],"member":"320","published-online":{"date-parts":[[2019,7,23]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2663204.2663263"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.2.1.Breazeal"},{"volume-title":"Proceedings of the International Conference on Agents and Artificial Intelligence (ICAART\u201912)","author":"Breuing A.","key":"e_1_2_1_3_1","unstructured":"A. Breuing and I. Wachsmuth . 2012. Let's talk topically with artificial agents! Providing agents with humanlike topic awareness in everyday dialog situations . In Proceedings of the International Conference on Agents and Artificial Intelligence (ICAART\u201912) . A. Breuing and I. Wachsmuth. 2012. Let's talk topically with artificial agents! Providing agents with humanlike topic awareness in everyday dialog situations. In Proceedings of the International Conference on Agents and Artificial Intelligence (ICAART\u201912)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2013.2283945"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157693"},{"volume-title":"Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201915)","author":"Chan M. T.","key":"e_1_2_1_6_1","unstructured":"M. T. Chan , R. Gorbet , P. Beesley , and D. Kuli\u010d . 2015. Curiosity-based learning algorithm for distributed interactive sculptural systems . In Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201915) . IEEE, Los Alamitos, CA, 3435--3441. M. T. Chan, R. Gorbet, P. Beesley, and D. Kuli\u010d. 2015. Curiosity-based learning algorithm for distributed interactive sculptural systems. In Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201915). IEEE, Los Alamitos, CA, 3435--3441."},{"key":"e_1_2_1_7_1","first-page":"13","article-title":"Exploring the possibility of using humanoid robots as instructional tools for teaching a second language in primary school","volume":"13","author":"Chang C.-W.","year":"2010","unstructured":"C.-W. Chang , J.-H. Lee , P.-Y. Chao , C.-Y. Wang , and G.-D. Chen . 2010 . Exploring the possibility of using humanoid robots as instructional tools for teaching a second language in primary school . Educ. Technol. Soc. 13 , 2 (2010), 13 -- 24 . C.-W. Chang, J.-H. Lee, P.-Y. Chao, C.-Y. Wang, and G.-D. Chen. 2010. Exploring the possibility of using humanoid robots as instructional tools for teaching a second language in primary school. Educ. Technol. Soc. 13, 2 (2010), 13--24.","journal-title":"Educ. Technol. Soc."},{"volume-title":"Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911)","author":"Chernova S.","key":"e_1_2_1_8_1","unstructured":"S. Chernova , N. Depalma , E. Morant , and C. Breazeal . 2011. Crowdsourcing human-robot interaction: Application from virtual to physical worlds . In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911) . IEEE, 21--26. S. Chernova, N. Depalma, E. Morant, and C. Breazeal. 2011. Crowdsourcing human-robot interaction: Application from virtual to physical worlds. In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201911). IEEE, 21--26."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622737.1622744"},{"volume-title":"Proceedings of the Workshop on Machine Learning for Interactive Systems (MLIS\u201912)","author":"Foster M. E.","key":"e_1_2_1_10_1","unstructured":"M. E. Foster , S. Keizer , Z. Wang , and O. Lemon . 2012. Machine learning of social states and skills for multi-party human-robot interaction . In Proceedings of the Workshop on Machine Learning for Interactive Systems (MLIS\u201912) . 9. M. E. Foster, S. Keizer, Z. Wang, and O. Lemon. 2012. Machine learning of social states and skills for multi-party human-robot interaction. In Proceedings of the Workshop on Machine Learning for Interactive Systems (MLIS\u201912). 9."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/100.580977"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2696454.2696469"},{"volume-title":"The Hidden Dimension","author":"Hall E. T.","key":"e_1_2_1_13_1","unstructured":"E. T. Hall . 1966. The Hidden Dimension . Doubleday , Garden City, NY . E. T. Hall. 1966. The Hidden Dimension. Doubleday, Garden City, NY."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2015.05.002"},{"volume-title":"Proceedings of the International Conference on Machine Learning, 448--456","author":"Ioffe S.","key":"e_1_2_1_15_1","unstructured":"S. Ioffe and C. Szegedy . 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift . In Proceedings of the International Conference on Machine Learning, 448--456 . S. Ioffe and C. Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of the International Conference on Machine Learning, 448--456."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3115\/980845.980950"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1901%262_4"},{"volume-title":"Developmental Psychology, and Brain Sciences","author":"Kaplan F.","key":"e_1_2_1_18_1","unstructured":"F. Kaplan and P.-Y. Oudeyer . 2011. From Hardware and Software to Kernels and Envelopes: A Concept Shift for Robotics , Developmental Psychology, and Brain Sciences . Cambridge University Press , Cambridge . F. Kaplan and P.-Y. Oudeyer. 2011. From Hardware and Software to Kernels and Envelopes: A Concept Shift for Robotics, Developmental Psychology, and Brain Sciences. Cambridge University Press, Cambridge."},{"volume-title":"Proceedings of the 5th ISCA Workshop on Speech Synthesis.","author":"Kawai H.","key":"e_1_2_1_19_1","unstructured":"H. Kawai , T. Toda , J. Ni , M. Tsuzaki , and K. Tokuda . 2004. XIMERA: A new TTS from ATR based on corpus-based technologies . In Proceedings of the 5th ISCA Workshop on Speech Synthesis. H. Kawai, T. Toda, J. Ni, M. Tsuzaki, and K. Tokuda. 2004. XIMERA: A new TTS from ATR based on corpus-based technologies. In Proceedings of the 5th ISCA Workshop on Speech Synthesis."},{"volume-title":"Proceedings of the 8th ACM\/IEEE International Conference on Human--Robot Interaction IEEE Press","author":"Kitade T.","key":"e_1_2_1_20_1","unstructured":"T. Kitade , S. Satake , T. Kanda , and M. Imai . 2013. Understanding suitable locations for waiting . In Proceedings of the 8th ACM\/IEEE International Conference on Human--Robot Interaction IEEE Press , Los Alamitos, CA, 57--64. T. Kitade, S. Satake, T. Kanda, and M. Imai. 2013. Understanding suitable locations for waiting. In Proceedings of the 8th ACM\/IEEE International Conference on Human--Robot Interaction IEEE Press, Los Alamitos, CA, 57--64."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-008-0009-8"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1080\/01638539809545028"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0082397"},{"volume-title":"Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201917)","author":"Law E.","key":"e_1_2_1_24_1","unstructured":"E. Law , V. Cai , Q. F. Liu , S. Sasy , J. Goh , A. Blidaru , and D. Kulic . 2017. A wizard-of-oz study of curiosity in human-robot interaction . In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201917) . E. Law, V. Cai, Q. F. Liu, S. Sasy, J. Goh, A. Blidaru, and D. Kulic. 2017. A wizard-of-oz study of curiosity in human-robot interaction. In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201917)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993190"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2588880"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-017-9671-8"},{"key":"e_1_2_1_28_1","article-title":"Two demonstrators are better than one-a social robot that learns to imitate people with different interaction styles","author":"Liu P.","year":"2017","unstructured":"P. Liu , D. F. Glas , T. Kanda , and H. Ishiguro . 2017 b. Two demonstrators are better than one-a social robot that learns to imitate people with different interaction styles . IEEE Trans. Cogn. Dev. Syst. Early access. P. Liu, D. F. Glas, T. Kanda, and H. Ishiguro. 2017b. Two demonstrators are better than one-a social robot that learns to imitate people with different interaction styles. IEEE Trans. Cogn. Dev. Syst. Early access.","journal-title":"IEEE Trans. Cogn. Dev. Syst. Early access."},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"K. Madani C. Sabourin and D. M. Ram\u00edk. 2016. Artificial curiosity emerging human-like behavior: Toward fully autonomous cognitive robots. In Computational Intelligence Springer Berlin 501--516.  K. Madani C. Sabourin and D. M. Ram\u00edk. 2016. Artificial curiosity emerging human-like behavior: Toward fully autonomous cognitive robots. In Computational Intelligence Springer Berlin 501--516.","DOI":"10.1007\/978-3-319-23392-5_28"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1228716.1228729"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2014.6926333"},{"volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201908)","author":"Nagai Y.","key":"e_1_2_1_32_1","unstructured":"Y. Nagai , C. Muhl , and K. J. Rohlfing . 2008. Toward designing a robot that learns actions from parental demonstrations . In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201908) . IEEE, Los Alamitos, CA, 3545--3550. Y. Nagai, C. Muhl, and K. J. Rohlfing. 2008. Toward designing a robot that learns actions from parental demonstrations. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201908). IEEE, Los Alamitos, CA, 3545--3550."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2006.890271"},{"volume-title":"Proceedings of the International Workshop on Cognitive Robotics (CogRob\u201912)","author":"Petrick R. P.","key":"e_1_2_1_34_1","unstructured":"R. P. Petrick and M. E. Foster . 2012. What would you like to drink? Recognising and planning with social states in a robot bartender domain . In Proceedings of the International Workshop on Cognitive Robotics (CogRob\u201912) . R. P. Petrick and M. E. Foster. 2012. What would you like to drink? Recognising and planning with social states in a robot bartender domain. In Proceedings of the International Workshop on Cognitive Robotics (CogRob\u201912)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2018.03.014"},{"volume-title":"Neural Networks","author":"Rojas R.","key":"e_1_2_1_36_1","unstructured":"R. Rojas . 1996. The backpropagation algorithm . In Neural Networks . Springer , Berlin , 149--182. R. Rojas. 1996. The backpropagation algorithm. In Neural Networks. Springer, Berlin, 149--182."},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"C. A. Rothkopf and D. H. Ballard. 2010. Credit assignment in multiple goal embodied visuomotor behavior. Front. Psychol. 1 173 (2010).  C. A. Rothkopf and D. H. Ballard. 2010. Credit assignment in multiple goal embodied visuomotor behavior. Front. Psychol. 1 173 (2010).","DOI":"10.3389\/fpsyg.2010.00173"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2016.11.016"},{"volume-title":"Intrinsically Motivated Learning in Natural and Artificial Systems","author":"Schmidhuber J.","key":"e_1_2_1_39_1","unstructured":"J. Schmidhuber . 2013. Maximizing fun by creating data with easily reducible subjective complexity . In Intrinsically Motivated Learning in Natural and Artificial Systems . Springer , 95--128. J. Schmidhuber. 2013. Maximizing fun by creating data with easily reducible subjective complexity. In Intrinsically Motivated Learning in Natural and Artificial Systems. Springer, 95--128."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.2200\/S00429ED1V01Y201207AIM018"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(02)00377-9"},{"volume-title":"Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201910)","author":"Shi C.","key":"e_1_2_1_42_1","unstructured":"C. Shi , T. Kanda , M. Shimada , F. Yamaoka , H. Ishiguro , and N. Hagita . 2010. Easy development of communicative behaviors in social robots . In Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201910) . 5302--5309. C. Shi, T. Kanda, M. Shimada, F. Yamaoka, H. Ishiguro, and N. Hagita. 2010. Easy development of communicative behaviors in social robots. In Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201910). 5302--5309."},{"key":"e_1_2_1_43_1","first-page":"00204","article-title":"Curious minds wonder alike: Studying multimodal behavioral dynamics to design social scaffolding of curiosity","volume":"1705","author":"Sinha T.","year":"2017","unstructured":"T. Sinha , Z. Bai , and J. Cassell . 2017 . Curious minds wonder alike: Studying multimodal behavioral dynamics to design social scaffolding of curiosity . Arxiv Preprint Arxiv : 1705 . 00204 . T. Sinha, Z. Bai, and J. Cassell. 2017. Curious minds wonder alike: Studying multimodal behavioral dynamics to design social scaffolding of curiosity. Arxiv Preprint Arxiv:1705.00204.","journal-title":"Arxiv Preprint Arxiv"},{"volume-title":"Proceedings of the Conference on Robot Learning. 67--76","author":"Thomason J.","key":"e_1_2_1_44_1","unstructured":"J. Thomason , A. Padmakumar , J. Sinapov , J. Hart , P. Stone , and R. J. Mooney . 2017. Opportunistic active learning for grounding natural language descriptions . In Proceedings of the Conference on Robot Learning. 67--76 . J. Thomason, A. Padmakumar, J. Sinapov, J. Hart, P. Stone, and R. J. Mooney. 2017. Opportunistic active learning for grounding natural language descriptions. In Proceedings of the Conference on Robot Learning. 67--76."},{"volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201906)","author":"Thomaz A. L.","key":"e_1_2_1_45_1","unstructured":"A. L. Thomaz and C. Breazeal . 2006. Reinforcement learning with human teachers: Evidence of feedback and guidance with implications for learning performance . In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201906) . 1000--1005. A. L. Thomaz and C. Breazeal. 2006. Reinforcement learning with human teachers: Evidence of feedback and guidance with implications for learning performance. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201906). 1000--1005."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2007.09.009"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/3109829.3109831"},{"key":"e_1_2_1_48_1","volume-title":"Spencer: A socially aware service robot for passenger guidance and help in busy airports. In Field and Service Robotics","author":"Triebel R.","year":"2016","unstructured":"R. Triebel , K. Arras , R. Alami , L. Beyer , S. Breuers , R. Chatila , M. Chetouani , D. Cremers , V. Evers , and M. Fiore . 2016 . Spencer: A socially aware service robot for passenger guidance and help in busy airports. In Field and Service Robotics . Springer , Berlin , 607--622. R. Triebel, K. Arras, R. Alami, L. Beyer, S. Breuers, R. Chatila, M. Chetouani, D. Cremers, V. Evers, and M. Fiore. 2016. Spencer: A socially aware service robot for passenger guidance and help in busy airports. In Field and Service Robotics. Springer, Berlin, 607--622."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1088\/1751-8113\/41\/6\/065004"},{"volume-title":"Proceedings of the Special Interest Group on Discourse and Dialogue Conference (SIGdial\u201913)","author":"Williams J. D.","key":"e_1_2_1_50_1","unstructured":"J. D. Williams , A. Raux , D. Ramachandran , and A. W. Black . 2013. The dialog state tracking challenge . In Proceedings of the Special Interest Group on Discourse and Dialogue Conference (SIGdial\u201913) . 404--413. J. D. Williams, A. Raux, D. Ramachandran, and A. W. Black. 2013. The dialog state tracking challenge. In Proceedings of the Special Interest Group on Discourse and Dialogue Conference (SIGdial\u201913). 404--413."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2006.06.008"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1349822.1349841"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2012.697046"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/235968.233324"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3326462","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3326462","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:18Z","timestamp":1750204398000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3326462"}},"subtitle":["A Curiosity-based Learning System for a Shopkeeper Robot"],"short-title":[],"issued":{"date-parts":[[2019,7,23]]},"references-count":54,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,9,30]]}},"alternative-id":["10.1145\/3326462"],"URL":"https:\/\/doi.org\/10.1145\/3326462","relation":{},"ISSN":["2573-9522"],"issn-type":[{"type":"electronic","value":"2573-9522"}],"subject":[],"published":{"date-parts":[[2019,7,23]]},"assertion":[{"value":"2018-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-07-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}