{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T12:44:56Z","timestamp":1788871496064,"version":"build-2803163510"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2014,10,14]],"date-time":"2014-10-14T00:00:00Z","timestamp":1413244800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004963","name":"Seventh Framework Programme","doi-asserted-by":"publisher","award":["270435"],"award-info":[{"award-number":["270435"]}],"id":[{"id":"10.13039\/501100004963","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2014,11,21]]},"abstract":"<jats:p>\n                    We describe a variety of machine-learning techniques that are being applied to social multiuser human--robot interaction using a robot bartender in our scenario. We first present a data-driven approach to social state recognition based on\n                    <jats:italic>supervised learning<\/jats:italic>\n                    . We then describe an approach to social skills execution\u2014that is, action selection for generating socially appropriate robot behavior\u2014which is based on\n                    <jats:italic>reinforcement learning<\/jats:italic>\n                    , using a data-driven simulation of multiple users to train execution policies for social skills. Next, we describe how these components for social state recognition and skills execution have been integrated into an end-to-end robot bartender system, and we discuss the results of a user evaluation. Finally, we present an alternative\n                    <jats:italic>unsupervised learning<\/jats:italic>\n                    framework that combines social state recognition and social skills execution based on hierarchical Dirichlet processes and an infinite POMDP interaction manager. The models make use of data from both human--human interactions collected in a number of German bars and human--robot interactions recorded in the evaluation of an initial version of the system.\n                  <\/jats:p>","DOI":"10.1145\/2600021","type":"journal-article","created":{"date-parts":[[2014,10,21]],"date-time":"2014-10-21T08:36:57Z","timestamp":1413880617000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Machine Learning for Social Multiparty Human--Robot Interaction"],"prefix":"10.1145","volume":"4","author":[{"given":"Simon","family":"Keizer","sequence":"first","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary","family":"Ellen Foster","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhuoran","family":"Wang","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oliver","family":"Lemon","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2014,10,14]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022689900470"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-012-0409-5"},{"key":"e_1_2_1_3_1","unstructured":"Matthew J. Beal Zoubin Ghahramani and Carl Edward Rasmussen. 2002. The infinite hidden Markov model. In Advances in Neural Information Processing Systems 14.  Matthew J. Beal Zoubin Ghahramani and Carl Edward Rasmussen. 2002. The infinite hidden Markov model. In Advances in Neural Information Processing Systems 14."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1647314.1647323"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1708376.1708411"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910)","author":"Bunt Harry","year":"2010","unstructured":"Harry Bunt , Jan Alexandersson , Jean Carletta , Jae-Woong Choe , Alex Chengyu Fang , Koiti Hasida , Kiyong Lee , Volha Petukhova , Andrei Popescu-Belis , Laurent Romary , Claudia Soria , and David Traum . 2010 . Towards an ISO standard for dialogue act annotation . In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910) . Harry Bunt, Jan Alexandersson, Jean Carletta, Jae-Woong Choe, Alex Chengyu Fang, Koiti Hasida, Kiyong Lee, Volha Petukhova, Andrei Popescu-Belis, Laurent Romary, Claudia Soria, and David Traum. 2010. Towards an ISO standard for dialogue act annotation. In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom-PASSAT.2012.51"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 10th National Conference on Artificial Intelligence. 183--188","author":"Chrisman Lonnie","year":"1992","unstructured":"Lonnie Chrisman . 1992 . Reinforcement learning with perceptual aliasing: The perceptual distinctions approach . In Proceedings of the 10th National Conference on Artificial Intelligence. 183--188 . Lonnie Chrisman. 1992. Reinforcement learning with perceptual aliasing: The perceptual distinctions approach. In Proceedings of the 10th National Conference on Artificial Intelligence. 183--188."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-377-6.50023-2"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1966407.1966410"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2009.07.001"},{"key":"e_1_2_1_14_1","unstructured":"Finale Doshi-Velez. 2009. The infinite partially observable Markov decision process. In Advances in Neural Information Processing Systems 22.  Finale Doshi-Velez. 2009. The infinite partially observable Markov decision process. In Advances in Neural Information Processing Systems 22."},{"key":"e_1_2_1_15_1","unstructured":"Mary Ellen Foster. 2002. State of the Art Review: Multimodal Fission. Deliverable 6.1. COMIC project.  Mary Ellen Foster. 2002. State of the Art Review: Multimodal Fission. Deliverable 6.1. COMIC project."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2522848.2522879"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2388676.2388680"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1214\/10-AOAS395"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007421302149"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 17th International Conference on Machine Learning (ICML\u201900)","author":"Hall Mark A.","year":"2000","unstructured":"Mark A. Hall . 2000 . Correlation-based feature selection for discrete and numeric class machine learning . In Proceedings of the 17th International Conference on Machine Learning (ICML\u201900) . 359--366. Mark A. Hall. 2000. Correlation-based feature selection for discrete and numeric class machine learning. In Proceedings of the 17th International Conference on Machine Learning (ICML\u201900). 359--366."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2003.1245283"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Michael S. Hamada Alyson Wilson C. Shane Reese and Harry Martz. 2008. Bayesian Reliability. Springer.  Michael S. Hamada Alyson Wilson C. Shane Reese and Harry Martz. 2008. Bayesian Reliability. Springer.","DOI":"10.1007\/978-0-387-77950-8"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/57.1.97"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214501750332758"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.2307\/3315951"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the11th Conference on Uncertainty in Artificial Intelligence. 338--345","author":"George","unstructured":"George H. John and Pat Langley. 1995. Estimating continuous distributions in Bayesian classifiers . In Proceedings of the11th Conference on Uncertainty in Artificial Intelligence. 338--345 . George H. John and Pat Langley. 1995. Estimating continuous distributions in Bayesian classifiers. In Proceedings of the11th Conference on Uncertainty in Artificial Intelligence. 338--345."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence (UAI\u201910)","author":"Matthew","unstructured":"Matthew J. Johnson and Alan Willsky. 2010. The hierarchical Dirichlet process hidden semi-Markov model . In Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence (UAI\u201910) . Matthew J. Johnson and Alan Willsky. 2010. The hierarchical Dirichlet process hidden semi-Markov model. In Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence (UAI\u201910)."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201913)","author":"Keizer Simon","year":"2013","unstructured":"Simon Keizer , Mary Ellen Foster , Oliver Lemon , Andre Gaschler , and Manuel Giuliani . 2013 a. Training and evaluation of an MDP model for social multi-user human-robot interaction . In Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201913) . Simon Keizer, Mary Ellen Foster, Oliver Lemon, Andre Gaschler, and Manuel Giuliani. 2013a. Training and evaluation of an MDP model for social multi-user human-robot interaction. In Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201913)."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the International Conference on Social Robotics (ICSR\u201913)","author":"Keizer Simon","year":"2013","unstructured":"Simon Keizer , Pantelis Kastoris , Mary Ellen Foster , Amol Deshmukh , and Oliver Lemon . 2013 b. User evaluation of a multi-user social interaction model implemented on a Nao robot . In Proceedings of the International Conference on Social Robotics (ICSR\u201913) Workshop on Robots in Public Spaces. Simon Keizer, Pantelis Kastoris, Mary Ellen Foster, Amol Deshmukh, and Oliver Lemon. 2013b. User evaluation of a multi-user social interaction model implemented on a Nao robot. In Proceedings of the International Conference on Social Robotics (ICSR\u201913) Workshop on Robots in Public Spaces."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201911)","author":"Klotz David","year":"2011","unstructured":"David Klotz , Johannes Wienke , Julia Peltason , Britta Wrede , Sebastian Wrede , Vasil Khalidov , and Jean-Marc Odobez . 2011 . Engagement-based multi-party dialog with a humanoid robot . In Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201911) . David Klotz, Johannes Wienke, Julia Peltason, Britta Wrede, Sebastian Wrede, Vasil Khalidov, and Jean-Marc Odobez. 2011. Engagement-based multi-party dialog with a humanoid robot. In Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL\u201911)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(97)00043-X"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.2307\/2347628"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2425296.2425319"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL","author":"Lison Pierre","year":"2011","unstructured":"Pierre Lison . 2011 . Multi-policy dialogue management . In Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2011). Portland, OR. Pierre Lison. 2011. Multi-policy dialogue management. In Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2011). Portland, OR."},{"key":"e_1_2_1_37_1","volume-title":"De Ruiter","author":"Loth Sebastian","year":"2013","unstructured":"Sebastian Loth , Kerstin Huth , and Jan P . De Ruiter . 2013 . Automatic detection of service initiation signals used in bars. Frontiers in Psychology 4, 557 (2013). DOI: http:\/\/dx.doi.org\/10.3389\/fpsyg.2013.00557 10.3389\/fpsyg.2013.00557 Sebastian Loth, Kerstin Huth, and Jan P. De Ruiter. 2013. Automatic detection of service initiation signals used in bars. Frontiers in Psychology 4, 557 (2013). DOI: http:\/\/dx.doi.org\/10.3389\/fpsyg.2013.00557"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.collaboratecom.2012.250429"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) 1998 Fall Symposium: Planning with Partially Observable Markov Decision Processes.","author":"Mahadevan Sridhar","year":"1998","unstructured":"Sridhar Mahadevan . 1998 . Partially observable semi-Markov decision processes: Theory and applications in engineering and cognitive science . In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) 1998 Fall Symposium: Planning with Partially Observable Markov Decision Processes. Sridhar Mahadevan. 1998. Partially observable semi-Markov decision processes: Theory and applications in engineering and cognitive science. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) 1998 Fall Symposium: Planning with Partially Observable Markov Decision Processes."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13318-3_38"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2012.6343882"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.1699114"},{"key":"e_1_2_1_43_1","volume-title":"Computer-Intensive Methods for Testing Hypotheses: An Introduction","author":"Noreen Eric W.","unstructured":"Eric W. Noreen . 1989. Computer-Intensive Methods for Testing Hypotheses: An Introduction . Wiley-Interscience . Eric W. Noreen. 1989. Computer-Intensive Methods for Testing Hypotheses: An Introduction. Wiley-Interscience."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of ICRA Workshop on Semantics, Identification and Control of Robot-Human-Environment Interaction.","author":"Pateraki Maria","year":"2013","unstructured":"Maria Pateraki , Markos Sigalas , Georgios Chliveros , and Panos Trahanias . 2013 . Visual human-robot communication in social settings . In Proceedings of ICRA Workshop on Semantics, Identification and Control of Robot-Human-Environment Interaction. Maria Pateraki, Markos Sigalas, Georgios Chliveros, and Panos Trahanias. 2013. Visual human-robot communication in social settings. In Proceedings of ICRA Workshop on Semantics, Identification and Control of Robot-Human-Environment Interaction."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS","author":"Ronald P.","year":"2013","unstructured":"Ronald P. A. Petrick and Mary Ellen Foster. 2013. Planning for social interaction in a robot bartender domain . In Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS 2013 ), Special Track on Novel Applications. Rome, Italy. Ronald P. A. Petrick and Mary Ellen Foster. 2013. Planning for social interaction in a robot bartender domain. In Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS 2013), Special Track on Novel Applications. Rome, Italy."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) 2012 Workshop on Grounding Language for Physical Systems.","author":"Petrick Ronald P. A.","year":"2012","unstructured":"Ronald P. A. Petrick , Mary Ellen Foster , and Amy Isard . 2012 . Social state recognition and knowledge-level planning for human-robot interaction in a bartender domain . In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) 2012 Workshop on Grounding Language for Physical Systems. Ronald P. A. Petrick, Mary Ellen Foster, and Amy Isard. 2012. Social state recognition and knowledge-level planning for human-robot interaction in a bartender domain. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) 2012 Workshop on Grounding Language for Physical Systems."},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the ICML Workshop on Hierarchy and Memory in Reinforcement Learning.","author":"Pineau Joelle","year":"2001","unstructured":"Joelle Pineau , Nicholas Roy , and Sebastian Thrun . 2001 . A hierarchical approach to POMDP planning and execution . In Proceedings of the ICML Workshop on Hierarchy and Memory in Reinforcement Learning. Joelle Pineau, Nicholas Roy, and Sebastian Thrun. 2001. A hierarchical approach to POMDP planning and execution. In Proceedings of the ICML Workshop on Hierarchy and Memory in Reinforcement Learning."},{"key":"e_1_2_1_48_1","volume-title":"Programs for Machine Learning. Morgan Kaufmann","author":"Quinlan Ross","unstructured":"Ross Quinlan . 1993. C4.5 : Programs for Machine Learning. Morgan Kaufmann , San Mateo, CA . Ross Quinlan. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00038"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDial\u201912)","author":"Selfridge Ethan O.","unstructured":"Ethan O. Selfridge , Iker Arizmendi , Peter A. Heeman , and Jason D. Williams . 2012. Integrating incremental speech recognition and POMDP-based dialogue systems . In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDial\u201912) . 275--279. Ethan O. Selfridge, Iker Arizmendi, Peter A. Heeman, and Jason D. Williams. 2012. Integrating incremental speech recognition and POMDP-based dialogue systems. In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDial\u201912). 275--279."},{"key":"e_1_2_1_51_1","first-page":"639","article-title":"A constructive definition of Dirichlet priors","volume":"4","author":"Sethuraman Jayaram","year":"1994","unstructured":"Jayaram Sethuraman . 1994 . A constructive definition of Dirichlet priors . Statistica Sinica 4 (1994), 639 -- 650 . Jayaram Sethuraman. 1994. A constructive definition of Dirichlet priors. Statistica Sinica 4 (1994), 639--650.","journal-title":"Statistica Sinica"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622519.1622525"},{"key":"e_1_2_1_53_1","volume-title":"Barto","author":"Sutton Richard S.","year":"1998","unstructured":"Richard S. Sutton and Andrew G . Barto . 1998 . Reinforcement Learning : An Introduction. MIT Press . Richard S. Sutton and Andrew G. Barto. 1998. Reinforcement Learning: An Introduction. MIT Press."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214506000000302"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2009.07.003"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/SLT.2012.6424162"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11168-006-9010-2"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2006.06.008"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC\u201906)","author":"Wittenburg Peter","year":"2006","unstructured":"Peter Wittenburg , Hennie Brugman , Albert Russel , Alex Klassmann , and Han Sloetjes . 2006 . ELAN: A professional framework for multimodality research . In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC\u201906) . Peter Wittenburg, Hennie Brugman, Albert Russel, Alex Klassmann, and Han Sloetjes. 2006. ELAN: A professional framework for multimodality research. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC\u201906)."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2009.04.001"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2600021","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2600021","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:01:20Z","timestamp":1750215680000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2600021"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,14]]},"references-count":58,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,11,21]]}},"alternative-id":["10.1145\/2600021"],"URL":"https:\/\/doi.org\/10.1145\/2600021","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,10,14]]},"assertion":[{"value":"2013-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-10-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}