{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,28]],"date-time":"2025-06-28T09:42:06Z","timestamp":1751103726310,"version":"3.41.0"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2014,6,1]],"date-time":"2014-06-01T00:00:00Z","timestamp":1401580800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004963","name":"Seventh Framework Programme","doi-asserted-by":"publisher","award":["215554"],"award-info":[{"award-number":["215554"]}],"id":[{"id":"10.13039\/501100004963","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2014,7]]},"abstract":"<jats:p>Social perception abilities are among the most important skills necessary for robots to engage humans in natural forms of interaction. Affect-sensitive robots are more likely to be able to establish and maintain believable interactions over extended periods of time. Nevertheless, the integration of affect recognition frameworks in real-time human-robot interaction scenarios is still underexplored. In this article, we propose and evaluate a context-sensitive affect recognition framework for a robotic game companion for children. The robot can automatically detect affective states experienced by children in an interactive chess game scenario. The affect recognition framework is based on the automatic extraction of task features and social interaction-based features. Vision-based indicators of the children\u2019s nonverbal behaviour are merged with contextual features related to the game and the interaction and given as input to support vector machines to create a context-sensitive multimodal system for affect recognition. The affect recognition framework is fully integrated in an architecture for adaptive human-robot interaction. Experimental evaluation showed that children\u2019s affect can be successfully predicted using a combination of behavioural and contextual data related to the game and the interaction with the robot. It was found that contextual data alone can be used to successfully predict a subset of affective dimensions, such as interest toward the robot. Experiments also showed that engagement with the robot can be predicted using information about the user\u2019s valence, interest and anticipatory behaviour. These results provide evidence that social engagement can be modelled as a state consisting of affect and attention components in the context of the interaction.<\/jats:p>","DOI":"10.1145\/2622615","type":"journal-article","created":{"date-parts":[[2014,7,1]],"date-time":"2014-07-01T14:23:02Z","timestamp":1404224582000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Context-Sensitive Affect Recognition for a Robotic Game Companion"],"prefix":"10.1145","volume":"4","author":[{"given":"Ginevra","family":"Castellano","sequence":"first","affiliation":[{"name":"University of Birmingham, United Kingdom"}]},{"given":"Iolanda","family":"Leite","sequence":"additional","affiliation":[{"name":"Yale University, New Haven, CT, USA"}]},{"given":"Andr\u00e9","family":"Pereira","sequence":"additional","affiliation":[{"name":"INESC-ID and Instituto Superior T\u00e9cnico, Technical University of Lisbon, Porto Salvo, Portugal"}]},{"given":"Carlos","family":"Martinho","sequence":"additional","affiliation":[{"name":"INESC-ID and Instituto Superior T\u00e9cnico, Technical University of Lisbon, Porto Salvo, Portugal"}]},{"given":"Ana","family":"Paiva","sequence":"additional","affiliation":[{"name":"INESC-ID and Instituto Superior T\u00e9cnico, Technical University of Lisbon, Porto Salvo, Portugal"}]},{"given":"Peter W.","family":"Mcowan","sequence":"additional","affiliation":[{"name":"Queen Mary University of London, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2014,6]]},"reference":[{"volume-title":"Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction (ACII\u201909)","author":"Afzal S.","key":"e_1_2_1_1_1"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.111.2.256"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070481.2070528"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2009.0157"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/3468.952718"},{"volume-title":"Workshop on Affective Interaction in Natural Environments (AFFINE), ACM International Conference on Multimodal Interfaces (ICMI\u201908)","author":"Castellano G.","key":"e_1_2_1_6_1"},{"volume-title":"Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction (ACII\u201909)","author":"Castellano G.","key":"e_1_2_1_7_1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-009-0031-7"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874142"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom-PASSAT.2012.51"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0219843613500102"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2011.2172415"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1647314.1647336"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1075\/is.11.2.04cas"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74889-2_7"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_17_1","unstructured":"Y.-W. Chen and C.-J. Lin. 2006. Combining SVMs with various feature selection strategies. In Feature Extraction Foundations and Applications I. Guyon S. Gunn M. Nikravesh and L. Zadeh (Eds.). Springer.  Y.-W. Chen and C.-J. Lin. 2006. Combining SVMs with various feature selection strategies. In Feature Extraction Foundations and Applications I. Guyon S. Gunn M. Nikravesh and L. Zadeh (Eds.). Springer."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2006.2004"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2007.79"},{"volume-title":"Proceedings of the Workshop on Real Time Computer Vision for Human Computer Interaction, IEEE International Conference on Computer Vision and Pattern Recognition.","author":"el Kaliouby R.","key":"e_1_2_1_20_1"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070481.2070545"},{"volume-title":"Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (IEEE FG\u201911)","author":"Eyben F.","key":"e_1_2_1_22_1"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957785"},{"volume-title":"New Perspective in Early Communicative Development","author":"Fogel A.","key":"e_1_2_1_24_1"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.4018\/jse.2010101605"},{"volume-title":"Proceedings of the International Conference on Intelligent Virtual Agents (IVA\u201910)","author":"Gunes H.","key":"e_1_2_1_26_1"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2008.927269"},{"key":"e_1_2_1_28_1","unstructured":"H. Gunes C. Shan S. Chen and Y. Tian. 2012. Bodily expression for automatic affect recognition. In Advances in Emotion Recognition A. Konar and A. Chakraborty (Eds.). Wiley-Blackwell.  H. Gunes C. Shan S. Chen and Y. Tian. 2012. Bodily expression for automatic affect recognition. In Advances in Emotion Recognition A. Konar and A. Chakraborty (Eds.). Wiley-Blackwell."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2388676.2388688"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","unstructured":"A. W. Harrist and R. M. Waugh. 2002. Dyadic synchrony: Its structure and function in children\u2019s development. Developmental Review 22 (2002).  A. W. Harrist and R. M. Waugh. 2002. Dyadic synchrony: Its structure and function in children\u2019s development. Developmental Review 22 (2002).","DOI":"10.1016\/S0273-2297(02)00500-2"},{"key":"e_1_2_1_31_1","first-page":"33","article-title":"The influence of social presence on acceptance of a companion robot by older people","volume":"2","author":"Heerink M.","year":"2008","journal-title":"Journal of Physical Agents"},{"volume-title":"Proceedings of the 2006 IEEE-RAS International Conference on Humanoid Robots (Humanoids\u201906)","author":"Hegel F.","key":"e_1_2_1_32_1"},{"key":"e_1_2_1_33_1","unstructured":"C.-W. Hsu C.-C. Chang and C.-J Lin. 2010. A Practical Guide to Support Vector Classification.  C.-W. Hsu C.-C. Chang and C.-J Lin. 2010. A Practical Guide to Support Vector Classification."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2007.02.003"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101300"},{"volume-title":"Proceedings of the 22nd Conference on Artificial Intelligence (AAAI\u201907)","author":"Kidd C. D.","key":"e_1_2_1_36_1"},{"volume-title":"Proceedings of the 6th International Language Resources and Evaluation (LREC\u201908)","year":"2008","author":"Kipp Michael","key":"e_1_2_1_37_1"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2009.09.015"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2010.2103557"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2007.904899"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34103-8_30"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157811"},{"volume-title":"Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201908)","year":"2008","author":"Leite Iolanda","key":"e_1_2_1_43_1"},{"volume-title":"IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE","author":"Leite I.","key":"e_1_2_1_44_1"},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","unstructured":"I. Leite A. Pereira C. Martinho and A. Paiva. 2008b. Are emotional robots more fun to play with&quest; In Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201908). 77--82. DOI: http:\/\/dx.doi.org\/10.1109\/ROMAN.2008.4600646  I. Leite A. Pereira C. Martinho and A. Paiva. 2008b. Are emotional robots more fun to play with&quest; In Proceedings of the 17th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201908). 77--82. DOI: http:\/\/dx.doi.org\/10.1109\/ROMAN.2008.4600646","DOI":"10.1109\/ROMAN.2008.4600646"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2008.2001362"},{"volume-title":"Proceedings of the American Association for Artificial Intelligence Technical Conference. 1--6.","year":"2006","author":"Martinho Carlos","key":"e_1_2_1_47_1"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957731"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/AMC.2006.1631755"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2009.5326143"},{"volume-title":"Proceedings of the 16th IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN\u201907)","author":"Mower E.","key":"e_1_2_1_51_1"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719990"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.9"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-7687.2008.00722.x"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957738"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-009-0029-1"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1655260.1655269"},{"volume-title":"A Goal and Belief View of Multimodal Communication","author":"Poggi I.","key":"e_1_2_1_58_1"},{"volume-title":"Proceeding of the 5th ACM\/IEEE International Conference on Human-Robot Interaction (HRI\u201910)","author":"Rich Charles","key":"e_1_2_1_59_1"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-009-0028-2"},{"key":"e_1_2_1_61_1","series-title":"Series in Affective Science","volume-title":"Emotion: Theory, Methods, Research","author":"Roseman I.","year":"2001"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0077714"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753567"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957781"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-bioeng-071811-150036"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.34"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.17"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1521\/scpq.18.2.158.21860"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/964442.964458"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.25"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207679"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0707769104"},{"key":"e_1_2_1_73_1","doi-asserted-by":"crossref","unstructured":"A. Tapus M. J. Mataric and B. Scassellati. 2007. The grand challenges in socially assistive robotics. IEEE Robotics and Automation Magazine (RAM) Special Issue on Grand Challenges in Robotics 14 1 (2007).  A. Tapus M. J. Mataric and B. Scassellati. 2007. The grand challenges in socially assistive robotics. IEEE Robotics and Automation Magazine (RAM) Special Issue on Grand Challenges in Robotics 14 1 (2007).","DOI":"10.1109\/MRA.2007.339605"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1082473.1082823"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070481.2070544"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2009.2035747"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.52"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2622615","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2622615","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:19:45Z","timestamp":1750231185000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2622615"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,6]]},"references-count":77,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2014,7]]}},"alternative-id":["10.1145\/2622615"],"URL":"https:\/\/doi.org\/10.1145\/2622615","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2014,6]]},"assertion":[{"value":"2007-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-06-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}