{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T04:35:56Z","timestamp":1780634156783,"version":"3.54.1"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,12,22]],"date-time":"2015-12-22T00:00:00Z","timestamp":1450742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["C2015-20"],"award-info":[{"award-number":["C2015-20"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004418","name":"Vrije Universiteit Brussel","doi-asserted-by":"publisher","award":["IRP5"],"award-info":[{"award-number":["IRP5"]}],"id":[{"id":"10.13039\/501100004418","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2016,1,7]]},"abstract":"<jats:p>We propose a real-time system that continuously recognizes emotions from body movements. The combined low-level 3D postural features and high-level kinematic and geometrical features are fed to a Random Forests classifier through summarization (statistical values) or aggregation (bag of features). In order to improve the generalization capability and the robustness of the system, a novel semisupervised adaptive algorithm is built on top of the conventional Random Forests classifier. The MoCap UCLIC affective gesture database (labeled with four emotions) was used to train the Random Forests classifier, which led to an overall recognition rate of 78% using a 10-fold cross-validation. Subsequently, the trained classifier was used in a stream-based semisupervised Adaptive Random Forests method for continuous unlabeled Kinect data classification. The very low update cost of our adaptive classifier makes it highly suitable for data stream applications. Tests performed on the publicly available emotion datasets (body gestures and facial expressions) indicate that our new classifier outperforms existing algorithms for data streams in terms of accuracy and computational costs.<\/jats:p>","DOI":"10.1145\/2738221","type":"journal-article","created":{"date-parts":[[2015,12,23]],"date-time":"2015-12-23T15:19:49Z","timestamp":1450883989000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["Adaptive Real-Time Emotion Recognition from Body Movements"],"prefix":"10.1145","volume":"5","author":[{"given":"Weiyi","family":"Wang","sequence":"first","affiliation":[{"name":"AVSP-ETRO, Vrije Universiteit Brussel (VUB), Brussels, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentin","family":"Enescu","sequence":"additional","affiliation":[{"name":"AVSP-ETRO, Vrije Universiteit Brussel (VUB), Brussels, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hichem","family":"Sahli","sequence":"additional","affiliation":[{"name":"AVSP-ETRO, Vrije Universiteit Brussel (VUB) and Interuniversity Microelectronics Center (IMEC), Brussels, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,12,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of Nonrigid and Articulated Motion Workshop. 90--102","author":"Jake","unstructured":"Jake K. Aggarwal and Quin Cai. 1997. Human motion analysis: A review . In Proceedings of Nonrigid and Articulated Motion Workshop. 90--102 . Jake K. Aggarwal and Quin Cai. 1997. Human motion analysis: A review. In Proceedings of Nonrigid and Articulated Motion Workshop. 90--102."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0020989"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1068\/p5096"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2006.05.005"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of 2011 IEEE International Conference on Automatic Face Gesture Recognition and Workshops (FG\u201911)","author":"Baltrusaitis Tadas","year":"2011","unstructured":"Tadas Baltrusaitis , D. McDuff , N. Banda , M. Mahmoud , R. el Kaliouby , P. Robinson , and R. Picard . 2011. Real-time inference of mental states from facial expressions and upper body gestures . In Proceedings of 2011 IEEE International Conference on Automatic Face Gesture Recognition and Workshops (FG\u201911) . 909--914. DOI:http:\/\/dx.doi.org\/10.1109\/FG. 2011 .5771372 10.1109\/FG.2011.5771372 Tadas Baltrusaitis, D. McDuff, N. Banda, M. Mahmoud, R. el Kaliouby, P. Robinson, and R. Picard. 2011. Real-time inference of mental states from facial expressions and upper body gestures. In Proceedings of 2011 IEEE International Conference on Automatic Face Gesture Recognition and Workshops (FG\u201911). 909--914. DOI:http:\/\/dx.doi.org\/10.1109\/FG.2011.5771372"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0025827"},{"key":"e_1_2_1_7_1","first-page":"33","article-title":"Multimodal child-robot interaction: Building social bonds","volume":"1","author":"Belpaeme Tony","year":"2012","unstructured":"Tony Belpaeme , Paul E. Baxter , Robin Read , Rachel Wood , Heriberto Cuay\u00e1huitl , Bernd Kiefer , Stefania Racioppa , Ivana Kruijff-Korbayov\u00e1 , Georgios Athanasopoulos , Valentin Enescu , Rosemarijn Looije , Mark Neerincx , Yiannis Demiris , Raquel Ros-Espinoza , Aryel Beck , Lola Ca\u00f1amero , Antione Hiolle , Matthew Lewis , Ilaria Baroni , Marco Nalin , Piero Cosi , Giulio Paci , Fabio Tesser , Giacomo Sommavilla , and Remi Humbert . 2012 . Multimodal child-robot interaction: Building social bonds . Journal of Human-Robot Interaction 1 , 2 (2012), 33 -- 53 . DOI:http:\/\/dx.doi.org\/10.5898\/jhri.v1i2.62 10.5898\/jhri.v1i2.62 Tony Belpaeme, Paul E. Baxter, Robin Read, Rachel Wood, Heriberto Cuay\u00e1huitl, Bernd Kiefer, Stefania Racioppa, Ivana Kruijff-Korbayov\u00e1, Georgios Athanasopoulos, Valentin Enescu, Rosemarijn Looije, Mark Neerincx, Yiannis Demiris, Raquel Ros-Espinoza, Aryel Beck, Lola Ca\u00f1amero, Antione Hiolle, Matthew Lewis, Ilaria Baroni, Marco Nalin, Piero Cosi, Giulio Paci, Fabio Tesser, Giacomo Sommavilla, and Remi Humbert. 2012. Multimodal child-robot interaction: Building social bonds. Journal of Human-Robot Interaction 1, 2 (2012), 33--53. DOI:http:\/\/dx.doi.org\/10.5898\/jhri.v1i2.62","journal-title":"Journal of Human-Robot Interaction"},{"key":"e_1_2_1_9_1","volume-title":"Joint Proceedings of the 2005, 2006, and 2007 International Workshops on Emotion in HCI. Citeseer, 74--80","author":"Bianchi-Berthouze Nadia","unstructured":"Nadia Bianchi-Berthouze , P. Cairns , and A. L. Cox . 2008. On posture as a modality for expressing and recognizing emotions . In Joint Proceedings of the 2005, 2006, and 2007 International Workshops on Emotion in HCI. Citeseer, 74--80 . Nadia Bianchi-Berthouze, P. Cairns, and A. L. Cox. 2008. On posture as a modality for expressing and recognizing emotions. In Joint Proceedings of the 2005, 2006, and 2007 International Workshops on Emotion in HCI. Citeseer, 74--80."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/09540090310001658793"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of 2014 Convention on Motion, Emotion and Cognition","volume":"1","author":"Camurri Antonio","year":"2004","unstructured":"Antonio Camurri , Paolo Coletta , Alberto Massari , Barbara Mazzarino , Massimiliano Peri , Matteo Ricchetti , Andrea Ricci , Gualtiero Volpe , and Max Msp . 2004 . Toward real-time multimodal processing: EyesWeb 4.0 . In Proceedings of 2014 Convention on Motion, Emotion and Cognition , Vol. 1 . Antonio Camurri, Paolo Coletta, Alberto Massari, Barbara Mazzarino, Massimiliano Peri, Matteo Ricchetti, Andrea Ricci, Gualtiero Volpe, and Max Msp. 2004. Toward real-time multimodal processing: EyesWeb 4.0. In Proceedings of 2014 Convention on Motion, Emotion and Cognition, Vol. 1."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(03)00050-8"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390169"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of 2007 Convention on Artificial and Ambient Intelligence. Newcastle upon Tyne, UK, 1--6.","author":"Castellano Ginevra","year":"2007","unstructured":"Ginevra Castellano , Antonio Camurri , Barbara Mazzarino , and Gualtiero Volpe . 2007 a. A mathematical model to analyse the dynamics of gesture expressivity . In Proceedings of 2007 Convention on Artificial and Ambient Intelligence. Newcastle upon Tyne, UK, 1--6. Ginevra Castellano, Antonio Camurri, Barbara Mazzarino, and Gualtiero Volpe. 2007a. A mathematical model to analyse the dynamics of gesture expressivity. In Proceedings of 2007 Convention on Artificial and Ambient Intelligence. Newcastle upon Tyne, UK, 1--6."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74889-2_7"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74889-2_7"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0025737"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10919-012-0130-0"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2009.0190"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00990296"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.107"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74889-2_43"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-006-6226-1"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of IEEE Workshops on Computer Vision and Pattern Recognition. 1--6. DOI:http:\/\/dx.doi.org\/10","author":"Glowinski Donald","year":"2008","unstructured":"Donald Glowinski , Antonio Camurri , Gualtiero Volpe , Nele Dael , and Klaus R. Scherer . 2008. Technique for automatic emotion recognition by body gesture analysis . In Proceedings of IEEE Workshops on Computer Vision and Pattern Recognition. 1--6. DOI:http:\/\/dx.doi.org\/10 .1109\/CVPRW. 2008 .4563173 10.1109\/CVPRW.2008.4563173 Donald Glowinski, Antonio Camurri, Gualtiero Volpe, Nele Dael, and Klaus R. Scherer. 2008. Technique for automatic emotion recognition by body gesture analysis. In Proceedings of IEEE Workshops on Computer Vision and Pattern Recognition. 1--6. DOI:http:\/\/dx.doi.org\/10.1109\/CVPRW.2008.4563173"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.7"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2013.64"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2005.1513796"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.39"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2008.927269"},{"key":"e_1_2_1_31_1","volume-title":"Categorical and dimensional affect analysis in continuous input: Current trends and future directions. Image and Vision Computing (July","author":"Gunes Hatice","year":"2012","unstructured":"Hatice Gunes and Bj\u00f6rn Schuller . 2012. Categorical and dimensional affect analysis in continuous input: Current trends and future directions. Image and Vision Computing (July 2012 ). DOI:http:\/\/dx.doi.org\/10.1016\/j.imavis.2012.06.016 10.1016\/j.imavis.2012.06.016 Hatice Gunes and Bj\u00f6rn Schuller. 2012. Categorical and dimensional affect analysis in continuous input: Current trends and future directions. Image and Vision Computing (July 2012). DOI:http:\/\/dx.doi.org\/10.1016\/j.imavis.2012.06.016"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2003.1246627"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/11573548_1"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2013.29"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the Workshop on Adapting the Interaction Style to Affective Factors.","author":"Kleinsmith Andrea","year":"2005","unstructured":"Andrea Kleinsmith . 2005 . An incremental and interactive affective posture recognition system . In Proceedings of the Workshop on Adapting the Interaction Style to Affective Factors. Andrea Kleinsmith. 2005. An incremental and interactive affective posture recognition system. In Proceedings of the Workshop on Adapting the Interaction Style to Affective Factors."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74889-2_5"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2012.16"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2010.2103557"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/11527886_8"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2006.04.003"},{"key":"e_1_2_1_42_1","volume-title":"Kroemer-Elbert","author":"Kroemer Karl H. E.","year":"1994","unstructured":"Karl H. E. Kroemer , Henrike B. Kroemer , and Katrin E . Kroemer-Elbert . 1994 . Ergonomics : How to Design for Ease and Efficiency. Prentice Hall . Karl H. E. Kroemer, Henrike B. Kroemer, and Katrin E. Kroemer-Elbert. 1994. Ergonomics: How to Design for Ease and Efficiency. Prentice Hall."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.20"},{"key":"e_1_2_1_44_1","unstructured":"Albert Mehrabian. 2007. Nonverbal communication.  Albert Mehrabian. 2007. Nonverbal communication."},{"key":"e_1_2_1_45_1","first-page":"315","article-title":"Affective state level recognition in naturalistic facial and vocal expressions","volume":"44","author":"Meng Hongying","year":"2014","unstructured":"Hongying Meng and Nadia Bianchi-Berthouze . 2014 . Affective state level recognition in naturalistic facial and vocal expressions . IEEE Transactions on Systems, Man, and Cybernetics Part B 44 , 3 (2014), 315 -- 328 . Hongying Meng and Nadia Bianchi-Berthouze. 2014. Affective state level recognition in naturalistic facial and vocal expressions. IEEE Transactions on Systems, Man, and Cybernetics Part B 44, 3 (2014), 315--328.","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics Part B"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2012.08.018"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2011.5946939"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2015.7344640"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the International Conference on Kansei Engineering and Emotion Research. 1684--1693","author":"Orero Joseph Onderi","year":"2010","unstructured":"Joseph Onderi Orero , Florent Levillain , Marc Damez-Fontaine , Maria Rifqi , and Bernadette Bouchon-Meunier . 2010 . Assessing gameplay emotions from physiological signals . In Proceedings of the International Conference on Kansei Engineering and Emotion Research. 1684--1693 . Joseph Onderi Orero, Florent Levillain, Marc Damez-Fontaine, Maria Rifqi, and Bernadette Bouchon-Meunier. 2010. Assessing gameplay emotions from physiological signals. In Proceedings of the International Conference on Kansei Engineering and Emotion Research. 1684--1693."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/2062850.2062905"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2009.5457447"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957781"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30214-5_17"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2012.2202663"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.21.43"},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems.","author":"Soh Harold","year":"2012","unstructured":"Harold Soh . 2012 . Online spatio-temporal Gaussian process experts with application to tactile classification . In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems. Harold Soh. 2012. Online spatio-temporal Gaussian process experts with application to tactile classification. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408954"},{"key":"e_1_2_1_58_1","volume-title":"AVEC 2011 the first international audio\/visual emotion challenge. In Proceedings of Affective Computing and Intelligent Interaction.","author":"Valstar Michel","year":"2011","unstructured":"Michel Valstar , Florian Eyben , Gary Mckeown , Roddy Cowie , and Maja Pantic . 2011 . AVEC 2011 the first international audio\/visual emotion challenge. In Proceedings of Affective Computing and Intelligent Interaction. Michel Valstar, Florian Eyben, Gary Mckeown, Roddy Cowie, and Maja Pantic. 2011. AVEC 2011 the first international audio\/visual emotion challenge. In Proceedings of Affective Computing and Intelligent Interaction."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0113647"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-0992(1998110)28:6<879::AID-EJSP901>3.0.CO;2-W"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the 4th Workshop on Child-Computer Interaction (WOCCI\u201914)","author":"Wang Weiyi","year":"2014","unstructured":"Weiyi Wang , Geogiors Athanasopoulos , Selma Yilmazyildiz , Geogiors Patsis , Valentin Enescu , Hichem Sahli , Werner Verhelst , Antoine Hiolle , Matthew Lewis , and Lola Ca\u00f1amero . 2014 . Natural emotion elicitation for emotion modeling in child-robot interactions . In Proceedings of the 4th Workshop on Child-Computer Interaction (WOCCI\u201914) . Weiyi Wang, Geogiors Athanasopoulos, Selma Yilmazyildiz, Geogiors Patsis, Valentin Enescu, Hichem Sahli, Werner Verhelst, Antoine Hiolle, Matthew Lewis, and Lola Ca\u00f1amero. 2014. Natural emotion elicitation for emotion modeling in child-robot interactions. In Proceedings of the 4th Workshop on Child-Computer Interaction (WOCCI\u201914)."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-02714-2_20"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2738221","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2738221","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:16:23Z","timestamp":1750227383000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2738221"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,12,22]]},"references-count":61,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,1,7]]}},"alternative-id":["10.1145\/2738221"],"URL":"https:\/\/doi.org\/10.1145\/2738221","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,12,22]]},"assertion":[{"value":"2014-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-12-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}