{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T01:40:02Z","timestamp":1714095602561},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2012,6,24]],"date-time":"2012-06-24T00:00:00Z","timestamp":1340496000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"},{"start":{"date-parts":[[2012,6,24]],"date-time":"2012-06-24T00:00:00Z","timestamp":1340496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Braz Comput Soc"],"published-print":{"date-parts":[[2013,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Non-verbal communication is of paramount importance in person-to-person interaction, as emotions are an integral part of human beings. A sociable robot should therefore display similar abilities as a way to interact seamlessly with the user. This work proposes a model for inference of conveyed emotion in real situations where a human is talking. It is based on the analysis of instantaneous emotion by Kalman filtering and the continuous movement of the emotional state over an Emotional Surface, resulting in evaluations similar to humans in conducted tests. A simulation-optimization heuristic for system tuning is described and allows easy adaptation to various facial expression analysis applications.<\/jats:p>","DOI":"10.1007\/s13173-012-0081-7","type":"journal-article","created":{"date-parts":[[2012,6,23]],"date-time":"2012-06-23T19:42:41Z","timestamp":1340480561000},"page":"3-13","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A model for inference of emotional state based on facial expressions"],"prefix":"10.1007","volume":"19","author":[{"given":"Rafael A. M.","family":"Gon\u00e7alves","sequence":"first","affiliation":[]},{"given":"Diego R.","family":"Cueva","sequence":"additional","affiliation":[]},{"given":"Marcos R.","family":"Pereira-Barretto","sequence":"additional","affiliation":[]},{"given":"Fabio G.","family":"Cozman","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2012,6,24]]},"reference":[{"key":"81_CR1","doi-asserted-by":"crossref","unstructured":"Birdwhistell R (1970) Kinesics and context. University of Pennsylvania Press, Philadelphia","DOI":"10.9783\/9780812201284"},{"key":"81_CR2","unstructured":"Picard RW (1995) Affective computing. MIT Press, Cambridge"},{"key":"81_CR3","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/S1071-5819(03)00052-1","volume":"59","author":"R Picard","year":"2003","unstructured":"Picard R (2003) Affective computing: challenges. Int J Hum Comput Stud 59:55\u201364","journal-title":"Int J Hum Comput Stud"},{"key":"81_CR4","unstructured":"Brothers L (1999) Emotion and the human brain. In: The MIT encyclopedia of the cognitive sciences. MIT Press, Cambridge, pp 271\u2013273"},{"issue":"1","key":"81_CR5","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1037\/0033-2909.115.1.102","volume":"115","author":"JA Russell","year":"1994","unstructured":"Russell JA (1994) Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychol Bull 115(1):102\u2013141","journal-title":"Psychol Bull"},{"key":"81_CR6","unstructured":"Ekman P, Friesen WV, Ellsworth P (1972) Emotion in the human face. Pergamon Press, Oxford"},{"issue":"12","key":"81_CR7","doi-asserted-by":"publisher","first-page":"1424","DOI":"10.1109\/34.895976","volume":"22","author":"M Pantic","year":"2000","unstructured":"Pantic M, Rothkrantz LJM (2000) Automatic analysis of facial expressions: the state of the art. IEEE Trans Pattern Anal Mach Intell 22(12):1424\u20131445","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"81_CR8","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1109\/TPAMI.2008.52","volume":"31","author":"Z Zeng","year":"2009","unstructured":"Zeng Z, Pantic M, Roisman GI, Huang TS (2009) A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell 31:39\u201358","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"81_CR9","unstructured":"Azcarate A, Hageloh F, Sande K, Valenti R (2005) Automatic facial emotion recognition. Universiteit van Amsterdam"},{"key":"81_CR10","doi-asserted-by":"crossref","unstructured":"Scherer KR (2001) Appraisal considered as a process of multilevel sequential checking. In: Appraisal processes in emotion: theory, methods, research. Oxford University Press, Oxford, pp 92\u2013120","DOI":"10.1093\/oso\/9780195130072.003.0005"},{"key":"81_CR11","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/j.neunet.2005.03.001","volume":"18","author":"D Sander","year":"2005","unstructured":"Sander D, Grandjean D, Scherer KR (2005) A systems approach to appraisal mechanisms in emotion. Neural Netw 18:317\u2013352","journal-title":"Neural Netw"},{"issue":"4","key":"81_CR12","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1037\/0003-066X.48.4.384","volume":"48","author":"P Ekman","year":"1993","unstructured":"Ekman P (1993) Facial expression and emotion. Am Psychol 48(4):376\u2013379","journal-title":"Am Psychol"},{"key":"81_CR13","doi-asserted-by":"crossref","unstructured":"Ekman P, Friesen WV (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Washington","DOI":"10.1037\/t27734-000"},{"issue":"4","key":"81_CR14","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1037\/1528-3542.7.4.736","volume":"7","author":"PJ Naab","year":"2007","unstructured":"Naab PJ, Russell JA (2007) Judgments of emotion from spontaneous facial expressions of New Guineans. Emotion 7(4):736\u2013744","journal-title":"Emotion"},{"key":"81_CR15","doi-asserted-by":"crossref","unstructured":"Le V, Tang H (2011) Expression recognition from 3D dynamic faces using robust spatio-temporal shape features. In: Proceedings of the IEEE international conference on automatic face and gesture recognition and workshops (FG 2011), pp 414\u2013421","DOI":"10.1109\/FG.2011.5771435"},{"key":"81_CR16","doi-asserted-by":"crossref","unstructured":"Sun Y, Yin L (2008) Facial expression recognition based on 3D dynamic range model sequences. In: Proceedings of the 10th European conference on computer vision: part II, pp 58\u201371","DOI":"10.1007\/978-3-540-88688-4_5"},{"key":"81_CR17","doi-asserted-by":"crossref","unstructured":"Valstar M, Gunes H (2007) How to distinguish posed from spontaneous smiles using geometric features. In: Proceedings of the ICMI\u201907: 9th international conference on multimodal interfaces","DOI":"10.1145\/1322192.1322202"},{"issue":"2","key":"81_CR18","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1017\/S0048577299971664","volume":"36","author":"MS Bartlett","year":"1999","unstructured":"Bartlett MS, Hager JC, Ekman P, Sejnowski TJ (1999) Measuring facial expressions by computer image analysis. Psychophysiology 36(2):253\u2013263","journal-title":"Psychophysiology"},{"issue":"7","key":"81_CR19","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1109\/34.598232","volume":"19","author":"IA Essa","year":"1997","unstructured":"Essa IA, Pentland AP (1997) Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans Pattern Anal Mach Intell 19(7):757\u2013763","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"81_CR20","doi-asserted-by":"crossref","unstructured":"Milanova M, Sirakov N (2008) Recognition of emotional states in natural human\u2013computer interaction. In: Proceedings of the ISSPIT 2008-IEEE international symposium on signal processing and information technology, pp 186\u2013191","DOI":"10.1109\/ISSPIT.2008.4775663"},{"key":"81_CR21","unstructured":"Fraunhofer(IIS): Fraunhofer Facedetect. http:\/\/www.iis.fraunhofer.de\/en\/bf\/bv\/ks\/gpe\/demo\/"},{"key":"81_CR22","unstructured":"Tian Y-l, Kanade T, Cohn JF (1978) Facial expression analysis. In: Handbook of facial recognition. Springer, Berlin"},{"key":"81_CR23","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/S0031-3203(02)00052-3","volume":"36","author":"B Fasel","year":"2003","unstructured":"Fasel B, Luettin J (2003) Automatic facial expression analysis: a survey. Pattern Recogn 36:259\u2013275","journal-title":"Pattern Recogn"},{"issue":"4","key":"81_CR24","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/scientificamerican0476-65","volume":"234","author":"EC Zeeman","year":"1976","unstructured":"Zeeman EC (1976) Catastrophe theory. Sci Am 234(4):65\u201383","journal-title":"Sci Am"},{"key":"81_CR25","doi-asserted-by":"crossref","unstructured":"Martin O, Kotsia I, Macq B, Pitas I (2006) The eNTERFACE 05 audio-visual emotion database. In: Proceedings of the 22nd international conference on data engineering workshops, pp 8\u20138","DOI":"10.1109\/ICDEW.2006.145"},{"key":"81_CR26","unstructured":"Cueva DR, Gon\u00e7alves RAM, Pereira-Barretto MR, Cozman FG (2011) Fus\u00e3o de Observa\u00e7\u00f5es Afetivas em Cen\u00e1rios Realistas (in Portuguese). Anais do XXXI CONGRESSO DA SOCIEDADE BRASILEIRA DE COMPUTA\u00c7\u00c3O\u2014Encontro Nacional de Intelig\u00eancia Artificial, pp 833\u2013842"},{"key":"81_CR27","unstructured":"Gon\u00e7alves RAM, Cueva DR, Pereira-Barretto MR, Cozman FG (2011) Determina\u00e7\u00e3o da Emo\u00e7\u00e3o Demonstrada pelo Interlocutor (in Portuguese). Anais do XXXI CONGRESSO DA SOCIEDADE BRASILEIRA DE COMPUTA\u00c7\u00c3O\u2014Encontro Nacional de Intelig\u00eancia Artificial, pp 737\u2013748"},{"key":"81_CR28","doi-asserted-by":"crossref","unstructured":"Cueva DR, Gon\u00e7alves RAM, Cozman FG, Pereira-Barretto MR (2011) Crawling to improve multimodal emotion detection. Lecture Notes in Artificial Intelligence, vol 7094, Part II. Springer, Berlin, pp 343\u2013350","DOI":"10.1007\/978-3-642-25330-0_30"}],"container-title":["Journal of the Brazilian Computer Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13173-012-0081-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13173-012-0081-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13173-012-0081-7","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13173-012-0081-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T01:24:37Z","timestamp":1714094677000},"score":1,"resource":{"primary":{"URL":"https:\/\/journal-bcs.springeropen.com\/articles\/10.1007\/s13173-012-0081-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,6,24]]},"references-count":28,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,3]]}},"alternative-id":["81"],"URL":"https:\/\/doi.org\/10.1007\/s13173-012-0081-7","relation":{},"ISSN":["0104-6500","1678-4804"],"issn-type":[{"value":"0104-6500","type":"print"},{"value":"1678-4804","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,6,24]]},"assertion":[{"value":"24 October 2011","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 May 2012","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 June 2012","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}