{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T21:15:06Z","timestamp":1785532506282,"version":"3.56.0"},"reference-count":147,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T00:00:00Z","timestamp":1656028800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T00:00:00Z","timestamp":1656028800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"leap in time foundation"},{"DOI":"10.13039\/501100005714","name":"Technische Universit\u00e4t Darmstadt","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005714","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J of Soc Robotics"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Facial expressions are an ideal means of communicating one\u2019s emotions or intentions to others. This overview will focus on human facial expression recognition as well as robotic facial expression generation. In the case of human facial expression recognition, both facial expression recognition on predefined datasets as well as in real-time will be covered. For robotic facial expression generation, hand-coded and automated methods i.e., facial expressions of a robot are generated by moving the features (eyes, mouth) of the robot by hand-coding or automatically using machine learning techniques, will also be covered. There are already plenty of studies that achieve high accuracy for emotion expression recognition on predefined datasets, but the accuracy for facial expression recognition in real-time is comparatively lower. In the case of expression generation in robots, while most of the robots are capable of making basic facial expressions, there are not many studies that enable robots to do so automatically. In this overview, state-of-the-art research in facial emotion expressions during human\u2013robot interaction has been discussed leading to several possible directions for future research.<\/jats:p>","DOI":"10.1007\/s12369-022-00867-0","type":"journal-article","created":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T16:10:41Z","timestamp":1656087041000},"page":"1583-1604","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":106,"title":["Facial Emotion Expressions in Human\u2013Robot Interaction: A Survey"],"prefix":"10.1007","volume":"14","author":[{"given":"Niyati","family":"Rawal","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8576-5883","authenticated-orcid":false,"given":"Ruth Maria","family":"Stock-Homburg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,6,24]]},"reference":[{"key":"867_CR1","doi-asserted-by":"crossref","unstructured":"Ahmed TU, Hossain S, Hossain MS, ul Islam R, Andersson K (2019) Facial expression recognition using convolutional neural network with data augmentation. In: 2019 joint 8th international conference on informatics, electronics vision (ICIEV) and 2019 3rd international conference on imaging, vision pattern recognition (icIVPR), pp 336\u2013341","DOI":"10.1109\/ICIEV.2019.8858529"},{"key":"867_CR2","doi-asserted-by":"crossref","unstructured":"Barros P, Weber C, Wermter S (2015) Emotional expression recognition with a cross-channel convolutional neural network for human\u2013robot interaction. In: 2015 IEEE-RAS 15th international conference on humanoid robots (humanoids), pp 582\u2013587","DOI":"10.1109\/HUMANOIDS.2015.7363421"},{"key":"867_CR3","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1080\/10904018.2010.508675","volume":"25","author":"J Bavelas","year":"2011","unstructured":"Bavelas J, Gerwing J (2011) The listener as addressee in face-to-face dialogue. Int J Listen 25:178\u2013198","journal-title":"Int J Listen"},{"issue":"3","key":"867_CR4","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1007\/s12369-013-0193-z","volume":"5","author":"A Beck","year":"2013","unstructured":"Beck A, Ca\u00f1amero L, Hiolle A, Damiano L, Cosi P, Tesser F, Sommavilla G (2013) Interpretation of emotional body language displayed by a humanoid robot: a case study with children. Int J Soc Robot 5(3):325\u2013334","journal-title":"Int J Soc Robot"},{"key":"867_CR5","doi-asserted-by":"crossref","unstructured":"Becker-Asano C, Ishiguro H (2011) Evaluating facial displays of emotion for the android robot geminoid f, pp 1\u20138","DOI":"10.1109\/WACI.2011.5953147"},{"issue":"2","key":"867_CR6","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1109\/72.279181","volume":"5","author":"Y Bengio","year":"1994","unstructured":"Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157\u2013166","journal-title":"IEEE Trans Neural Netw"},{"key":"867_CR7","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1007\/s12369-014-0237-z","volume":"6","author":"CC Bennett","year":"2014","unstructured":"Bennett CC, Sabanovic S (2014) Deriving minimal features for human-like facial expressions in robotic faces. Int J Soc Robot 6:367\u2013381","journal-title":"Int J Soc Robot"},{"key":"867_CR8","unstructured":"Bera A, Randhavane T, Prinja R, Kapsaskis K, Wang A, Gray K, Manocha D (2019) The emotionally intelligent robot: improving social navigation in crowded environments. ArXiv arXiv:1903.03217"},{"issue":"1\u20132","key":"867_CR9","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/S1071-5819(03)00018-1","volume":"59","author":"C Breazeal","year":"2003","unstructured":"Breazeal C (2003) Emotion and sociable humanoid robots. Int J Hum Comput Stud 59(1\u20132):119\u2013155","journal-title":"Int J Hum Comput Stud"},{"key":"867_CR10","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1162\/1064546053278955","volume":"11","author":"C Breazeal","year":"2005","unstructured":"Breazeal C, Buchsbaum D, Gray J, Gatenby D, Blumberg B (2005) Learning from and about others: towards using imitation to bootstrap the social understanding of others by robots. Artif Life 11:31\u201362. https:\/\/doi.org\/10.1162\/1064546053278955","journal-title":"Artif Life"},{"key":"867_CR11","doi-asserted-by":"crossref","unstructured":"Buciu I, Kotsia I, Pitas I (2005) Facial expression analysis under partial occlusion, pp v\/453 \u2013v\/456, vol 5","DOI":"10.1109\/ICASSP.2005.1416338"},{"key":"867_CR12","doi-asserted-by":"crossref","unstructured":"Byeon YH, Kwak KC (2014) Facial expression recognition using 3d convolutional neural network. Int J Adva Comput Sci Appl 5(12)","DOI":"10.14569\/IJACSA.2014.051215"},{"key":"867_CR13","doi-asserted-by":"publisher","DOI":"10.3390\/app9214678","author":"D Canedo","year":"2019","unstructured":"Canedo D (2019) Facial expression recognition using computer vision: a systematic review. Appl Sci. https:\/\/doi.org\/10.3390\/app9214678","journal-title":"Appl Sci"},{"issue":"1","key":"867_CR14","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1186\/s40064-015-1427-3","volume":"4","author":"P Carcagn\u00ec","year":"2015","unstructured":"Carcagn\u00ec P, Del Coco M, Leo M, Distante C (2015) Facial expression recognition and histograms of oriented gradients: a comprehensive study. Springerplus 4(1):645","journal-title":"Springerplus"},{"key":"867_CR15","doi-asserted-by":"crossref","unstructured":"Chen H, Gu Y, Wang F, Sheng W (2018) Facial expression recognition and positive emotion incentive system for human\u2013robot interaction. In: 2018 13th world congress on intelligent control and automation (WCICA), pp 407\u2013412","DOI":"10.1109\/WCICA.2018.8630711"},{"key":"867_CR16","doi-asserted-by":"crossref","unstructured":"Chen X, Yang X, Wang M, Zou J (2017) Convolution neural network for automatic facial expression recognition. In: 2017 international conference on applied system innovation (ICASI), pp 814\u2013817","DOI":"10.1109\/ICASI.2017.7988558"},{"key":"867_CR17","doi-asserted-by":"crossref","unstructured":"Churamani N, Barros P, Strahl E, Wermter S (2018) Learning empathy-driven emotion expressions using affective modulations","DOI":"10.1109\/IJCNN.2018.8489158"},{"key":"867_CR18","doi-asserted-by":"publisher","first-page":"7711","DOI":"10.3390\/s140507711","volume":"14","author":"F Cid","year":"2014","unstructured":"Cid F, Moreno J, Bustos P, N\u00fa\u00f1ez P (2014) Muecas: a multi-sensor robotic head for affective human robot interaction and imitation. Sensors (Basel, Switzerland) 14:7711\u20137737","journal-title":"Sensors (Basel, Switzerland)"},{"key":"867_CR19","doi-asserted-by":"publisher","unstructured":"Cid F, Prado JA, Bustos P, N\u00fa\u00f1ez P (2013) A real time and robust facial expression recognition and imitation approach for affective human\u2013robot interaction using gabor filtering. In: 2013 IEEE\/RSJ international conference on intelligent robots and systems, pp 2188\u20132193 . https:\/\/doi.org\/10.1109\/IROS.2013.6696662","DOI":"10.1109\/IROS.2013.6696662"},{"key":"867_CR20","unstructured":"Cohen I (2010) Recognizing robotic emotions: facial versus body posture expression and the effects of context and learning. Master\u2019s thesis"},{"issue":"8","key":"867_CR21","doi-asserted-by":"publisher","first-page":"1548","DOI":"10.1109\/TPAMI.2016.2515606","volume":"38","author":"CA Corneanu","year":"2016","unstructured":"Corneanu CA, Sim\u00f3n MO, Cohn JF, Guerrero SE (2016) Survey on rgb, 3d, thermal, and multimodal approaches for facial expression recognition: history, trends, and affect-related applications. IEEE Trans Pattern Anal Mach Intell 38(8):1548\u20131568","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"867_CR22","doi-asserted-by":"crossref","unstructured":"Costa S, Soares F, Santos C (2013) Facial expressions and gestures to convey emotions with a humanoid robot. In: International conference on social robotics. Springer, pp 542\u2013551","DOI":"10.1007\/978-3-319-02675-6_54"},{"issue":"1","key":"867_CR23","first-page":"13","volume":"2","author":"E Dand\u0131l","year":"2019","unstructured":"Dand\u0131l E, \u00d6zdemir R (2019) Real-time facial emotion classification using deep learning. Data Sci Appl 2(1):13\u201317","journal-title":"Data Sci Appl"},{"key":"867_CR24","doi-asserted-by":"publisher","unstructured":"Datcu D, Rothkrantz L (2007) Facial expression recognition in still pictures and videos using active appearance models. A comparison approach, p 112. https:\/\/doi.org\/10.1145\/1330598.1330717","DOI":"10.1145\/1330598.1330717"},{"key":"867_CR25","doi-asserted-by":"publisher","first-page":"15","DOI":"10.5772\/5702","volume":"4","author":"K Dautenhahn","year":"2007","unstructured":"Dautenhahn K (2007) Methodology & themes of human\u2013robot interaction: a growing research field. Int J Adv Robot Syst 4:15","journal-title":"Int J Adv Robot Syst"},{"key":"867_CR26","doi-asserted-by":"crossref","unstructured":"Davis M (2018) Empathy: a social psychological approach","DOI":"10.4324\/9780429493898"},{"key":"867_CR27","doi-asserted-by":"publisher","first-page":"9848","DOI":"10.1109\/ACCESS.2019.2891668","volume":"7","author":"J Deng","year":"2019","unstructured":"Deng J, Pang G, Zhang Z, Pang Z, Yang H, Yang G (2019) cgan based facial expression recognition for human\u2013robot interaction. IEEE Access 7:9848\u20139859","journal-title":"IEEE Access"},{"key":"867_CR28","unstructured":"de\u00a0Graaf M, Allouch S, Van\u00a0Dijk JA (2016) Long-term acceptance of social robots in domestic environments: insights from a user\u2019s perspective"},{"key":"867_CR29","doi-asserted-by":"crossref","unstructured":"Dhall A, Goecke R, Lucey S, Gedeon T (2011) Static facial expression analysis in tough conditions: data, evaluation protocol and benchmark. In: 2011 IEEE international conference on computer vision workshops (ICCV Workshops), pp 2106\u20132112","DOI":"10.1109\/ICCVW.2011.6130508"},{"key":"867_CR30","doi-asserted-by":"crossref","unstructured":"Ding H, Zhou SK, Chellappa R (2017) Facenet2expnet: regularizing a deep face recognition net for expression recognition. In: 2017 12th IEEE international conference on automatic face gesture recognition (FG 2017), pp 118\u2013126","DOI":"10.1109\/FG.2017.23"},{"key":"867_CR31","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1006\/jesp.1999.1395","volume":"36","author":"A Drolet","year":"2000","unstructured":"Drolet A, Morris MW (2000) Rapport in conflict resolution: accounting for how face-to-face contact fosters mutual cooperation in mixed-motive conflicts. J Exp Soc Psychol 36:26\u201350","journal-title":"J Exp Soc Psychol"},{"key":"867_CR32","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.patcog.2015.07.006","volume":"49","author":"S Elaiwat","year":"2016","unstructured":"Elaiwat S, Bennamoun M, Boussa\u00efd F (2016) A spatio-temporal rbm-based model for facial expression recognition. Pattern Recogn 49:152\u2013161","journal-title":"Pattern Recogn"},{"key":"867_CR33","doi-asserted-by":"crossref","unstructured":"Esfandbod A, Rokhi Z, Taheri A, Alemi M, Meghdari A (2019) Human\u2013robot interaction based on facial expression imitation. In: 2019 7th international conference on robotics and Mechatronics (ICRoM), pp 69\u201373","DOI":"10.1109\/ICRoM48714.2019.9071837"},{"key":"867_CR34","doi-asserted-by":"crossref","unstructured":"Faria DR, Vieira M, Faria FCC, Premebida C (2017) Affective facial expressions recognition for human\u2013robot interaction. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN), pp 805\u2013810","DOI":"10.1109\/ROMAN.2017.8172395"},{"issue":"1","key":"867_CR35","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1109\/MRA.2010.940150","volume":"18","author":"D Feil-Seifer","year":"2011","unstructured":"Feil-Seifer D, Matari\u0107 MJ (2011) Socially assistive robotics. IEEE Robot Autom Mag 18(1):24\u201331","journal-title":"IEEE Robot Autom Mag"},{"key":"867_CR36","doi-asserted-by":"publisher","first-page":"53930","DOI":"10.1109\/ACCESS.2018.2870063","volume":"6","author":"PM Ferreira","year":"2018","unstructured":"Ferreira PM, Marques F, Cardoso JS, Rebelo A (2018) Physiological inspired deep neural networks for emotion recognition. IEEE Access 6:53930\u201353943","journal-title":"IEEE Access"},{"key":"867_CR37","doi-asserted-by":"crossref","unstructured":"Fix E (1951) Discriminatory analysis: nonparametric discrimination, consistency properties. USAF School of Aviation Medicine","DOI":"10.1037\/e471672008-001"},{"key":"867_CR38","doi-asserted-by":"crossref","unstructured":"Ge S, Wang C, Hang C (2008) A facial expression imitation system in human robot interaction","DOI":"10.1109\/ROMAN.2008.4600668"},{"key":"867_CR39","doi-asserted-by":"crossref","unstructured":"Gers FA, Schmidhuber J (2000) Recurrent nets that time and count. In: Proceedings of the IEEE-INNS-ENNS international joint conference on neural networks. IJCNN 2000. Neural computing: new challenges and perspectives for the new millennium. IEEE, vol\u00a03, pp 189\u2013194","DOI":"10.1109\/IJCNN.2000.861302"},{"key":"867_CR40","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-018-1585-8","author":"I Gogi\u0107","year":"2018","unstructured":"Gogi\u0107 I, Manhart M, Pand\u017ei\u0107 I, Ahlberg J (2018) Fast facial expression recognition using local binary features and shallow neural networks. Vis Comput. https:\/\/doi.org\/10.1007\/s00371-018-1585-8","journal-title":"Vis Comput"},{"issue":"4","key":"867_CR41","doi-asserted-by":"publisher","first-page":"1334","DOI":"10.1016\/j.jnca.2006.09.007","volume":"30","author":"H Gunes","year":"2007","unstructured":"Gunes H, Piccardi M (2007) Bi-modal emotion recognition from expressive face and body gestures. J Netw Comput Appl 30(4):1334\u20131345","journal-title":"J Netw Comput Appl"},{"key":"867_CR42","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.imavis.2012.06.016","volume":"31","author":"H Gunes","year":"2013","unstructured":"Gunes H, Schuller B (2013) Categorical and dimensional affect analysis in continuous input: current trends and future directions. Image Vis Comput 31:120\u2013136","journal-title":"Image Vis Comput"},{"key":"867_CR43","first-page":"827","volume":"2011","author":"H Gunes","year":"2011","unstructured":"Gunes H, Schuller B, Pantic M, Cowie R (2011) Emotion representation, analysis and synthesis in continuous space: a survey. Face Gesture 2011:827\u2013834","journal-title":"Face Gesture"},{"key":"867_CR44","doi-asserted-by":"publisher","unstructured":"Hamester D, Barros P, Wermter S (2015) Face expression recognition with a 2-channel convolutional neural network, pp 1\u20138 . https:\/\/doi.org\/10.1109\/IJCNN.2015.7280539","DOI":"10.1109\/IJCNN.2015.7280539"},{"key":"867_CR45","doi-asserted-by":"publisher","DOI":"10.1007\/s11265-014-0967-z","author":"M Hazar","year":"2015","unstructured":"Hazar M, Fendri E, Hammami M (2015) Face recognition through different facial expressions. J Signal Process Syst. https:\/\/doi.org\/10.1007\/s11265-014-0967-z","journal-title":"J Signal Process Syst"},{"key":"867_CR46","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1126\/science.1127647","volume":"313","author":"G Hinton","year":"2006","unstructured":"Hinton G, Salakhutdinov R (2006) Reducing the dimensionality of data with neural networks. Science (New York, NY) 313:504\u20137. https:\/\/doi.org\/10.1126\/science.1127647","journal-title":"Science (New York, NY)"},{"issue":"8","key":"867_CR47","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"867_CR48","unstructured":"Hoffman G, Breazeal C (2006) Robotic partners\u2019 bodies and minds: an embodied approach to fluid human\u2013robot collaboration. In: AAAI workshop\u2014technical report"},{"key":"867_CR49","doi-asserted-by":"publisher","unstructured":"Hoffman G, Zuckerman O, Hirschberger G, Luria M, Shani\u00a0Sherman T (2015) Design and evaluation of a peripheral robotic conversation companion. In: Proceedings of the Tenth Annual ACM\/IEEE international conference on human\u2013robot interaction, HRI \u201915, pp 3\u201310. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/2696454.2696495","DOI":"10.1145\/2696454.2696495"},{"key":"867_CR50","doi-asserted-by":"publisher","DOI":"10.1515\/pjbr-2016-0004","author":"T Horii","year":"2016","unstructured":"Horii T, Nagai Y, Asada M (2016) Imitation of human expressions based on emotion estimation by mental simulation. Paladyn J Behav Robot. https:\/\/doi.org\/10.1515\/pjbr-2016-0004","journal-title":"Paladyn J Behav Robot"},{"key":"867_CR51","doi-asserted-by":"publisher","first-page":"2281","DOI":"10.1109\/ACCESS.2017.2672829","volume":"5","author":"MS Hossain","year":"2017","unstructured":"Hossain MS, Muhammad G (2017) An emotion recognition system for mobile applications. IEEE Access 5:2281\u20132287","journal-title":"IEEE Access"},{"key":"867_CR52","doi-asserted-by":"publisher","first-page":"24321","DOI":"10.1109\/ACCESS.2019.2900231","volume":"7","author":"W Hua","year":"2019","unstructured":"Hua W, Dai F, Huang L, Xiong J, Gui G (2019) Hero: human emotions recognition for realizing intelligent internet of things. IEEE Access 7:24321\u201324332","journal-title":"IEEE Access"},{"key":"867_CR53","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2017\/2107451","volume":"2017","author":"Y Huang","year":"2017","unstructured":"Huang Y, Yang J, Liao P, Pan J (2017) Fusion of facial expressions and eeg for multimodal emotion recognition. Comput Intell Neurosci 2017:1\u20138. https:\/\/doi.org\/10.1155\/2017\/2107451","journal-title":"Comput Intell Neurosci"},{"key":"867_CR54","doi-asserted-by":"crossref","unstructured":"Ilic, D., \u017du\u017ei\u0107, I., Brscic, D.: Calibrate my smile: robot learning its facial expressions through interactive play with humans, pp 68\u201375 (2019)","DOI":"10.1145\/3349537.3351890"},{"key":"867_CR55","doi-asserted-by":"crossref","unstructured":"Inthiam J, Hayashi E, Jitviriya W, Mowshowitz A (2019) Mood estimation for human\u2013robot interaction based on facial and bodily expression using a hidden Markov model. In: 2019 IEEE\/SICE international symposium on system integration (SII). IEEE, pp 352\u2013356","DOI":"10.1109\/SII.2019.8700422"},{"key":"867_CR56","doi-asserted-by":"publisher","first-page":"629","DOI":"10.20965\/jrm.2019.p0629","volume":"31","author":"J Inthiam","year":"2019","unstructured":"Inthiam J, Mowshowitz A, Hayashi E (2019) Mood perception model for social robot based on facial and bodily expression using a hidden Markov model. J Robot Mechatron 31:629\u2013638","journal-title":"J Robot Mechatron"},{"key":"867_CR57","doi-asserted-by":"crossref","unstructured":"Jiang L, Cai Z, Wang D, Jiang S (2007) Survey of improving k-nearest-neighbor for classification. In: Fourth international conference on fuzzy systems and knowledge discovery (FSKD 2007), vol\u00a01, pp 679\u2013683","DOI":"10.1109\/FSKD.2007.552"},{"key":"867_CR58","doi-asserted-by":"publisher","first-page":"8880","DOI":"10.1109\/ACCESS.2017.2704087","volume":"5","author":"MH Kabir","year":"2017","unstructured":"Kabir MH, Salekin MS, Uddin MZ, Abdullah-Al-Wadud M (2017) Facial expression recognition from depth video with patterns of oriented motion flow. IEEE Access 5:8880\u20138889","journal-title":"IEEE Access"},{"key":"867_CR59","first-page":"61","volume":"19","author":"T Kanda","year":"2004","unstructured":"Kanda T, Hirano T, Eaton D, Ishiguro H (2004) Interactive robots as social partners and peer tutors for children: a field trial. Hum Comput Interact (Special issues on human\u2013robot interaction) 19:61\u201384","journal-title":"Hum Comput Interact (Special issues on human\u2013robot interaction)"},{"key":"867_CR60","doi-asserted-by":"crossref","unstructured":"Kar NB, Babu KS, Jena SK (2017) Face expression recognition using histograms of oriented gradients with reduced features. In: Raman B, Kumar S, Roy PP, Sen D (eds) Proceedings of international conference on computer vision and image processing. Springer, Singapore, pp 209\u2013219","DOI":"10.1007\/978-981-10-2107-7_19"},{"key":"867_CR61","doi-asserted-by":"crossref","unstructured":"Kim DH, Jung S, An K, Lee H, Chung M (2006) Development of a facial expression imitation system, pp 3107\u20133112","DOI":"10.1109\/IROS.2006.282329"},{"key":"867_CR62","doi-asserted-by":"publisher","first-page":"41273","DOI":"10.1109\/ACCESS.2019.2907327","volume":"7","author":"J Kim","year":"2019","unstructured":"Kim J, Kim B, Roy PP, Jeong D (2019) Efficient facial expression recognition algorithm based on hierarchical deep neural network structure. IEEE Access 7:41273\u201341285","journal-title":"IEEE Access"},{"key":"867_CR63","first-page":"448","volume-title":"Collaborative robotics","author":"FP Kirgis","year":"2016","unstructured":"Kirgis FP, Katsos P, Kohlmaier M (2016) Collaborative robotics. Springer, Cham, pp 448\u2013453"},{"key":"867_CR64","doi-asserted-by":"crossref","unstructured":"Kishi T, Otani T, Endo N, Kryczka P, Hashimoto K, Nakata K, Takanishi A (2012) Development of expressive robotic head for bipedal humanoid robot. In: 2012 IEEE\/RSJ international conference on intelligent robots and systems, pp 4584\u20134589","DOI":"10.1109\/IROS.2012.6386050"},{"key":"867_CR65","doi-asserted-by":"crossref","unstructured":"Kotsia I, Nikolaidis N, Pitas I (2007) Facial expression recognition in videos using a novel multi-class support vector machines variant. In: 2007 IEEE international conference on acoustics, speech and signal processing\u2013ICASSP \u201907, vol\u00a02, pp II-585\u2013II-588","DOI":"10.1109\/ICASSP.2007.366303"},{"issue":"1","key":"867_CR66","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1109\/TIP.2006.884954","volume":"16","author":"I Kotsia","year":"2007","unstructured":"Kotsia I, Pitas I (2007) Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans Image Process 16(1):172\u2013187","journal-title":"IEEE Trans Image Process"},{"key":"867_CR67","doi-asserted-by":"crossref","unstructured":"Kozima H, Nakagawa C, Yasuda Y (2005) Interactive robots for communication-care: a case-study in autism therapy. In: ROMAN 2005. In: IEEE international workshop on robot and human interactive communication, pp 341\u2013346","DOI":"10.1109\/ROMAN.2005.1513802"},{"issue":"7553","key":"867_CR68","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436\u2013444","journal-title":"Nature"},{"issue":"4","key":"867_CR69","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","volume":"1","author":"Y LeCun","year":"1989","unstructured":"LeCun Y, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD (1989) Backpropagation applied to handwritten zip code recognition. Neural Comput 1(4):541\u2013551","journal-title":"Neural Comput"},{"key":"867_CR70","doi-asserted-by":"crossref","unstructured":"LeCun Y, Kavukcuoglu K, Farabet C (2010) Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE international symposium on circuits and systems, pp 253\u2013256","DOI":"10.1109\/ISCAS.2010.5537907"},{"key":"867_CR71","unstructured":"Li S, Deng W (2020) Deep facial expression recognition: a survey. IEEE Trans Affect Comput, pp 1\u20131"},{"key":"867_CR72","doi-asserted-by":"publisher","first-page":"93998","DOI":"10.1109\/ACCESS.2019.2928364","volume":"7","author":"TS Li","year":"2019","unstructured":"Li TS, Kuo P, Tsai T, Luan P (2019) Cnn and lstm based facial expression analysis model for a humanoid robot. IEEE Access 7:93998\u201394011","journal-title":"IEEE Access"},{"key":"867_CR73","doi-asserted-by":"crossref","unstructured":"Li Y, Hashimoto M (2011) Effect of emotional synchronization using facial expression recognition in human\u2013robot communication","DOI":"10.1109\/ROBIO.2011.6181741"},{"key":"867_CR74","doi-asserted-by":"crossref","unstructured":"Li Y, Zeng J, Shan S, Chen X (2018) Occlusion aware facial expression recognition using cnn with attention mechanism. IEEE Trans Image Process, pp 1\u20131 (2018)","DOI":"10.1109\/ICPR.2018.8545853"},{"key":"867_CR75","doi-asserted-by":"crossref","unstructured":"Li Y, Zeng J, Shan S, Chen X (2018) Patch-gated cnn for occlusion-aware facial expression recognition. In: 2018 24th international conference on pattern recognition (ICPR), pp 2209\u20132214","DOI":"10.1109\/ICPR.2018.8545853"},{"key":"867_CR76","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1007\/s00371-019-01636-3","volume":"36","author":"D Liang","year":"2019","unstructured":"Liang D, Liang H, Yu Z, Zhang Y (2019) Deep convolutional bilstm fusion network for facial expression recognition. Vis Comput 36:499\u2013508","journal-title":"Vis Comput"},{"key":"867_CR77","doi-asserted-by":"crossref","unstructured":"Liliana DY, Basaruddin C, Widyanto MR (2017) Mix emotion recognition from facial expression using svm-crf sequence classifier. In: Proceedings of the international conference on algorithms, computing and systems, ICACS \u201917. Association for Computing Machinery, New York, NY, USA, pp 27\u201331","DOI":"10.1145\/3127942.3127958"},{"key":"867_CR78","unstructured":"Lipton ZC, Berkowitz J, Elkan C (2015) A critical review of recurrent neural networks for sequence learning. arXiv preprint arXiv:1506.00019"},{"key":"867_CR79","doi-asserted-by":"publisher","unstructured":"Liu K, Hsu C, Wang W, Chiang H (2019) Real-time facial expression recognition based on cnn. In: 2019 international conference on system science and engineering (ICSSE), pp 120\u2013123 . https:\/\/doi.org\/10.1109\/ICSSE.2019.8823409","DOI":"10.1109\/ICSSE.2019.8823409"},{"issue":"23","key":"867_CR80","doi-asserted-by":"publisher","first-page":"7053","DOI":"10.1007\/s00500-016-2247-2","volume":"21","author":"P Liu","year":"2017","unstructured":"Liu P, Choo KKR, Wang L, Huang F (2017) Svm or deep learning? A comparative study on remote sensing image classification. Soft Comput 21(23):7053\u20137065","journal-title":"Soft Comput"},{"key":"867_CR81","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1109\/JAS.2017.7510622","volume":"4","author":"ZT Liu","year":"2017","unstructured":"Liu ZT, Wu M, Cao W, Chen LF, Xu J, Zhang R, Zhou M, Mao J (2017) A facial expression emotion recognition based human\u2013robot interaction system. IEEE\/CAA J Autom Sin 4:668\u2013676. https:\/\/doi.org\/10.1109\/JAS.2017.7510622","journal-title":"IEEE\/CAA J Autom Sin"},{"key":"867_CR82","doi-asserted-by":"crossref","unstructured":"Lopez-Rincon A (2019) Emotion recognition using facial expressions in children using the nao robot. In: 2019 international conference on electronics, communications and computers (CONIELECOMP), pp 146\u2013153","DOI":"10.1109\/CONIELECOMP.2019.8673111"},{"key":"867_CR83","doi-asserted-by":"publisher","first-page":"7239","DOI":"10.3390\/app10207239","volume":"10","author":"F Ma","year":"2020","unstructured":"Ma F, Zhang W, Li Y, Huang SL, Zhang L (2020) Learning better representations for audio-visual emotion recognition with common information. Appl Sci 10:7239. https:\/\/doi.org\/10.3390\/app10207239","journal-title":"Appl Sci"},{"key":"867_CR84","doi-asserted-by":"crossref","unstructured":"Maeda Y, Geshi S (2018) Human\u2013robot interaction using Markovian emotional model based on facial recognition. In: 2018 Joint 10th international conference on soft computing and intelligent systems (SCIS) and 19th international symposium on advanced intelligent systems (ISIS). IEEE, pp 209\u2013214","DOI":"10.1109\/SCIS-ISIS.2018.00044"},{"key":"867_CR85","first-page":"304","volume-title":"Adv Intell Comput Theor Appl","author":"MA Mannan","year":"2015","unstructured":"Mannan MA, Lam A, Kobayashi Y, Kuno Y (2015) Facial expression recognition based on hybrid approach. In: Huang DS, Han K (eds) Adv Intell Comput Theor Appl. Springer, Cham, pp 304\u2013310"},{"key":"867_CR86","doi-asserted-by":"crossref","unstructured":"Marmpena M, Lim A, Dahl TS, Hemion N (2019) Generating robotic emotional body language with variational autoencoders. In: 2019 8th international conference on affective computing and intelligent interaction (ACII). IEEE, pp 545\u2013551","DOI":"10.1109\/ACII.2019.8925459"},{"key":"867_CR87","doi-asserted-by":"publisher","unstructured":"Martin C, Werner U, Gross H (2008) A real-time facial expression recognition system based on active appearance models using gray images and edge images. In: 2008 8th IEEE international conference on automatic face gesture recognition, pp 1\u20136 . https:\/\/doi.org\/10.1109\/AFGR.2008.4813412","DOI":"10.1109\/AFGR.2008.4813412"},{"issue":"3","key":"867_CR88","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1109\/TAFFC.2017.2731763","volume":"10","author":"B Martinez","year":"2019","unstructured":"Martinez B, Valstar MF, Jiang B, Pantic M (2019) Automatic analysis of facial actions: a survey. IEEE Trans Affect Comput 10(3):325\u2013347","journal-title":"IEEE Trans Affect Comput"},{"key":"867_CR89","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1016\/j.procs.2016.07.233","volume":"93","author":"V Mayya","year":"2016","unstructured":"Mayya V, Pai RM, Pai MMM (2016) Automatic facial expression recognition using DCNN. Proc Comput Sci 93:453\u2013461. https:\/\/doi.org\/10.1016\/j.procs.2016.07.233","journal-title":"Proc Comput Sci"},{"issue":"2","key":"867_CR90","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/s12369-013-0226-7","volume":"6","author":"D McColl","year":"2014","unstructured":"McColl D, Nejat G (2014) Recognizing emotional body language displayed by a human-like social robot. Int J Soc Robot 6(2):261\u2013280","journal-title":"Int J Soc Robot"},{"key":"867_CR91","doi-asserted-by":"crossref","unstructured":"Meghdari A, Shouraki S, Siamy A, Shariati A (2016) The real-time facial imitation by a social humanoid robot","DOI":"10.1109\/ICRoM.2016.7886797"},{"key":"867_CR92","first-page":"53","volume":"2","author":"A Mehrabian","year":"1968","unstructured":"Mehrabian A (1968) Communication without words. Psychol Today 2:53\u201356","journal-title":"Psychol Today"},{"key":"867_CR93","doi-asserted-by":"crossref","unstructured":"Meng Z, Liu P, Cai J, Han S, Tong Y (2017) Identity-aware convolutional neural network for facial expression recognition. In: 2017 12th IEEE international conference on automatic face gesture recognition (FG 2017), pp 558\u2013565 (2017)","DOI":"10.1109\/FG.2017.140"},{"key":"867_CR94","unstructured":"Minaee S, Abdolrashidi A (2019) Deep-emotion: facial expression recognition using attentional convolutional network. arXiv preprint arXiv:1902.01019"},{"issue":"6","key":"867_CR95","doi-asserted-by":"publisher","first-page":"1496","DOI":"10.1109\/TCYB.2016.2549639","volume":"47","author":"K Mistry","year":"2017","unstructured":"Mistry K, Zhang L, Neoh SC, Lim CP, Fielding B (2017) A micro-GA embedded PSO feature selection approach to intelligent facial emotion recognition. IEEE Trans Cybern 47(6):1496\u20131509","journal-title":"IEEE Trans Cybern"},{"key":"867_CR96","doi-asserted-by":"publisher","unstructured":"Moeini A, Moeini H, Faez K (2014) Pose-invariant facial expression recognition based on 3d face reconstruction and synthesis from a single 2d image. In: 2014 22nd international conference on pattern recognition, pp 1746\u20131751. https:\/\/doi.org\/10.1109\/ICPR.2014.307","DOI":"10.1109\/ICPR.2014.307"},{"key":"867_CR97","doi-asserted-by":"crossref","unstructured":"Mollahosseini A, Chan D, Mahoor MH (2016) Going deeper in facial expression recognition using deep neural networks. In: 2016 IEEE winter conference on applications of computer vision (WACV), pp 1\u201310 (2016)","DOI":"10.1109\/WACV.2016.7477450"},{"key":"867_CR98","unstructured":"Ngiam J, Khosla A, Kim M, Nam J, Lee H, Ng AY (2011) Multimodal deep learning. In: ICML"},{"issue":"5","key":"867_CR99","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1109\/3468.952716","volume":"31","author":"MN Nicolescu","year":"2001","unstructured":"Nicolescu MN, Mataric MJ (2001) Learning and interacting in human\u2013robot domains. IEEE Trans Syst Man Cybern Part A Syst Hum 31(5):419\u2013430","journal-title":"IEEE Trans Syst Man Cybern Part A Syst Hum"},{"key":"867_CR100","unstructured":"Nunes ARV (2019) Deep emotion recognition through upper body movements and facial expression. Master\u2019s thesis, Aalborg University"},{"key":"867_CR101","doi-asserted-by":"crossref","unstructured":"Nwosu L, Wang H, Lu J, Unwala I, Yang X, Zhang T (2017) Deep convolutional neural network for facial expression recognition using facial parts. In: 2017 IEEE 15th international conference on dependable, autonomic and secure computing, 15th international conference on pervasive intelligence and computing, 3rd international conference on big data intelligence and computing and cyber science and technology congress, pp 1318\u20131321","DOI":"10.1109\/DASC-PICom-DataCom-CyberSciTec.2017.213"},{"key":"867_CR102","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/s10846-014-0066-1","volume":"78","author":"JW Park","year":"2014","unstructured":"Park JW, Lee H, Chung M (2014) Generation of realistic robot facial expressions for human robot interaction. J Intell Robot Syst 78:443\u2013462","journal-title":"J Intell Robot Syst"},{"key":"867_CR103","doi-asserted-by":"crossref","unstructured":"Prajapati S, Shrinivasa\u00a0Naika CL, Jha S, Nair S (2013) On rendering emotions on a robotic face, pp 1\u20137","DOI":"10.1145\/2506095.2506151"},{"issue":"2","key":"867_CR104","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1109\/5.18626","volume":"77","author":"LR Rabiner","year":"1989","unstructured":"Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257\u2013286","journal-title":"Proc IEEE"},{"key":"867_CR105","doi-asserted-by":"crossref","unstructured":"Ray C, Mondada F, Siegwart R (2008) What do people expect from robots? pp 3816\u20133821","DOI":"10.1109\/IROS.2008.4650714"},{"key":"867_CR106","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.patrec.2014.11.007","volume":"66","author":"F Ringeval","year":"2015","unstructured":"Ringeval F, Eyben F, Kroupi E, Yuce A, Thiran JP, Ebrahimi T, Lalanne D, Schuller B (2015) Prediction of asynchronous dimensional emotion ratings from audiovisual and physiological data. Pattern Recogn Lett 66:22\u201330. https:\/\/doi.org\/10.1016\/j.patrec.2014.11.007 (Pattern Recognition in Human Computer Interaction)","journal-title":"Pattern Recogn Lett"},{"key":"867_CR107","doi-asserted-by":"crossref","unstructured":"Ringeval F, Schuller B, Valstar M, Jaiswal S, Marchi E, Lalanne D, Cowie R, Pantic M (2015) Av+ ec 2015\u2013the first affect recognition challenge bridging across audio, video, and physiological data","DOI":"10.1145\/2808196.2811642"},{"key":"867_CR108","unstructured":"Romero P, Cid F, N\u00fanez P (2013) A novel real time facial expression recognition system based on candide-3 reconstruction model. In: Proceedings of the XIV workshop on physical agents (WAF 2013), Madrid, Spain, pp 18\u201319"},{"key":"867_CR109","unstructured":"Rouast PV, Adam MTP, Chiong R (2019) Deep learning for human affect recognition: insights and new developments. ArXiv arXiv:1901.02884"},{"key":"867_CR110","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-018-3358-8","author":"A Ruiz-Garcia","year":"2018","unstructured":"Ruiz-Garcia A, Elshaw M, Altahhan A, Palade V (2018) A hybrid deep learning neural approach for emotion recognition from facial expressions for socially assistive robots. Neural Comput Appl. https:\/\/doi.org\/10.1007\/s00521-018-3358-8","journal-title":"Neural Comput Appl"},{"key":"867_CR111","doi-asserted-by":"crossref","unstructured":"Saerbeck M, Bartneck C (2010) Perception of affect elicited by robot motion, pp. 53\u201360","DOI":"10.1109\/HRI.2010.5453269"},{"issue":"6","key":"867_CR112","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1109\/TPAMI.2014.2366127","volume":"37","author":"E Sariyanidi","year":"2015","unstructured":"Sariyanidi E, Gunes H, Cavallaro A (2015) Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Trans Pattern Anal Mach Intell 37(6):1113\u20131133","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"867_CR113","doi-asserted-by":"publisher","unstructured":"Saxena S, Tripathi S, Sudarshan TSB (2019) Deep dive into faces: Pose illumination invariant multi-face emotion recognition system. In: 2019 IEEE\/RSJ international conference on intelligent robots and systems (IROS), pp. 1088\u20131093 . https:\/\/doi.org\/10.1109\/IROS40897.2019.8967874","DOI":"10.1109\/IROS40897.2019.8967874"},{"key":"867_CR114","doi-asserted-by":"crossref","unstructured":"Shi Y, Chen Y, Ardila LR, Venture G, Bourguet ML (2019) A visual sensing platform for robot teachers. In: Proceedings of the 7th international conference on human\u2013agent interaction, pp 200\u2013201","DOI":"10.1145\/3349537.3352764"},{"key":"867_CR115","doi-asserted-by":"crossref","unstructured":"Sikka K, Dhall A, Bartlett M (2015) Exemplar hidden Markov models for classification of facial expressions in videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 18\u201325","DOI":"10.1109\/CVPRW.2015.7301350"},{"key":"867_CR116","doi-asserted-by":"crossref","unstructured":"Simul NS, Ara NM, Islam MS (2016) A support vector machine approach for real time vision based human robot interaction. In: 2016 19th international conference on computer and information technology (ICCIT), pp 496\u2013500","DOI":"10.1109\/ICCITECHN.2016.7860248"},{"key":"867_CR117","first-page":"2222","volume-title":"Advances in neural information processing systems","author":"N Srivastava","year":"2012","unstructured":"Srivastava N, Salakhutdinov RR (2012) Multimodal learning with deep Boltzmann machines. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems, vol 25. Curran Associates Inc, Red Hook, pp 2222\u20132230"},{"key":"867_CR118","doi-asserted-by":"publisher","unstructured":"Stock R, Merkle M (2018) Can humanoid service robots perform better than service employees? a comparison of innovative behavior cues. https:\/\/doi.org\/10.24251\/HICSS.2018.133","DOI":"10.24251\/HICSS.2018.133"},{"key":"867_CR119","doi-asserted-by":"crossref","unstructured":"Stock R, Nguyen MA (2019) Robotic psychology what do we know about human\u2013robot interaction and what do we still need to learn?","DOI":"10.24251\/HICSS.2019.234"},{"key":"867_CR120","unstructured":"Stock RM (2016) Emotion transfer from frontline social robots to human customers during service encounters: testing an artificial emotional contagion modell. In: ICIS"},{"key":"867_CR121","doi-asserted-by":"publisher","unstructured":"Stock RM, Merkle M (2017) A service robot acceptance model: user acceptance of humanoid robots during service encounters. In: IEEE international conference on pervasive computing and communications workshops (PerCom Workshops), pp 339\u2013344 . https:\/\/doi.org\/10.1109\/PERCOMW.2017.7917585","DOI":"10.1109\/PERCOMW.2017.7917585"},{"key":"867_CR122","unstructured":"Stock-Homburg R (2021) Survey of emotions in human\u2013robot interaction\u2014after 20 years of research: What do we know and what have we still to learn? Int J Soc Robot"},{"key":"867_CR123","unstructured":"Sukhbaatar S, Makino T, Aihara K, Chikayama T (2011) Robust generation of dynamical patterns in human motion by a deep belief nets. In: Asian conference on machine learning, pp 231\u2013246"},{"key":"867_CR124","unstructured":"Taira H, Haruno M (1999) Feature selection in SVM text categorization. In: AAAI\/IAAI, pp 480\u2013486"},{"key":"867_CR125","doi-asserted-by":"publisher","first-page":"17954","DOI":"10.1073\/pnas.0707769104","volume":"104","author":"F Tanaka","year":"2007","unstructured":"Tanaka F, Cicourel A, Movellan J (2007) Socialization between toddlers and robots at an early childhood education center. Proc Natl Acad Sci USA 104:17954\u20138","journal-title":"Proc Natl Acad Sci USA"},{"key":"867_CR126","doi-asserted-by":"publisher","first-page":"4525","DOI":"10.1109\/ACCESS.2017.2676238","volume":"5","author":"MZ Uddin","year":"2017","unstructured":"Uddin MZ, Hassan MM, Almogren A, Alamri A, Alrubaian M, Fortino G (2017) Facial expression recognition utilizing local direction-based robust features and deep belief network. IEEE Access 5:4525\u20134536","journal-title":"IEEE Access"},{"key":"867_CR127","doi-asserted-by":"publisher","first-page":"26146","DOI":"10.1109\/ACCESS.2017.2777003","volume":"5","author":"MZ Uddin","year":"2017","unstructured":"Uddin MZ, Khaksar W, Torresen J (2017) Facial expression recognition using salient features and convolutional neural network. IEEE Access 5:26146\u201326161","journal-title":"IEEE Access"},{"key":"867_CR128","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2440-0","volume-title":"The nature of statistical learning theory","author":"VN Vapnik","year":"1995","unstructured":"Vapnik VN (1995) The nature of statistical learning theory. Springer, NewYork"},{"issue":"5","key":"867_CR129","doi-asserted-by":"publisher","first-page":"988","DOI":"10.1109\/72.788640","volume":"10","author":"VN Vapnik","year":"1999","unstructured":"Vapnik VN (1999) An overview of statistical learning theory. IEEE Trans Neural Netw 10(5):988\u2013999","journal-title":"IEEE Trans Neural Netw"},{"key":"867_CR130","doi-asserted-by":"crossref","unstructured":"Vithanawasam T, Madhusanka A (2019) Face and upper-body emotion recognition using service robot\u2019s eyes in a domestic environment, pp 44\u201350","DOI":"10.23919\/SCSE.2019.8842658"},{"key":"867_CR131","doi-asserted-by":"publisher","first-page":"4057","DOI":"10.1109\/TIP.2019.2956143","volume":"29","author":"K Wang","year":"2020","unstructured":"Wang K, Peng X, Yang J, Meng D, Qiao Y (2020) Region attention networks for pose and occlusion robust facial expression recognition. IEEE Trans Image Process 29:4057\u20134069","journal-title":"IEEE Trans Image Process"},{"key":"867_CR132","doi-asserted-by":"crossref","unstructured":"Wang Q, Ju S (2008) A mixed classifier based on combination of HMM and KNN. In: 2008 fourth international conference on natural computation, vol\u00a04, pp 38\u201342","DOI":"10.1109\/ICNC.2008.680"},{"key":"867_CR133","doi-asserted-by":"crossref","unstructured":"Webb N, Ruiz-Garcia A, Elshaw M, Palade V (2020) Emotion recognition from face images in an unconstrained environment for usage on social robots. In: 2020 international joint conference on neural networks (IJCNN), pp. 1\u20138","DOI":"10.1109\/IJCNN48605.2020.9207494"},{"key":"867_CR134","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1007\/978-3-540-78157-8_11","volume-title":"Robot Vis","author":"M Wimmer","year":"2008","unstructured":"Wimmer M, MacDonald BA, Jayamuni D, Yadav A (2008) Facial expression recognition for human\u2013robot interaction\u2014a prototype. In: Sommer G, Klette R (eds) Robot Vis. Springer, Berlin, pp 139\u2013152"},{"key":"867_CR135","unstructured":"Wu C, Wang S, Ji Q (2015) Multi-instance hidden Markov model for facial expression recognition. In: 2015 11th IEEE international conference and workshops on automatic face and gesture recognition (FG), vol\u00a01, pp 1\u20136"},{"key":"867_CR136","unstructured":"Wu M, Su W, Chen L, Liu Z, Cao W, Hirota K (2019) Weight-adapted convolution neural network for facial expression recognition in human\u2013robot interaction. IEEE Trans Syst Man Cybern Syst"},{"key":"867_CR137","doi-asserted-by":"crossref","unstructured":"Yaddaden Y, Bouzouane A, Adda M, Bouchard B (2016) A new approach of facial expression recognition for ambient assisted living. In: Proceedings of the 9th ACM international conference on PErvasive technologies related to assistive environments, PETRA \u201916. Association for Computing Machinery, New York, NY, USA","DOI":"10.1145\/2910674.2910703"},{"key":"867_CR138","doi-asserted-by":"crossref","unstructured":"Yamashita R, Nishio M, Do RKG, Togashi K (2018) Convolutional neural networks: an overview and application in radiology. Insights Imaging 9(4):611\u2013629","DOI":"10.1007\/s13244-018-0639-9"},{"key":"867_CR139","doi-asserted-by":"publisher","first-page":"4630","DOI":"10.1109\/ACCESS.2017.2784096","volume":"6","author":"B Yang","year":"2018","unstructured":"Yang B, Cao J, Ni R, Zhang Y (2018) Facial expression recognition using weighted mixture deep neural network based on double-channel facial images. IEEE Access 6:4630\u20134640","journal-title":"IEEE Access"},{"key":"867_CR140","doi-asserted-by":"crossref","unstructured":"Yang H, Yin L (2017) CNN based 3d facial expression recognition using masking and landmark features. In: 2017 seventh international conference on affective computing and intelligent interaction (ACII), pp 556\u2013560","DOI":"10.1109\/ACII.2017.8273654"},{"key":"867_CR141","doi-asserted-by":"crossref","unstructured":"Yoo B, Cho S, Kim J (2011) Fuzzy integral-based composite facial expression generation for a robotic head. In: 2011 IEEE international conference on fuzzy systems (FUZZ-IEEE 2011), pp 917\u2013923","DOI":"10.1109\/FUZZY.2011.6007468"},{"key":"867_CR142","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1007\/978-3-030-35888-4_59","volume-title":"Social robotics","author":"C Yu","year":"2019","unstructured":"Yu C, Tapus A (2019) Interactive robot learning for multimodal emotion recognition. In: Salichs MA, Ge SS, Barakova EI, Cabibihan JJ, Wagner AR, Castro-Gonz\u00e1lez \u00c1, He H (eds) Social robotics. Springer, Cham, pp 633\u2013642"},{"key":"867_CR143","doi-asserted-by":"publisher","unstructured":"Zhang F, Zhang T, Mao Q, Xu C (2018) Joint pose and expression modeling for facial expression recognition. In: 2018 IEEE\/CVF conference on computer vision and pattern recognition, pp 3359\u20133368 . https:\/\/doi.org\/10.1109\/CVPR.2018.00354","DOI":"10.1109\/CVPR.2018.00354"},{"key":"867_CR144","doi-asserted-by":"publisher","unstructured":"Zhang F, Zhang T, Mao Q, Xu C (2020) Geometry guided pose-invariant facial expression recognition. IEEE Trans Image Process 29:4445\u20134460. https:\/\/doi.org\/10.1109\/TIP.2020.2972114","DOI":"10.1109\/TIP.2020.2972114"},{"issue":"9","key":"867_CR145","doi-asserted-by":"publisher","first-page":"4193","DOI":"10.1109\/TIP.2017.2689999","volume":"26","author":"K Zhang","year":"2017","unstructured":"Zhang K, Huang Y, Du Y, Wang L (2017) Facial expression recognition based on deep evolutional spatial-temporal networks. IEEE Trans Image Process 26(9):4193\u20134203","journal-title":"IEEE Trans Image Process"},{"key":"867_CR146","doi-asserted-by":"crossref","unstructured":"Zhang Z, Luo P, Loy CC, Tang X (2016) From facial expression recognition to interpersonal relation prediction. Int J Comput Vis","DOI":"10.1007\/s11263-017-1055-1"},{"key":"867_CR147","doi-asserted-by":"crossref","unstructured":"Zhao L, Wang Z, Zhang G (2017) Facial expression recognition from video sequences based on spatial-temporal motion local binary pattern and Gabor multiorientation fusion histogram. Math Probl Eng","DOI":"10.1155\/2017\/7206041"}],"container-title":["International Journal of Social Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-022-00867-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12369-022-00867-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-022-00867-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T19:09:01Z","timestamp":1727464141000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12369-022-00867-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,24]]},"references-count":147,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["867"],"URL":"https:\/\/doi.org\/10.1007\/s12369-022-00867-0","relation":{},"ISSN":["1875-4791","1875-4805"],"issn-type":[{"value":"1875-4791","type":"print"},{"value":"1875-4805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,24]]},"assertion":[{"value":"4 January 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 June 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The authors declare that there are no compliance issues with this research.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}