{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T05:08:10Z","timestamp":1780636090994,"version":"3.54.1"},"reference-count":82,"publisher":"Springer Science and Business Media LLC","issue":"47-48","license":[{"start":{"date-parts":[[2020,8,13]],"date-time":"2020-08-13T00:00:00Z","timestamp":1597276800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,8,13]],"date-time":"2020-08-13T00:00:00Z","timestamp":1597276800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100007195","name":"Universit\u00e0 degli Studi di Napoli Federico II","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100007195","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Emotions represent a key aspect of human life and behavior. In recent years, automatic recognition of emotions has become an important component in the fields of affective computing and human-machine interaction. Among many physiological and kinematic signals that could be used to recognize emotions, acquiring facial expression images is one of the most natural and inexpensive approaches. The creation of a generalized, inter-subject, model for emotion recognition from facial expression is still a challenge, due to anatomical, cultural and environmental differences. On the other hand, using traditional machine learning approaches to create a subject-customized, personal, model would require a large dataset of labelled samples. For these reasons, in this work, we propose the use of transfer learning to produce subject-specific models for extracting the emotional content of facial images in the valence\/arousal dimensions. Transfer learning allows us to reuse the knowledge assimilated from a large multi-subject dataset by a deep-convolutional neural network and employ the feature extraction capability in the single subject scenario. In this way, it is possible to reduce the amount of labelled data necessary to train a personalized model, with respect to relying just on subjective data. Our results suggest that generalized transferred knowledge, in conjunction with a small amount of personal data, is sufficient to obtain high recognition performances and improvement with respect to both a generalized model and personal models. For both valence and arousal dimensions, quite good performances were obtained (RMSE\u2009=\u20090.09 and RMSE\u2009=\u20090.1 for valence and arousal, respectively). Overall results suggested that both the transferred knowledge and the personal data helped in achieving this improvement, even though they alternated in providing the main contribution. Moreover, in this task, we observed that the benefits of transferring knowledge are so remarkable that no specific active or passive sampling techniques are needed for selecting images to be labelled.<\/jats:p>","DOI":"10.1007\/s11042-020-09405-4","type":"journal-article","created":{"date-parts":[[2020,8,13]],"date-time":"2020-08-13T22:02:38Z","timestamp":1597356158000},"page":"35811-35828","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["Personalized models for facial emotion recognition through transfer learning"],"prefix":"10.1007","volume":"79","author":[{"given":"Martina","family":"Rescigno","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matteo","family":"Spezialetti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3379-1756","authenticated-orcid":false,"given":"Silvia","family":"Rossi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,8,13]]},"reference":[{"key":"9405_CR1","unstructured":"Arriaga O, Valdenegro-Toro M, Pl\u04e7ger PG (2019) Real-time convolutional neural networks for emotion and gender classification. In: Proceedings of the 2019 European symposium on artificial neural networks, computational intelligence. ISBN 978-287-587-065-0"},{"issue":"1","key":"9405_CR2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1529100619832930","volume":"20","author":"LF Barrett","year":"2019","unstructured":"Barrett LF, Adolphs R, Marsella S, Martinez AM, Pollak SD (2019) Emotional expressions reconsidered: challenges to inferring emotion from human facial movements. Psychol Sci Public Interest 20(1):1\u201368","journal-title":"Psychol Sci Public Interest"},{"issue":"6","key":"9405_CR3","doi-asserted-by":"crossref","first-page":"22","DOI":"10.4304\/jmm.1.6.22-35","volume":"1","author":"MS Bartlett","year":"2006","unstructured":"Bartlett MS, Littlewort G, Frank MG, Lainscsek C, Fasel IR, Movellan JR (2006) Automatic recognition of facial actions in spontaneous expressions. J Multimed 1(6):22\u201335","journal-title":"J Multimed"},{"key":"9405_CR4","doi-asserted-by":"crossref","unstructured":"Chang WY, Hsu SH, Chien JH (2017) FATAUVA-net: an integrated deep learning framework for facial attribute recognition, action unit detection, and valence-arousal estimation. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 17\u201325","DOI":"10.1109\/CVPRW.2017.246"},{"key":"9405_CR5","doi-asserted-by":"crossref","unstructured":"Chao L, Tao J, Yang M, Li Y, Wen Z (2015) Long short term memory recurrent neural network based multimodal dimensional emotion recognition. In: Proceedings of the 5th international workshop on audio\/visual emotion challenge, pp 65\u201372","DOI":"10.1145\/2808196.2811634"},{"issue":"15","key":"9405_CR6","doi-asserted-by":"crossref","first-page":"1964","DOI":"10.1016\/j.patrec.2013.02.002","volume":"34","author":"J Chen","year":"2013","unstructured":"Chen J, Liu X, Tu P, Aragones A (2013) Learning person-specific models for facial expression and action unit recognition. Pattern Recogn Lett 34(15):1964\u20131970","journal-title":"Pattern Recogn Lett"},{"issue":"3","key":"9405_CR7","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1109\/TPAMI.2016.2547397","volume":"39","author":"WS Chu","year":"2016","unstructured":"Chu WS, De la Torre F, Cohn JF (2016) Selective transfer machine for personalized facial expression analysis. IEEE Trans Pattern Anal Mach Intell 39(3):529\u2013545","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"9405_CR8","doi-asserted-by":"crossref","unstructured":"Dhall A, Ramana Murthy O, Goecke R, Joshi J, Gedeon T (2015) Video and image based emotion recognition challenges in the wild: Emotiw 2015. In: Proceedings of the 2015 ACM on international conference on multi-modal interaction, pp 423\u2013426","DOI":"10.1145\/2818346.2829994"},{"key":"9405_CR9","doi-asserted-by":"crossref","unstructured":"Donahue J, Hendricks AL, Guadarrama S, Rohrbach M, Venugopalan S, Saenko K, Darrell T (2015) Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2625\u20132634","DOI":"10.1109\/CVPR.2015.7298878"},{"issue":"15","key":"9405_CR10","doi-asserted-by":"crossref","first-page":"E1454","DOI":"10.1073\/pnas.1322355111","volume":"111","author":"S Du","year":"2014","unstructured":"Du S, Tao Y, Martinez AM (2014) Compound facial expressions of emotion. Proc Natl Acad Sci 111(15):E1454\u2013E1462","journal-title":"Proc Natl Acad Sci"},{"issue":"3\u20134","key":"9405_CR11","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1080\/02699939208411068","volume":"6","author":"P Ekman","year":"1992","unstructured":"Ekman P (1992) An argument for basic emotions. Cognit Emot 6(3\u20134):169\u2013200","journal-title":"Cognit Emot"},{"key":"9405_CR12","unstructured":"Ekman P, Keltner D (1997) Universal facial expressions of emotion. In: Segerstrale U, Molnar P (eds) Nonverbal communication: where nature meets culture, pp 27\u201346"},{"key":"9405_CR13","doi-asserted-by":"crossref","unstructured":"Feffer M, Picard RW (2018) A mixture of personalized experts for human affect estimation. In: International conference on machine learning and data mining in pattern recognition, pp 316\u2013330","DOI":"10.1007\/978-3-319-96133-0_24"},{"key":"9405_CR14","volume-title":"Uncertainty in deep learning","author":"Y Gal","year":"2016","unstructured":"Gal Y (2016) Uncertainty in deep learning. University of Cambridge, Cambridge"},{"issue":"6","key":"9405_CR15","doi-asserted-by":"crossref","first-page":"7714","DOI":"10.3390\/s130607714","volume":"13","author":"D Ghimire","year":"2013","unstructured":"Ghimire D, Lee J (2013) Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines. Sensors 13(6):7714\u20137734","journal-title":"Sensors"},{"key":"9405_CR16","doi-asserted-by":"crossref","unstructured":"Goodfellow IJ, Erhan D, Carrier PL, Courville A, Mirza M, Hamner B, Cukierski W et al (2013) Challenges in representation learning: a report on three machine learning contests. In: International conference on neural information processing, pp 117\u2013124","DOI":"10.1007\/978-3-642-42051-1_16"},{"key":"9405_CR17","doi-asserted-by":"crossref","unstructured":"Guo R, Li S, He L, Gao W, Qi H, Owens G (2013) Pervasive and unobtrusive emotion sensing for human mental health. In: Proceedings of the 7th international conference on pervasive computing Technologies for Healthcare, Venice, Italy, 5\u20138 May 2013, pp 436\u2013439","DOI":"10.4108\/icst.pervasivehealth.2013.252133"},{"issue":"3","key":"9405_CR18","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1002\/cb.1710","volume":"17","author":"JM Harris","year":"2018","unstructured":"Harris JM, Ciorciari J, Gountas J (2018) Consumer neuroscience for marketing researchers. J Consum Behav 17(3):239\u2013252","journal-title":"J Consum Behav"},{"key":"9405_CR19","doi-asserted-by":"crossref","unstructured":"Hasani B, Mahoor MH (2017) Facial expression recognition using enhanced deep 3D convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 30\u201340","DOI":"10.1109\/CVPRW.2017.282"},{"key":"9405_CR20","doi-asserted-by":"crossref","unstructured":"Hasani B, Mahoor MH (2017) Facial affect estimation in the wild using deep residual and convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 9\u201316","DOI":"10.1109\/CVPRW.2017.245"},{"issue":"3","key":"9405_CR21","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1111\/j.1745-6916.2007.00044.x","volume":"2","author":"CE Izard","year":"2007","unstructured":"Izard CE (2007) Basic emotions, natural kinds, emotion schemas, and a new paradigm. Perspect Psychol Sci 2(3):260\u2013280","journal-title":"Perspect Psychol Sci"},{"issue":"4","key":"9405_CR22","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1007\/s12008-018-0473-9","volume":"12","author":"J Izquierdo-Reyes","year":"2018","unstructured":"Izquierdo-Reyes J, Ramirez-Mendoza RA, Bustamante-Bello MR, Pons-Rovira JL, Gonzalez-Vargas JE (2018) Emotion recognition for semi-autonomous vehicles framework. International Journal on Interactive Design and Manufacturing (IJIDeM) 12(4):1447\u20131454","journal-title":"International Journal on Interactive Design and Manufacturing (IJIDeM)"},{"issue":"19","key":"9405_CR23","doi-asserted-by":"crossref","first-page":"7241","DOI":"10.1073\/pnas.1200155109","volume":"109","author":"RE Jack","year":"2012","unstructured":"Jack RE, Garrod OG, Yu H, Caldara R, Schyns PG (2012) Facial expressions of emotion are not culturally universal. Proc Natl Acad Sci 109(19):7241\u20137244","journal-title":"Proc Natl Acad Sci"},{"issue":"1","key":"9405_CR24","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1162\/neco.1991.3.1.79","volume":"3","author":"RA Jacobs","year":"1991","unstructured":"Jacobs RA, Jordan MI, Nowlan SJ, Hinton GE (1991) Adaptive mixtures of local experts. Neural Comput 3(1):79\u201387","journal-title":"Neural Comput"},{"key":"9405_CR25","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-7138-7","volume-title":"An introduction to statistical learning","author":"G James","year":"2013","unstructured":"James G, Witten D, Hastie T, Tibshirani R (2013) An introduction to statistical learning. Springer, New York"},{"key":"9405_CR26","unstructured":"Jiang J (2008) A literature survey on domain adaptation of statistical classifiers. Technical report, University of Illinois at Urbana-Champaign"},{"key":"9405_CR27","doi-asserted-by":"crossref","unstructured":"Jung H, Lee S, Yim J, Park S, Kim J (2015) Joint fine-tuning in deep neural networks for facial expression recognition. In: Proceedings of the IEEE international conference on computer vision, pp 2983\u20132991","DOI":"10.1109\/ICCV.2015.341"},{"key":"9405_CR28","doi-asserted-by":"crossref","unstructured":"Kahou ES, Michalski V, Konda K, Memisevic R, Pal C (2015) Recurrent neural networks for emotion recognition in video. In: Proceedings of the 2015 ACM on international conference on multimodal interaction, pp 467\u2013474","DOI":"10.1145\/2818346.2830596"},{"key":"9405_CR29","doi-asserted-by":"crossref","unstructured":"Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings fourth IEEE international conference on automatic face and gesture recognition (cat. No. PR00580), pp 46\u201353","DOI":"10.1109\/AFGR.2000.840611"},{"issue":"3","key":"9405_CR30","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0032321","volume":"7","author":"K Kaulard","year":"2012","unstructured":"Kaulard K, Cunningham DW, B\u00fclthoff HH, Wallraven C (2012) The MPI facial expression database\u2014a validated database of emotional and conversational facial expressions. PLoS One 7(3):e32321","journal-title":"PLoS One"},{"key":"9405_CR31","doi-asserted-by":"crossref","unstructured":"Khorrami P, Le Paine T, Brady K, Dagli C, Huang TS (2016) How deep neural networks can improve emotion recognition on video data. In: 2016 IEEE international conference on image processing (ICIP), pp 619\u2013623","DOI":"10.1109\/ICIP.2016.7532431"},{"issue":"1","key":"9405_CR32","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/T-AFFC.2012.16","volume":"4","author":"A Kleinsmith","year":"2012","unstructured":"Kleinsmith A, Bianchi-Berthouze N (2012) Affective body expression perception and recognition: a survey. IEEE Trans Affect Comput 4(1):15\u201333","journal-title":"IEEE Trans Affect Comput"},{"issue":"2","key":"9405_CR33","doi-asserted-by":"crossref","first-page":"401","DOI":"10.3390\/s18020401","volume":"18","author":"B Ko","year":"2018","unstructured":"Ko B (2018) A brief review of facial emotion recognition based on visual information. Sensors 18(2):401","journal-title":"Sensors"},{"issue":"2","key":"9405_CR34","first-page":"1137","volume":"14","author":"R Kohavi","year":"1995","unstructured":"Kohavi R (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. Ijcai 14(2):1137\u20131145","journal-title":"Ijcai"},{"issue":"2","key":"9405_CR35","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s10772-011-9125-1","volume":"15","author":"SG Koolagudi","year":"2012","unstructured":"Koolagudi SG, Rao KS (2012) Emotion recognition from speech: a review. International journal of speech technology 15(2):99\u2013117","journal-title":"International journal of speech technology"},{"key":"9405_CR36","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097\u20131105"},{"key":"9405_CR37","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-6849-3","volume-title":"Applied predictive modeling","author":"M Kuhn","year":"2013","unstructured":"Kuhn M, Johnson K (2013) Applied predictive modeling. Springer, New York"},{"issue":"5","key":"9405_CR38","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1037\/a0024244","volume":"137","author":"HC Lench","year":"2011","unstructured":"Lench HC, Flores SA, Bench SW (2011) Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology: a meta-analysis of experimental emotion elicitations. Psychol Bull 137(5):834\u2013855","journal-title":"Psychol Bull"},{"key":"9405_CR39","doi-asserted-by":"crossref","unstructured":"Li M, Zhang T, Chen Y, Smola AJ (2014) Efficient mini-batch training for stochastic optimization. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 661\u2013670","DOI":"10.1145\/2623330.2623612"},{"key":"9405_CR40","doi-asserted-by":"crossref","unstructured":"Li J, Chen Y, Xiao S, Zhao J, Roy S, Feng J, Yan S, Sim T (2017) Estimation of affective level in the wild with multiple memory networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 1\u20138","DOI":"10.1109\/CVPRW.2017.244"},{"issue":"1","key":"9405_CR41","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1037\/a0029038","volume":"139","author":"KA Lindquist","year":"2013","unstructured":"Lindquist KA, Siegel EH, Quigley KS, Barrett LF (2013) The hundred-year emotion war: are emotions natural kinds or psychological constructions? Comment on Lench, Flores, and Bench (2011). Psychol Bull 139(1):255\u2013263","journal-title":"Psychol Bull"},{"key":"9405_CR42","doi-asserted-by":"crossref","unstructured":"Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE computer society conference on computer vision and pattern recognition-workshops, pp 94\u2013101","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"9405_CR43","doi-asserted-by":"crossref","unstructured":"Lyons M, Akamatsu S, Kamachi M, Gyoba J (1998) Coding facial expressions with gabor wavelets. In: Proceedings third IEEE international conference on automatic face and gesture recognition, pp 200\u2013205","DOI":"10.1109\/AFGR.1998.670949"},{"issue":"2","key":"9405_CR44","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1109\/T-AFFC.2013.4","volume":"4","author":"SM Mavadati","year":"2013","unstructured":"Mavadati SM, Mahoor MH, Bartlett K, Trinh P, Cohn JF (2013) Disfa: a spontaneous facial action intensity database. IEEE Trans Affect Comput 4(2):151\u2013160","journal-title":"IEEE Trans Affect Comput"},{"issue":"4","key":"9405_CR45","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/BF02686918","volume":"14","author":"A Mehrabian","year":"1996","unstructured":"Mehrabian A (1996) Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr Psychol 14(4):261\u2013292","journal-title":"Curr Psychol"},{"key":"9405_CR46","unstructured":"Miranda-Correa JA, Abadi MK, Sebe N, Patras I (2018) AMIGOS: a dataset for affect, personality and mood research on individuals and groups. IEEE Trans Affect Comput"},{"issue":"1","key":"9405_CR47","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/TAFFC.2017.2740923","volume":"10","author":"A Mollahosseini","year":"2017","unstructured":"Mollahosseini A, Hasani B, Mahoor MH (2017) Affectnet: a database for facial expression, valence, and arousal computing in the wild. IEEE Trans Affect Comput 10(1):18\u201331","journal-title":"IEEE Trans Affect Comput"},{"key":"9405_CR48","unstructured":"Ng HW, Nguyen VD, Vonikakis V, Winkler S (2015) Deep learning for emotion recognition on small datasets using transfer learning. In: Proceedings of the 2015 ACM on international conference on multimodal interaction. ACM, pp 443\u2013449"},{"issue":"10","key":"9405_CR49","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","volume":"22","author":"SJ Pan","year":"2009","unstructured":"Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345\u20131359","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"9405_CR50","unstructured":"Pantic M, Valstar M, Rademaker R, Maat L (2005) Web-based database for facial expression analysis. In: 2005 IEEE international conference on multimedia and expo, p 5"},{"key":"9405_CR51","unstructured":"Picard RW (1999) Affective computing for HCI. In: HCI (1), pp 829\u2013833"},{"key":"9405_CR52","volume-title":"Theories of emotion","author":"R Plutchik","year":"1980","unstructured":"Plutchik R, Kellerman H (1980) Theories of emotion. Academic, New York"},{"key":"9405_CR53","doi-asserted-by":"crossref","unstructured":"Ringeval F, Sonderegger A, Sauer J, Lalanne D (2013) Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions. In: 2013 10th IEEE international conference and workshops on automatic face and gesture recognition (FG), pp 1\u20138","DOI":"10.1109\/FG.2013.6553805"},{"key":"9405_CR54","doi-asserted-by":"crossref","unstructured":"Ringeval F, Schuller B, Valstar M, Jaiswal S, Marchi E, Lalanne D, Cowie R, Pantic M (2015) Av+ ec 2015: the first affect recognition challenge bridging across audio, video, and physiological data. In: Proceedings of the 5th international workshop on audio\/visual emotion challenge, pp 3\u20138","DOI":"10.1145\/2808196.2811642"},{"key":"9405_CR55","doi-asserted-by":"crossref","unstructured":"Rossi S, Ercolano G, Raggioli L, Savino E, Ruocco M (2018) The disappearing robot: an analysis of disengagement and distraction during non-interactive tasks. In: 2018 27th IEEE international symposium on robot and human interactive communication (RO-MAN), pp 522\u2013527","DOI":"10.1109\/ROMAN.2018.8525514"},{"issue":"3","key":"9405_CR56","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211\u2013252","journal-title":"Int J Comput Vis"},{"issue":"6","key":"9405_CR57","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","volume":"39","author":"J Russell","year":"1980","unstructured":"Russell J (1980) A circumplex model of affect. J Pers Soc Psychol 39(6):1161\u20131178","journal-title":"J Pers Soc Psychol"},{"issue":"3","key":"9405_CR58","doi-asserted-by":"crossref","first-page":"185","DOI":"10.2190\/DUGG-P24E-52WK-6CDG","volume":"9","author":"P Salovey","year":"1990","unstructured":"Salovey P, Mayer JD (1990) Emotional intelligence. Imagin Cogn Pers 9(3):185\u2013211","journal-title":"Imagin Cogn Pers"},{"issue":"6","key":"9405_CR59","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1109\/TPAMI.2014.2366127","volume":"37","author":"E Sariyanidi","year":"2014","unstructured":"Sariyanidi E, Gunes H, Cavallaro A (2014) Automatic analysis of facial affect: a survey of registration, representation, and recognition. IEEE Trans Pattern Anal Mach Intell 37(6):1113\u20131133","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"8","key":"9405_CR60","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1177\/0956797611435134","volume":"23","author":"MA Sayette","year":"2012","unstructured":"Sayette MA, Creswell KG, Dimoff JD, Fairbairn CE, Cohn JF, Heckman BW, Kirchner TR, Levine JM, Moreland RL (2012) Alcohol and group formation a multimodal investigation of the effects of alcohol on emotion and social bonding. Psychol Sci 23(8):869\u2013878","journal-title":"Psychol Sci"},{"issue":"6","key":"9405_CR61","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1016\/j.imavis.2008.08.005","volume":"27","author":"C Shan","year":"2009","unstructured":"Shan C, Gong S, McOwan PW (2009) Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis Comput 27(6):803\u2013816","journal-title":"Image Vis Comput"},{"issue":"7","key":"9405_CR62","doi-asserted-by":"crossref","first-page":"2074","DOI":"10.3390\/s18072074","volume":"18","author":"L Shu","year":"2018","unstructured":"Shu L, Xie J, Yang M, Li Z, Li Z, Liao D, Xu X, Yang X (2018) A review of emotion recognition using physiological signals. Sensors 18(7):2074","journal-title":"Sensors"},{"key":"9405_CR63","doi-asserted-by":"crossref","unstructured":"Soleymani M, Pantic M (2012) Human-centered implicit tagging: overview and perspectives. In: 2012 IEEE international conference on systems, man, and cybernetics (SMC), pp 3304\u20133309","DOI":"10.1109\/ICSMC.2012.6378301"},{"key":"9405_CR64","doi-asserted-by":"crossref","unstructured":"Soleymani M, Asghari-Esfeden S, Pantic M, Fu Y (2014) Continuous emotion detection using EEG signals and facial expressions. In: 2014 IEEE international conference on multimedia and expo (ICME), pp 1\u20136","DOI":"10.1109\/ICME.2014.6890301"},{"issue":"8","key":"9405_CR65","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1080\/0144929X.2018.1485745","volume":"37","author":"M Spezialetti","year":"2018","unstructured":"Spezialetti M, Cinque L, Tavares JMR, Placidi G (2018) Towards EEG-based BCI driven by emotions for addressing BCI-illiteracy: a meta-analytic review. Behav Inform Technol 37(8):855\u2013871","journal-title":"Behav Inform Technol"},{"key":"9405_CR66","doi-asserted-by":"crossref","unstructured":"Suk M, Prabhakaran B (2014) Real-time mobile facial expression recognition system-a case study. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 132\u2013137","DOI":"10.1109\/CVPRW.2014.25"},{"key":"9405_CR67","unstructured":"Susskind J, Anderson A, Hinton G (2010). The Toronto face database. Technical report, UTML TR 2010-001, University of Toronto."},{"key":"9405_CR68","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, VanHoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1\u20139","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"9405_CR69","doi-asserted-by":"crossref","unstructured":"Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-First AAAI Conference on Artificial Intelligence","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"9405_CR70","doi-asserted-by":"crossref","unstructured":"Tan C, Sun F, Kong T, Zhang W, Yang C, Liu C (2018) A survey on deep transfer learning. In: International conference on artificial neural networks. Springer, Cham, pp 270\u2013279","DOI":"10.1007\/978-3-030-01424-7_27"},{"key":"9405_CR71","volume-title":"Affect imagery consciousness: the complete edition: two volumes","author":"SS Tomkins","year":"2008","unstructured":"Tomkins SS (2008) Affect imagery consciousness: the complete edition: two volumes. Springer publishing company, New York"},{"key":"9405_CR72","doi-asserted-by":"crossref","first-page":"522","DOI":"10.3389\/fpsyg.2016.00522","volume":"7","author":"R Trnka","year":"2016","unstructured":"Trnka R, La\u010dev A, Balcar K, Ku\u0161ka M, Tavel P (2016) Modeling semantic emotion space using a 3D hypercube-projection: an innovative analytical approach for the psychology of emotions. Front Psychol 7:522","journal-title":"Front Psychol"},{"key":"9405_CR73","doi-asserted-by":"crossref","unstructured":"Tsymbalov E, Panov M, Shapeev A (2018) Dropout-based active learning for regression. In: International conference on analysis of images, social networks and texts, pp 247\u2013258","DOI":"10.1007\/978-3-030-11027-7_24"},{"key":"9405_CR74","doi-asserted-by":"crossref","unstructured":"Valstar MF, Jiang B, Mehu M, Pantic M, Scherer K (2011) The first facial expression recognition and analysis challenge. In: IEEE international conference on automatic face and gesture recognition and workshops (FG\u201911), pp 921\u2013926","DOI":"10.1109\/FG.2011.5771374"},{"key":"9405_CR75","doi-asserted-by":"crossref","first-page":"99","DOI":"10.5334\/pb-46-1-2-99","volume":"46","author":"B Verschuere","year":"2006","unstructured":"Verschuere B, Crombez G, Koster E, Uzieblo K (2006) Psychopathy and physiological detection of concealed information: a review. Psychol Belg 46:99\u2013116","journal-title":"Psychol Belg"},{"key":"9405_CR76","doi-asserted-by":"crossref","unstructured":"Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: CVPR (1), vol 1, pp 511\u2013518 3","DOI":"10.1109\/CVPR.2001.990517"},{"key":"9405_CR77","unstructured":"Wager S, Wang S, Liang PS (2013) Dropout training as adaptive regularization. In: Advances in neural information processing systems, pp 351\u2013359"},{"key":"9405_CR78","first-page":"143","volume":"259","author":"R Walecki","year":"2017","unstructured":"Walecki R, Rudovic O, Pavlovic V, Schuller B, Pantic M (2017) Deep structured learning for facial expression intensity estimation. Image Vis Comput 259:143\u2013154","journal-title":"Image Vis Comput"},{"key":"9405_CR79","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.ins.2018.09.060","volume":"474","author":"D Wu","year":"2019","unstructured":"Wu D, Lin CT, Huang J (2019) Active learning for regression using greedy sampling. Inf Sci 474:90\u2013105","journal-title":"Inf Sci"},{"key":"9405_CR80","doi-asserted-by":"crossref","unstructured":"Zafeiriou S, Kollias D, Nicolaou MA, Papaioannou A, Zhao G, Kotsia I (2017) Aff-wild: valence and arousal 'In-the-Wild' challenge. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 34\u201341","DOI":"10.1109\/CVPRW.2017.248"},{"issue":"4","key":"9405_CR81","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1109\/TMM.2016.2523421","volume":"18","author":"G Zen","year":"2016","unstructured":"Zen G, Porzi L, Sangineto E, Ricci E, Sebe N (2016) Learning personalized models for facial expression analysis and gesture recognition. IEEE Transactions on Multimedia 18(4):775\u2013788","journal-title":"IEEE Transactions on Multimedia"},{"issue":"4","key":"9405_CR82","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1007\/s00138-015-0677-y","volume":"26","author":"X Zhang","year":"2015","unstructured":"Zhang X, Mahoor MH, Mavadati SM (2015) Facial expression recognition using lp-norm MKL multiclass-SVM. Mach Vis Appl 26(4):467\u2013483","journal-title":"Mach Vis Appl"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09405-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-020-09405-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-020-09405-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,6]],"date-time":"2022-11-06T22:00:57Z","timestamp":1667772057000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-020-09405-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,13]]},"references-count":82,"journal-issue":{"issue":"47-48","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["9405"],"URL":"https:\/\/doi.org\/10.1007\/s11042-020-09405-4","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,13]]},"assertion":[{"value":"30 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 August 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}