{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T03:30:08Z","timestamp":1778038208441,"version":"3.51.4"},"reference-count":181,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,11,2]],"date-time":"2019-11-02T00:00:00Z","timestamp":1572652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Emotion recognition has attracted major attention in numerous fields because of its relevant applications in the contemporary world: marketing, psychology, surveillance, and entertainment are some examples. It is possible to recognize an emotion through several ways; however, this paper focuses on facial expressions, presenting a systematic review on the matter. In addition, 112 papers published in ACM, IEEE, BASE and Springer between January 2006 and April 2019 regarding this topic were extensively reviewed. Their most used methods and algorithms will be firstly introduced and summarized for a better understanding, such as face detection, smoothing, Principal Component Analysis (PCA), Local Binary Patterns (LBP), Optical Flow (OF), Gabor filters, among others. This review identified a clear difficulty in translating the high facial expression recognition (FER) accuracy in controlled environments to uncontrolled and pose-variant environments. The future efforts in the FER field should be put into multimodal systems that are robust enough to face the adversities of real world scenarios. A thorough analysis on the research done on FER in Computer Vision based on the selected papers is presented. This review aims to not only become a reference for future research on emotion recognition, but also to provide an overview of the work done in this topic for potential readers.<\/jats:p>","DOI":"10.3390\/app9214678","type":"journal-article","created":{"date-parts":[[2019,11,4]],"date-time":"2019-11-04T04:13:08Z","timestamp":1572840788000},"page":"4678","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":154,"title":["Facial Expression Recognition Using Computer Vision: A Systematic Review"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5184-3265","authenticated-orcid":false,"given":"Daniel","family":"Canedo","sequence":"first","affiliation":[{"name":"IEETA\/DETI, University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5433-6667","authenticated-orcid":false,"given":"Ant\u00f3nio J. R.","family":"Neves","sequence":"additional","affiliation":[{"name":"IEETA\/DETI, University of Aveiro, 3810-193 Aveiro, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,2]]},"reference":[{"key":"ref_1","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.biopsycho.2004.03.002","article-title":"Frontal EEG asymmetry as a moderator and mediator of emotion","volume":"67","author":"Coan","year":"2004","journal-title":"Biol. Psychol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2015.03.015","article-title":"A survey on face detection in the wild: Past, present and future","volume":"138","author":"Zafeiriou","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_5","unstructured":"Perez, L., and Wang, J. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/34.908962","article-title":"Recognizing action units for facial expression analysis","volume":"23","author":"Tian","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Boser, B.E., Guyon, I.M., and Vapnik, V.N. (1992, January 27\u201329). A training algorithm for optimal margin classifiers. Proceedings of the Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, PA, USA.","DOI":"10.1145\/130385.130401"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neucom.2016.12.038","article-title":"A survey of deep neural network architectures and their applications","volume":"234","author":"Liu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_9","unstructured":"(2019, September 26). ACM Digital Library. Available online: https:\/\/dl.acm.org\/."},{"key":"ref_10","unstructured":"(2019, September 26). IEEE Xplore Digital Library. Available online: https:\/\/ieeexplore.ieee.org\/Xplore\/home.jsp."},{"key":"ref_11","unstructured":"(2019, September 26). Bielefeld Academic Search Engine. Available online: https:\/\/www.base-search.net\/."},{"key":"ref_12","unstructured":"(2019, September 26). Springer Link. Available online: https:\/\/link.springer.com\/."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Valstar, M.F., Pantic, M., Ambadar, Z., and Cohn, J.F. (2006, January 2\u20134). Spontaneous vs. posed facial behavior: Automatic analysis of brow actions. Proceedings of the 8th International Conference on Multimodal Interfaces, Banff, AB, Canada.","DOI":"10.1145\/1180995.1181031"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Duthoit, C.J., Sztynda, T., Lal, S.K., Jap, B.T., and Agbinya, J.I. (2008, January 21\u201323). Optical flow image analysis of facial expressions of human emotion: Forensic applications. Proceedings of the 1st International Conference on Forensic Applications and Techniques in Telecommunications, Information, and Multimedia and Workshop, Adelaide, Australia.","DOI":"10.4108\/e-forensics.2008.2743"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/s11263-007-0059-7","article-title":"Simultaneous facial action tracking and expression recognition in the presence of head motion","volume":"76","author":"Dornaika","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2553","DOI":"10.1016\/j.neucom.2007.11.043","article-title":"User and context adaptive neural networks for emotion recognition","volume":"71","author":"Caridakis","year":"2008","journal-title":"Neurocomputing"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sun, X., Rothkrantz, L., Datcu, D., and Wiggers, P. (2009, January 18\u201319). A Bayesian approach to recognise facial expressions using vector flows. Proceedings of the International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing, Ruse, Bulgaria.","DOI":"10.1145\/1731740.1731772"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Popa, M., Rothkrantz, L., and Wiggers, P. (2010, January 17\u201318). Products appreciation by facial expressions analysis. Proceedings of the 11th International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing on International Conference on Computer Systems and Technologies, Sofia, Bulgaria.","DOI":"10.1145\/1839379.1839431"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, X., Zhang, L., and Yadegar, J. (2011, January 10\u201313). A multi-modal emotion recognition system for persistent and non-invasive personal health monitoring. Proceedings of the 2nd Conference on Wireless Health, La Jolla.","DOI":"10.1145\/2077546.2077577"},{"key":"ref_20","first-page":"171","article-title":"Facial emotion recognition using context based multimodal approach","volume":"2","author":"Metri","year":"2012","journal-title":"Int. J. Emerg. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Cruz, A.C., Bhanu, B., and Thakoor, N. (2012, January 22\u201326). Facial emotion recognition with expression energy. Proceedings of the 14th ACM International Conference on Multimodal Interaction, Santa Monica, CA, USA.","DOI":"10.1145\/2388676.2388777"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Soladi\u00e9, C., Salam, H., Pelachaud, C., Stoiber, N., and S\u00e9guier, R. (2012, January 22\u201326). A multimodal fuzzy inference system using a continuous facial expression representation for emotion detection. Proceedings of the 14th ACM International Conference on Multimodal Interaction, Santa Monica, CA, USA.","DOI":"10.1145\/2388676.2388782"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Monkaresi, H., Calvo, R.A., and Hussain, M.S. (2012, January 21\u201325). Automatic natural expression recognition using head movement and skin color features. Proceedings of the International Working Conference on Advanced Visual Interfaces, Capri Island, Italy.","DOI":"10.1145\/2254556.2254678"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Biel, J.I., Teijeiro-Mosquera, L., and Gatica-Perez, D. (2012, January 22\u201326). Facetube: Predicting personality from facial expressions of emotion in online conversational video. Proceedings of the 14th ACM International Conference on Multimodal Interaction, Santa Monica, CA, USA.","DOI":"10.1145\/2388676.2388689"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Nedkov, S., and Dimov, D. (2013, January 28\u201329). Emotion recognition by face dynamics. Proceedings of the 14th International Conference on Computer Systems and Technologies, Ruse, Bulgaria.","DOI":"10.1145\/2516775.2516794"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s00779-011-0477-y","article-title":"Measuring instant emotions based on facial expressions during computer-based assessment","volume":"17","author":"Terzis","year":"2013","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Meng, H., Huang, D., Wang, H., Yang, H., Ai-Shuraifi, M., and Wang, Y. (2013, January 21\u201325). Depression recognition based on dynamic facial and vocal expression features using partial least square regression. Proceedings of the 3rd ACM International Workshop on Audio\/visual Emotion Challenge, Barcelona, Spain.","DOI":"10.1145\/2512530.2512532"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"G\u00f3mez J\u00e1uregui, D.A., and Martin, J.C. (2013, January 9\u201313). Evaluation of vision-based real-time measures for emotions discrimination under uncontrolled conditions. Proceedings of the 2013 on Emotion Recognition in the Wild Challenge and Workshop, Sydney, Australia.","DOI":"10.1145\/2531923.2531925"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1467","DOI":"10.1007\/s00521-014-1637-6","article-title":"Fuzzy model of dominance emotions in affective computing","volume":"25","author":"Bakhtiyari","year":"2014","journal-title":"Neural Comput. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sangineto, E., Zen, G., Ricci, E., and Sebe, N. (2014, January 3\u20137). We are not all equal: Personalizing models for facial expression analysis with transductive parameter transfer. Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654916"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Jang, G.J., Jo, A., and Park, J.S. (2014, January 28\u201331). Video-based emotion identification using face alignment and support vector machines. Proceedings of the Second International Conference on Human-agent Interaction, Tsukuba, Japa.","DOI":"10.1145\/2658861.2658943"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zen, G., Sangineto, E., Ricci, E., and Sebe, N. (2014, January 12\u201316). Unsupervised domain adaptation for personalized facial emotion recognition. Proceedings of the 16th International Conference on Multimodal Interaction, Istanbul, Turkey.","DOI":"10.1145\/2663204.2663247"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Rothkrantz, L. (2014, January 27\u201328). Online emotional facial expression dictionary. Proceedings of the 15th International Conference on Computer Systems and Technologies, Ruse, Bulgaria.","DOI":"10.1145\/2659532.2659627"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chao, L., Tao, J., Yang, M., Li, Y., and Wen, Z. (2015, January 26\u201330). Long short term memory recurrent neural network based multimodal dimensional emotion recognition. Proceedings of the 5th International Workshop on Audio\/Visual Emotion Challenge, Brisbane, Australia.","DOI":"10.1145\/2808196.2811634"},{"key":"ref_35","first-page":"25","article-title":"Emotion recognition during speech using dynamics of multiple regions of the face","volume":"12","author":"Kim","year":"2015","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl. (TOMM)"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nomiya, H., Sakaue, S., and Hochin, T. (2016, January 26\u201329). Recognition and intensity estimation of facial expression using ensemble classifiers. Proceedings of the 2016 IEEE\/ACIS 15th International Conference on Computer and Information Science (ICIS), Okayama, Japan.","DOI":"10.1109\/ICIS.2016.7550861"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"8375","DOI":"10.1109\/ACCESS.2016.2628407","article-title":"Facial emotion recognition based on biorthogonal wavelet entropy, fuzzy support vector machine, and stratified cross validation","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Access"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Barsoum, E., Zhang, C., Ferrer, C.C., and Zhang, Z. (2016, January 12\u201316). Training deep networks for facial expression recognition with crowd-sourced label distribution. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/2993148.2993165"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1109\/JAS.2017.7510622","article-title":"A facial expression emotion recognition based human-robot interaction system","volume":"4","author":"Liu","year":"2017","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Bouzakraoui, M.S., Sadiq, A., and Enneya, N. (2017, January 29\u201330). A Customer Emotion Recognition through Facial Expression using POEM descriptor and SVM classifier. Proceedings of the 2nd International Conference on Big Data, Cloud and Applications, Tetouan, Morocco.","DOI":"10.1145\/3090354.3090436"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Elfaramawy, N., Barros, P., Parisi, G.I., and Wermter, S. (2017, January 17\u201320). Emotion recognition from body expressions with a neural network architecture. Proceedings of the 5th International Conference on Human Agent Interaction, Bielefeld, Germany.","DOI":"10.1145\/3125739.3125772"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"18795","DOI":"10.1109\/ACCESS.2018.2816044","article-title":"Facial expressions recognition based on cognition and mapped binary patterns","volume":"6","author":"Qi","year":"2018","journal-title":"IEEE Access"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"71143","DOI":"10.1109\/ACCESS.2018.2879485","article-title":"SMEConvnet: A convolutional neural network for spotting spontaneous facial micro-expression from long videos","volume":"6","author":"Zhang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"26391","DOI":"10.1109\/ACCESS.2018.2831927","article-title":"Dominant and complementary emotion recognition from still images of faces","volume":"6","author":"Guo","year":"2018","journal-title":"IEEE Access"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Slimani, K., Kas, M., El Merabet, Y., Messoussi, R., and Ruichek, Y. (2018, January 27\u201328). Facial emotion recognition: A comparative analysis using 22 LBP variants. Proceedings of the 2nd Mediterranean Conference on Pattern Recognition and Artificial Intelligence, Rabat, Morocco.","DOI":"10.1145\/3177148.3180092"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bernin, A., M\u00fcller, L., Ghose, S., Grecos, C., Wang, Q., Jettke, R., von Luck, K., and Vogt, F. (2018, January 26\u201329). Automatic Classification and Shift Detection of Facial Expressions in Event-Aware Smart Environments. Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference, Corfu, Greece.","DOI":"10.1145\/3197768.3201527"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"7","DOI":"10.9781\/ijimai.2017.11.002","article-title":"Real time facial expression recognition using webcam and SDK affectiva","volume":"5","author":"Magdin","year":"2018","journal-title":"IJIMAI"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"5200","DOI":"10.1109\/ACCESS.2018.2889852","article-title":"Facial action units-based image retrieval for facial expression recognition","volume":"7","author":"Pham","year":"2019","journal-title":"IEEE Access"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Slimani, K., Lekdioui, K., Messoussi, R., and Touahni, R. (2019, January 28\u201329). Compound Facial Expression Recognition Based on Highway CNN. Proceedings of the New Challenges in Data Sciences: Acts of the Second Conference of the Moroccan Classification Society, Kenitra, Morocco.","DOI":"10.1145\/3314074.3314075"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13\u201318). The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_51","unstructured":"Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J., and Budynek, J. (1998, January 14\u201316). The Japanese female facial expression (JAFFE) database. Proceedings of the Third International Conference on Automatic Face And Gesture Recognition, Nara, Japan."},{"key":"ref_52","unstructured":"Yin, L., Wei, X., Sun, Y., Wang, J., and Rosato, M.J. (2006, January 10\u201312). A 3D facial expression database for facial behavior research. Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition (FGR06), Southampton, UK."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Goodfellow, I.J., Erhan, D., Carrier, P.L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., and Lee, D.H. (2013). Challenges in representation learning: A report on three machine learning contests. International Conference on Neural Information Processing, Springer.","DOI":"10.1007\/978-3-642-42051-1_16"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Dhall, A., Ramana Murthy, O., Goecke, R., Joshi, J., and Gedeon, T. (2015, January 9\u201313). Video and image based emotion recognition challenges in the wild: Emotiw 2015. Proceedings of the 2015 ACM on International Conference On Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2829994"},{"key":"ref_55","unstructured":"Pantic, M., Valstar, M., Rademaker, R., and Maat, L. (2005, January 6). Web-based database for facial expression analysis. Proceedings of the 2005 IEEE International Conference on Multimedia and Expo, Amsterdam, Netherlands."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Martin, O., Kotsia, I., Macq, B., and Pitas, I. (2006, January 3\u20137). The eNTERFACE\u201905 audio-visual emotion database. Proceedings of the 22nd International Conference on Data Engineering Workshops (ICDEW\u201906), Atlanta, GA, USA.","DOI":"10.1109\/ICDEW.2006.145"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"109","DOI":"10.3758\/BRM.40.1.109","article-title":"Facial expressions of emotion (KDEF): Identification under different display-duration conditions","volume":"40","author":"Calvo","year":"2008","journal-title":"Behav. Res. Methods"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1080\/02699930903485076","article-title":"Presentation and validation of the Radboud Faces Database","volume":"24","author":"Langner","year":"2010","journal-title":"Cogn. Emot."},{"key":"ref_59","unstructured":"(2019, September 08). The Extended Cohn\u2013Kanade Database. Available online: http:\/\/www.consortium.ri.cmu.edu\/ckagree\/."},{"key":"ref_60","unstructured":"(2019, September 08). The Japanese Female Facial Expression Database. Available online: http:\/\/www.kasrl.org\/jaffe.html."},{"key":"ref_61","unstructured":"(2019, September 08). Binghamton University 3D Facial Expression Database. Available online: http:\/\/www.cs.binghamton.edu\/~lijun\/Research\/3DFE\/3DFE_Analysis.html."},{"key":"ref_62","unstructured":"(2019, September 08). Facial Expression Recognition 2013 Database. Available online: https:\/\/www.kaggle.com\/c\/challenges-in-representation-learning-facial-expression-recognition-challenge\/data."},{"key":"ref_63","unstructured":"(2019, September 08). Emotion Recognition in the Wild Database. Available online: https:\/\/cs.anu.edu.au\/few\/AFEW.html."},{"key":"ref_64","unstructured":"(2019, September 08). MMI Database. Available online: https:\/\/mmifacedb.eu\/."},{"key":"ref_65","unstructured":"(2019, September 08). eNTERFACE\u201905 Audio-Visual Emotion Database. Available online: http:\/\/www.enterface.net\/enterface05\/."},{"key":"ref_66","unstructured":"(2019, September 08). Karolinska Directed Emotional Faces Database. Available online: http:\/\/kdef.se\/."},{"key":"ref_67","unstructured":"(2019, September 08). Radboud Faces Database. Available online: http:\/\/www.socsci.ru.nl:8180\/RaFD2\/RaFD?p=main."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Kazemi, V., and Sullivan, J. (2014, January 23\u201328). One millisecond face alignment with an ensemble of regression trees. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.241"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint face detection and alignment using multitask cascaded convolutional networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Farfade, S.S., Saberian, M.J., and Li, L.J. (2015, January 23\u201326). Multi-view face detection using deep convolutional neural networks. Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, Shanghai, China.","DOI":"10.1145\/2671188.2749408"},{"key":"ref_72","unstructured":"Azulay, A., and Weiss, Y. (2018). Why do deep convolutional networks generalize so poorly to small image transformations?. arXiv."},{"key":"ref_73","first-page":"2","article-title":"Bilateral filtering for gray and color images","volume":"98","author":"Tomasi","year":"1998","journal-title":"ICCV"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0031-3203(94)90013-2","article-title":"On Gabor\u2019s contribution to image enhancement","volume":"27","author":"Lindenbaum","year":"1994","journal-title":"Pattern Recognit."},{"key":"ref_75","first-page":"41","article-title":"A Comparative Study on Histogram Equalization and Cumulative Histogram Equalization","volume":"3","author":"Garg","year":"2017","journal-title":"Int. J. New Technol. Res."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive histogram equalization and its variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1021\/ci0342472","article-title":"The problem of overfitting","volume":"44","author":"Hawkins","year":"2004","journal-title":"J. Chem. Inf. Comput. Sci."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Jolliffe, I. (2011). Principal Component Analysis, Springer.","DOI":"10.1007\/978-3-642-04898-2_455"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Analy. Mach. Intell."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_81","unstructured":"Barron, J.L., Fleet, D.J., Beauchemin, S.S., and Burkitt, T. (1992, January 15\u201318). Performance of optical flow techniques. Proceedings of the 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, USA."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1109\/34.927467","article-title":"Active appearance models","volume":"23","author":"Cootes","year":"2001","journal-title":"IEEE Trans. Pattern Analy. Mach. Intell."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Abdulameer, M.H., Abdullah, S., Huda, S.N., and Othman, Z.A. (2014). A modified active appearance model based on an adaptive artificial bee colony. Sci. World J., 2014.","DOI":"10.1155\/2014\/879031"},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Ekman, R. (1997). What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS), Oxford University Press.","DOI":"10.1093\/oso\/9780195104462.001.0001"},{"key":"ref_85","unstructured":"Pakstas, A., Forchheimer, R., and Pandzic, I.S. (2002). MPEG-4 Facial Animation: The Standard, Implementation and Applications, John Wiley & Sons, Inc."},{"key":"ref_86","first-page":"1007","article-title":"Real time facial expression recognition system with applications to facial animation in MPEG-4","volume":"84","author":"Chandrasiri","year":"2001","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1016\/0031-3203(91)90143-S","article-title":"Unsupervised texture segmentation using Gabor filters","volume":"24","author":"Jain","year":"1991","journal-title":"Pattern Recognit."},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Chora\u015b, R.S. (2010). Image Processing and Communications Challenges 2, Springer.","DOI":"10.1007\/978-3-642-16295-4"},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"122","DOI":"10.2478\/msr-2013-0021","article-title":"A Comparative Study of SIFT and its Variants","volume":"13","author":"Wu","year":"2013","journal-title":"Meas. Sci. Rev."},{"key":"ref_91","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Liu, Y., Li, Y., Ma, X., and Song, R. (2017). Facial expression recognition with fusion features extracted from salient facial areas. Sensors, 17.","DOI":"10.20944\/preprints201701.0102.v1"},{"key":"ref_93","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1023\/A:1007465528199","article-title":"Bayesian network classifiers","volume":"29","author":"Friedman","year":"1997","journal-title":"Mach. Learn."},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/S0959-440X(96)80056-X","article-title":"Hidden markov models","volume":"6","author":"Eddy","year":"1996","journal-title":"Curr. Opin. Struct. Biol."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Chui, K.T., and Lytras, M.D. (2019). A Novel MOGA-SVM Multinomial Classification for Organ Inflammation Detection. Appl. Sci., 9.","DOI":"10.3390\/app9112284"},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1214\/09-SS054","article-title":"A survey of cross-validation procedures for model selection","volume":"4","author":"Arlot","year":"2010","journal-title":"Stat. Surv."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"501","DOI":"10.3390\/bs3030501","article-title":"On the evolution and optimality of mood states","volume":"3","author":"Trimmer","year":"2013","journal-title":"Behav. Sci."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1007\/s11263-017-1055-1","article-title":"From facial expression recognition to interpersonal relation prediction","volume":"126","author":"Zhang","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"4630","DOI":"10.1109\/ACCESS.2017.2784096","article-title":"Facial expression recognition using weighted mixture deep neural network based on double-channel facial images","volume":"6","author":"Yang","year":"2017","journal-title":"IEEE Access"},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Gogi\u0107, I., Manhart, M., Pand\u017ei\u0107, I.S., and Ahlberg, J. (2018). Fast facial expression recognition using local binary features and shallow neural networks. Vis. Comput., 1\u201316.","DOI":"10.1007\/s00371-018-1585-8"},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"41273","DOI":"10.1109\/ACCESS.2019.2907327","article-title":"Efficient Facial Expression Recognition Algorithm Based on Hierarchical Deep Neural Network Structure","volume":"7","author":"Kim","year":"2019","journal-title":"IEEE Access"},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"24321","DOI":"10.1109\/ACCESS.2019.2900231","article-title":"HERO: Human emotions recognition for realizing intelligent Internet of Things","volume":"7","author":"Hua","year":"2019","journal-title":"IEEE Access"},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"12451","DOI":"10.1109\/ACCESS.2018.2805861","article-title":"Adaptive feature mapping for customizing deep learning based facial expression recognition model","volume":"6","author":"Wu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/s00521-018-3358-8","article-title":"A hybrid deep learning neural approach for emotion recognition from facial expressions for socially assistive robots","volume":"29","author":"Elshaw","year":"2018","journal-title":"Neural Comput. Appl."},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Meng, Z., Liu, P., Cai, J., Han, S., and Tong, Y. (June, January 30). Identity-aware convolutional neural network for facial expression recognition. Proceedings of the 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), Washington, DC, USA.","DOI":"10.1109\/FG.2017.140"},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s00521-014-1569-1","article-title":"A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering","volume":"27","author":"Demir","year":"2016","journal-title":"Neural Comput. Appl."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"1496","DOI":"10.1109\/TCYB.2016.2549639","article-title":"A micro-GA embedded PSO feature selection approach to intelligent facial emotion recognition","volume":"47","author":"Mistry","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_112","doi-asserted-by":"crossref","unstructured":"Liliana, D.Y., Basaruddin, C., and Widyanto, M.R. (2017, January 10\u201313). Mix emotion recognition from facial expression using SVM-CRF sequence classifier. Proceedings of the International Conference on Algorithms, Computing and Systems, Jeju Island, Korea.","DOI":"10.1145\/3127942.3127958"},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"53930","DOI":"10.1109\/ACCESS.2018.2870063","article-title":"Physiological Inspired Deep Neural Networks for Emotion Recognition","volume":"6","author":"Ferreira","year":"2018","journal-title":"IEEE Access"},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s11263-017-1010-1","article-title":"Confidence-weighted local expression predictions for occlusion handling in expression recognition and action unit detection","volume":"126","author":"Dapogny","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_115","unstructured":"Yaddaden, Y., Bouzouane, A., Adda, M., and Bouchard, B. (\u20131, January 29). A new approach of facial expression recognition for ambient assisted living. Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Corfu, Island, Greece."},{"key":"ref_116","unstructured":"Ratliff, M.S., and Patterson, E. (2008, January 17\u201319). Emotion recognition using facial expressions with active appearance models. Proceedings of the Third IASTED International Conference on Human Computer Interaction, Innsbruck, Austria."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"67459","DOI":"10.1109\/ACCESS.2018.2878601","article-title":"An effective framework for driver fatigue recognition based on intelligent facial expressions analysis","volume":"6","author":"Khan","year":"2018","journal-title":"IEEE Access"},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"29882","DOI":"10.1109\/ACCESS.2019.2899024","article-title":"Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern","volume":"7","author":"Hu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"9848","DOI":"10.1109\/ACCESS.2019.2891668","article-title":"cGAN Based Facial Expression Recognition for Human-Robot Interaction","volume":"7","author":"Deng","year":"2019","journal-title":"IEEE Access"},{"key":"ref_120","doi-asserted-by":"crossref","unstructured":"Shan, K., Guo, J., You, W., Lu, D., and Bie, R. (2017, January 7\u20139). Automatic facial expression recognition based on a deep convolutional-neural-network structure. Proceedings of the 2017 IEEE 15th International Conference on Software Engineering Research, Management and Applications (SERA), London, UK.","DOI":"10.1109\/SERA.2017.7965717"},{"key":"ref_121","unstructured":"Ige, E.O., Debattista, K., and Chalmers, A. (July, January 28). Towards hdr based facial expression recognition under complex lighting. Proceedings of the 33rd Computer Graphics International, Heraklion, Greece."},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1007\/s00371-011-0611-x","article-title":"3D facial expression recognition using SIFT descriptors of automatically detected keypoints","volume":"27","author":"Berretti","year":"2011","journal-title":"Vis. Comput."},{"key":"ref_123","doi-asserted-by":"crossref","unstructured":"Rassadin, A., Gruzdev, A., and Savchenko, A. (2017, January 13\u201317). Group-level emotion recognition using transfer learning from face identification. Proceedings of the 19th ACM International Conference on Multimodal Interaction, Glasgow, UK.","DOI":"10.1145\/3136755.3143007"},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"32297","DOI":"10.1109\/ACCESS.2019.2901521","article-title":"Learning Affective Video Features for Facial Expression Recognition via Hybrid Deep Learning","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_125","doi-asserted-by":"crossref","first-page":"118","DOI":"10.3969\/j.issn.1004-4132.2010.01.019","article-title":"Person-independent expression recognition based on person-similarity weighted expression feature","volume":"21","author":"Tan","year":"2010","journal-title":"J. Syst. Eng. Electron."},{"key":"ref_126","doi-asserted-by":"crossref","unstructured":"Sang, D.V., Cuong, L.T.B., and Van Thieu, V. (2017, January 7\u20138). Multi-task learning for smile detection, emotion recognition and gender classification. Proceedings of the Eighth International Symposium on Information and Communication Technology, Nha Trang City, Vietnam.","DOI":"10.1145\/3155133.3155207"},{"key":"ref_127","doi-asserted-by":"crossref","unstructured":"Yu, Z., and Zhang, C. (2015, January 9\u201313). Image based static facial expression recognition with multiple deep network learning. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2830595"},{"key":"ref_128","doi-asserted-by":"crossref","unstructured":"Ng, H.W., Nguyen, V.D., Vonikakis, V., and Winkler, S. (2015, January 9\u201313). Deep learning for emotion recognition on small datasets using transfer learning. Proceedings of the 2015 ACM on International Conference On Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2830593"},{"key":"ref_129","doi-asserted-by":"crossref","unstructured":"Levi, G., and Hassner, T. (2015, January 9\u201313). Emotion recognition in the wild via convolutional neural networks and mapped binary patterns. Proceedings of the 2015 ACM on International Conference On Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2830587"},{"key":"ref_130","doi-asserted-by":"crossref","unstructured":"Sert, M., and Aksoy, N. (2016, January 12\u201316). Recognizing facial expressions of emotion using action unit specific decision thresholds. Proceedings of the 2nd Workshop on Advancements in Social Signal Processing for Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/3005467.3005471"},{"key":"ref_131","doi-asserted-by":"crossref","unstructured":"Sun, B., Li, L., Zhou, G., Wu, X., He, J., Yu, L., Li, D., and Wei, Q. (2015, January 9\u201313). Combining multimodal features within a fusion network for emotion recognition in the wild. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2830586"},{"key":"ref_132","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1007\/s00371-016-1243-y","article-title":"A spatio-temporal wavelet-based descriptor for dynamic 3D facial expression retrieval and recognition","volume":"32","author":"Danelakis","year":"2016","journal-title":"Vis. Comput."},{"key":"ref_133","doi-asserted-by":"crossref","first-page":"2281","DOI":"10.1109\/ACCESS.2017.2672829","article-title":"An emotion recognition system for mobile applications","volume":"5","author":"Hossain","year":"2017","journal-title":"IEEE Access"},{"key":"ref_134","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1007\/s00371-018-1477-y","article-title":"Learning deep facial expression features from image and optical flow sequences using 3D CNN","volume":"34","author":"Zhao","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_135","doi-asserted-by":"crossref","first-page":"42532","DOI":"10.1109\/ACCESS.2018.2858278","article-title":"Geometric-convolutional feature fusion based on learning propagation for facial expression recognition","volume":"6","author":"Tang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_136","first-page":"461","article-title":"Use of septum as reference point in a neurophysiologic approach to facial expression recognition","volume":"35","author":"Stankovic","year":"2013","journal-title":"Songklanakarin J. Sci. Technol."},{"key":"ref_137","doi-asserted-by":"crossref","first-page":"4525","DOI":"10.1109\/ACCESS.2017.2676238","article-title":"Facial expression recognition utilizing local direction-based robust features and deep belief network","volume":"5","author":"Uddin","year":"2017","journal-title":"IEEE Access"},{"key":"ref_138","doi-asserted-by":"crossref","first-page":"26146","DOI":"10.1109\/ACCESS.2017.2777003","article-title":"Facial expression recognition using salient features and convolutional neural network","volume":"5","author":"Uddin","year":"2017","journal-title":"IEEE Access"},{"key":"ref_139","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/s00371-015-1142-7","article-title":"A robust spatio-temporal scheme for dynamic 3D facial expression retrieval","volume":"32","author":"Danelakis","year":"2016","journal-title":"Vis. Comput."},{"key":"ref_140","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s00371-016-1323-z","article-title":"Anubhav: Recognizing emotions through facial expression","volume":"34","author":"Agarwal","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_141","doi-asserted-by":"crossref","first-page":"19409","DOI":"10.1109\/ACCESS.2017.2737821","article-title":"Facial expression recognition from image sequence based on LBP and Taylor expansion","volume":"5","author":"Ding","year":"2017","journal-title":"IEEE Access"},{"key":"ref_142","doi-asserted-by":"crossref","first-page":"8880","DOI":"10.1109\/ACCESS.2017.2704087","article-title":"Facial expression recognition from depth video with patterns of oriented motion flow","volume":"5","author":"Kabir","year":"2017","journal-title":"IEEE Access"},{"key":"ref_143","doi-asserted-by":"crossref","unstructured":"Agarwal, S., Chatterjee, M., and Mukherjee, P.D. (2012, January 16\u201319). Recognizing facial expressions using a novel shape motion descriptor. Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing, Mumbai, India.","DOI":"10.1145\/2425333.2425362"},{"key":"ref_144","doi-asserted-by":"crossref","unstructured":"Datcu, D., and Rothkrantz, L. (2007, January 14\u201315). Facial expression recognition in still pictures and videos using active appearance models: A comparison approach. Proceedings of the 2007 International Conference on Computer Systems and Technologies, Bulgaria.","DOI":"10.1145\/1330598.1330717"},{"key":"ref_145","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1007\/s00371-013-0869-2","article-title":"Automatic facial expression recognition in real-time from dynamic sequences of 3D face scans","volume":"29","author":"Berretti","year":"2013","journal-title":"Vis. Comput."},{"key":"ref_146","doi-asserted-by":"crossref","unstructured":"Caridakis, G., Malatesta, L., Kessous, L., Amir, N., Raouzaiou, A., and Karpouzis, K. (2006, January 2\u20134). Modeling naturalistic affective states via facial and vocal expressions recognition. Proceedings of the 8th International Conference on Multimodal Interfaces, Banff, AB, Canada.","DOI":"10.1145\/1180995.1181029"},{"key":"ref_147","doi-asserted-by":"crossref","unstructured":"Meng, H., Romera-Paredes, B., and Bianchi-Berthouze, N. (2011, January 21\u201325). Emotion recognition by two view SVM_2K classifier on dynamic facial expression features. Proceedings of the Ninth IEEE International Conference on Automatic Face and Gesture Recognition (FG 2011), Santa Barbara, CA, USA.","DOI":"10.1109\/FG.2011.5771362"},{"key":"ref_148","doi-asserted-by":"crossref","unstructured":"Kumano, S., Otsuka, K., Yamato, J., Maeda, E., and Sato, Y. (2007). Pose-invariant facial expression recognition using variable-intensity templates. Asian Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-540-76386-4_30"},{"key":"ref_149","doi-asserted-by":"crossref","unstructured":"Park, S.Y., Lee, S.H., and Ro, Y.M. (2015, January 26\u201330). Subtle facial expression recognition using adaptive magnification of discriminative facial motion. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806362"},{"key":"ref_150","doi-asserted-by":"crossref","first-page":"48807","DOI":"10.1109\/ACCESS.2019.2907271","article-title":"A Deep Spatial and Temporal Aggregation Framework for Video-Based Facial Expression Recognition","volume":"7","author":"Pan","year":"2019","journal-title":"IEEE Access"},{"key":"ref_151","doi-asserted-by":"crossref","unstructured":"Ghazi, M.M., and Ekenel, H.K. (2016, January 12\u201316). Automatic emotion recognition in the wild using an ensemble of static and dynamic representations. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/2993148.2997634"},{"key":"ref_152","doi-asserted-by":"crossref","unstructured":"Almaev, T.R., Y\u00fcce, A., Ghitulescu, A., and Valstar, M.F. (2013, January 9\u201313). Distribution-based iterative pairwise classification of emotions in the wild using lgbp-tofp. Proceedings of the 15th ACM on International Conference On Multimodal Interaction, Sydney, NSW, Australia.","DOI":"10.1145\/2522848.2531742"},{"key":"ref_153","doi-asserted-by":"crossref","unstructured":"Gehrig, T., and Ekenel, H.K. (2013, January 9). Why is facial expression analysis in the wild challenging?. Proceedings of the 2013 on Emotion Recognition in the Wild Challenge and Workshop, Sydney, Australia.","DOI":"10.1145\/2531923.2531924"},{"key":"ref_154","unstructured":"R\u00e1zuri, J.G. (2019, October 01). Decision-making content of an agent affected by emotional feedback provided by capture of human\u2019s emotions through a Bimodal System. Available online: https:\/\/pdfs.semanticscholar.org\/111c\/55156dac0e7b31a13e80ca6a4534cd962174.pdf?_ga=2.192627626.1409604446.1572417099-1535876467.1565229560."},{"key":"ref_155","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1007\/s00371-012-0768-y","article-title":"Human emotion recognition from videos using spatio-temporal and audio features","volume":"29","author":"Rashid","year":"2013","journal-title":"Vis. Comput."},{"key":"ref_156","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1007\/s00521-012-1228-3","article-title":"Audiovisual emotion recognition using ANOVA feature selection method and multi-classifier neural networks","volume":"24","author":"Bejani","year":"2014","journal-title":"Neural Comput. Appl."},{"key":"ref_157","doi-asserted-by":"crossref","unstructured":"Paleari, M., Huet, B., and Chellali, R. (2010, January 5\u20137). Towards multimodal emotion recognition: A new approach. Proceedings of the ACM International Conference on Image and Video Retrieval, Xi\u2019an, China.","DOI":"10.1145\/1816041.1816069"},{"key":"ref_158","doi-asserted-by":"crossref","unstructured":"Liu, C., Tang, T., Lv, K., and Wang, M. (2018, January 16\u201320). Multi-feature based emotion recognition for video clips. Proceedings of the 2018 on International Conference on Multimodal Interaction, Boulder, CO, USA.","DOI":"10.1145\/3242969.3264989"},{"key":"ref_159","doi-asserted-by":"crossref","unstructured":"Mansoorizadeh, M., and Charkari, N.M. (2008, January 16\u201318). Bimodal person-dependent emotion recognition comparison of feature level and decision level information fusion. Proceedings of the 1st International Conference on PErvasive Technologies Related to Assistive Environments, Athens, Greece.","DOI":"10.1145\/1389586.1389688"},{"key":"ref_160","doi-asserted-by":"crossref","unstructured":"Ding, W., Xu, M., Huang, D., Lin, W., Dong, M., Yu, X., and Li, H. (2016, January 12\u201316). Audio and face video emotion recognition in the wild using deep neural networks and small datasets. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/2993148.2997637"},{"key":"ref_161","doi-asserted-by":"crossref","unstructured":"Yao, A., Shao, J., Ma, N., and Chen, Y. (2015, January 9\u201313). Capturing au-aware facial features and their latent relations for emotion recognition in the wild. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2830585"},{"key":"ref_162","doi-asserted-by":"crossref","unstructured":"Kaya, H., G\u00fcrpinar, F., Afshar, S., and Salah, A.A. (2015, January 9\u201313). Contrasting and combining least squares based learners for emotion recognition in the wild. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2830588"},{"key":"ref_163","doi-asserted-by":"crossref","unstructured":"Ebrahimi Kahou, S., Michalski, V., Konda, K., Memisevic, R., and Pal, C. (2015, January 9\u201313). Recurrent neural networks for emotion recognition in video. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA.","DOI":"10.1145\/2818346.2830596"},{"key":"ref_164","doi-asserted-by":"crossref","unstructured":"Pini, S., Ahmed, O.B., Cornia, M., Baraldi, L., Cucchiara, R., and Huet, B. (2017, January 13\u201317). Modeling multimodal cues in a deep learning-based framework for emotion recognition in the wild. Proceedings of the 19th ACM International Conference on Multimodal Interaction, Glasgow, UK.","DOI":"10.1145\/3136755.3143006"},{"key":"ref_165","doi-asserted-by":"crossref","unstructured":"Gideon, J., Zhang, B., Aldeneh, Z., Kim, Y., Khorram, S., Le, D., and Provost, E.M. (2016, January 12\u201316). Wild wild emotion: A multimodal ensemble approach. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/2993148.2997626"},{"key":"ref_166","doi-asserted-by":"crossref","unstructured":"Chen, J., Chen, Z., Chi, Z., and Fu, H. (2014, January 12\u201316). Emotion recognition in the wild with feature fusion and multiple kernel learning. Proceedings of the 16th International Conference on Multimodal Interaction, Istanbul, Turkey.","DOI":"10.1145\/2663204.2666277"},{"key":"ref_167","doi-asserted-by":"crossref","unstructured":"Paleari, M.L., Singh, V., Huet, B., and Jain, R. (2009, January 19\u201324). Toward environment-to-environment (E2E) affective sensitive communication systems. Proceedings of the First, ACM International Workshop on Multimedia Technologies for Distance Learning, Beijing, China.","DOI":"10.1145\/1631111.1631115"},{"key":"ref_168","doi-asserted-by":"crossref","unstructured":"Sidorov, M., and Minker, W. (2014, January 12\u201316). Emotion recognition in real-world conditions with acoustic and visual features. Proceedings of the 16th International Conference on Multimodal Interaction, Istanbul, Turkey.","DOI":"10.1145\/2663204.2666279"},{"key":"ref_169","doi-asserted-by":"crossref","unstructured":"Kahou, S.E., Pal, C., Bouthillier, X., Froumenty, P., G\u00fcl\u00e7ehre, \u00c7., Memisevic, R., Vincent, P., Courville, A., Bengio, Y., and Ferrari, R.C. (2013, January 9\u201313). Combining modality specific deep neural networks for emotion recognition in video. Proceedings of the 15th ACM on International Conference On Multimodal Interaction, Sydney, Australia.","DOI":"10.1145\/2522848.2531745"},{"key":"ref_170","unstructured":"Krishna, T., Rai, A., Bansal, S., Khandelwal, S., Gupta, S., and Goyal, D. (2010, January 9\u201313). Emotion recognition using facial and audio features. Proceedings of the 15th ACM on International Conference On Multimodal Interaction, Sydney, Australia."},{"key":"ref_171","unstructured":"Wang, H., Huang, H., Hu, Y., Anderson, M., Rollins, P., and Makedon, F. (2018, January 26\u201329). Emotion detection via discriminative kernel method. Proceedings of the 3rd International Conference on Pervasive Technologies Related to Assistive Environments, Corfu, Greece."},{"key":"ref_172","unstructured":"Nicolaou, M.A., Gunes, H., and Pantic, M. (01, January November). A multi-layer hybrid framework for dimensional emotion classification. Proceedings of the 19th ACM International Conference on Multimedia, Scottsdale, AZ, USA."},{"key":"ref_173","doi-asserted-by":"crossref","unstructured":"Chao, L., Tao, J., Yang, M., Li, Y., and Wen, Z. (2014, January 7). Multi-scale temporal modeling for dimensional emotion recognition in video. Proceedings of the 4th International Workshop on Audio\/Visual Emotion Challenge, Orlando, FL, USA.","DOI":"10.1145\/2661806.2661811"},{"key":"ref_174","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1109\/TCYB.2013.2253768","article-title":"Affective state level recognition in naturalistic facial and vocal expressions","volume":"44","author":"Meng","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_175","doi-asserted-by":"crossref","unstructured":"Song, Y., Morency, L.P., and Davis, R. (2013, January 9\u201313). Learning a sparse codebook of facial and body microexpressions for emotion recognition. Proceedings of the 15th ACM on International Conference On Multimodal Interaction, Sydney, Australia.","DOI":"10.1145\/2522848.2522851"},{"key":"ref_176","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1109\/TCYB.2015.2418092","article-title":"Time-delay neural network for continuous emotional dimension prediction from facial expression sequences","volume":"46","author":"Meng","year":"2015","journal-title":"IEEE Trans. Cybern."},{"key":"ref_177","doi-asserted-by":"crossref","unstructured":"Liu, M., Wang, R., Li, S., Shan, S., Huang, Z., and Chen, X. (2014, January 12\u201316). Combining multiple kernel methods on riemannian manifold for emotion recognition in the wild. Proceedings of the 16th International Conference on Multimodal Interaction, Istanbul, Turkey.","DOI":"10.1145\/2663204.2666274"},{"key":"ref_178","doi-asserted-by":"crossref","unstructured":"Fan, Y., Lu, X., Li, D., and Liu, Y. (2016, January 12\u201316). Video-based emotion recognition using CNN-RNN and C3D hybrid networks. Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan.","DOI":"10.1145\/2993148.2997632"},{"key":"ref_179","doi-asserted-by":"crossref","unstructured":"Hu, P., Cai, D., Wang, S., Yao, A., and Chen, Y. (2017, January 13\u201317). Learning supervised scoring ensemble for emotion recognition in the wild. Proceedings of the 19th ACM International Conference on Multimodal Interaction, Glasgow, UK.","DOI":"10.1145\/3136755.3143009"},{"key":"ref_180","first-page":"6","article-title":"Deep face recognition","volume":"1","author":"Parkhi","year":"2015","journal-title":"BMVC"},{"key":"ref_181","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/9\/21\/4678\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:31:30Z","timestamp":1760189490000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/9\/21\/4678"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,2]]},"references-count":181,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["app9214678"],"URL":"https:\/\/doi.org\/10.3390\/app9214678","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,2]]}}}