{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T13:37:08Z","timestamp":1792071428256,"version":"4.4.0"},"reference-count":61,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,30]],"date-time":"2021-01-30T00:00:00Z","timestamp":1611964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>As we all know, there are many ways to express emotions. Among them, facial emotion recognition, which is widely used in human\u2013computer interaction, psychoanalysis of mental patients, multimedia retrieval, and other fields, is still a challenging task. At present, although convolutional neural network has achieved great success in face emotion recognition algorithms, it has a rising space in effective feature extraction and recognition accuracy. According to a large number of literature studies, histogram of oriented gradient (HOG) can effectively extract face features, and ensemble methods can effectively improve the accuracy and robustness of the algorithm. Therefore, this paper proposes a new algorithm, HOG-ESRs, which improves the traditional ensemble methods to the ensembles with shared representations (ESRs) method, effectively reducing the residual generalization error, and then combining HOG features with ESRs. The experimental results on the FER2013 dataset show that the new algorithm can not only effectively extract features and reduce the residual generalization error, but also improve the accuracy and robustness of the algorithm, the purpose of the study being achieved. The application of HOG-ESRs in facial emotion recognition is helpful to solve the symmetry of edge detection and the deficiency of related methods in an outdoor lighting environment.<\/jats:p>","DOI":"10.3390\/sym13020228","type":"journal-article","created":{"date-parts":[[2021,1,30]],"date-time":"2021-01-30T06:22:20Z","timestamp":1611987740000},"page":"228","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["HOG-ESRs Face Emotion Recognition Algorithm Based on HOG Feature and ESRs Method"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6934-9222","authenticated-orcid":false,"given":"Yuanchang","family":"Zhong","sequence":"first","affiliation":[{"name":"School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400030, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lili","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400030, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenhao","family":"Ge","sequence":"additional","affiliation":[{"name":"School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400030, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huilian","family":"Fan","sequence":"additional","affiliation":[{"name":"School of Big Data and Intelligent Engineering, Yangtze Normal University, Chongqing 408100, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,30]]},"reference":[{"key":"ref_1","unstructured":"Bettadapura, V. (2012). Face Expression Recognition and Analysis: The State of the Art, CoRR."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2595","DOI":"10.1038\/s41467-020-16089-9","article-title":"A unified neurocognitive model of semantics language social behaviour and face recognition in semantic dementia","volume":"11","author":"Ding","year":"2020","journal-title":"Nat. Commun."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s10462-012-9368-5","article-title":"Features and classifiers for emotion recognition from speech: A survey from 2000 to 2011","volume":"43","author":"Anagnostopoulos","year":"2015","journal-title":"Artif. Intell. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1258","DOI":"10.1038\/s41467-019-09239-1","article-title":"How face perception unfolds over time","volume":"10","author":"Dobs","year":"2019","journal-title":"Nat. Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4150","DOI":"10.1007\/s10489-019-01500-w","article-title":"Detecting facial emotions using normalized minimal feature vectors and semi-supervised twin support vector machines classifier","volume":"49","author":"Kumar","year":"2019","journal-title":"Appl. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2912","DOI":"10.1007\/s10489-017-1121-y","article-title":"Accurate and robust facial expression recognition system using real-time youtube-based datasets","volume":"48","author":"Siddiqi","year":"2018","journal-title":"Appl. Intell."},{"key":"ref_7","unstructured":"Navneet, D., and Triggs, B. (July, January 27). His-tograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Washington, DC, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MITS.2015.2427366","article-title":"An enhanced histogram of oriented gradients for pedestrian detection","volume":"7","author":"Zhao","year":"2015","journal-title":"Intell. Transp. Sys. Mag. IEEE"},{"key":"ref_9","unstructured":"Alizadeh, S., and Fazel, A. (2017). Convolutional neural networks for facial expression recognition. arXiv."},{"key":"ref_10","first-page":"31","article-title":"Spontaneous facial expression recognition based on histogram of oriented gradients descriptor","volume":"7","author":"Donia","year":"2014","journal-title":"Comp. Inform. Ence."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"14821","DOI":"10.1038\/ncomms14821","article-title":"The human amygdala parametrically encodes the intensity of specific facial emotions and their categorical ambiguity","volume":"8","author":"Wang","year":"2017","journal-title":"Nat. Commun."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Dols, J.M., and Crivelli, C. (2015). Recognition of facial expressions: Past, present, and future challenges. Understanding Facial Expressions in Communication, Springer.","DOI":"10.1007\/978-81-322-1934-7_2"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s12193-013-0144-x","article-title":"Analysis of significant dialog events in realistic human\u2013Computer interaction","volume":"8","author":"Prylipko","year":"2014","journal-title":"J. Multimodal User Interf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1049\/iet-cvi.2011.0064","article-title":"Facial expression recognition based on geometric and optical flow features in colour image sequences","volume":"6","author":"Niese","year":"2012","journal-title":"IET Comp. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1016\/j.imavis.2008.08.005","article-title":"Facial expression recognition based on local binary patterns: A comprehensive study","volume":"27","author":"Shan","year":"2009","journal-title":"Image Vis. Comp."},{"key":"ref_16","first-page":"4766","article-title":"Facial expression recognition in video sequences","volume":"6","author":"Wan","year":"2012","journal-title":"Intell. Control Automat. IEEE"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Praseeda Lekshmi, V., SasiKumar Vidyadharan, D.S., and Naveen, S. (2008, January 7\u20139). In Proceedings of the 2008 International Conference on Audio, Language and Image Processing\u2013Analysis of Facial Expressions using pca on Half and Full Faces, Shanghai, China.","DOI":"10.1109\/ICALIP.2008.4590224"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Nguyen, B.T., Trinh, M.H., Phan, T.V., and Nguyen, H.D. (2017, January 16\u201319). An efficient real-time emotion detection using camera and facial landmarks. Proceedings of the Seventh International Conference on Information Science & Technology, IEEE, Da Nang, Vietnam.","DOI":"10.1109\/ICIST.2017.7926765"},{"key":"ref_19","unstructured":"Loconsole, C., Miranda, C.R., Augusto, G., Frisoli, A., and Orvalho, V. (2014, January 5\u20138). Real-time emotion recognition novel method for geometrical facial features extraction. Proceedings of the 2014 International Conference on Computer Vision Theory (VISAPP), IEEE, Lisbon, Portugal."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Palestra, G., Pettinicchio, A., Coco, M.D., Pierluigi Carcagn, I., and Distante, C. (2015). Improved Performance in Facial Expression Recognition Using 32 Geometric Features. Image Analysis and Processing\u2013ICIAP 2015, Proceedings of the International Conference on Image Analysis & Processing, Genoa, Italy, 7\u201311 September 2015, Springer International Publishing.","DOI":"10.1007\/978-3-319-23234-8_48"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tian, Y.L., Kanade, T., Cohn, J.F., Li, S.Z., and Jain, A.K. (2005). Facial expression analysis. Handbook of Face Recognition, Springer.","DOI":"10.1007\/0-387-27257-7_12"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/TAFFC.2017.2740923","article-title":"Affectnet: A database for facial expression, valence, and arousal computing in the wild","volume":"10","author":"Mollahosseini","year":"2017","journal-title":"IEEE Trans. Affect. Comp."},{"key":"ref_23","unstructured":"Lewis, M., Haviland Jones, J.M., and Ekman, P. (2000). Darwin and facial expression: A century of research in review. Unemotion, Handbook of Emotions, Gilford Press."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1037\/h0030377","article-title":"Constants across cultures in the face and emotion","volume":"17","author":"Ekman","year":"1971","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_25","unstructured":"Ekman, P. (2006). Darwin and Facial Expression: A Century of Research in Review, Academic Press Ishk."},{"key":"ref_26","first-page":"1123","article-title":"Facial signs of emotional experience","volume":"39","author":"Ekman","year":"1980","journal-title":"J. Personal. Soc. Psyc."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Barsoum, E., Zhang, C., Ferrer, C.C., and Zhang, Z. (2016). Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distribution, Proceedings of the ICMI 18th ACM International Conference, Tokio, Japan,12-16 November 2016, ACM.","DOI":"10.1145\/2993148.2993165"},{"key":"ref_28","unstructured":"Hewitt, C., and Gunes, H. (2018). Cnn-based facial affect analysis on mobile devices. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Khorrami, P., Paine, T.L., and Huang, T.S. (2015, January 11\u201312). Do deepneural networks learn facial action units when doing expres-sion recognition?. Proceedings of the IEEE on CVPR\u2013Workshops, Boston, Massachusetts, USA.","DOI":"10.1109\/ICCVW.2015.12"},{"key":"ref_30","unstructured":"Ekman, P. (1989). The argument and evidence about universals in facial expressions. Handbook of Social Psychophysiology, John Weily & Sons Ltd."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hamester, D., Barros, P., and Wermter, S. (2015, January 12\u201317). Face expression recognition with a 2-channel convolutional neural network. international joint conference on neural networks. Proceedings of the IEEE 2015 International Joint Conference on Neural Networks (IJCNN), Killarney, Ireland.","DOI":"10.1109\/IJCNN.2015.7280539"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1109\/TMM.2018.2844085","article-title":"Facial expression recognition using hierarchical features with deep comprehensive multipatches aggregation convolutional neural networks","volume":"21","author":"Xie","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Laptev, D., Savinov, N., Buhmann, J.M., and Pollefeys, M. (2016). TI-POOLING: Transformation-invariant pooling for feature learning in convolutional neural networks. CVPR 2016. IEEE Comp. Soc., 289\u2013297.","DOI":"10.1109\/CVPR.2016.38"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3188","DOI":"10.1007\/s10489-019-01435-2","article-title":"Graph-based dynamic ensemble pruning for facial expression recognition","volume":"49","author":"Li","year":"2019","journal-title":"Appl. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"4193","DOI":"10.1109\/TIP.2017.2689999","article-title":"Facial expression recognition based on deep evolutional spatial-temporal networks","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Proces. Publ. IEEE Signal Proces. Soc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.patrec.2017.10.022","article-title":"Deep spatial-temporal feature fusion for facial expression recognition in static images","volume":"119","author":"Sun","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"ref_37","first-page":"1","article-title":"Cnn and lstm based facial expression analysis model for a humanoid robot","volume":"99","author":"Li","year":"2019","journal-title":"IEEE Access PP"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4934","DOI":"10.1038\/s41467-019-12623-6","article-title":"Convergent evolution of face spaces across human face-selective neuronal groups and deep convolutional networks","volume":"10","author":"Grossman","year":"2019","journal-title":"Nat. Commun."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ouyang, X., Kawaai, S., Goh, E.G.H., Shen, S., Ding, W., Ming, H., and Huang, D.Y. (2017, January 13\u201317). Audiovisual emotion recognition using deep transfer learning and multiple temporal models. Proceedings of the 19th ACM International Conference, Glasgow, Scotland.","DOI":"10.1145\/3136755.3143012"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Jung, H., Lee, S., Yim, J., Park, S., and Kim, J. (2015, January 16\u201317). Joint fine-tuning in deep neural networks for facial expression recognition. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.341"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/978-3-319-01796-9_7","article-title":"Object detection using scale invariant feature transform","volume":"Volume 238","author":"Nguyen","year":"2014","journal-title":"Genetic and Evolutionary Computing"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Dietterich, T.G. (2000). Ensemble methods in machine learning. Multiple Classifier Systems, Springer.","DOI":"10.1007\/3-540-45014-9_1"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/34.58871","article-title":"Neural network ensemble","volume":"12","author":"Hansen","year":"1990","journal-title":"IEEE Trans Pattern Anal. Mach. Intell."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1109\/TIP.2018.2886767","article-title":"Occlusion aware facial expression recognition using cnn with attention mechanism","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Proces. IP"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2659","DOI":"10.1007\/s10489-018-1388-7","article-title":"Sparse modified marginal fisher analysis for facial expression recognition","volume":"49","author":"Wang","year":"2019","journal-title":"Appl. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Meshgi, K., Oba, S., and Ishii, S. (2018, January 18\u201323). Efficient diverse ensemble for discriminative co-tracking. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00506"},{"key":"ref_47","unstructured":"Seung, H.S., Opper, M.A., and Sompolinsky, H. (, January 27\u201329). Query by committee. Proceedings of the 5th Workshop on Computional Learning Theory, Pittsburgh, PA, USA."},{"key":"ref_48","first-page":"38","article-title":"Distilling the knowledge in a neural network","volume":"14","author":"Hinton","year":"2015","journal-title":"Comp. ence."},{"key":"ref_49","unstructured":"Shen, Z., He, Z., and Xue, X. (2019, January 7\u201312). Meal: Multi-modelensemble via adversarial learning. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Siqueira, H., Magg, S., and Wermter, S. (2020). Efficient facial feature learning with wide ensemble-based convolutional neural networks. arXiv.","DOI":"10.1609\/aaai.v34i04.6037"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Siqueira, H., Barros, P., Magg, S., and Wermter, S. (2018, January 1\u20135). An ensemble with shared representations based on convolutional networks for continually learning facial expressions. Proceedings of the IEEE\/RSJ International Conference on IROS, Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594276"},{"key":"ref_52","unstructured":"Chollet, F. (2018). Deep learning with python and keras. The Handbook by the Developer of the Keras Library, MITP-Verlag GmbH & Co. KG."},{"key":"ref_53","unstructured":"Kamachi, M., Lyons, M., and Gyoba, J. (1998). Japanese Female Facial Expression Database, Psychology Department in Kyushu University."},{"key":"ref_54","unstructured":"Valstar, M.F., and Pantic, M. (2021, January 29). Induced disgust, happiness and surprise: An addition to the MMI facial expression database. Proc.intern.workshop on Emotion Corpora for Research on Emotion & Affect. Available online: http:\/\/lrec.elra.info\/proceedings\/lrec2010\/workshops\/W24.pdf#page=73."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Gehrig, T. (2015). Action unit intensity estimation using hierarchical partial least squares. Feminist Theory and Literary Practice, Foreign Language Teaching and Research Press.","DOI":"10.1109\/FG.2015.7163152"},{"key":"ref_56","first-page":"149","article-title":"The cas-peal large-scale chinese face database and baseline evaluations","volume":"38","author":"Gao","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., and Matthews, I. (2010, January 13\u201318). The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression. Proceedings of the 2010 IEEE Computer Vision & Pattern Recognition\u2013Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_58","first-page":"E3086","article-title":"Cross-cultural recognition of basic emotions through emotional vocalizations","volume":"112","author":"Sauter","year":"2015","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_59","unstructured":"Lyons, M.J., Kamachi, M., and Gyoba, J. (1997). The Japanese female facial expression. (JAFFE) Database J., 1\u201325."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1126\/science.aau6595","article-title":"Using neuroscience to develop artificial intelligence","volume":"363","author":"Ullman","year":"2019","journal-title":"Science"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"78000","DOI":"10.1109\/ACCESS.2019.2921220","article-title":"Recognizing facial expressions using a shallow convolutional neural network","volume":"7","author":"Miao","year":"2019","journal-title":"IEEE Access"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/2\/228\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:17:27Z","timestamp":1760159847000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/2\/228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,30]]},"references-count":61,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["sym13020228"],"URL":"https:\/\/doi.org\/10.3390\/sym13020228","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,30]]}}}