{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T02:36:26Z","timestamp":1772678186283,"version":"3.50.1"},"reference-count":59,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,3,6]],"date-time":"2025-03-06T00:00:00Z","timestamp":1741219200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>This study introduces a custom-designed CNN architecture that extracts robust, multi-level facial features and incorporates preprocessing techniques to correct or reduce asymmetry before classification. The innovative characteristics of this research lie in its integrated approach to overcoming facial asymmetry challenges and enhancing CNN-based emotion recognition. This is completed by well-known data augmentation strategies\u2014using methods such as vertical flipping and shuffling\u2014that generate symmetric variations in facial images, effectively balancing the dataset and improving recognition accuracy. Additionally, a Loss Weight parameter is used to fine-tune training, thereby optimizing performance across diverse and unbalanced emotion classes. Collectively, all these contribute to an efficient, real-time facial emotion recognition system that outperforms traditional CNN models and offers practical benefits for various applications while also addressing the inherent challenges of facial asymmetry in emotion detection. Our experimental results demonstrate superior performance compared to other CNN methods, marking a step forward in applications ranging from human\u2013computer interaction to immersive technologies while also acknowledging privacy and ethical considerations.<\/jats:p>","DOI":"10.3390\/sym17030397","type":"journal-article","created":{"date-parts":[[2025,3,6]],"date-time":"2025-03-06T06:02:13Z","timestamp":1741240933000},"page":"397","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Leveraging Symmetry and Addressing Asymmetry Challenges for Improved Convolutional Neural Network-Based Facial Emotion Recognition"],"prefix":"10.3390","volume":"17","author":[{"given":"Gabriela Laura","family":"S\u0103l\u0103gean","sequence":"first","affiliation":[{"name":"Doctoral School, University of Petro\u0219ani, 332006 Petrosani, Romania"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4083-9121","authenticated-orcid":false,"given":"Monica","family":"Leba","sequence":"additional","affiliation":[{"name":"System Control and Computer Engineering Department, University of Petro\u0219ani, 332006 Petrosani, Romania"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1988-9340","authenticated-orcid":false,"given":"Andreea Cristina","family":"Ionica","sequence":"additional","affiliation":[{"name":"Management and Industrial Engineering Department, University of Petro\u0219ani, 332006 Petrosani, Romania"}]}],"member":"1968","published-online":{"date-parts":[[2025,3,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Darwin, C. (1872). The Expression of the Emotions in Man and Animals, John Murray.","DOI":"10.1037\/10001-000"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sagliano, L., Ponari, M., Conson, M., and Trojano, L. (2022). The interpersonal effects of emotions: The influence of facial ex-pressions on social interactions. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.1074216"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1146\/annurev.ps.30.020179.002523","article-title":"Facial expressions of emotion","volume":"30","author":"Ekman","year":"1979","journal-title":"Annu. Rev. Psychol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1037\/a0036052","article-title":"Perceptions of emotion from facial expressions are not culturally universal: Evidence from a remote culture","volume":"14","author":"Gendron","year":"2014","journal-title":"Emotion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1177\/1754073912457228","article-title":"Coherence between emotion and facial expression: Evidence from laboratory experiments","volume":"5","author":"Reisenzein","year":"2013","journal-title":"Emot. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3820","DOI":"10.1523\/JNEUROSCI.23-09-03820.2003","article-title":"Emotion processing in chimeric faces: Hemispheric asymmetries in expression and recognition of emotions","volume":"23","author":"Indersmitten","year":"2003","journal-title":"J. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mandal, M., and Awasthi, A. (2014). Asymmetry of facial expressions of emotion. Understanding Facial Expressions in Communication, Springer.","DOI":"10.1007\/978-81-322-1934-7"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1662","DOI":"10.1016\/S0028-3932(02)00024-6","article-title":"The effect of left and right poses on the expression of facial emotion","volume":"40","author":"Nicholls","year":"2002","journal-title":"Neuropsychologia"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Belhumeur, P.N., Hespanha, J.P., and Kriegman, D. (1997, January 17\u201319). Eigenfaces vs. Fisherfaces: Recognition using class-specific linear projection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 1997), San Juan, PR, USA.","DOI":"10.1109\/34.598228"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for recognition","volume":"3","author":"Turk","year":"1991","journal-title":"J. Cogn. Neurosci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ramadhani, A.L., Musa, P., and Wibowo, E.P. (2017, January 1\u20133). Human face recognition application using PCA and eigenface approach. In Proceeding of the 7 Second International Conference on Informatics and Computing (ICIC), Jayapura, Indonesia.","DOI":"10.1109\/IAC.2017.8280652"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1109\/TNN.2002.806647","article-title":"Face recognition using LDA-based algorithms","volume":"14","author":"Lu","year":"2003","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_14","unstructured":"Kanade, T., Cohn, J.F., and Tian, Y. (2000, January 28\u201330). Comprehensive database for facial expression analysis. Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000), Grenoble, France."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13\u201318). The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specific expression. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2010), San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_16","first-page":"327","article-title":"Adaptive multi-column deep neural networks with application to robust image denoising","volume":"26","author":"Agostinelli","year":"2013","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_17","unstructured":"Lyons, M., Akamatsu, S., Kamachi, M., and Gyoba, J. (1998, January 14\u201316). Coding facial expressions with Gabor wavelets. Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition (FG 1998), Nara, Japan."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1109\/TAFFC.2020.2981446","article-title":"Deep facial expression recognition: A survey","volume":"13","author":"Li","year":"2022","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_19","unstructured":"Supta, S.R., Sahriar, M.R., Rashed, M.G., Das, D., and Yasmin, R. (2020, January 26\u201327). An effective facial expression recognition system. Proceedings of the 2020 IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE 2020), Dhaka, Bangladesh."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shi, W., and Jiang, M. (2018, January 10\u201312). Fuzzy wavelet network with feature fusion and LM algorithm for facial emotion recognition. Proceedings of the 2018 IEEE International Conference of Safety Produce Informatization (IICSPI 2018), Chongqing, China.","DOI":"10.1109\/IICSPI.2018.8690353"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ramalingam, S., and Garzia, F. (2018, January 22\u201325). Facial expression recognition using transfer learning. Proceedings of the International Carnahan Conference on Security Technology (CCST 2018), Montreal, QC, Canada.","DOI":"10.1109\/CCST.2018.8585504"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Raja Sekaran, S.A.P.C., Lee, P., and Lim, K.M. (2021, January 3\u20135). Facial emotion recognition using transfer learning of AlexNet. Proceedings of the 2021 9th International Conference on Information and Communication Technology (ICoICT 2021), Yogyakarta, Indonesia.","DOI":"10.1109\/ICoICT52021.2021.9527512"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Abdulsattar, N.S., and Hussain, M.N. (2022, January 26\u201327). Facial expression recognition using transfer learning and fine-tuning strategies: A comparative study. Proceedings of the 2nd 2022 International Conference on Computer Science and Software Engineering (CSASE 2022), Baghdad, Iraq.","DOI":"10.1109\/CSASE51777.2022.9759754"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sajjanhar, A., Wu, Z., and Wen, Q. (2018, January 10\u201313). Deep learning models for facial expression recognition. Proceedings of the 2018 International Conference on Digital Image Computing: Techniques and Applications (DICTA 2018), Canberra, Australia.","DOI":"10.1109\/DICTA.2018.8615843"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"15711","DOI":"10.1007\/s11042-023-16174-3","article-title":"Identifying emotions from facial expressions using a deep convolutional neural network-based approach","volume":"83","author":"Meena","year":"2024","journal-title":"Multimed. Tools Appl."},{"key":"ref_26","first-page":"200339","article-title":"Detection of human emotions through facial expressions using hybrid convolutional neural network-recurrent neural network algorithm","volume":"21","author":"Manalu","year":"2024","journal-title":"Intell. Syst. Appl."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"107708","DOI":"10.1016\/j.engappai.2023.107708","article-title":"Multimodal Emotion Recognition via Convolutional Neural Networks: Comparison of different strategies on two multimodal datasets","volume":"130","author":"Bilotti","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.neunet.2014.09.005","article-title":"Challenges in representation learning: A report on three machine learning contests","volume":"64","author":"Goodfellow","year":"2015","journal-title":"Neural Netw."},{"key":"ref_29","first-page":"606","article-title":"Database Development and Recognition of Facial Expression using Deep Learning","volume":"23","author":"Bapat","year":"2024","journal-title":"Int. J. Comput."},{"key":"ref_30","unstructured":"Hatzilygeroudis, I., and Palade, V. (2018). Deep Learning Approaches for Facial Emotion Recognition: A Case Study on FER-2013. Advances in Hybridization of Intelligent Methods. Smart Innovation, Systems and Technologies, Springer."},{"key":"ref_31","unstructured":"Kaggle (2024, December 20). FER2013 Dataset. Available online: https:\/\/kaggle.com\/competitions\/challenges-in-representation-learning-facial-expression-recognition-challenge."},{"key":"ref_32","unstructured":"Kaggle (2024, December 20). Face Expression Recognition Dataset. Available online: https:\/\/www.kaggle.com\/datasets\/jonathanoheix\/face-expression-recognition-dataset\/data."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s12626-020-00061-6","article-title":"Hybrid-deep learning model for emotion recognition using facial expressions","volume":"14","author":"Verma","year":"2020","journal-title":"Rev. Socionetwork Strateg."},{"key":"ref_34","unstructured":"Saha, S.A. (2024, December 20). Comprehensive Guide to Convolutional Neural Networks\u2014The ELI5 Way, Towards Data Science, Available online: https:\/\/ise.ncsu.edu\/wp-content\/uploads\/sites\/9\/2022\/08\/A-Comprehensive-Guide-to-Convolutional-Neural-Networks-%E2%80%94-the-ELI5-way-_-by-Sumit-Saha-_-Towards-Data-Science.pdf."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rackauckas, C., Ma, Y., Martensen, J., Warner, C., and Edelman, A. (2020). Universal differential equations for scientific machine learning. arXiv.","DOI":"10.21203\/rs.3.rs-55125\/v1"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Farfade, S.S., Saberian, M.J., and Li, L.J. (2015, January 23\u201326). Multi-view face detection using deep convolutional neural networks. Proceedings of the 5th ACM International Conference on Multimedia Retrieval (ICMR 2015), Shanghai, China.","DOI":"10.1145\/2671188.2749408"},{"key":"ref_38","unstructured":"Tomasi, C., and Manduchi, R. (1998, January 4\u20137). Bilateral filtering for gray and color images. Proceedings of the 6th IEEE International Conference on Computer Vision (ICCV 1998), Bombay, India."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0031-3203(94)90013-2","article-title":"On Gabor\u2019s contribution to image enhancement","volume":"27","author":"Lindenbaum","year":"1994","journal-title":"Pattern Recognit."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive histogram equalization and its variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1021\/ci0342472","article-title":"The problem of overfitting","volume":"44","author":"Hawkins","year":"2004","journal-title":"J. Chem. Inf. Comput. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"6190","DOI":"10.3934\/mbe.2024272","article-title":"Image data augmentation techniques based on deep learning: A survey","volume":"21","author":"Wu","year":"2024","journal-title":"Math. Biosci. Eng."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Gupta, S. (2018, January 19\u201320). Facial emotion recognition in real-time and static images. Proceedings of the 2nd International Conference on Inventive Systems and Control (ICISC 2018), Coimbatore, India.","DOI":"10.1109\/ICISC.2018.8398861"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Anthwal, S., and Ganotra, D. (2019, January 16\u201318). An optical flow-based approach for facial expression recognition. Proceedings of the 2019 International Conference on Power Electronics, Control and Automation (ICPECA 2019), Noida, India.","DOI":"10.1109\/ICPECA47973.2019.8975442"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jolliffe, I. (2011). Principal Component Analysis, Springer.","DOI":"10.1007\/978-3-642-04898-2_455"},{"key":"ref_47","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_48","first-page":"599","article-title":"Classification Model Evaluation Metrics","volume":"12","author":"Vujovic","year":"2021","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1038\/nmeth.3945","article-title":"Classification evaluation","volume":"13","author":"Lever","year":"2016","journal-title":"Nat. Methods"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5121\/ijdkp.2015.5201","article-title":"A Review on Evaluation Metrics for Data Classification Evaluations","volume":"5","author":"Sulaiman","year":"2015","journal-title":"Int. J. Data Min. Knowl. Manag. Process"},{"key":"ref_51","unstructured":"Kulatilleke, G.K., and Samarakoon, S. (2022). Empirical study of Machine Learning Classifier Evaluation Metrics behavior in Massively Imbalanced and Noisy data. arXiv."},{"key":"ref_52","first-page":"41","article-title":"A Review of the Deep Convolutional Neural Networks for the Analysis of Facial Expressions","volume":"6","author":"Kumar","year":"2024","journal-title":"J. Innov. Technol."},{"key":"ref_53","unstructured":"Pramerdorfer, C., and Kampel, M. (2016). Facial expression recognition using convolutional neural networks: State of the art. arXiv."},{"key":"ref_54","unstructured":"Mollahosseini, A., Chan, D., and Mahoor, M.H. (2017, January 24\u201331). Going deeper in facial expression recognition using deep neural networks. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV 2017), Santa Rosa, CA, USA."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Minaee, S., Minaei, M., and Abdolrashidi, A. (2021). Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network. Sensors, 21.","DOI":"10.3390\/s21093046"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Ghadekar, P., Gupta, A.K., Datta, J., Singh, G., Anand, D.S., Oswal, P., Sharma, D., and Khare, S. (2022, January 1\u20133). Facial Expression Recognition Based on Deep Learning-Deep Convolutional Neural Network. Proceedings of the 2022 IEEE 7th International Conference on Recent Advances and Innovations in Engineering (ICRAIE), Mangalore, India.","DOI":"10.1109\/ICRAIE56454.2022.10054303"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Khan, A.R. (2022). Facial Emotion Recognition Using Conventional Machine Learning and Deep Learning Methods: Current Achievements. Anal. Remain. Chall. Inf., 13.","DOI":"10.3390\/info13060268"},{"key":"ref_58","unstructured":"Christou, N., and Kanojiya, N. (2019, January 22\u201324). Human facial expression recognition with convolutional neural networks. Proceedings of the 2019 Springer International Conference, Singapore."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Punuri, S.B., Kuanar, S.K., Kolhar, M., Mishra, T.K., Alameen, A., Mohapatra, H., and Mishra, S.R. (2023). Efficient Net-XGBoost: An Implementation for Facial Emotion Recognition Using Transfer Learning. Mathematics, 11.","DOI":"10.3390\/math11030776"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/3\/397\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:48:07Z","timestamp":1760028487000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/3\/397"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,6]]},"references-count":59,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["sym17030397"],"URL":"https:\/\/doi.org\/10.3390\/sym17030397","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,6]]}}}