{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T03:25:17Z","timestamp":1792466717321,"version":"4.5.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,6]],"date-time":"2024-02-06T00:00:00Z","timestamp":1707177600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,6]],"date-time":"2024-02-06T00:00:00Z","timestamp":1707177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Facial expression detection from images and videos has recently gained attention due to the wide variety of applications it has found in the field of computer vision such as advanced driving assistance systems (ADAS), augmented and virtual reality (AR\/VR), video retrieval, and security systems. Facial terms, body language, hand gestures, and eye contact have all been researched as a means of deciphering and understanding human emotions. Automated facial expression recognition (FER) is a significant visual recognition procedure because human emotions are a worldwide signal used in non-verbal communication. The six primary universal manifestations of emotion are characterized as happiness, sadness, anger, contempt, fear, and surprise. While the accuracy of deep learning (DL)-based approaches has improved significantly across many domains, automated FER remains a difficult undertaking, especially when it comes to real-world applications. In this research work, two publicly available datasets such as FER2013 and EMOTIC are considered for validation process. Initially, pre-processing includes histogram equalization, image normalization and face detection using Multi-task Cascaded Convolutional Network (MT-CNN) is used. Then, DL-based EfficinetNetB0 is used to extract the features of pre-processed images for further process. Finally, the Weighted Kernel Extreme Learning Machine (WKELM) is used for classification of emotions, where the kernel parameters are optimized by Red Fox Optimizer (RFO). From the experimental analysis, the proposed model achieved 95.82% of accuracy, 95.81% of F1-score and 95% of recall for the testing data.<\/jats:p>","DOI":"10.1007\/s44196-024-00406-x","type":"journal-article","created":{"date-parts":[[2024,2,6]],"date-time":"2024-02-06T09:02:42Z","timestamp":1707210162000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Multi-class Facial Emotion Expression Identification Using DL-Based Feature Extraction with Classification Models"],"prefix":"10.1007","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5205-9678","authenticated-orcid":false,"given":"M.","family":"Anand","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S.","family":"Babu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,6]]},"reference":[{"issue":"5","key":"406_CR1","doi-asserted-by":"publisher","first-page":"1493","DOI":"10.1007\/s10826-019-01636-w","volume":"29","author":"MM Assed","year":"2020","unstructured":"Assed, M.M., Khafif, T.C., Belizario, G.O., Fatorelli, R., Rocca, C.C.D.A., de P\u00e1dua Serafim, A.: Facial emotion recognition in maltreated children: a systematic review. J. Child Fam. Stud. 29(5), 1493\u20131509 (2020)","journal-title":"J. Child Fam. Stud."},{"issue":"3","key":"406_CR2","doi-asserted-by":"publisher","first-page":"205","DOI":"10.36548\/jtcsst.2021.3.004","volume":"3","author":"JS Manoharan","year":"2021","unstructured":"Manoharan, J.S.: Design of an intelligent approach on capsule networks to detect forged images. J. Trend. Comput. Sci. Smart Technol. 3(3), 205\u2013221 (2021)","journal-title":"J. Trend. Comput. Sci. Smart Technol."},{"issue":"3","key":"406_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s42452-020-2234-1","volume":"2","author":"N Mehendale","year":"2020","unstructured":"Mehendale, N.: Facial emotion recognition using convolutional neural networks (FERC). SN Appl. Sci. 2(3), 1\u20138 (2020)","journal-title":"SN Appl. Sci."},{"issue":"1","key":"406_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/informatics7010006","volume":"7","author":"A Alreshidi","year":"2020","unstructured":"Alreshidi, A., Ullah, M.: Facial emotion recognition using hybrid features. Informatics 7(1), 1\u20138 (2020)","journal-title":"Informatics"},{"issue":"1","key":"406_CR5","first-page":"30","volume":"1","author":"J Samuel Manoharan","year":"2019","unstructured":"Samuel Manoharan, J.: A smart image processing algorithm for text recognition, information extraction and vocalization for the visually challenged. J. Innov. Image Process. 1(1), 30\u201338 (2019)","journal-title":"J. Innov. Image Process."},{"issue":"2","key":"406_CR6","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/s00371-019-01627-4","volume":"36","author":"K Li","year":"2020","unstructured":"Li, K., Jin, Y., Akram, M.W., Han, R., Chen, J.: Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy. Vis. Comput. 36(2), 391\u2013404 (2020)","journal-title":"Vis. Comput."},{"issue":"9","key":"406_CR7","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.3390\/electronics10091036","volume":"10","author":"MAH Akhand","year":"2021","unstructured":"Akhand, M.A.H., Roy, S., Siddique, N., Kamal, M.A.S., Shimamura, T.: Facial emotion recognition using transfer learning in the deep CNN. Electronics 10(9), 1036\u20131043 (2021)","journal-title":"Electronics"},{"issue":"10","key":"406_CR8","doi-asserted-by":"publisher","first-page":"11532","DOI":"10.1109\/JSEN.2020.3028075","volume":"21","author":"X Liu","year":"2020","unstructured":"Liu, X., Cheng, X., Lee, K.: GA-SVM-based facial emotion recognition using facial geometric features. IEEE Sens. J. 21(10), 11532\u201311542 (2020)","journal-title":"IEEE Sens. J."},{"issue":"21","key":"406_CR9","doi-asserted-by":"publisher","first-page":"4678","DOI":"10.3390\/app9214678","volume":"9","author":"D Canedo","year":"2019","unstructured":"Canedo, D., Neves, A.J.: Facial expression recognition using computer vision: a systematic review. Appl. Sci. 9(21), 4678\u20134685 (2019)","journal-title":"Appl. Sci."},{"issue":"2","key":"406_CR10","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1007\/s00371-019-01630-9","volume":"36","author":"A Agrawal","year":"2020","unstructured":"Agrawal, A., Mittal, N.: Using CNN for facial expression recognition: a study of the effects of kernel size and number of filters on accuracy. Vis. Comput. 36(2), 405\u2013412 (2020)","journal-title":"Vis. Comput."},{"issue":"2","key":"406_CR11","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s12626-020-00061-6","volume":"14","author":"G Verma","year":"2020","unstructured":"Verma, G., Verma, H.: Hybrid-deep learning model for emotion recognition using facial expressions. Rev Socionetwork Strategies 14(2), 171\u2013180 (2020)","journal-title":"Rev Socionetwork Strategies"},{"issue":"1","key":"406_CR12","first-page":"53","volume":"2","author":"A Saxena","year":"2020","unstructured":"Saxena, A., Khanna, A., Gupta, D.: Emotion recognition and detection methods: a comprehensive survey. J. Artif. Intell. Syst. 2(1), 53\u201379 (2020)","journal-title":"J. Artif. Intell. Syst."},{"key":"406_CR13","doi-asserted-by":"crossref","unstructured":"Chowdary, M.K., Nguyen, T.N. and Hemanth, D.J.: Deep learning-based facial emotion recognition for human\u2013computer interaction applications. Neural Comput. Appl. 1\u201318 (2021)","DOI":"10.1007\/s00521-021-06012-8"},{"issue":"7","key":"406_CR14","first-page":"5432","volume":"12","author":"PNR Bodavarapu","year":"2021","unstructured":"Bodavarapu, P.N.R., Srinivas, P.S.: An optimized neural network model for facial expression recognition over traditional deep neural networks. Int. J. Adv. Comput. Sci. Appl. 12(7), 5432\u20135443 (2021)","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"406_CR15","doi-asserted-by":"crossref","unstructured":"Sivaiah, B., Gopalan, N.P., Mala, C. and Lavanya, S.: FL-CapsNet: facial localization augmented capsule network for human emotion recognition. Signal Image Video Process. 1\u20139 (2022)","DOI":"10.1007\/s11760-022-02381-2"},{"issue":"9","key":"406_CR16","doi-asserted-by":"publisher","first-page":"6253","DOI":"10.1109\/TCSVT.2022.3165321","volume":"32","author":"H Liu","year":"2022","unstructured":"Liu, H., Cai, H., Lin, Q., Li, X., Xiao, H.: Adaptive multilayer perceptual attention network for facial expression recognition. IEEE Trans. Circ. Syst. Video Technol. 32(9), 6253\u20136266 (2022)","journal-title":"IEEE Trans. Circ. Syst. Video Technol."},{"issue":"4","key":"406_CR17","doi-asserted-by":"publisher","first-page":"80","DOI":"10.3390\/asi5040080","volume":"5","author":"A Chaudhari","year":"2022","unstructured":"Chaudhari, A., Bhatt, C., Krishna, A., Mazzeo, P.L.: ViTFER: facial emotion recognition with vision transformers. Appl. Syst. Innov. 5(4), 80\u201391 (2022)","journal-title":"Appl. Syst. Innov."},{"key":"406_CR18","doi-asserted-by":"publisher","first-page":"90465","DOI":"10.1109\/ACCESS.2021.3091169","volume":"9","author":"MH Hoang","year":"2021","unstructured":"Hoang, M.H., Kim, S.H., Yang, H.J., Lee, G.S.: Context-aware emotion recognition based on visual relationship detection. IEEE Access 9, 90465\u201390474 (2021)","journal-title":"IEEE Access"},{"issue":"3","key":"406_CR19","doi-asserted-by":"publisher","first-page":"1256","DOI":"10.3390\/app12031256","volume":"12","author":"A Fujisawa","year":"2022","unstructured":"Fujisawa, A., Matsumoto, K., Yoshida, M., Kita, K.: Emotion estimation method based on emoticon image features and distributed representations of sentences. Appl. Sci. 12(3), 1256\u20131264 (2022)","journal-title":"Appl. Sci."},{"key":"406_CR20","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1016\/j.inffus.2020.11.007","volume":"76","author":"I Bendjoudi","year":"2021","unstructured":"Bendjoudi, I., Vanderhaegen, F., Hamad, D., Dornaika, F.: Multi-label, multi-task CNN approach for context-based emotion recognition. Inf. Fus. 76, 422\u2013428 (2021)","journal-title":"Inf. Fus."},{"key":"406_CR21","doi-asserted-by":"publisher","first-page":"103264","DOI":"10.1109\/ACCESS.2022.3210109","volume":"10","author":"J Yang","year":"2022","unstructured":"Yang, J., Lv, Z., Kuang, K., Yang, S., Xiao, L., Tang, Q.: RASN: using attention and sharing affinity features to address sample imbalance in facial expression recognition. IEEE Access 10, 103264\u2013103274 (2022)","journal-title":"IEEE Access"},{"key":"406_CR22","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S. J., Bourdev, L. D., Girshick, R. B., Hays, J., Perona, P., Ramanan, D., Dollar, P. and Zitnick, C. L.: Microsoft COCO: common objects in context. Computer Vision -Lecture Notes in Computer Science, vol. 8693, pp. 740\u2013755.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"406_CR23","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1007\/s11263-018-1140-0","volume":"127","author":"B Zhou","year":"2019","unstructured":"Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., Torralba, A.: Semantic understanding of scenes through ade20k dataset. Int. J. Comput. Vis. 127, 302\u2013321 (2019)","journal-title":"Int. J. Comput. Vis."},{"key":"406_CR24","doi-asserted-by":"publisher","first-page":"2545","DOI":"10.1007\/s11694-022-01367-5","volume":"16","author":"A Soleimanipour","year":"2022","unstructured":"Soleimanipour, A., Azadbakht, M., Rezaei Asl, A.: Cultivar identification of pistachio nuts in bulk mode through EfficientNet deep learning model. J. Food Measure. Characteriz. 16, 2545\u20132555 (2022)","journal-title":"J. Food Measure. Characteriz."},{"issue":"2","key":"406_CR25","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1080\/00405000.2020.1868672","volume":"113","author":"J Li","year":"2022","unstructured":"Li, J., Shi, W., Yang, D.: Fabric wrinkle evaluation model with regularized extreme learning machine based on improved Harris Hawks optimization. J. Textile Inst. 113(2), 199\u2013211 (2022)","journal-title":"J. Textile Inst."},{"key":"406_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.eswa.2020.114107","volume":"166","author":"D Po\u0142ap","year":"2021","unstructured":"Po\u0142ap, D., Wo\u017aniak, M.: Red fox optimization algorithm. Expert Syst. Appl. 166, 1\u201314 (2021)","journal-title":"Expert Syst. Appl."},{"issue":"2","key":"406_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.54060\/JIEEE\/002.02.018","volume":"2","author":"M Athavle","year":"2021","unstructured":"Athavle, M., Mudale, D., Shrivastav, U., Gupta, M.: Music recommendation based on face emotion recognition. J. Inf. Electric. Electron. Eng. (JIEEE) 2(2), 1\u201311 (2021)","journal-title":"J. Inf. Electric. Electron. Eng. (JIEEE)"},{"key":"406_CR28","doi-asserted-by":"publisher","first-page":"71311","DOI":"10.1109\/ACCESS.2022.3188730","volume":"10","author":"D Tarim","year":"2022","unstructured":"Tarim, D., Javed, A., Bourouis, S., Hussein, H.S., Alshazly, H.: Efficient-SwishNet based system for facial emotion recognition. IEEE Access 10, 71311\u201371328 (2022)","journal-title":"IEEE Access"},{"issue":"1","key":"406_CR29","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.gltp.2022.03.008","volume":"3","author":"D Nixon","year":"2022","unstructured":"Nixon, D., Mallappa, V.V., Petli, V., HosgurMath, S.: A novel AI therapy for depression counseling using face emotion techniques. Global Trans. Proc. 3(1), 190\u2013194 (2022)","journal-title":"Global Trans. Proc."},{"issue":"19","key":"406_CR30","first-page":"1","volume":"100","author":"S Agarwal","year":"2022","unstructured":"Agarwal, S., Mukesh Kumar Gupta, D.R.: Emotion detection using context based features using deep learning technique. J. Theor. Appl. Inf. Technol. 100(19), 1\u201312 (2022)","journal-title":"J. Theor. Appl. Inf. Technol."},{"key":"406_CR31","doi-asserted-by":"publisher","unstructured":"Jin, W., Yu, H. and Luo, X.: CvT-ASSD: convolutional vision-transformer based attentive single shot MultiBox detector. In: 2021 IEEE 33rd International Conference on Tools with Artificial Intelligence (ICTAI), Washington, DC, USA, pp. 736\u2013744 (2021). https:\/\/doi.org\/10.1109\/ICTAI52525.2021.00117","DOI":"10.1109\/ICTAI52525.2021.00117"},{"key":"406_CR32","doi-asserted-by":"publisher","first-page":"1011","DOI":"10.1007\/s10994-022-06198-5","volume":"112","author":"N Xia","year":"2023","unstructured":"Xia, N., Yu, H., Wang, Y., Xuan, J., Luo, X.: DAFS: a domain aware few shot generative model for event detection. Mach. Learn. 112, 1011\u20131031 (2023)","journal-title":"Mach. Learn."},{"key":"406_CR33","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.126519","author":"Y Lin","year":"2023","unstructured":"Lin, Y., Xu, C., Yu, H., Tian, P., Luo, X.: Incremental event detection via an improved knowledge distillation-based model. Neurocomputing (2023). https:\/\/doi.org\/10.1016\/j.neucom.2023.126519","journal-title":"Neurocomputing"},{"key":"406_CR34","unstructured":"https:\/\/www.kaggle.com\/datasets\/msambare\/fer2013"}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00406-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-024-00406-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00406-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,6]],"date-time":"2024-02-06T09:06:12Z","timestamp":1707210372000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-024-00406-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,6]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["406"],"URL":"https:\/\/doi.org\/10.1007\/s44196-024-00406-x","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,6]]},"assertion":[{"value":"6 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The author has no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"The paper is an original contribution of research and is not published elsewhere in any form or language.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"All authors mentioned have contributed towards the research work, drafting of the paper as well as have given consent for publishing of this article.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent Statement"}},{"value":"All authors listed above have consented to get their data and image published.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Publication"}},{"value":"No Humans or Animals were involved in the experimentation.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Humans or Animals Participant"}}],"article-number":"25"}}