{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:52:35Z","timestamp":1777697555429,"version":"3.51.4"},"reference-count":28,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDT"],"published-print":{"date-parts":[[2023,5,15]]},"abstract":"<jats:p>Facial emotion recognition analysis is widely used in various social fields, including Law Enforcement for police interrogation, virtual assistants, hospitals for understanding patients\u2019 expressions, etc. In the field of medical treatment such as psychologically affected patients, patients undergoing difficult surgeries, etc require emotional recognition in real-time. The current emotional analysis employs interest points as landmarks in facial images affected by a few emotions Many researchers have proposed 7 different types of emotions (amusement, anger, disgust, fear, and sadness). In our work, we propose a deep learning-based multi-level graded facial emotions of 21 different types with our proposed facial emotional feature extraction technique called as Deep Facial Action Extraction Units (DFAEU). Then using our Multi-Class Artificial Neural Network (MCANN) architecture the model is trained to classify different emotions. The proposed method makes use of VGG-16 for the analysis of emotion grades. The performance of our model is evaluated using two algorithms Sparse Batch Normalization CNN (SBN-CNN) and CNN with Attention mechanism (ACNN) along with datasets Facial Emotion Recognition Challenge (FERC-2013). Our model outperforms 86.34 percent and 98.6 percent precision.<\/jats:p>","DOI":"10.3233\/idt-220301","type":"journal-article","created":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T11:41:22Z","timestamp":1673955682000},"page":"331-341","source":"Crossref","is-referenced-by-count":1,"title":["Multi-level graded facial emotion intensity recognition using MCANN for health care"],"prefix":"10.1177","volume":"17","author":[{"given":"Nazmin","family":"Begum","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A. Syed","family":"Mustafa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"3","key":"10.3233\/IDT-220301_ref1","doi-asserted-by":"crossref","first-page":"2285","DOI":"10.1007\/s11042-019-08397-0","article-title":"PRATIT: a CNN-based emotion recognition system using histogram equalization and data augmentation","volume":"79","author":"Mungra","year":"2020","journal-title":"Multimedia Tools and Applications"},{"key":"10.3233\/IDT-220301_ref2","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.neunet.2015.09.009","article-title":"Multimodal emotional state recognition using sequence-dependent deep hierarchical features","volume":"72","author":"Barros","year":"2015","journal-title":"Neural Networks"},{"issue":"4","key":"10.3233\/IDT-220301_ref3","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1007\/s12559-019-09654-y","article-title":"Facial expression recognition based on a hybrid model combining deep and shallow features","volume":"11","author":"Sun","year":"2019","journal-title":"Cognitive Computation"},{"issue":"3","key":"10.3233\/IDT-220301_ref4","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1109\/TAFFC.2019.2940224","article-title":"Spatio-temporal encoder-decoder fully convolutional network for video-based dimensional emotion recognition","volume":"12","author":"Du","year":"2019","journal-title":"IEEE Transactions on Affective Computing"},{"issue":"21","key":"10.3233\/IDT-220301_ref5","doi-asserted-by":"crossref","first-page":"4678","DOI":"10.3390\/app9214678","article-title":"Facial expression recognition using computer vision: A systematic review","volume":"9","author":"Canedo","year":"2019","journal-title":"Applied Sciences"},{"issue":"2","key":"10.3233\/IDT-220301_ref7","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1109\/4.996","article-title":"Design of an image edge detection filter using the Sobel operator","volume":"23","author":"Kanopoulos","year":"1988","journal-title":"IEEE Journal of Solid-state Circuits"},{"issue":"2","key":"10.3233\/IDT-220301_ref8","doi-asserted-by":"crossref","first-page":"2123","DOI":"10.32604\/cmc.2021.014782","article-title":"A machine learning approach for expression detection in healthcare monitoring systems","volume":"67","author":"Kashif","year":"2021","journal-title":"Computers, Materials & Continua"},{"key":"10.3233\/IDT-220301_ref9","first-page":"1","article-title":"An approach to face detection and recognition","author":"Meena","year":"2016","journal-title":"2016 International Conference on Recent Advances and Innovations in Engineering (ICRAIE)"},{"key":"10.3233\/IDT-220301_ref10","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1109\/ICISC.2018.8398861","article-title":"Facial emotion recognition in real-time and static images","author":"Gupta","year":"2018","journal-title":"2018 2nd International Conference on Inventive Systems and Control (ICISC)"},{"issue":"8","key":"10.3233\/IDT-220301_ref11","doi-asserted-by":"crossref","first-page":"5789","DOI":"10.1007\/s10462-021-09958-2","article-title":"Transformer models for text-based emotion detection: a review of BERT-based approaches","volume":"54","author":"Acheampong","year":"2021","journal-title":"Artificial Intelligence Review"},{"key":"10.3233\/IDT-220301_ref12","doi-asserted-by":"crossref","first-page":"3507","DOI":"10.1109\/ICASSP40776.2020.9053762","article-title":"Multimodal transformer fusion for continuous emotion recognition","author":"Huang","year":"2020","journal-title":"ICASSP 2020\u20132020 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP)"},{"key":"10.3233\/IDT-220301_ref13","unstructured":"Yu Z, Wang Y, Liu Z, Cheng X. EmotionXAntenna: An emotion detector with residual GRU and text CNN. Technical report. 2019."},{"issue":"12","key":"10.3233\/IDT-220301_ref14","doi-asserted-by":"crossref","first-page":"8971","DOI":"10.1007\/s00521-019-04230-9","article-title":"Text emotion detection in social networks using a novel ensemble classifier based on Parzen Tree Estimator (TPE)","volume":"31","author":"Ghanbari-Adivi","year":"2019","journal-title":"Neural Computing and Applications"},{"key":"10.3233\/IDT-220301_ref15","first-page":"1","article-title":"Real-Time Facial Expression Recognition using Facial Landmarks and Neural Networks","author":"Haghpanah","year":"2022","journal-title":"2022 International Conference on Machine Vision and Image Processing (MVIP)"},{"key":"10.3233\/IDT-220301_ref16","article-title":"Qiu, Y","volume":"1","author":"[16]","year":"2019","journal-title":"Wan, Facial Expression Recognition based on Landmarks"},{"key":"10.3233\/IDT-220301_ref17","first-page":"448","article-title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift","author":"Ioffe","year":"2015","journal-title":"International Conference on Machine Learning"},{"issue":"7","key":"10.3233\/IDT-220301_ref18","doi-asserted-by":"crossref","first-page":"2140","DOI":"10.1109\/TIP.2015.2416634","article-title":"Robust representation and recognition of facial emotions using extreme sparse learning","volume":"24","author":"Shojaeilangari","year":"2015","journal-title":"IEEE Transactions on Image Processing"},{"issue":"4","key":"10.3233\/IDT-220301_ref19","doi-asserted-by":"crossref","first-page":"1386","DOI":"10.1109\/TIP.2015.2405346","article-title":"Human facial expression recognition using stepwise linear discriminant analysis and hidden conditional random fields","volume":"24","author":"Siddiqi","year":"2015","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDT-220301_ref20","unstructured":"Simonyan K, Vedaldi A, Zisserman A. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034. 2013 Dec 20."},{"issue":"8","key":"10.3233\/IDT-220301_ref21","doi-asserted-by":"crossref","first-page":"3590","DOI":"10.1109\/TIP.2014.2331141","article-title":"Structure-preserving sparse decomposition for facial expression analysis","volume":"23","author":"Taheri","year":"2014","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDT-220301_ref22","first-page":"1701","article-title":"Deepface: Closing the gap to human-level performance in face verification","author":"Taigman","year":"2014","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"issue":"7","key":"10.3233\/IDT-220301_ref23","doi-asserted-by":"crossref","first-page":"2140","DOI":"10.1109\/TIP.2015.2416634","article-title":"Robust representation and recognition of facial emotions using extreme sparse learning","volume":"24","author":"Shojaeilangari","year":"2015","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDT-220301_ref24","first-page":"1","article-title":"Learning bayesian networks with qualitative constraints","author":"Tong","year":"2008","journal-title":"2008 IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"10.3233\/IDT-220301_ref25","first-page":"2746","article-title":"Web-scale training for face identification","author":"Taigman","year":"2015","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"10.3233\/IDT-220301_ref26","unstructured":"Simonyan K, Vedaldi A, Zisserman A. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034. 2013 Dec 20."},{"issue":"24","key":"10.3233\/IDT-220301_ref29","doi-asserted-by":"crossref","first-page":"4091","DOI":"10.3390\/electronics11244091","article-title":"Visual-GRoup AFFEct Recognition (V-GRAFFER): A Unified Application for Real-Time Group Concentration Estimation in E-Lectures","volume":"11","author":"Triantafyllou","year":"2022","journal-title":"Electronics"},{"key":"10.3233\/IDT-220301_ref30","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1117\/12.600746","article-title":"Multimodal approaches for emotion recognition: a survey","author":"Sebe","year":"2005","journal-title":"Internet Imaging VI"},{"key":"10.3233\/IDT-220301_ref31","doi-asserted-by":"crossref","unstructured":"Picard RW. Affective computing. MIT press; 2000 Jul 24.","DOI":"10.7551\/mitpress\/1140.001.0001"}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDT-220301","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:23:33Z","timestamp":1777454613000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDT-220301"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,15]]},"references-count":28,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/idt-220301","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"value":"1872-4981","type":"print"},{"value":"1875-8843","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,15]]}}}