{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:41:23Z","timestamp":1780357283918,"version":"3.54.1"},"reference-count":62,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T00:00:00Z","timestamp":1745452800000},"content-version":"vor","delay-in-days":113,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100010226","name":"Department of Education of Guangdong Province","doi-asserted-by":"publisher","award":["2024GCZX014"],"award-info":[{"award-number":["2024GCZX014"]}],"id":[{"id":"10.13039\/501100010226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010226","name":"Department of Education of Guangdong Province","doi-asserted-by":"publisher","award":["6022210111K"],"award-info":[{"award-number":["6022210111K"]}],"id":[{"id":"10.13039\/501100010226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010226","name":"Department of Education of Guangdong Province","doi-asserted-by":"publisher","award":["2022ZDZX3071"],"award-info":[{"award-number":["2022ZDZX3071"]}],"id":[{"id":"10.13039\/501100010226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004242","name":"Princess Nourah Bint Abdulrahman University","doi-asserted-by":"publisher","award":["PNURSP2025R 343"],"award-info":[{"award-number":["PNURSP2025R 343"]}],"id":[{"id":"10.13039\/501100004242","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012840","name":"Shenzhen Polytechnic","doi-asserted-by":"publisher","award":["6024331021K"],"award-info":[{"award-number":["6024331021K"]}],"id":[{"id":"10.13039\/100012840","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Intelligent Systems"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:p>Human emotion recognition (HER) has rapidly advanced, with applications in intelligent customer service, adaptive system training, human\u2013robot interaction (HRI), and mental health monitoring. HER\u2019s primary goal is to accurately recognize and classify emotions from digital inputs. Emotion recognition (ER) and feature extraction have long been core elements of HER, with deep neural networks (DNNs), particularly convolutional neural networks (CNNs), playing a critical role due to their superior visual feature extraction capabilities. This study proposes improving HER by integrating EfficientNet with transfer learning (TL) to train CNNs. Initially, an efficient R\u2010CNN accurately recognizes faces in online and offline videos. The ensemble classification model is trained by combining features from four CNN models using feature pooling. The novel VGG\u201019 block is used to enhance the Faster R\u2010CNN learning block, boosting face recognition efficiency and accuracy. The model benefits from fully connected mean pooling, dense pooling, and global dropout layers, solving the evanescent gradient issue. Tested on CK+, FER\u20102013, and the custom novel HER dataset (HERD), the approach shows significant accuracy improvements, reaching 89.23% (CK+), 94.36% (FER\u20102013), and 97.01% (HERD), proving its robustness and effectiveness.<\/jats:p>","DOI":"10.1155\/int\/6611276","type":"journal-article","created":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T05:52:12Z","timestamp":1745473932000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Novel Emotion Recognition System for Human\u2013Robot Interaction (HRI) Using Deep Ensemble Classification"],"prefix":"10.1155","volume":"2025","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8212-4696","authenticated-orcid":false,"given":"Khalid","family":"Zaman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6833-1594","authenticated-orcid":false,"given":"Gan","family":"Zengkang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7382-0892","authenticated-orcid":false,"given":"Sun","family":"Zhaoyun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sayyed Mudassar","family":"Shah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1700-0299","authenticated-orcid":false,"given":"Waqar","family":"Riaz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiancheng (Charles)","family":"Ji","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4761-0346","authenticated-orcid":false,"given":"Tariq","family":"Hussain","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9819-7945","authenticated-orcid":false,"given":"Razaz Waheeb","family":"Attar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2025,4,24]]},"reference":[{"key":"e_1_2_10_1_2","doi-asserted-by":"publisher","DOI":"10.1109\/access.2022.3200762"},{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-019-00524-z"},{"key":"e_1_2_10_3_2","doi-asserted-by":"crossref","unstructured":"ZhaoX.andWeiC. A Real-Time Face Recognition System Based on the Improved LBPH Algorithm 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP) 2017 IEEE 72\u201376.","DOI":"10.1109\/SIPROCESS.2017.8124508"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.3390\/sym14040687"},{"key":"e_1_2_10_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-018-01142-4"},{"key":"e_1_2_10_6_2","doi-asserted-by":"crossref","unstructured":"AdeyanjuI. A. OmidioraE. O. andOyedokunO. F. Performance Evaluation of Different Support Vector Machine Kernels for Face Emotion Recognition 2015 SAI Intelligent Systems Conference (IntelliSys) 2015 November IEEE 804\u2013806.","DOI":"10.1109\/IntelliSys.2015.7361233"},{"key":"e_1_2_10_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/taffc.2017.2713783"},{"key":"e_1_2_10_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/access.2019.2928364"},{"key":"e_1_2_10_9_2","doi-asserted-by":"crossref","unstructured":"FariaD. R. VieiraM. andFariaF. C. Towards the Development of Affective Facial Expression Recognition for Human-Robot Interaction Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments 2017 300\u2013304 https:\/\/doi.org\/10.1145\/3056540.3076199 2-s2.0-85025124790.","DOI":"10.1145\/3056540.3076199"},{"key":"e_1_2_10_10_2","first-page":"1188","article-title":"Lightweight CNN-Based Expression Recognition on Humanoid Robot","volume":"14","author":"Zhao G.","year":"2020","journal-title":"KSII Transactions on Internet and Information Systems (TIIS)"},{"key":"e_1_2_10_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scitotenv.2019.135484"},{"key":"e_1_2_10_12_2","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/6005446"},{"key":"e_1_2_10_13_2","unstructured":"LittlewortW. JacobW. WuT.et al. The Computer Expression Recognition Toolbox Proceedings of IEEE International Conference on Automatic Face & Gesture Recognition & Workshops 2011 IEEE 298\u2013305."},{"key":"e_1_2_10_14_2","doi-asserted-by":"crossref","unstructured":"LittlewortG. WhitehillJ. WuT.et al. The Computer Expression Recognition Toolbox (CERT) 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG) 2011 IEEE 298\u2013305.","DOI":"10.1109\/FG.2011.5771414"},{"key":"e_1_2_10_15_2","doi-asserted-by":"publisher","DOI":"10.3390\/brainsci11060734"},{"key":"e_1_2_10_16_2","doi-asserted-by":"publisher","DOI":"10.37391\/ijeer.100103"},{"key":"e_1_2_10_17_2","doi-asserted-by":"publisher","DOI":"10.3390\/s18113993"},{"key":"e_1_2_10_18_2","doi-asserted-by":"crossref","unstructured":"SasteS. T.andJagdaleS. M. Emotion Recognition From Speech Using MFCC and DWT for Security System 1 2017 International Conference of Electronics Communication and Aerospace Technology (ICECA) 2017 IEEE 701\u2013704 https:\/\/doi.org\/10.1109\/iceca.2017.8203631 2-s2.0-85042799558.","DOI":"10.1109\/ICECA.2017.8203631"},{"key":"e_1_2_10_19_2","unstructured":"ChenJ. ChenZ. ChiZ. andFuH. Facial Expression Recognition Based on Facial Components Detection and Hog Features International Workshops on Electrical and Computer Engineering Subfields 2014 884\u2013888."},{"key":"e_1_2_10_20_2","doi-asserted-by":"crossref","unstructured":"LuceyP. CohnJ. F. KanadeT. SaragihJ. AmbadarZ. andMatthewsI. The Extended Cohn-Kanade Dataset (CK+): A Complete Dataset for Action Unit and Emotion-Specified Expression 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops 2010 IEEE 94\u2013101.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"e_1_2_10_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2020.106798"},{"key":"e_1_2_10_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-022-07292-4"},{"key":"e_1_2_10_23_2","doi-asserted-by":"crossref","unstructured":"MollahosseiniA. ChanD. andMahoorM. H. Going Deeper in Facial Expression Recognition Using Deep Neural Networks 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) 2016 IEEE 1\u201310.","DOI":"10.1109\/WACV.2016.7477450"},{"key":"e_1_2_10_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2022.03.017"},{"key":"e_1_2_10_25_2","doi-asserted-by":"crossref","unstructured":"JiangH.andLearned-MillerE. Face Detection With the Faster R-CNN 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) 2017 IEEE 650\u2013657.","DOI":"10.1109\/FG.2017.82"},{"key":"e_1_2_10_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2024.3470042"},{"key":"e_1_2_10_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2020.106798"},{"key":"e_1_2_10_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/jstsp.2017.2764438"},{"key":"e_1_2_10_29_2","doi-asserted-by":"crossref","unstructured":"ZhangW. QiuF. WangS.et al. Transformer-Based Multimodal Information Fusion for Facial Expression Analysis Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition 2022 2428\u20132437.","DOI":"10.1109\/CVPRW56347.2022.00271"},{"key":"e_1_2_10_30_2","volume-title":"MnasNet: Platform-Aware Neural Architecture Search for Mobile","author":"Tan M.","year":"2019"},{"key":"e_1_2_10_31_2","doi-asserted-by":"crossref","unstructured":"BolioliA. BoscaA. DamianoR. LietoA. andStrianiM. A Complementary Account to Emotion Extraction and Classification in Cultural Heritage Based on the Plutchik\u2019s Theory Adjunct Proceedings of the 30th ACM Conference on User Modeling Adaptation and Personalization 2022 374\u2013382 https:\/\/doi.org\/10.1145\/3511047.3537659.","DOI":"10.1145\/3511047.3537659"},{"key":"e_1_2_10_32_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0266442"},{"key":"e_1_2_10_33_2","doi-asserted-by":"crossref","unstructured":"HuoY.andZhangL. OCFER-Net: Recognizing Facial Expression in Online Learning System Proceedings of the 2022 International Conference on Advanced Visual Interfaces 2022 1\u20133 https:\/\/doi.org\/10.1145\/3531073.3534470.","DOI":"10.1145\/3531073.3534470"},{"key":"e_1_2_10_34_2","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/4623188"},{"key":"e_1_2_10_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2022.106621"},{"key":"e_1_2_10_36_2","volume-title":"Pattern Recognition and Event Detection on Iot Data-Streams","author":"Karras C.","year":"2022"},{"key":"e_1_2_10_37_2","doi-asserted-by":"publisher","DOI":"10.3390\/math11030776"},{"key":"e_1_2_10_38_2","doi-asserted-by":"crossref","unstructured":"BarsoumE. ZhangC. FerrerC. C. andZhangZ. Training Deep Networks for Facial Expression Recognition With Crowd-Sourced Label Distribution Proceedings of the 18th ACM International Conference on Multimodal Interaction 2016 279\u2013283 https:\/\/doi.org\/10.1145\/2993148.2993165 2-s2.0-85016568635.","DOI":"10.1145\/2993148.2993165"},{"key":"e_1_2_10_39_2","article-title":"Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognition","volume":"29","author":"Han S.","year":"2016","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_10_40_2","doi-asserted-by":"crossref","unstructured":"MengZ. LiuP. CaiJ. HanS. andTongY. Identity-Aware Convolutional Neural Network for Facial Expression Recognition 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) 2017 IEEE 558\u2013565.","DOI":"10.1109\/FG.2017.140"},{"key":"e_1_2_10_41_2","volume-title":"Feratt: Facial Expression Recognition With Attention Net","author":"Fernandez P. M.","year":"2019"},{"key":"e_1_2_10_42_2","doi-asserted-by":"crossref","unstructured":"WangK. PengX. YangJ. LuS. andQiaoY. Suppressing Uncertainties for Large-Scale Facial Expression Recognition Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition 2020 6897\u20136906.","DOI":"10.1109\/CVPR42600.2020.00693"},{"key":"e_1_2_10_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2019.2956143"},{"key":"e_1_2_10_44_2","doi-asserted-by":"crossref","unstructured":"YahyaouiM. A. OujabourM. LetaifaL. B. andBohiA. Multi-Face Emotion Detection for Effective Human-Robot Interaction International Conference on Agents and Artificial Intelligence 2025.","DOI":"10.5220\/0013170300003890"},{"key":"e_1_2_10_45_2","first-page":"117","volume-title":"Lecture Notes in Computer Science","author":"Goodfellow I. J.","year":"2013"},{"key":"e_1_2_10_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2020.04.163"},{"key":"e_1_2_10_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/access.2020.2963913"},{"key":"e_1_2_10_48_2","doi-asserted-by":"crossref","unstructured":"El BoudouriY.andBohiA. Emonext: An Adapted Convnext for Facial Emotion Recognition 2023 IEEE 25th International Workshop on Multimedia Signal Processing (MMSP) 2023 IEEE 1\u20136.","DOI":"10.1109\/MMSP59012.2023.10337732"},{"key":"e_1_2_10_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2021.3126876"},{"key":"e_1_2_10_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssci.2024.106633"},{"key":"e_1_2_10_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-024-03563-4"},{"key":"e_1_2_10_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-024-01568-6"},{"key":"e_1_2_10_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jii.2024.100759"},{"key":"e_1_2_10_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/tie.2020.2970680"},{"key":"e_1_2_10_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.121097"},{"key":"e_1_2_10_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-023-15066-w"},{"key":"e_1_2_10_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/taffc.2023.3282704"},{"key":"e_1_2_10_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548025"},{"key":"e_1_2_10_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/lsp.2021.3078698"},{"key":"e_1_2_10_60_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/6971100"},{"key":"e_1_2_10_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/tcyb.2014.2362101"},{"key":"e_1_2_10_62_2","doi-asserted-by":"crossref","unstructured":"ZhengW.-L. DongB.-N. andLuB.-L. Multimodal Emotion Recognition Using EEG and Eye Tracking Data 2014 Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2014 5040\u20135043 https:\/\/doi.org\/10.1109\/EMBC.2014.6944757 2-s2.0-84929464757.","DOI":"10.1109\/EMBC.2014.6944757"}],"container-title":["International Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/int\/6611276","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1155\/int\/6611276","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/int\/6611276","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T18:15:38Z","timestamp":1772993738000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/int\/6611276"}},"subtitle":[],"editor":[{"given":"Stefano","family":"Cirillo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10.1155\/int\/6611276"],"URL":"https:\/\/doi.org\/10.1155\/int\/6611276","archive":["Portico"],"relation":{},"ISSN":["0884-8173","1098-111X"],"issn-type":[{"value":"0884-8173","type":"print"},{"value":"1098-111X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"2024-10-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-19","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"6611276"}}