{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T07:03:15Z","timestamp":1777705395072,"version":"3.51.4"},"reference-count":35,"publisher":"SAGE Publications","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,12,16]]},"abstract":"<jats:p>Ensemble learning using a set of deep convolutional neural networks (DCNNs) as weak classifiers has become a powerful tool for face expression. Nevertheless, training a DCNNS-based ensemble is not only time consuming but also gives rise to high redundancy due to the nature of DCNNs. In this paper, a novel DCNNs-based ensemble method, named weighted ensemble with angular feature learning (WDEA), is proposed to improve the computational efficiency and diversity of the ensemble. Specifically, the proposed ensemble consists of four parts including input layer, trunk layers, diversity layers and loss fusion. Among them, the trunk layers which are used to extract the local features of face images are shared by diversity layers such that the lower-level redundancy can be largely reduced. The independent branches enable the diversity of the ensemble. Rather than the traditional softmax loss, the angular softmax loss is employed to extract more discriminant deep feature representation. Moreover, a novel weighting technique is proposed to enhance the diversity of the ensemble. Extensive experiments were performed on CK+ and AffectNet. Experimental results demonstrate that the proposed WDEA outperforms existing ensemble learning methods on the recogntion rate and computational efficiency.<\/jats:p>","DOI":"10.3233\/jifs-210762","type":"journal-article","created":{"date-parts":[[2021,10,9]],"date-time":"2021-10-09T00:43:32Z","timestamp":1633740212000},"page":"6845-6857","source":"Crossref","is-referenced-by-count":1,"title":["Weighted ensemble with angular feature learning for facial expression recognition"],"prefix":"10.1177","volume":"41","author":[{"given":"Guojiang","family":"Han","sequence":"first","affiliation":[{"name":"College of Information Engineering, Yangzhou University, Yangzhou, China"}]},{"given":"Caikou","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Yangzhou University, Yangzhou, China"}]},{"given":"Zhixuan","family":"Xu","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Yangzhou University, Yangzhou, China"}]},{"given":"Shengwei","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Yangzhou University, Yangzhou, China"}]}],"member":"179","reference":[{"key":"10.3233\/JIFS-210762_ref1","unstructured":"Mehrabian R.J.A. A, An approach to environmental psychology, The MIT Press (1974)."},{"key":"10.3233\/JIFS-210762_ref2","first-page":"271","article-title":"Facial action coding system: a technique for the measurement of facial movement","volume":"24","author":"Ekman","year":"1978","journal-title":"Consulting Psychologists Press"},{"issue":"4","key":"10.3233\/JIFS-210762_ref3","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1037\/0003-066X.48.4.384","article-title":"Facial expression of emotion","volume":"48","author":"Keltner","year":"1993","journal-title":"American Psychologist"},{"issue":"1","key":"10.3233\/JIFS-210762_ref4","first-page":"72","article-title":"Core affect and the psychological construction of emotion","volume":"10","author":"Russell","year":"2003","journal-title":"Psychological Review"},{"issue":"1","key":"10.3233\/JIFS-210762_ref5","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.patcog.2011.05.006","article-title":"Facial expression recognition using radial encoding of local gabor features and classifier synthesis","volume":"45","author":"Gu","year":"2012","journal-title":"Pattern Recognition"},{"issue":"4","key":"10.3233\/JIFS-210762_ref6","doi-asserted-by":"crossref","first-page":"784","DOI":"10.21629\/JSEE.2017.04.18","article-title":"Identity-aware convolutional neural networks for facial expression recognition","volume":"28","author":"Zhang","year":"2017","journal-title":"Journal of Systems Engineering and Electronics"},{"key":"10.3233\/JIFS-210762_ref7","doi-asserted-by":"crossref","unstructured":"Liu X. , Vijaya Kumar B. , You J. , Jia P. , Adaptive deep metric learning for identity-aware facial expression recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2017), 20\u201329.","DOI":"10.1109\/CVPRW.2017.79"},{"key":"10.3233\/JIFS-210762_ref8","doi-asserted-by":"crossref","unstructured":"Yu Z. , Zhang C. , Image based static facial expression recognition with multiple deep network learning, in: Proceedings of the 2015 ACM on international conference on multimodal interaction, (2015), 435\u2013442.","DOI":"10.1145\/2818346.2830595"},{"key":"10.3233\/JIFS-210762_ref9","doi-asserted-by":"crossref","first-page":"4630","DOI":"10.1109\/ACCESS.2017.2784096","article-title":"Facial expression recognition using weighted mixture deep neural network based on double-channel facial images","volume":"6","author":"Yang","year":"2017","journal-title":"IEEE Access"},{"issue":"6","key":"10.3233\/JIFS-210762_ref10","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Communications of the ACM"},{"key":"10.3233\/JIFS-210762_ref12","doi-asserted-by":"crossref","unstructured":"He K. , Zhang X. , Ren S. , Sun J. , Deep residual learning for image recognition, in: Proceedings of the IEEE conference on computer vision and pattern recognition (2016), 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"10.3233\/JIFS-210762_ref13","doi-asserted-by":"crossref","unstructured":"Huang G. , Liu Z. , Van Der Maaten L. , Weinberger K.Q. , Densely connected convolutional networks, in: Proceedings of the IEEE conference on computer vision and pattern recognition (2017), 4700\u20134708.","DOI":"10.1109\/CVPR.2017.243"},{"key":"10.3233\/JIFS-210762_ref14","doi-asserted-by":"crossref","unstructured":"Sajjanhar A. , Wu Z. , Wen Q. , Deep learning models for facial expression recognition, in: 2018 Digital Image Computing: Techniques and Applications (DICTA), IEEE, (2018), 1\u20136.","DOI":"10.1109\/DICTA.2018.8615843"},{"issue":"9","key":"10.3233\/JIFS-210762_ref15","doi-asserted-by":"crossref","first-page":"6530","DOI":"10.1109\/TGRS.2019.2906883","article-title":"Hydra: An ensemble of convolutional neural networks for geospatial land classification","volume":"57","author":"Minetto","year":"2019","journal-title":"IEEE Transactions on Geoscience and Remote Sensing"},{"issue":"4","key":"10.3233\/JIFS-210762_ref16","doi-asserted-by":"crossref","first-page":"1002","DOI":"10.1109\/TPAMI.2017.2700390","article-title":"Trunk-branch ensemble convolutional neural networks for video-based face recognition","volume":"40","author":"Ding","year":"2017","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"10.3233\/JIFS-210762_ref18","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1016\/j.neucom.2017.08.043","article-title":"Facial expression recognition via learning deep sparse autoencoders","volume":"273","author":"Zeng","year":"2018","journal-title":"Neurocomputing"},{"key":"10.3233\/JIFS-210762_ref20","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.patrec.2019.01.008","article-title":"Extended deep neural network for facial emotion recognition","volume":"120","author":"Jain","year":"2019","journal-title":"Pattern Recognition Letters"},{"key":"10.3233\/JIFS-210762_ref21","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.patcog.2016.07.026","article-title":"Facial expression recognition with convolutional neural networks: coping with few data and the training sample order","volume":"61","author":"Lopes","year":"2017","journal-title":"Pattern Recognition"},{"key":"10.3233\/JIFS-210762_ref22","doi-asserted-by":"crossref","first-page":"4630","DOI":"10.1109\/ACCESS.2017.2784096","article-title":"Facial expression recognition using weighted mixture deep neural network based on double-channel facial images","volume":"6","author":"Yang","year":"2017","journal-title":"IEEE Access"},{"key":"10.3233\/JIFS-210762_ref23","doi-asserted-by":"crossref","unstructured":"Marrero Fernandez P.D. , Guerrero Pena F.A. , Ren T. , Cunha A. , Feratt: Facial expression recognition with attention net, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2019), 0\u20130.","DOI":"10.1109\/CVPRW.2019.00112"},{"issue":"1","key":"10.3233\/JIFS-210762_ref24","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"Journal of Computer and System Sciences"},{"issue":"5","key":"10.3233\/JIFS-210762_ref25","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1109\/TIP.2018.2886767","article-title":"Occlusion aware facial expression recognition using cnn with attention mechanism","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/JIFS-210762_ref27","first-page":"4886","article-title":"Meal: Multi-model ensemble via adversarial learning","volume":"33","author":"Shen","year":"2019","journal-title":"in: Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"10.3233\/JIFS-210762_ref28","first-page":"2672","article-title":"Generative adversarial nets","volume":"27","author":"Goodfellow","year":"2014","journal-title":"Advances in Neural Information Processing Systems"},{"key":"10.3233\/JIFS-210762_ref29","first-page":"3894","article-title":"Inter-class angular loss for convolutional neural networks","volume":"33","author":"Hui","year":"2019","journal-title":"in: Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"10.3233\/JIFS-210762_ref30","first-page":"8682","article-title":"Angular triplet-center loss for multi-view 3d shape retrieval","volume":"33","author":"Li","year":"2019","journal-title":"in: Proceedings of the AAAI Conference on Artificial Intelligence"},{"issue":"3","key":"10.3233\/JIFS-210762_ref31","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"International Journal of Computer Vision"},{"key":"10.3233\/JIFS-210762_ref32","doi-asserted-by":"crossref","unstructured":"Bottou L. , Large-scale machine learning with stochastic gradient descent, in: Proceedings of COMPSTAT\u20192010, Springer, (2010), 177\u2013186.","DOI":"10.1007\/978-3-7908-2604-3_16"},{"issue":"7","key":"10.3233\/JIFS-210762_ref33","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1109\/LSP.2018.2822810","article-title":"Additive margin softmax for face verification","volume":"25","author":"Wang","year":"2018","journal-title":"IEEE Signal Processing Letters"},{"key":"10.3233\/JIFS-210762_ref34","doi-asserted-by":"crossref","unstructured":"Lucey P. , Cohn J.F. , Kanade T. , Saragih J. , Ambadar Z. , Matthews I. . The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression, in: 2010 ieee computer society conference on computer vision and pattern recognition-workshops, IEEE (2010), 94\u2013101.","DOI":"10.1109\/CVPRW.2010.5543262"},{"issue":"1","key":"10.3233\/JIFS-210762_ref35","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/TAFFC.2017.2740923","article-title":"Affectnet: A database for facial expression, valence, and arousal computing in the wild","volume":"10","author":"Mollahosseini","year":"2017","journal-title":"IEEE Transactions on Affective Computing"},{"key":"10.3233\/JIFS-210762_ref38","doi-asserted-by":"crossref","unstructured":"Siqueira H. , Barros P. , Magg S. , Wermter S. , An ensemble with shared representations based on convolutional networks for continually learning facial expressions, in: 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, (2018), 1563\u20131568.","DOI":"10.1109\/IROS.2018.8594276"},{"key":"10.3233\/JIFS-210762_ref39","first-page":"2928","article-title":"Stochastic gradient descent tricks","volume":"7700","author":"L","year":"2012","journal-title":"Neural Networks: Tricks of the Trade"},{"key":"10.3233\/JIFS-210762_ref40","doi-asserted-by":"crossref","unstructured":"Selvaraju R.R. , Cogswell M. , Das A. , Vedantam R. , Parikh D. , Batra D. , Grad-cam: Visual explanations from deep networks via gradientbased localization, in: Proceedings of the IEEE international conference on computer vision, (2017), 618\u2013626.","DOI":"10.1109\/ICCV.2017.74"},{"key":"10.3233\/JIFS-210762_ref42","doi-asserted-by":"crossref","unstructured":"He K. , Zhang X. , Ren S. , Sun J. , Identity mappings in deep residual networks, in: European conference on computer vision, Springer, (2016), 630\u2013645.","DOI":"10.1007\/978-3-319-46493-0_38"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-210762","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:43:43Z","timestamp":1777455823000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-210762"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,16]]},"references-count":35,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.3233\/jifs-210762","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,16]]}}}