{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:26:06Z","timestamp":1777695966014,"version":"3.51.4"},"reference-count":31,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2021,1,26]]},"abstract":"<jats:p>The goal of research in Facial Expression Recognition (FER) is to build a robust and strong recognizability model. In this paper, we propose a new scheme for FER systems based on convolutional neural network. Part of the regular convolution operation is replaced by depthwise separable convolution to reduce the number of parameters and the computational workload; the self-adaption joint loss function is adopted to improve the classification performance. In addition, we balance our train set through data augmentation, and we preprocess the input images through illumination processing, face detection, and other methods, effectively maximizing the expression recognition rate. Experiments to validate our methods are conducted based on the TensorFlow platform and Fer2013 dataset. We analyze the experimental results before and after train set balancing and network model modification, and we compare our results with those of other researchers. The results show that our method is effective at increasing the expression recognition rate under the same experiment conditions. We further conduct an experiment on our own expression dataset relevant to driving safety, and it yields similar results.<\/jats:p>","DOI":"10.3233\/ida-194965","type":"journal-article","created":{"date-parts":[[2021,2,2]],"date-time":"2021-02-02T14:48:53Z","timestamp":1612277333000},"page":"139-154","source":"Crossref","is-referenced-by-count":7,"title":["Efficient facial expression recognition based on convolutional neural network"],"prefix":"10.1177","volume":"25","author":[{"given":"Yongxiang","family":"Cai","sequence":"first","affiliation":[{"name":"School of Geosciences, Yangtze University, Wuhan, Hubei, China"},{"name":"State Key Laboratory of Geo-Information Engineering, Xi\u2019an, Shaanxi, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingwen","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Geosciences, Yangtze University, Wuhan, Hubei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gen","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Geosciences, Yangtze University, Wuhan, Hubei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuangang","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Geosciences, Yangtze University, Wuhan, Hubei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"4","key":"10.3233\/IDA-194965_ref1","first-page":"53","article-title":"Communication without words","volume":"2","author":"Mehrabian","year":"1968","journal-title":"Psychology Today"},{"key":"10.3233\/IDA-194965_ref2","unstructured":"T. Chang, G. Wen, Y. Hu and J.J. Ma, Facial expression recognition based on complexity perception classification algorithm, https:\/\/arxiv.org\/abs\/1803. 00185, 2018."},{"key":"10.3233\/IDA-194965_ref3","doi-asserted-by":"crossref","first-page":"26146","DOI":"10.1109\/ACCESS.2017.2777003","article-title":"Facial expression recognition using salient features and convolutional neural network","author":"Uddin","year":"2017","journal-title":"IEEE Access"},{"key":"10.3233\/IDA-194965_ref4","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.patcog.2016.07.026","article-title":"Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order","author":"Lopes","year":"2017","journal-title":"Pattern Recognition"},{"key":"10.3233\/IDA-194965_ref5","first-page":"1","article-title":"Supervised committee of convolutional neural networks in automated facial expression analysis","author":"Pons","year":"2017","journal-title":"IEEE Transactions on Affective Computing"},{"key":"10.3233\/IDA-194965_ref6","unstructured":"C. Jiwen, Slimming Convolutional Neural Networks with Depthwise Separable Convolutions, M.S. Dissertation, Xiamen University, 2018."},{"key":"10.3233\/IDA-194965_ref7","unstructured":"Y. Kim, B. Yoo, Y. Kwak, C. Choi and J. Kim, Deep generative contrastive networks for facial expression recognition, arXiv preprint arXiv:1703.07140, 2017."},{"key":"10.3233\/IDA-194965_ref8","first-page":"1","article-title":"Deep peak-neutral difference feature for facial expression recognition","author":"Chen","year":"2018","journal-title":"Multimedia Tools and Applications"},{"key":"10.3233\/IDA-194965_ref9","doi-asserted-by":"crossref","unstructured":"K. He, X. Zhang, S. Ren and J. Sun, Deep residual learning for image recognition, the IEEE Conference on Computer Vision and Pattern Recognition, pp.\u00a02016, 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"10.3233\/IDA-194965_ref10","doi-asserted-by":"crossref","unstructured":"F. Schroff, K. Dmitry and P. James, Facenet: A unified embedding for face recognition and clustering, the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp.\u00a0815\u2013823.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"10.3233\/IDA-194965_ref11","unstructured":"Y. Guo, D. Tao, J. Yu, H. Xiong, Y. Li and D. Tao, Deep neural networks with relativity learning for facial expression recognition, IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2016, pp.\u00a01\u20136."},{"issue":"S2","key":"10.3233\/IDA-194965_ref12","first-page":"55","article-title":"Deep face recognition combined with angular margin loss and center loss","volume":"39","author":"Li","year":"2019","journal-title":"Journal of Computer Applications"},{"key":"10.3233\/IDA-194965_ref15","doi-asserted-by":"crossref","unstructured":"T. Devries, K. Biswaranjan and W.T. Graham, Multi-task learning of facial landmarks and expression, Canadian Conference on Computer & Robot Vision CRV, 2014, pp.\u00a098\u2013103.","DOI":"10.1109\/CRV.2014.21"},{"key":"10.3233\/IDA-194965_ref16","doi-asserted-by":"crossref","unstructured":"Z. Zhang, P. Luo, L.C. Change et al., Learning social relation traits from face images, IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015, pp.\u00a03631\u20133639.","DOI":"10.1109\/ICCV.2015.414"},{"key":"10.3233\/IDA-194965_ref17","unstructured":"Y. Guo, D. Tao, J. Yu et al., Deep neural networks with relativity learning for facial expression recognition, IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Seattle, USA, 2016, pp.\u00a01\u20136."},{"key":"10.3233\/IDA-194965_ref18","unstructured":"K. Bo-Kyeong, D. Suh-Yeon, R. Jihyeon et al., Fusing aligned and non-aligned face information for automatic affect recognition in the wild: a deep learning approach, IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Las Vegas, USA, 2016, pp.\u00a01499\u20131508."},{"key":"10.3233\/IDA-194965_ref19","unstructured":"C. Pramerdorfer and M. Kampel, Facial expression recognition using convolutional neural networks: state of the art, https:\/\/arxiv.org\/abs\/1612.02903, 2016."},{"issue":"12","key":"10.3233\/IDA-194965_ref21","doi-asserted-by":"crossref","first-page":"2153","DOI":"10.3390\/s16122153","article-title":"Classification of Clouds in Satellite Imagery Using Adaptive Fuzzy Sparse Representation.","volume":"16","author":"Jin","year":"2016","journal-title":"Sensors"},{"key":"10.3233\/IDA-194965_ref23","doi-asserted-by":"crossref","unstructured":"F. Chollet, Xception: deep learning with depthwise separable convolutions, the 30th IEEE Conference on Computer Vision and Pattern Recognition Honolulu, HI, USA, 2017, pp.\u00a01800\u20131807.","DOI":"10.1109\/CVPR.2017.195"},{"key":"10.3233\/IDA-194965_ref24","doi-asserted-by":"crossref","unstructured":"C. Szegedy, W. Liu, Y. Jia et al., Going deeper with convolutions, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 2015, pp.\u00a01\u20139.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"10.3233\/IDA-194965_ref25","doi-asserted-by":"crossref","unstructured":"C. Szegedy, V. Vanhoucke, S. Ioffe et al., Re-thinking the Inception architecture for computer vision, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016, pp.\u00a02818\u20132826.","DOI":"10.1109\/CVPR.2016.308"},{"key":"10.3233\/IDA-194965_ref27","unstructured":"G. Lu, H. Zhu, Q. Hao and J. Yan, Facial expression recognition based on deep residual network, Journal of Data Acquisition and Processing 34(1) (2019), 50\u201357."},{"key":"10.3233\/IDA-194965_ref28","unstructured":"M.P. Omkar, V. Andrea and Z. Andrew, Deep face recognition, Proceedings of the 2015 British Machine Vision Conference, Guildford: BMVC Press, 2015, pp.\u00a01\u201312."},{"key":"10.3233\/IDA-194965_ref29","doi-asserted-by":"crossref","unstructured":"Y. Wen, K. Zhang, Z. Li et al., A discriminative feature learning approach for deep face recognition, Computer Vision \u2013 ECCV 2016 14th European Conference, Amsterdam, Netherlands, 2016, pp.\u00a0499\u2013515.","DOI":"10.1007\/978-3-319-46478-7_31"},{"issue":"8","key":"10.3233\/IDA-194965_ref31","first-page":"62","article-title":"Research on Image Recognition of Convolution Neural Network Based on Data Enhancement","volume":"28","author":"Gao","year":"2018","journal-title":"Computer Technology and Development"},{"key":"10.3233\/IDA-194965_ref32","doi-asserted-by":"crossref","unstructured":"K. Zhang, Z. Zhang and Z. Li, Joint face detection and alignment using multi-task cascaded convolutional networks, IEEE Signal Processing Letters 23(10) (2016), 1499\u20131503.","DOI":"10.1109\/LSP.2016.2603342"},{"key":"10.3233\/IDA-194965_ref33","doi-asserted-by":"crossref","unstructured":"W. Jin, F. Gong, X. Zeng and R. Fu, Illumination robust face recognition using random projection and sparse representation, Signal Image and Video Processing 12(4) (2018), 721\u2013729.","DOI":"10.1007\/s11760-017-1213-5"},{"issue":"2","key":"10.3233\/IDA-194965_ref34","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"International Journal of Computer Vision"},{"key":"10.3233\/IDA-194965_ref35","first-page":"59","article-title":"Challenges in representation learning: a report on three machine learning contests","author":"Ian","year":"2015","journal-title":"Neural Networks"},{"issue":"2","key":"10.3233\/IDA-194965_ref36","first-page":"0227","article-title":"Expression recognition algorithm for parallel convolutional neural networks","volume":"24","author":"Xu","year":"2019","journal-title":"Journal of Image and Graphics"},{"issue":"24","key":"10.3233\/IDA-194965_ref37","first-page":"12","article-title":"Multi-view facial expression recognition based on improved convolutional neural network","volume":"54","author":"Qian","year":"2018","journal-title":"Computer Engineering and Applications"}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-194965","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:18:55Z","timestamp":1777454335000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-194965"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,26]]},"references-count":31,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/ida-194965","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,26]]}}}