{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T15:13:01Z","timestamp":1770045181472,"version":"3.49.0"},"reference-count":41,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,8,11]]},"abstract":"<jats:p>Facial expression recognition (FER) has been an active research area in recent years, which plays a vital role in national security and human-computer interaction. Due to the lacking of sufficient expression features and facial images, it is challenging to automatically recognize facial expression with high accuracy. In this paper, we propose a fusion handcraft feature method to improve FER from images. Firstly, a new texture feature extraction method PD-LDN (Pixel Difference Local Directional Number pattern) is proposed, which can extract more local information, reduce noise disturbance and feature dimension. Secondly, the handcrafted features including PD-LDN texture features, geometric features, and BOVW (Bag of Visual Words) semantic features are connected in parallel to an improved autoencoder network for fusion. Finally, the fused features are input into the softmax classifier for recognizing facial expression. We conduct extensive experiments on JAFFE and CK+datasets. Our proposed method shows superior performance than the state-of-the-art approaches on recognizing facial expressions.<\/jats:p>","DOI":"10.3233\/jifs-200713","type":"journal-article","created":{"date-parts":[[2021,6,15]],"date-time":"2021-06-15T13:53:28Z","timestamp":1623765208000},"page":"113-123","source":"Crossref","is-referenced-by-count":4,"title":["Facial expression recognition with fused handcraft features based on pixel difference local directional number pattern"],"prefix":"10.1177","volume":"41","author":[{"given":"Yan","family":"Wang","sequence":"first","affiliation":[{"name":"College of Information Engineering, Tianjin University of Commerce, Tianjin, China"}]},{"given":"Jianchun","family":"Wang","sequence":"additional","affiliation":[{"name":"Agriculture Information Department in Institute of Information, Tianjin Academy of Agricultural Sciences, Tianjin, China"}]},{"given":"Yanju","family":"Li","sequence":"additional","affiliation":[{"name":"Agriculture Information Department in Institute of Information, Tianjin Academy of Agricultural Sciences, Tianjin, China"}]},{"given":"Ming","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Hebei University of Technology, Tianjin, China"}]},{"given":"Yancong","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Tianjin University of Commerce, Tianjin, China"}]},{"given":"Bo","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Tianjin University of Commerce, Tianjin, China"}]}],"member":"179","reference":[{"issue":"10","key":"10.3233\/JIFS-200713_ref1","doi-asserted-by":"crossref","first-page":"974","DOI":"10.1109\/34.799905","article-title":"Classifying facial actions","volume":"21","author":"Donato","year":"1999","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"4","key":"10.3233\/JIFS-200713_ref2","doi-asserted-by":"crossref","first-page":"1446","DOI":"10.3758\/s13428-017-0996-1","article-title":"Facial expression analysis with AFFDEX and FACET: A validation study","volume":"50","author":"St\u00f6ckli","year":"2018","journal-title":"Behavior Research Methods"},{"issue":"15","key":"10.3233\/JIFS-200713_ref3","doi-asserted-by":"crossref","first-page":"5577","DOI":"10.1007\/s11042-014-1869-6","article-title":"A survey on facial expression recognition in 3D video sequences","volume":"74","author":"Danelakis","year":"2015","journal-title":"Multimedia Tools and Applications"},{"issue":"15","key":"10.3233\/JIFS-200713_ref4","doi-asserted-by":"crossref","first-page":"6195","DOI":"10.1016\/j.ijleo.2016.04.015","article-title":"Facial expression recognition on real world face images using intelligent techniques: A survey","volume":"127","author":"Khan","year":"2016","journal-title":"Optik"},{"issue":"1","key":"10.3233\/JIFS-200713_ref5","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1186\/s13640-017-0190-5","article-title":"Improved gradient local ternary patterns for facial expression recognition","volume":"17","author":"Holder","year":"2017","journal-title":"EURASIP Journal on Image and Video Processing"},{"issue":"4","key":"10.3233\/JIFS-200713_ref6","doi-asserted-by":"crossref","first-page":"712","DOI":"10.3390\/s17040712","article-title":"Facial expression recognition with fusion features extracted from salient facial areas","volume":"17","author":"Liu","year":"2017","journal-title":"Sensors"},{"issue":"12","key":"10.3233\/JIFS-200713_ref7","doi-asserted-by":"crossref","first-page":"2528","DOI":"10.1109\/TMM.2016.2598092","article-title":"A deep neural network-driven feature learning method for multi-view facial expression recognition","volume":"18","author":"Zhang","year":"2016","journal-title":"IEEE Transactions on Multimedia"},{"issue":"8","key":"10.3233\/JIFS-200713_ref8","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1007\/s11760-017-1111-x","article-title":"Rotation-reversal invariant HOG cascade for facial expression recognition","volume":"11","author":"Chen","year":"2017","journal-title":"Signal, Image and Video Processing"},{"key":"10.3233\/JIFS-200713_ref10","unstructured":"Kwon S. , Kim J. and Lee D. , ROI analysis for remote photoplethysmography on facial video, 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (2015), 4938\u20134941."},{"key":"10.3233\/JIFS-200713_ref11","doi-asserted-by":"crossref","unstructured":"Jabid T. , Kabir M.H. and Chae O. , Facial expression recognition using local directional pattern, IEEE International Conference on Image Processing (2010), 1605\u20131608.","DOI":"10.1109\/ICIP.2010.5652374"},{"key":"10.3233\/JIFS-200713_ref12","doi-asserted-by":"crossref","unstructured":"Wang Z. and Ying Z. , Facial expression recognition based on local phase quantization and sparse representation, 8th International Conference on Natural Computation (2012), 222\u2013225.","DOI":"10.1109\/ICNC.2012.6234551"},{"key":"10.3233\/JIFS-200713_ref13","doi-asserted-by":"crossref","unstructured":"Shokoohi Z. , Bahmanjeh R. and Faez K. , Expression recognition using directional gradient local pattern and gradient-based ternary texture patterns, 2nd International Conference on Pattern Recognition and Image Analysis (2015), 1\u20137.","DOI":"10.1109\/PRIA.2015.7161615"},{"issue":"3","key":"10.3233\/JIFS-200713_ref14","doi-asserted-by":"crossref","first-page":"19409","DOI":"10.1109\/ACCESS.2017.2737821","article-title":"Facial expression recognition from image based on LBP and Taylor expansion","volume":"5","author":"Ding","year":"2017","journal-title":"IEEE Access"},{"issue":"1","key":"10.3233\/JIFS-200713_ref15","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.patcog.2011.05.006","article-title":"Facial expression recognition using radial encoding of local Gabor features and classifier synthesis","volume":"45","author":"Gu","year":"2012","journal-title":"Pattern Recognition"},{"issue":"15","key":"10.3233\/JIFS-200713_ref16","doi-asserted-by":"crossref","first-page":"6195","DOI":"10.1016\/j.ijleo.2016.04.015","article-title":"Facial expression recognition on real world face images using intelligent techniques: A survey","volume":"127","author":"Khan","year":"2016","journal-title":"Optik"},{"key":"10.3233\/JIFS-200713_ref17","doi-asserted-by":"crossref","unstructured":"Durmu\u015fo\u011flu A. and Kahraman Y. , Facial expression recognition using geometric features, International Conference on Systems, Signals and Image Processing (2016), 1\u20135.","DOI":"10.1109\/IWSSIP.2016.7502700"},{"issue":"16","key":"10.3233\/JIFS-200713_ref18","doi-asserted-by":"crossref","first-page":"7714","DOI":"10.3390\/s130607714","article-title":"Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines","volume":"13","author":"Ghimire","year":"2013","journal-title":"Sensors"},{"issue":"3","key":"10.3233\/JIFS-200713_ref19","first-page":"420","article-title":"A novel facial expression recognition method based on semantic knowledge of analytical hierarchy process","volume":"16","author":"Hu","year":"2018","journal-title":"Journal of Image and Graphics"},{"key":"10.3233\/JIFS-200713_ref20","doi-asserted-by":"crossref","unstructured":"Harrati N. , Bouchrika I. and Tari A. , Automated classification of facial expressions using bag of visual words and texture-based features, 16th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering (2015), 363\u2013367.","DOI":"10.1109\/STA.2015.7505100"},{"key":"10.3233\/JIFS-200713_ref21","doi-asserted-by":"crossref","unstructured":"Kumari J. , Rajesh R. and Kumar A. , Fusion of features for the effective facial expression recognition, International Conference on Communication and Signal Processing (2016), 0457\u20130461.","DOI":"10.1109\/ICCSP.2016.7754178"},{"issue":"6","key":"10.3233\/JIFS-200713_ref22","first-page":"1338","article-title":"Facial expression recognition based on local texture and shape features","volume":"40","author":"Hu","year":"2018","journal-title":"Journal of Electronics & Information Technology"},{"key":"10.3233\/JIFS-200713_ref23","doi-asserted-by":"crossref","unstructured":"Chen J. , Chen Z. and Chi Z. , Dynamic texture and geometry features for facial expression recognition in video, IEEE International Conference on Image Processing (2015), 4967\u20134971.","DOI":"10.1109\/ICIP.2015.7351752"},{"issue":"9","key":"10.3233\/JIFS-200713_ref24","first-page":"1473","article-title":"Occluded facial expression recognition based on the fusion of local features","volume":"21","author":"Wang","year":"2016","journal-title":"Journal of Image and Graphics"},{"issue":"3","key":"10.3233\/JIFS-200713_ref25","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1504\/IJES.2018.091775","article-title":"Multiple features fusion for facial expression recognition based on ELM","volume":"10","author":"Yang","year":"2018","journal-title":"International Journal of Embedded Systems"},{"key":"10.3233\/JIFS-200713_ref26","doi-asserted-by":"crossref","unstructured":"Chen X. , Yang X. and Wang M. , Convolution neural network for automatic facial expression recognition, International Conference on Applied SystemInnovation (2017), 814\u2013817.","DOI":"10.1109\/ICASI.2017.7988558"},{"key":"10.3233\/JIFS-200713_ref27","doi-asserted-by":"crossref","unstructured":"Liu P. , Han S. and Meng Z. , Facial expression recognition via a boosted deep belief network, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2014), 1805\u20131812.","DOI":"10.1109\/CVPR.2014.233"},{"issue":"8","key":"10.3233\/JIFS-200713_ref28","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.patcog.2016.07.026","article-title":"Facial expression recognition with convolutional neural networks: coping with few data and the training sample order","volume":"61","author":"Lopes","year":"2017","journal-title":"Pattern Recognition"},{"issue":"6","key":"10.3233\/JIFS-200713_ref29","doi-asserted-by":"crossref","first-page":"4630","DOI":"10.1109\/ACCESS.2017.2784096","article-title":"Facial expression recognition using weighted mixture deep neural network based on double-channel facial images","volume":"8","author":"Yang","year":"2018","journal-title":"IEEE Access"},{"issue":"4","key":"10.3233\/JIFS-200713_ref30","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1049\/el.2016.4328","article-title":"Facial expression recognition with FRR-CNN","volume":"53","author":"Xie","year":"2017","journal-title":"Electronics Letters"},{"issue":"5","key":"10.3233\/JIFS-200713_ref31","first-page":"268","article-title":"Face expression detection on kinect using activeappearance model and fuzzy logic","volume":"59","author":"Gunawan","year":"2015","journal-title":"Procedia Computer Science"},{"issue":"5","key":"10.3233\/JIFS-200713_ref32","doi-asserted-by":"crossref","first-page":"1740","DOI":"10.1109\/TIP.2012.2235848","article-title":"Local directional number pattern for face analysis: Face and expression recognition","volume":"22","author":"Rivera","year":"2013","journal-title":"IEEE Transactions on Image Processing"},{"issue":"5","key":"10.3233\/JIFS-200713_ref33","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1016\/S0146-664X(77)80024-5","article-title":"Edge detection by compass gradient mask","volume":"6","author":"G\u00fcner","year":"1977","journal-title":"Computer Graphics and Image Processing"},{"issue":"2","key":"10.3233\/JIFS-200713_ref35","first-page":"170","article-title":"Application of generative autoencoder in denovo molecular design","volume":"37","author":"Blaschke","year":"2018","journal-title":"Molecular Informatics"},{"issue":"6","key":"10.3233\/JIFS-200713_ref36","first-page":"128","article-title":"Diagnosis of electrical corrosion fault in wind turbine generator bearing based on vibration signal analysis","volume":"52","author":"Jiang","year":"2019","journal-title":"Electric Power"},{"key":"10.3233\/JIFS-200713_ref37","unstructured":"Lyons M. , Hamamatsu S. and Kamachi M. , Coding facial yexpressions with gabor wavelets, Proceedings 3rd IEEE International Conference on Automatic Face and Gesture Recognition (1998), 200\u2013205."},{"key":"10.3233\/JIFS-200713_ref38","doi-asserted-by":"crossref","unstructured":"Lucey P. , Cohn J.F. and Kanade T. , The extended cohn-kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression, IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops (2010), 94\u2013101.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"10.3233\/JIFS-200713_ref39","doi-asserted-by":"crossref","unstructured":"Li J. and Lam E. , Facial expression recognition using deep neural networks, IEEE International Conference on Imaging Systems and Techniques (2015), 1\u20136.","DOI":"10.1109\/IST.2015.7294547"},{"key":"10.3233\/JIFS-200713_ref40","doi-asserted-by":"crossref","unstructured":"Lv Y. , Feng Z. and Xu C. , Facial expression recognition via deep learning, International Conference on Smart Computing. IEEE Computer Society (2015), 303\u2013308.","DOI":"10.1109\/SMARTCOMP.2014.7043872"},{"key":"10.3233\/JIFS-200713_ref42","doi-asserted-by":"crossref","unstructured":"Ghimire D. , Jeong S. , Yoon S. , et al., Facial expression recognition based on region specific appearance and geometric features, 10th International Conference on Digital Information Management (2016), 142\u2013147.","DOI":"10.1109\/ICDIM.2015.7381857"},{"key":"10.3233\/JIFS-200713_ref43","doi-asserted-by":"crossref","unstructured":"Happy S.L. and Routray A. , Robust facial expression classification using shape and appearance features, 8th International Conference on Advances in Pattern Recognition (2015), 1\u20135.","DOI":"10.1109\/ICAPR.2015.7050661"},{"key":"10.3233\/JIFS-200713_ref44","doi-asserted-by":"crossref","unstructured":"Liu P. , Han S. , Meng Z. , et al., Facial expression recognition via a boost deep belief network, IEEE Conference on Computer Vision and Pattern Recognition (2015), 1805\u20131812.","DOI":"10.1109\/CVPR.2014.233"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-200713","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T03:16:59Z","timestamp":1770002219000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-200713"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,11]]},"references-count":41,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/jifs-200713","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,11]]}}}