{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T06:16:55Z","timestamp":1768457815013,"version":"3.49.0"},"reference-count":38,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2019,11,28]],"date-time":"2019-11-28T00:00:00Z","timestamp":1574899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Yong Song","award":["61573213"],"award-info":[{"award-number":["61573213"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>As an important part of emotion research, facial expression recognition is a necessary requirement in human\u2013machine interface. Generally, a face expression recognition system includes face detection, feature extraction, and feature classification. Although great success has been made by the traditional machine learning methods, most of them have complex computational problems and lack the ability to extract comprehensive and abstract features. Deep learning-based methods can realize a higher recognition rate for facial expressions, but a large number of training samples and tuning parameters are needed, and the hardware requirement is very high. For the above problems, this paper proposes a method combining features that extracted by the convolutional neural network (CNN) with the C4.5 classifier to recognize facial expressions, which not only can address the incompleteness of handcrafted features but also can avoid the high hardware configuration in the deep learning model. Considering some problems of overfitting and weak generalization ability of the single classifier, random forest is applied in this paper. Meanwhile, this paper makes some improvements for C4.5 classifier and the traditional random forest in the process of experiments. A large number of experiments have proved the effectiveness and feasibility of the proposed method.<\/jats:p>","DOI":"10.3390\/info10120375","type":"journal-article","created":{"date-parts":[[2019,11,28]],"date-time":"2019-11-28T10:54:10Z","timestamp":1574938450000},"page":"375","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Facial Expression Recognition Based on Random Forest and Convolutional Neural Network"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8805-6724","authenticated-orcid":false,"given":"Yingying","family":"Wang","sequence":"first","affiliation":[{"name":"School of Control Science and Engineering, Shandong University, Jinan 250061, China"}]},{"given":"Yibin","family":"Li","sequence":"additional","affiliation":[{"name":"School of Control Science and Engineering, Shandong University, Jinan 250061, China"}]},{"given":"Yong","family":"Song","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electrical and Information Engineering, Shandong University, Weihai 264209, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3283-5347","authenticated-orcid":false,"given":"Xuewen","family":"Rong","sequence":"additional","affiliation":[{"name":"School of Control Science and Engineering, Shandong University, Jinan 250061, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,28]]},"reference":[{"key":"ref_1","first-page":"4","article-title":"Communication without words","volume":"2","author":"Mehrabian","year":"1968","journal-title":"Psychol. Today"},{"key":"ref_2","first-page":"146","article-title":"Expression of the emotions in man and animals","volume":"123","author":"Darwin","year":"2003","journal-title":"Portable Darwin"},{"key":"ref_3","unstructured":"Ying, Z., and Fang, X. (2008, January 26\u201329). Combining LBP and Adaboost for facial expression recognition. Proceedings of the International Conference on Signal Processing, Beijing, China."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1037\/h0030377","article-title":"Constants across cultures in the face and emotion","volume":"17","author":"Ekman","year":"1971","journal-title":"J. Pers. Soc. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kalansuriya, T.R., and Dharmaratne, A.T. (2014, January 10\u201314). Facial image classification based on age and gender. Proceedings of the Fourteenth International Conference on Advances in ICT for Emerging Regions, Colombo, Sri Lanka.","DOI":"10.1109\/ICTer.2013.6761153"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1016\/j.neucom.2005.07.005","article-title":"A new nonlinear feature extraction method for face recognition","volume":"69","author":"Pang","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.patcog.2016.07.026","article-title":"Facial Expression Recognition with Convolutional Neural Networks: Coping with Few Data and the Training Sample Order","volume":"61","author":"Lopes","year":"2017","journal-title":"Pattern Recog."},{"key":"ref_8","unstructured":"Liu, W., Song, C., and Wang, Y. (2012, January 11\u201315). Facial expression recognition based on discriminative dictionary learning. Proceedings of the 21st International Conference on Pattern Recognition, Tsukuba Science City, Japan."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.patcog.2016.01.032","article-title":"Boosted NNE collections for multicultural facial expression recognition","volume":"55","author":"Ali","year":"2016","journal-title":"Pattern Recog."},{"key":"ref_10","unstructured":"Zhang, Z., Lyons, M., Schuster, M., and Akamatsu, S. (1998, January 14\u201316). Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron. Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition, Nara, Japan."},{"key":"ref_11","unstructured":"Bartlett, M.S., Littlewort, G., Frank, M., and Lainscsek, C. (2005, January 20\u201325). Recognizing facial expression: machine learning and application to spontaneous behavior. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_12","unstructured":"Qi, W., and Jaja, J. (2014, January 15\u201319). From Maxout to Channel-Out: Encoding Information on Sparse Pathways. Proceedings of the 24th International Conference on Artificial Neural Networks, Hamburg, Germany."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction on decision tree","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.bspc.2011.03.007","article-title":"Classification of complete blood count and haemoglobin typing data by a C4.5 decision tree, a na\u00efve Bayes classifier and a multilayer perceptron for thalassaemia screening","volume":"7","author":"Setsirichok","year":"2012","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2767","DOI":"10.1016\/j.ijleo.2012.08.040","article-title":"Facial expression recognition based on fusion feature of PCA and LBP with SVM","volume":"124","author":"Luo","year":"2013","journal-title":"Optik-Int. J. Light Electron Optics"},{"key":"ref_16","unstructured":"Chen, J., Chen, Z., Chi, Z., and Fu, H. (2014, January 22\u201323). Facial expression recognition based on facial components detection and hog features. Proceedings of the International Workshops on Electrical and Computer Engineering Subfields, Istanbul, Turkey."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mollahosseini, A., Chan, D., and Mahoor, M.H. (2016, January 7\u20139). Going Deeper in Facial Expression Recognition using Deep Neural Networks. In Proceeding of the IEEE Winter Conference on Applications of Computer Vision, Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477450"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12559-017-9472-6","article-title":"Ensemble of Deep Neural Networks with Probability-Based Fusion for Facial Expression Recognition","volume":"9","author":"Wen","year":"2017","journal-title":"Cognit. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/72.554195","article-title":"Face recognition: a convolutional neural-network approach","volume":"8","author":"Lawrence","year":"1997","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kim, P. (2017). Convolutional Neural Network. MATLAB Deep Learning, Apress.","DOI":"10.1007\/978-1-4842-2845-6"},{"key":"ref_21","unstructured":"Ming, L., and Hu, X. (2015, January 7\u201312). Recurrent convolutional neural network for object recognition. Proceedings of the Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xu, M., Wang, J.L., and Chen, T. (2006). Improved Decision Tree Algorithm: ID3 +. Intelligent Computing in Signal Processing and Pattern Recognition, Springer.","DOI":"10.1007\/978-3-540-37258-5_15"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1111\/j.1600-0587.2001.tb00472.x","article-title":"Differential colonization causing non-random forest plant community structure in a fragmented agricultural landscape","volume":"24","author":"Butaye","year":"2001","journal-title":"Ecography"},{"key":"ref_24","unstructured":"Oza, N.C. (August, January 30). Online Ensemble Learning. Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on on Innovative Applications of Artificial Intelligence, Austin, TX, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1142\/S0218001408006284","article-title":"Performance comparisons of facial expression recognition in JAFFE database","volume":"22","author":"Shih","year":"2011","journal-title":"Int. J. Pattern Recog. Artif. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., and Saragih, J. (2010, January 13\u201318). The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. Proceedings of the Computer Vision and Pattern Recognition Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kankanamge, S., Fookes, C., and Sridharan, S. (2018, January 7\u201310). Facial analysis in the wild with LSTM networks. Proceedings of the 25th IEEE International Conference on Image Processing, Athens, Greece.","DOI":"10.1109\/ICIP.2017.8296442"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1016\/j.imavis.2008.08.005","article-title":"Facial expression recognition based on local binary patterns: A comprehensive study","volume":"27","author":"Shan","year":"2009","journal-title":"Image Vision Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.neucom.2015.02.011","article-title":"Au-inspired deep networks for facial expression feature learning","volume":"159","author":"Liu","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_30","first-page":"101","article-title":"Face Behavior Recognition through Support Vector Machines","volume":"7","author":"Ahmed","year":"2016","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rashid, T.A. (2016). Convolutional Neural Networks based Method for Improving Facial Expression Recognition. The International Symposium on Intelligent Systems Technologies and Applications, Springer.","DOI":"10.1007\/978-3-319-47952-1_6"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tumen, V., Soylemez, O.F., and Ergen, B. (2017, January 16\u201317). Facial emotion recognition on a dataset using convolutional neural network. Proceedings of the 2017 International Artificial Intelligence and Data Processing Symposium (IDAP), Malatya, Turkey.","DOI":"10.1109\/IDAP.2017.8090281"},{"key":"ref_33","unstructured":"Chang, T., Wen, G., Yang, H., and Ma, J.J. (2018). Facial Expression Recognition Based on Complexity Perception Classification Algorithm. arXiv."},{"key":"ref_34","unstructured":"Kuang, L., Zhang, M., and Pan, Z. (2016, January 28\u201330). Facial Expression Recognition with CNN Ensemble. Proceedings of the International Conference on Cyberworlds, Chongqing, China."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s12193-015-0209-0","article-title":"Hierarchical committee of deep convolutional neural networks for robust facial expression recognition","volume":"10","author":"Kim","year":"2016","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1109\/TIP.2018.2868382","article-title":"Reliable Crowdsourcing and Deep Locality-Preserving Learning for Unconstrained Facial Expression Recognition","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1109\/TIP.2018.2886767","article-title":"Occlusion aware facial expression recognition using CNN with attention mechanism","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/10\/12\/375\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:38:25Z","timestamp":1760189905000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/10\/12\/375"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,28]]},"references-count":38,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["info10120375"],"URL":"https:\/\/doi.org\/10.3390\/info10120375","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,28]]}}}