{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T04:59:16Z","timestamp":1773464356486,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T00:00:00Z","timestamp":1673395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U19344221"],"award-info":[{"award-number":["U19344221"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61733015"],"award-info":[{"award-number":["61733015"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61933013"],"award-info":[{"award-number":["61933013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["RCS2021K007"],"award-info":[{"award-number":["RCS2021K007"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"State Key Laboratory of Rail Traffic Control and Safety","award":["U19344221"],"award-info":[{"award-number":["U19344221"]}]},{"name":"State Key Laboratory of Rail Traffic Control and Safety","award":["61733015"],"award-info":[{"award-number":["61733015"]}]},{"name":"State Key Laboratory of Rail Traffic Control and Safety","award":["61933013"],"award-info":[{"award-number":["61933013"]}]},{"name":"State Key Laboratory of Rail Traffic Control and Safety","award":["RCS2021K007"],"award-info":[{"award-number":["RCS2021K007"]}]},{"name":"Beijing Jiaotong University","award":["U19344221"],"award-info":[{"award-number":["U19344221"]}]},{"name":"Beijing Jiaotong University","award":["61733015"],"award-info":[{"award-number":["61733015"]}]},{"name":"Beijing Jiaotong University","award":["61933013"],"award-info":[{"award-number":["61933013"]}]},{"name":"Beijing Jiaotong University","award":["RCS2021K007"],"award-info":[{"award-number":["RCS2021K007"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Expression recognition is a very important direction for computers to understand human emotions and human-computer interaction. However, for 3D data such as video sequences, the complex structure of traditional convolutional neural networks, which stretch the input 3D data into vectors, not only leads to a dimensional explosion, but also fails to retain structural information in 3D space, simultaneously leading to an increase in computational cost and a lower accuracy rate of expression recognition. This paper proposes a video sequence face expression recognition method based on Squeeze-and-Excitation and 3DPCA Network (SE-3DPCANet). The introduction of a 3DPCA algorithm in the convolution layer directly constructs tensor convolution kernels to extract the dynamic expression features of video sequences from the spatial and temporal dimensions, without weighting the convolution kernels of adjacent frames by shared weights. Squeeze-and-Excitation Network is introduced in the feature encoding layer, to automatically learn the weights of local channel features in the tensor features, thus increasing the representation capability of the model and further improving recognition accuracy. The proposed method is validated on three video face expression datasets. Comparisons were made with other common expression recognition methods, achieving higher recognition rates while significantly reducing the time required for training.<\/jats:p>","DOI":"10.3390\/s23020823","type":"journal-article","created":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T04:59:58Z","timestamp":1673413198000},"page":"823","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["A Video Sequence Face Expression Recognition Method Based on Squeeze-and-Excitation and 3DPCA Network"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7129-6468","authenticated-orcid":false,"given":"Chang","family":"Li","sequence":"first","affiliation":[{"name":"School of Automation, Guangdong University of Petrochemical Technology, Maoming 525000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chenglin","family":"Wen","sequence":"additional","affiliation":[{"name":"School of Automation, Guangdong University of Petrochemical Technology, Maoming 525000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiting","family":"Qiu","sequence":"additional","affiliation":[{"name":"School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,11]]},"reference":[{"key":"ref_1","unstructured":"Sown, M. (1978, January 7\u201310). A preliminary note on pattern recognition of facial emotional expression. Proceedings of the 4th International Joint Conferences on Pattern Recognition, Kyoto, Japan."},{"key":"ref_2","unstructured":"Jain, A.K., and Li, S.Z. (2011). Handbook of Face Recognition, Springer."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1016\/j.imavis.2008.08.005","article-title":"Facial expression recognition based on local binary patterns: A comprehensive study","volume":"27","author":"Shan","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/S1077-3142(03)00081-X","article-title":"Facial expression recognition from video sequences: Temporal and static modeling","volume":"91","author":"Cohen","year":"2003","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_5","unstructured":"Chibelushi, C.C., and Bourel, F. (2003). Facial expression recognition: A brief tutorial overview. CVonline-Line Compend. Comput. Vis., 9."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1111\/desc.12281","article-title":"Mapping the development of facial expression recognition","volume":"18","author":"Rodger","year":"2015","journal-title":"Dev. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wang, K., Peng, X., Yang, J., Lu, S., and Qiao, Y. (2020, January 13\u201319). Suppressing uncertainties for large-scale facial expression recognition. Proceedings of the IEEE\/CVF conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00693"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1295","DOI":"10.1016\/S0167-8655(02)00371-9","article-title":"Facial expression recognition: A clustering-based approach","volume":"24","author":"Chen","year":"2003","journal-title":"Pattern Recognit. Lett."},{"key":"ref_9","unstructured":"Kimura, S., and Yachida, M. (1997, January 17\u201319). Facial expression recognition and its degree estimation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Michel, P., and El Kaliouby, R. (2003, January 5\u20137). Real time facial expression recognition in video using support vector machines. Proceedings of the 5th International Conference on Multimodal Interfaces, Vancouver, BC, Canada.","DOI":"10.1145\/958432.958479"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1109\/TMM.2010.2060716","article-title":"A natural visible and infrared facial expression database for expression recognition and emotion inference","volume":"12","author":"Wang","year":"2010","journal-title":"IEEE Trans. Multimed."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1082","DOI":"10.1016\/j.jvcir.2014.03.006","article-title":"PCA-based dictionary building for accurate facial expression recognition via sparse representation","volume":"25","author":"Mohammadi","year":"2014","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Patil, M.N., Iyer, B., and Arya, R. (2016). Performance evaluation of PCA and ICA algorithm for facial expression recognition application. Proceedings of the Fifth International Conference on Soft Computing for Problem Solving, Springer.","DOI":"10.1007\/978-981-10-0448-3_81"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2767","DOI":"10.1016\/j.ijleo.2012.08.040","article-title":"Facial expression recognition based on fusion feature of PCA and LBP with SVM","volume":"124","author":"Luo","year":"2013","journal-title":"Opt.-Int. J. Light Electron Opt."},{"key":"ref_15","first-page":"86","article-title":"A new facial expression recognition method based on local Gabor filter bank and PCA plus LDA","volume":"11","author":"Deng","year":"2005","journal-title":"Int. J. Inf. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Buciu, I., and Pitas, I. (2004, January 26). Application of non-negative and local non negative matrix factorization to facial expression recognition. Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, Cambridge, UK.","DOI":"10.1109\/ICPR.2004.1334109"},{"key":"ref_17","unstructured":"Lien, J.J., Kanade, T., Cohn, J.F., and Li, C.-C. (1998, January 14\u201316). Automated facial expression recognition based on FACS action units. Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara, Japan."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s11760-008-0074-3","article-title":"Comparison of ICA approaches for facial expression recognition","volume":"3","author":"Buciu","year":"2009","journal-title":"Signal Image Video Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"402","DOI":"10.4304\/jmm.8.4.402-409","article-title":"Facial Expression Recognition based on Independent Component Analysis","volume":"8","author":"Guo","year":"2013","journal-title":"J. Multimed."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Varma, S., Shinde, M., and Chavan, S.S. (2020). Analysis of PCA and LDA features for facial expression recognition using SVM and HMM classifiers. Techno-Societal 2018, Springer.","DOI":"10.1007\/978-3-030-16848-3_11"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wu, T., Bartlett, M.S., and Movellan, J.R. (2010, January 13\u201318). Facial expression recognition using gabor motion energy filters. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543267"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.patcog.2011.05.006","article-title":"Facial expression recognition using radial encoding of local Gabor features and classifier synthesis","volume":"45","author":"Gu","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ou, J., Bai, X.-B., Pei, Y., Ma, L., and Liu, W. (2010, January 22\u201324). Automatic facial expression recognition using Gabor filter and expression analysis. Proceedings of the 2010 Second International Conference on Computer Modeling and Simulation, Sanya, China.","DOI":"10.1109\/ICCMS.2010.45"},{"key":"ref_24","unstructured":"Liu, W., and Wang, Z. (2006, January 20\u201324). Facial expression recognition based on fusion of multiple Gabor features. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Almaev, T.R., and Valstar, M.F. (2013, January 2\u20135). Local gabor binary patterns from three orthogonal planes for automatic facial expression recognition. Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland.","DOI":"10.1109\/ACII.2013.65"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"47","DOI":"10.4103\/0256-4602.107339","article-title":"Facial expression recognition using local transitional pattern on Gabor filtered facial images","volume":"30","author":"Ahsan","year":"2013","journal-title":"IETE Tech. Rev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"19409","DOI":"10.1109\/ACCESS.2017.2737821","article-title":"Facial expression recognition from image sequence based on LBP and Taylor expansion","volume":"5","author":"Ding","year":"2017","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Shan, C., and Gritti, T. (2008, January 1\u20138). Learning Discriminative LBP-Histogram Bins for Facial Expression Recognition. Proceedings of the BMVC, Leeds, UK.","DOI":"10.5244\/C.22.27"},{"key":"ref_29","unstructured":"Shan, C., Gong, S., and McOwan, P.W. (2005, January 11\u201314). Robust facial expression recognition using local binary patterns. Proceedings of the IEEE International Conference on Image Processing, Geneva, Switzerland."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Huang, M.-W., Wang, Z.-W., and Ying, Z.-L. (2010, January 16\u201318). A new method for facial expression recognition based on sparse representation plus LBP. Proceedings of the 2010 3rd International Congress on Image and Signal Processing, Yantai, China.","DOI":"10.1109\/CISP.2010.5647898"},{"key":"ref_31","unstructured":"He, L., Zou, C., Zhao, L., and Hu, D. (2006, January 17\u201318). An enhanced LBP feature based on facial expression recognition. Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1007\/s00779-019-01238-9","article-title":"Facial expression recognition method based on deep convolutional neural network combined with improved LBP features","volume":"23","author":"Kong","year":"2019","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5815\/ijigsp.2019.04.01","article-title":"Discrete complex fuzzy transform based face image recognition method","volume":"11","author":"Tuncer","year":"2019","journal-title":"Int. J. Image Graph. Signal Process"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tuncer, T., Dogan, S., Abdar, M., Ehsan Basiri, M., and P\u0142awiak, P. (2019). Face recognition with triangular fuzzy set-based local cross patterns in wavelet domain. Symmetry, 11.","DOI":"10.3390\/sym11060787"},{"key":"ref_35","first-page":"1159","article-title":"Improved algorithm for motion image analysis based on optical flow and its application","volume":"19","author":"Tu","year":"2011","journal-title":"Guangxue Jingmi Gongcheng"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1109\/TMECH.2010.2046421","article-title":"A Kalman filter-integrated optical flow method for velocity sensing of mobile robots","volume":"16","author":"Song","year":"2010","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. (2004, January 11\u201314). High accuracy optical flow estimation based on a theory for warping. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24673-2_3"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/S1004-4132(07)60097-8","article-title":"Discontinuity-preserving optical flow algorithm","volume":"18","author":"Lei","year":"2007","journal-title":"J. Syst. Eng. Electron."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1023\/B:VISI.0000045324.43199.43","article-title":"Lucas\/Kanade meets Horn\/Schunck: Combining local and global optic flow methods","volume":"61","author":"Bruhn","year":"2005","journal-title":"Int. J. Comput. Vis."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Tran, D., Bourdev, L., Fergus, R., Torresani, L., and Paluri, M. (2015, January 11\u201318). Learning spatiotemporal features with 3d convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.510"},{"key":"ref_42","first-page":"103","article-title":"Video face expression recognition based on attention mechanism","volume":"44","author":"He","year":"2020","journal-title":"Inf. Technol."},{"key":"ref_43","first-page":"2978","article-title":"Fusing CNN and BLSTM neural networks for facial expression recognition","volume":"48","author":"Wang","year":"2020","journal-title":"Comput. Digit. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Vielzeuf, V., Pateux, S., and Jurie, F. (2017, January 13\u201317). Temporal multimodal fusion for video emotion classification in the wild. Proceedings of the 19th ACM International Conference on Multimodal Interaction, Glasgow, UK.","DOI":"10.1145\/3136755.3143011"},{"key":"ref_45","first-page":"2695","article-title":"Fast 3D principal component analysis-based lung CT image detection","volume":"18","author":"Wang","year":"2010","journal-title":"Opt. Precis. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1137\/S0895479896305696","article-title":"A Multilinear Singular Value Decomposition","volume":"21","author":"Lathauwer","year":"2000","journal-title":"SIAM J. Matrix Anal. Appl."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13\u201318). The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2014Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MMUL.2012.26","article-title":"Collecting Large, Richly Annotated Facial-Expression Databases from Movies","volume":"19","author":"Dhall","year":"2012","journal-title":"IEEE MultiMedia"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Yan, W.J., Li, X., Wang, S.J., Zhao, G., Liu, Y.J., Chen, Y.H., and Fu, X. (2014). CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0086041"},{"key":"ref_51","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_52","first-page":"95","article-title":"Expression Recognition Based on KPCANet and Linear Discriminant Analysis","volume":"48","author":"Chen","year":"2020","journal-title":"J. Huazhong Univ. Sci. Technol. (Nat. Sci. Ed.)"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1109\/TAFFC.2020.2981446","article-title":"Deep Facial Expression Recognition: A Survey","volume":"13","author":"Li","year":"2022","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_54","unstructured":"Ma, A. (2021). Research on Video Oriented Dynamic Facial Expression Recognition Algorithm. [Master\u2019s Thesis, Jilin University]."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Park, S.Y., Lee, S.H., and Ro, Y.M. (2015, January 26\u201330). Subtle Facial Expression Recognition Using Adaptive Magnification of Discriminative Facial Motion. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806362"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1109\/TAFFC.2017.2667642","article-title":"Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods","volume":"9","author":"Li","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Kim, D.H., Baddar, W.J., and Ro, Y.M. (2016, January 15\u201319). Micro-Expression Recognition with Expression-State Constrained Spatio-Temporal Feature Representations. Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands.","DOI":"10.1145\/2964284.2967247"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/823\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:06:31Z","timestamp":1760119591000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/823"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,11]]},"references-count":57,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23020823"],"URL":"https:\/\/doi.org\/10.3390\/s23020823","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,11]]}}}