{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T21:31:22Z","timestamp":1775251882711,"version":"3.50.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T00:00:00Z","timestamp":1620777600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T00:00:00Z","timestamp":1620777600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61702464"],"award-info":[{"award-number":["61702464"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61771432"],"award-info":[{"award-number":["61771432"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61702462"],"award-info":[{"award-number":["61702462"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61502435"],"award-info":[{"award-number":["61502435"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61873246"],"award-info":[{"award-number":["61873246"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100013066","name":"Key Scientific Research Project of Colleges and Universities in Henan Province","doi-asserted-by":"publisher","award":["16A520028"],"award-info":[{"award-number":["16A520028"]}],"id":[{"id":"10.13039\/501100013066","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011447","name":"Science and Technology Department of Henan Province","doi-asserted-by":"publisher","award":["182102210607 and 192102210108"],"award-info":[{"award-number":["182102210607 and 192102210108"]}],"id":[{"id":"10.13039\/501100011447","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Doctorate Research Funding of Zhengzhou University of Light Industry","award":["2014BSJJ077"],"award-info":[{"award-number":["2014BSJJ077"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Image Video Proc."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Methods using salient facial patches (SFPs) play a significant role in research on facial expression recognition. However, most SFP methods use only frontal face images or videos for recognition, and they do not consider head position variations. We contend that SFP can be an effective approach for recognizing facial expressions under different head rotations. Accordingly, we propose an algorithm, called profile salient facial patches (PSFP), to achieve this objective. First, to detect facial landmarks and estimate head poses from profile face images, a tree-structured part model is used for pose-free landmark localization. Second, to obtain the salient facial patches from profile face images, the facial patches are selected using the detected facial landmarks while avoiding their overlap or the transcending of the actual face range. To analyze the PSFP recognition performance, three classical approaches for local feature extraction, specifically the histogram of oriented gradients (HOG), local binary pattern, and Gabor, were applied to extract profile facial expression features. Experimental results on the Radboud Faces Database show that PSFP with HOG features can achieve higher accuracies under most head rotations.<\/jats:p>","DOI":"10.1186\/s13640-021-00555-5","type":"journal-article","created":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T17:03:24Z","timestamp":1620839004000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Non-frontal facial expression recognition based on salient facial patches"],"prefix":"10.1186","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6338-4051","authenticated-orcid":false,"given":"Bin","family":"Jiang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiuwen","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zuhe","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qinggang","family":"Wu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huanlong","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,5,12]]},"reference":[{"issue":"6","key":"555_CR1","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1109\/TPAMI.2014.2366127","volume":"37","author":"E Sariyanidi","year":"2015","unstructured":"E. Sariyanidi, H. Gunes, A. Cavallaro, Automatic analysis of facial affect: A survey of registration, representation, and recognition. IEEE Transactions on Pattern Analysis & Machine Intelligence 37(6), 1113\u20131133 (2015)","journal-title":"IEEE Transactions on Pattern Analysis & Machine Intelligence"},{"issue":"2","key":"555_CR2","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1109\/TSMCB.2005.859075","volume":"36","author":"M Pantic","year":"2006","unstructured":"M. Pantic, I. Patras, Dynamics of facial expression: Recognition of facial actions and their temporal segments from face profile image sequences. IEEE Transactions on Systems Man & Cybernetics Part B 36(2), 433\u2013449 (2006)","journal-title":"IEEE Transactions on Systems Man & Cybernetics Part B"},{"key":"555_CR3","unstructured":"Y.X. Hu, Z.H. Zeng, L.J. Yin, X.Z. Wei, J.L. Tu, T.S. Huang, A study of non-frontal-view facial expressions recognition. IEEE International Conference on Pattern Recognition, 2008. ICPR, 1\u20134 (2008)"},{"issue":"2","key":"555_CR4","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1109\/TAFFC.2017.2708106","volume":"10","author":"A Dapogny","year":"2019","unstructured":"A. Dapogny, K. Bailly, S. Dubuisson, Dynamic pose-robust facial expression recognition by multi-view pairwise conditional random forests. IEEE Transactions on Affective Computing 10(2), 167\u2013181 (2019)","journal-title":"IEEE Transactions on Affective Computing"},{"key":"555_CR5","first-page":"490","volume":"2010","author":"WM Zheng","year":"2010","unstructured":"W.M. Zheng, H. Tang, Z.C. Lin, T.S. Huang, Emotion recognition from arbitrary view facial images. Proceeding International Conference European Conference on Computer Vision 2010, 490\u2013503 (2010)","journal-title":"Proceeding International Conference European Conference on Computer Vision"},{"key":"555_CR6","first-page":"211","volume":"2006","author":"LJ Yin","year":"2006","unstructured":"L.J. Yin, X.Z. Wei, Y. Sun, J. Wang, M.J. Rosato, A 3D facial expression database for facial behavior research. IEEE International Conference on Automatic Face and Gesture Recognition 2006, 211\u2013216 (2006)","journal-title":"IEEE International Conference on Automatic Face and Gesture Recognition"},{"key":"555_CR7","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.neucom.2017.02.012","volume":"239","author":"JL Wu","year":"2017","unstructured":"J.L. Wu, Z.C. Lin, W.M. Zheng, H.B. Zha, Locality-constrained linear coding based bi-layer model for multi-view facial expression recognition. Neurocomputing 239, 143\u2013152 (2017)","journal-title":"Neurocomputing"},{"key":"555_CR8","first-page":"263","volume":"2018","author":"YH Lai","year":"2018","unstructured":"Y.H. Lai, S.H. Lai, Emotion-preserving representation learning via generative adversarial network for multi-view facial expression recognition. IEEE International Conference on Automatic Face and Gesture Recognition 2018, 263\u2013270 (2018)","journal-title":"IEEE International Conference on Automatic Face and Gesture Recognition"},{"issue":"4","key":"555_CR9","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1109\/TMM.2016.2629282","volume":"19","author":"QR Mao","year":"2017","unstructured":"Q.R. Mao, Q.Y. Rao, Y.B. Yu, M. Dong, Hierarchical Bayesian theme models for multipose facial expression recognition. IEEE Transactions on Multimedia 19(4), 861\u2013873 (2017)","journal-title":"IEEE Transactions on Multimedia"},{"key":"555_CR10","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.imavis.2016.05.002","volume":"58","author":"M Jampour","year":"2017","unstructured":"M. Jampour, V. Lepetit, T. Mauthner, H. Bischof, Pose-specific non-linear mappings in feature space towards multiview facial expression recognition. Image & Vision Computing 58, 38\u201346 (2017)","journal-title":"Image & Vision Computing"},{"key":"555_CR11","first-page":"847","volume":"2015","author":"E Sabu","year":"2015","unstructured":"E. Sabu, P.P. Mathai, An extensive review of facial expression recognition using salient facial patches. Proceeding International Conference Applied and Theoretical Computing and Communication Technology 2015, 847\u2013851 (2015)","journal-title":"Proceeding International Conference Applied and Theoretical Computing and Communication Technology"},{"issue":"1","key":"555_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TAFFC.2014.2386334","volume":"6","author":"SL Happy","year":"2015","unstructured":"S.L. Happy, A. Routray, Automatic facial expression recognition using features of salient facial patches. IEEE Transactions on Affective Computing 6(1), 1\u201312 (2015)","journal-title":"IEEE Transactions on Affective Computing"},{"key":"555_CR13","first-page":"2806","volume":"2016","author":"KK Chitta","year":"2016","unstructured":"K.K. Chitta, N.N. Sajjan, A reduced region of interest based approach for facial expression recognition from static images. IEEE Region 10 Conference 2016, 2806\u20132809 (2016)","journal-title":"IEEE Region 10 Conference"},{"key":"555_CR14","first-page":"502","volume":"2016","author":"R Zhang","year":"2016","unstructured":"R. Zhang, J. Li, Z.Z. Xiang, J.B. Su, Facial expression recognition based on salient patch selection. IEEE International Conference on Machine Learning and Cybernetics 2016, 502\u2013507 (2016)","journal-title":"IEEE International Conference on Machine Learning and Cybernetics"},{"issue":"9","key":"555_CR15","first-page":"2861","volume":"36","author":"YM Wen","year":"2019","unstructured":"Y.M. Wen, W. Ouyang, Y.Q. Ling, Expression-oriented ROI region secondary voting mechanism. Application Research of Computers 36(9), 2861\u20132865 (2019)","journal-title":"Application Research of Computers"},{"key":"555_CR16","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.neucom.2018.03.034","volume":"296","author":"WY Sun","year":"2018","unstructured":"W.Y. Sun, H.T. Zhao, Z. Jin, A visual attention based ROI detection method for facial expression recognition. Neurocomputing 296, 12\u201322 (2018)","journal-title":"Neurocomputing"},{"key":"555_CR17","doi-asserted-by":"publisher","first-page":"105540","DOI":"10.1016\/j.asoc.2019.105540","volume":"82","author":"JZ Yi","year":"2019","unstructured":"J.Z. Yi, A.B. Chen, Z.X. Cai, Y. Sima, X.Y. Wu, Facial expression recognition of intercepted video sequences based on feature point movement trend and feature block texture variation. Applied Soft Computing 82, 105540 (2019)","journal-title":"Applied Soft Computing"},{"issue":"6","key":"555_CR18","doi-asserted-by":"publisher","first-page":"1172","DOI":"10.1007\/s11390-017-1792-1","volume":"32","author":"NM Yao","year":"2017","unstructured":"N.M. Yao, H. Chen, Q.P. Guo, H.A. Wang, Non-frontal facial expression recognition using a depth-patch based deep neural network. Journal of computer science and technology 32(6), 1172\u20131185 (2017)","journal-title":"Journal of computer science and technology"},{"key":"555_CR19","doi-asserted-by":"crossref","unstructured":"A. Barman, P. Dutta, Facial expression recognition using distance and shape signature features. Pattern Recognition Letters 145, 254\u2013261(2021)","DOI":"10.1016\/j.patrec.2017.06.018"},{"key":"555_CR20","doi-asserted-by":"crossref","unstructured":"Y. Sun, X.G. Wang, X.O. Tang, Deep convolutional network cascade for facial point detection. IEEE International Conference on Computer Vision and Pattern Recognition, 3476\u20133483 (2013, 2013)","DOI":"10.1109\/CVPR.2013.446"},{"issue":"6","key":"555_CR21","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1109\/34.927467","volume":"23","author":"TF Cootes","year":"2001","unstructured":"T.F. Cootes, G.J. Edwards, C.J. Taylor, Active appearance models. IEEE Transaction on Pattern Analysis and Machine Intelligence 23(6), 681\u2013685 (2001)","journal-title":"IEEE Transaction on Pattern Analysis and Machine Intelligence"},{"key":"555_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cviu.2017.08.008","volume":"162","author":"X Jin","year":"2017","unstructured":"X. Jin, X.Y. Tan, Face alignment in-the-wild: A survey. Computer Vision and Image Understanding 162, 1\u201322 (2017)","journal-title":"Computer Vision and Image Understanding"},{"key":"555_CR23","first-page":"1944","volume":"2013","author":"X Yu","year":"2013","unstructured":"X. Yu, J.Z. Huang, S.T. Zhang, W. Yan, D.N. Metaxas, Pose-free facial landmark fitting via optimized part mixtures and cascaded deformable shape model. IEEE International Conference on Computer Vision 2013, 1944\u20131951 (2013)","journal-title":"IEEE International Conference on Computer Vision"},{"key":"555_CR24","volume-title":"SLEP: Sparse Learning with Efficient Projections","author":"J Liu","year":"2009","unstructured":"J. Liu, S.W. Ji, J.P. Ye, SLEP: Sparse Learning with Efficient Projections (Arizona State University, Arizona, 2009)"},{"issue":"8","key":"555_CR25","doi-asserted-by":"publisher","first-page":"1377","DOI":"10.1080\/02699930903485076","volume":"24","author":"O Langner","year":"2010","unstructured":"O. Langner, R. Dotsch, G. Bijlstra, D.H.J. Wigboldus, S.T. Hawk, A.V. Knippenberg, Presentation and validation of the Radboud faces database. Cognition & Emotion 24(8), 1377\u20131388 (2010)","journal-title":"Cognition & Emotion"},{"issue":"4","key":"555_CR26","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1016\/j.cviu.2010.12.001","volume":"115","author":"S Moore","year":"2011","unstructured":"S. Moore, R. Bowden, Local binary patterns for multi-view facial expression recognition. Computer Vision Image Understand 115(4), 541\u2013558 (2011)","journal-title":"Computer Vision Image Understand"},{"key":"555_CR27","doi-asserted-by":"crossref","unstructured":"M. Haghighat, S. Zonouz, M. Abdel-Mottaleb, Identification using encrypted biometrics. Computer Analysis of Images and Patterns, 440\u2013448 (2013) York, United Kingdom","DOI":"10.1007\/978-3-642-40246-3_55"},{"key":"555_CR28","first-page":"1401","volume":"1999","author":"RE Schapire","year":"1999","unstructured":"R.E. Schapire, A brief introduction to boosting. IEEE International Joint Conference on Artificial Intelligence 1999, 1401\u20131406 (1999)","journal-title":"IEEE International Joint Conference on Artificial Intelligence"},{"key":"555_CR29","unstructured":"K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition. International Conference on Learning Representations, 1\u20134 (2015)"},{"key":"555_CR30","first-page":"1097","volume-title":"ImageNet classification with deep convolutional neural networks. Neural Information Processing Systems","author":"A Krizhevsky","year":"2012","unstructured":"A. Krizhevsky, I. Sutskever, G.E. Hinton, ImageNet classification with deep convolutional neural networks. Neural Information Processing Systems (Curran Associates Inc, Red Hook, 2012), pp. 1097\u20131105"}],"container-title":["EURASIP Journal on Image and Video Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-021-00555-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13640-021-00555-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13640-021-00555-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T17:05:48Z","timestamp":1620839148000},"score":1,"resource":{"primary":{"URL":"https:\/\/jivp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13640-021-00555-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,12]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["555"],"URL":"https:\/\/doi.org\/10.1186\/s13640-021-00555-5","relation":{},"ISSN":["1687-5281"],"issn-type":[{"value":"1687-5281","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,12]]},"assertion":[{"value":"19 September 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Authors have permissions on usage of photos of RaFD database as in strictly scientific publications RaFD images can be presented as stimulus examples.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"15"}}