{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T15:56:19Z","timestamp":1769010979090,"version":"3.49.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,2,20]],"date-time":"2022-02-20T00:00:00Z","timestamp":1645315200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,20]],"date-time":"2022-02-20T00:00:00Z","timestamp":1645315200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61405028"],"award-info":[{"award-number":["61405028"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["82073833"],"award-info":[{"award-number":["82073833"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["ZYGX2015J046"],"award-info":[{"award-number":["ZYGX2015J046"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["ZYGX2019J053"],"award-info":[{"award-number":["ZYGX2019J053"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["ZYGX2016J069"],"award-info":[{"award-number":["ZYGX2016J069"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Microexpressions cannot be observed easily due to their short duration and small-expression range. These properties pose considerable challenges for the recognition of microexpressions. Thus, video motion magnification techniques help us to see small motions previously invisible to the naked eye. This study aimed to enhance the microexpression features with the help of motion amplification technology. Also, a motion magnification multi-feature relation network (MMFRN) combining video motion amplification and two feature relation modules was proposed. The spatial feature is enlarged while completing the spatial feature extraction, which is used for classification. In addition, we transferred Resnet50 network to extract the global features and improve feature comprehensiveness. The magnification of the features is controlled through hyperparameter amplification factor \u03b1. The effects of different magnification factors on the results are compared, and the best is selected. The experiments have verified that the enlarged network can resolve the misclassification problem caused by the one-to-one correspondence between microexpressions and facial action coding units. On CASME II datasets, MMFRN outperforms the traditional recognition methods and other neural networks.<\/jats:p>","DOI":"10.1007\/s40747-022-00680-2","type":"journal-article","created":{"date-parts":[[2022,2,20]],"date-time":"2022-02-20T06:08:26Z","timestamp":1645337306000},"page":"3363-3376","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Motion magnification multi-feature relation network for facial microexpression recognition"],"prefix":"10.1007","volume":"8","author":[{"given":"Jing","family":"Zhang","sequence":"first","affiliation":[]},{"given":"Boyun","family":"Yan","sequence":"additional","affiliation":[]},{"given":"Xiaohui","family":"Du","sequence":"additional","affiliation":[]},{"given":"Quanhao","family":"Guo","sequence":"additional","affiliation":[]},{"given":"Ruqian","family":"Hao","sequence":"additional","affiliation":[]},{"given":"Juanxiu","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Lin","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Guangming","family":"Ni","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2601-4227","authenticated-orcid":false,"given":"Xiechuan","family":"Weng","sequence":"additional","affiliation":[]},{"given":"Yong","family":"Liu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,20]]},"reference":[{"key":"680_CR1","doi-asserted-by":"crossref","unstructured":"Ekman P, Friesen WV (1980) Constants across cultures in the face and emotion.pdf. 124,129","DOI":"10.1037\/h0030377"},{"key":"680_CR2","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1080\/00332747.1969.11023575","volume":"32","author":"P Ekman","year":"1969","unstructured":"Ekman P, Friesen WV (1969) Nonverbal leakage and clues to deception. Psychiatry 32:88\u2013106. https:\/\/doi.org\/10.1080\/00332747.1969.11023575","journal-title":"Psychiatry"},{"key":"680_CR3","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/WACV.2009.5403044","volume":"2009","author":"M Shreve","year":"2009","unstructured":"Shreve M, Godavarthy S, Manohar V et al (2009) Towards macro- and micro-expression spotting in video using strain patterns. 2009 Work Appl Comput Vision. WACV 2009:26\u201331. https:\/\/doi.org\/10.1109\/WACV.2009.5403044","journal-title":"WACV"},{"key":"680_CR4","unstructured":"Krishna G, V SKN (2014) Micro-expression extraction for lie detection using Eulerian video (motion and color) magnification"},{"key":"680_CR5","doi-asserted-by":"publisher","unstructured":"Kim DH, Baddar WJ, Ro YM (2016) Micro-expression recognition with expression-state constrained spatio-temporal feature representations. MM 2016 - Proc 2016 ACM Multimed Conf 382\u2013386. https:\/\/doi.org\/10.1145\/2964284.2967247","DOI":"10.1145\/2964284.2967247"},{"key":"680_CR6","doi-asserted-by":"publisher","unstructured":"Khor HQ, See J, Phan RCW, Lin W (2018) Enriched long-term recurrent convolutional network for facial micro-expression recognition. In: Proceedings of 13th IEEE Int Conf Autom Face Gesture Recognition, FG 2018 667\u2013674. https:\/\/doi.org\/10.1109\/FG.2018.00105","DOI":"10.1109\/FG.2018.00105"},{"key":"680_CR7","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1007\/s10044-018-0757-5","volume":"22","author":"J Li","year":"2019","unstructured":"Li J, Wang Y, See J, Liu W (2019) Micro-expression recognition based on 3D flow convolutional neural network. Pattern Anal Appl 22:1331\u20131339. https:\/\/doi.org\/10.1007\/s10044-018-0757-5","journal-title":"Pattern Anal Appl"},{"key":"680_CR8","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1002\/tee.23272","volume":"16","author":"C Wu","year":"2021","unstructured":"Wu C, Guo F (2021) TSNN: three-stream combining 2D and 3D convolutional neural network for micro-expression recognition. IEEJ Trans Electr Electron Eng 16:98\u2013107. https:\/\/doi.org\/10.1002\/tee.23272","journal-title":"IEEJ Trans Electr Electron Eng"},{"key":"680_CR9","doi-asserted-by":"publisher","unstructured":"Oh TH, Jaroensri R, Kim C et al (2018) Learning-based video motion magnification. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 11208 LNCS:663\u2013679. https:\/\/doi.org\/10.1007\/978-3-030-01225-0_39","DOI":"10.1007\/978-3-030-01225-0_39"},{"key":"680_CR10","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00378","author":"H Hu","year":"2018","unstructured":"Hu H, Gu J, Zhang Z et al (2018) Relation networks for object detection. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. https:\/\/doi.org\/10.1109\/CVPR.2018.00378","journal-title":"Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit"},{"key":"680_CR11","doi-asserted-by":"publisher","first-page":"8590","DOI":"10.1109\/TIP.2020.3018222","volume":"29","author":"Z Xia","year":"2020","unstructured":"Xia Z, Peng W, Khor HQ et al (2020) Revealing the invisible with model and data shrinking for composite-database micro-expression recognition. IEEE Trans Image Process 29:8590\u20138605. https:\/\/doi.org\/10.1109\/TIP.2020.3018222","journal-title":"IEEE Trans Image Process"},{"key":"680_CR12","doi-asserted-by":"publisher","unstructured":"Yan WJ, Wu Q, Liu YJ, et al (2013) CASME database: A dataset of spontaneous micro-expressions collected from neutralized faces. In: 10th IEEE Int Conf Work Autom Face Gesture Recognition, FG 2013. https:\/\/doi.org\/10.1109\/FG.2013.6553799","DOI":"10.1109\/FG.2013.6553799"},{"key":"680_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0086041","volume":"9","author":"WJ Yan","year":"2014","unstructured":"Yan WJ, Li X, Wang SJ et al (2014) CASME II: an improved spontaneous micro-expression database and the baseline evaluation. PLoS ONE 9:1\u20138. https:\/\/doi.org\/10.1371\/journal.pone.0086041","journal-title":"PLoS ONE"},{"key":"680_CR14","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","volume":"24","author":"T Ojala","year":"2002","unstructured":"Ojala T, Pietik\u00e4inen M, M\u00e4enp\u00e4\u00e4 T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24:971\u2013987. https:\/\/doi.org\/10.1109\/TPAMI.2002.1017623","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"680_CR15","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185561","author":"HY Wu","year":"2012","unstructured":"Wu HY, Rubinstein M, Shih E et al (2012) Eulerian video magnification for revealing subtle changes in the world. ACM Trans Graph. https:\/\/doi.org\/10.1145\/2185520.2185561","journal-title":"ACM Trans Graph"},{"key":"680_CR16","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461966","author":"N Wadhwa","year":"2013","unstructured":"Wadhwa N, Rubinstein M, Durand F, Freeman WT (2013) Phase-based video motion processing. ACM Trans Graph. https:\/\/doi.org\/10.1145\/2461912.2461966","journal-title":"ACM Trans Graph"},{"key":"680_CR17","unstructured":"Kingma DP, Ba JL (2015) Adam: a method for stochastic optimization. In: 3rd Int Conf Learn Represent ICLR 2015 - Conf Track Proc 1\u201315"},{"key":"680_CR18","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1016\/j.image.2016.06.004","volume":"47","author":"ST Liong","year":"2016","unstructured":"Liong ST, See J, Phan RCW et al (2016) Spontaneous subtle expression detection and recognition based on facial strain. Signal Process Image Commun 47:170\u2013182. https:\/\/doi.org\/10.1016\/j.image.2016.06.004","journal-title":"Signal Process Image Commun"},{"key":"680_CR19","doi-asserted-by":"publisher","unstructured":"Park SY, Lee SH, Ro YM (2015) Subtle facial expression recognition using adaptive magnification of discriminative facial motion. In: MM 2015 - Proc 2015 ACM Multimed Conf 911\u2013914. https:\/\/doi.org\/10.1145\/2733373.2806362","DOI":"10.1145\/2733373.2806362"},{"key":"680_CR20","first-page":"1","volume":"29","author":"G Zhao","year":"2007","unstructured":"Zhao G, Pietik M (2007) Patterns with an application to facial expressions. Most 29:1\u201314","journal-title":"Most"},{"key":"680_CR21","doi-asserted-by":"publisher","unstructured":"Cremers D, Reid I, Saito H, Yang MH (2014) Computer Vision-ACCV 2014:12th Asian Conference on Computer Vision Singapore, Singapore, November 1\u20135, 2014 Revised Selected Papers, Part I. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 9003:525\u2013537. https:\/\/doi.org\/10.1007\/978-3-319-16865-4","DOI":"10.1007\/978-3-319-16865-4"},{"key":"680_CR22","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1109\/TAFFC.2016.2518162","volume":"8","author":"F Xu","year":"2017","unstructured":"Xu F, Zhang J, Wang JZ (2017) Microexpression identification and categorization using a facial dynamics map. IEEE Trans Affect Comput 8:254\u2013267. https:\/\/doi.org\/10.1109\/TAFFC.2016.2518162","journal-title":"IEEE Trans Affect Comput"},{"key":"680_CR23","doi-asserted-by":"publisher","unstructured":"See J, Yap MH, Li J, et al (2019) MEGC 2019 - The second facial micro-expressions grand challenge. In: Proceedings of 14th IEEE Int Conf Autom Face Gesture Recognition, FG 2019 1\u20135. https:\/\/doi.org\/10.1109\/FG.2019.8756611","DOI":"10.1109\/FG.2019.8756611"},{"key":"680_CR24","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1109\/TAFFC.2017.2667642","volume":"9","author":"X Li","year":"2018","unstructured":"Li X, Hong X, Moilanen A et al (2018) Towards reading hidden emotions: a comparative study of spontaneous micro-expression spotting and recognition methods. IEEE Trans Affect Comput 9:563\u2013577. https:\/\/doi.org\/10.1109\/TAFFC.2017.2667642","journal-title":"IEEE Trans Affect Comput"},{"key":"680_CR25","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/j.neucom.2018.05.107","volume":"312","author":"SJ Wang","year":"2018","unstructured":"Wang SJ, Li BJ, Liu YJ et al (2018) Micro-expression recognition with small sample size by transferring long-term convolutional neural network. Neurocomputing 312:251\u2013262. https:\/\/doi.org\/10.1016\/j.neucom.2018.05.107","journal-title":"Neurocomputing"},{"key":"680_CR26","unstructured":"Wang C, Peng M, Bi T et al Micro-Attention for Micro-Expression Recognition. 1\u201317"},{"key":"680_CR27","doi-asserted-by":"publisher","unstructured":"Van Quang N, Chun J, Tokuyama T (2019) CapsuleNet for micro-expression recognition. Proc - 14th IEEE Int Conf Autom Face Gesture Recognit FG 2019. https:\/\/doi.org\/10.1109\/FG.2019.8756544","DOI":"10.1109\/FG.2019.8756544"},{"key":"680_CR28","doi-asserted-by":"publisher","first-page":"184537","DOI":"10.1109\/ACCESS.2019.2960629","volume":"7","author":"B Song","year":"2019","unstructured":"Song B, Li K, Zong Y et al (2019) Recognizing spontaneous micro-expression using a three-stream convolutional neural network. IEEE Access 7:184537\u2013184551. https:\/\/doi.org\/10.1109\/ACCESS.2019.2960629","journal-title":"IEEE Access"},{"key":"680_CR29","doi-asserted-by":"publisher","DOI":"10.3390\/INFO11080380","author":"B Chen","year":"2020","unstructured":"Chen B, Zhang Z, Liu N et al (2020) Spatiotemporal convolutional neural network with convolutional block attention module for micro-expression recognition. Informatics. https:\/\/doi.org\/10.3390\/INFO11080380","journal-title":"Informatics"},{"key":"680_CR30","doi-asserted-by":"publisher","unstructured":"Xie H-X, Lo L, Shuai H-H, Cheng W-H (2020) AU-assisted graph attention convolutional network for micro-expression recognition. 2871\u20132880. https:\/\/doi.org\/10.1145\/3394171.3414012","DOI":"10.1145\/3394171.3414012"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00680-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-022-00680-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00680-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T10:34:30Z","timestamp":1659522870000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-022-00680-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,20]]},"references-count":30,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["680"],"URL":"https:\/\/doi.org\/10.1007\/s40747-022-00680-2","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,20]]},"assertion":[{"value":"1 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}