{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:42:13Z","timestamp":1777696933071,"version":"3.51.4"},"reference-count":22,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T00:00:00Z","timestamp":1753228800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Intelligent Data Analysis: An International Journal"],"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:p>\n                    Micro-expression is difficult to recognize due to short duration and subtle action range, but it contains rich and real psychological information, which has important research value in criminal investigation, teaching and other fields. In response to issues like limited facial expression dynamics, suboptimal feature extraction, and susceptibility to overfitting, we proposed a micro-expression recognition method based on optical flow and multi-task convolutional neural network (OFMT-Net). It capitalizes on optical flow data from onset to apex frames as input. Feature extraction is conducted through a shared-parameter network, funnelling outputs into a dual-tower network designed for emotional and Action Unit (AU) recognition. This network incorporates a self-attention mechanism for effective classification, driven by a dual weighted loss function. The method fully extracts the relevant information contained in the facial action unit, and uses the implicit data enhancement advantages of the multi-task framework to improve the recognition accuracy and reduce the sample dependence problems. Cross-validation results on the joint dataset demonstrate that the model achieves an accuracy rate of 79.89%, an unweighted average recall rate of 75.05%, and an unweighted F1 score of 75.08%, surpassing many mainstream models. The related code is publicly available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/WenyuanLi001\/OFMT-Net\">https:\/\/github.com\/WenyuanLi001\/OFMT-Net<\/jats:ext-link>\n                  <\/jats:p>","DOI":"10.1177\/1088467x251353227","type":"journal-article","created":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T07:00:04Z","timestamp":1753340404000},"page":"339-353","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["OFMT-net: Advancing micro-expression recognition through optical flow and multi-task network with self-attention"],"prefix":"10.1177","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-3382-3246","authenticated-orcid":false,"given":"Wenyuan","family":"Li","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qinfeng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2025,7,23]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2662237"},{"key":"e_1_3_3_3_2","unstructured":"Frank MG Herbasz M Sinuk K et\u00a0al. I see how you feel: training laypeople and professionals to recognize fleeting emotions. In: Proceedings of the 2009 Annual meeting of the international communication association 2009 pp.3515\u20133522."},{"key":"e_1_3_3_4_2","doi-asserted-by":"crossref","unstructured":"Li X Pfister T Huang X et\u00a0al. A spontaneous micro-expression database: Inducement collection and baseline. In: 2013 10th IEEE International conference and workshops on automatic face and gesture recognition (FG) 2013 pp.1\u20136.","DOI":"10.1109\/FG.2013.6553717"},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","unstructured":"Yan W-J Wu Q Liu Y-J et\u00a0al. Casme database: a dataset of spontaneous micro-expressions collected from neutralized faces. In: 2013 IEEE International conference and workshops on automatic face and gesture recognition (FG) 2013 pp.1\u20137.","DOI":"10.1109\/FG.2013.6553799"},{"key":"e_1_3_3_6_2","article-title":"Casme ii: an improved spontaneous micro-expression database and the baseline evaluation","volume":"9","author":"Yan W-J","year":"2014","unstructured":"Yan W-J, Li X, Wang S-J, et\u00a0al. Casme ii: an improved spontaneous micro-expression database and the baseline evaluation. PLoS ONE 2014; 9: e86041.","journal-title":"PLoS ONE"},{"key":"e_1_3_3_7_2","doi-asserted-by":"crossref","unstructured":"Qu F Wang S-J Yan W-J et\u00a0al. Cas(me)(2): a database of spontaneous macro-expressions and micro-expressions. In: International conference on human-computer interaction 2016 pp.424\u2013436.","DOI":"10.1007\/978-3-319-39513-5_5"},{"key":"e_1_3_3_8_2","doi-asserted-by":"crossref","unstructured":"Chaudhry R Ravichandran A Hager G. Histograms of oriented optical flow and binet-cauchy kernels on nonlinear dynamical systems for the recognition of human actions. In: 2009 IEEE conference on computer vision and pattern recognition 2009 pp.1932\u20131939.","DOI":"10.1109\/CVPR.2009.5206821"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2317711"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2017.2723386"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2485205"},{"key":"e_1_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Teed Z Deng J. Raft: Recurrent all-pairs field transforms for optical flow. In: European conference on computer vision (ECCV) 2020 pp.402\u2013419.","DOI":"10.1007\/978-3-030-58536-5_24"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.06.079"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2020.04.041"},{"key":"e_1_3_3_15_2","doi-asserted-by":"crossref","unstructured":"Luvizon DC Picard D Tabia H. 2D\/3D pose estimation and action recognition using multitask deep learning. In: Computer vision and pattern recognition (CVPR) 2018 pp.5137\u20135146.","DOI":"10.1109\/CVPR.2018.00539"},{"key":"e_1_3_3_16_2","doi-asserted-by":"crossref","unstructured":"Chowdhuri S Pankaj T Zipser K. Multinet: multi-modal multi-task learning for autonomous driving. In: Winter conference on applications of computer vision (WACV) 2017 pp.1496\u20131504.","DOI":"10.1109\/WACV.2019.00164"},{"key":"e_1_3_3_17_2","doi-asserted-by":"crossref","unstructured":"Ma J Zhe Z Yi X et\u00a0al. Modeling task relationships in multi-task learning with multi-gate mixture-of-experts. In: Knowledge discovery & data mining (KDD) 2018 pp.1930\u20131939.","DOI":"10.1145\/3219819.3220007"},{"key":"e_1_3_3_18_2","unstructured":"Vaswani A Shazeer N Parmar N et\u00a0al. Attention is all you need. In: Proceedings of the 31st International conference on neural information processing systems (NIPS) 2017 pp.6000\u20136010."},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2017.11.006"},{"key":"e_1_3_3_20_2","doi-asserted-by":"crossref","unstructured":"Liu Y Yang X Xie D et\u00a0al. Adaptive activation network and functional regularization for efficient and flexible deep multi-task learning. In: Proceedings of the AAAI conference on artificial intelligence vol. 34 no. 4 2020 pp.4924\u20134931.","DOI":"10.1609\/aaai.v34i04.5930"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2019.02.005"},{"key":"e_1_3_3_22_2","doi-asserted-by":"crossref","unstructured":"Lo L Xie H-X Shuai H-H et\u00a0al. Mer-gcn: micro expression recognition based on relation modeling with graph convolutional network. In: 2020 IEEE Conference on multimedia information processing and retrieval (MIPR) 2020 pp.79\u201384.","DOI":"10.1109\/MIPR49039.2020.00023"},{"key":"e_1_3_3_23_2","doi-asserted-by":"crossref","unstructured":"Leong SM Noman F Phan W et\u00a0al. Graphex: facial action unit graph for micro-expression classification. In: 2022 IEEE International conference on image processing (ICIP) 2022 pp.3296\u20133300.","DOI":"10.1109\/ICIP46576.2022.9897873"}],"container-title":["Intelligent Data Analysis: An International Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1088467X251353227","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1088467X251353227","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1088467X251353227","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:21:21Z","timestamp":1777454481000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1088467X251353227"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,23]]},"references-count":22,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,3]]}},"alternative-id":["10.1177\/1088467X251353227"],"URL":"https:\/\/doi.org\/10.1177\/1088467x251353227","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,23]]}}}