{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T04:56:26Z","timestamp":1768539386332,"version":"3.49.0"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T00:00:00Z","timestamp":1766188800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T00:00:00Z","timestamp":1768435200000},"content-version":"vor","delay-in-days":26,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Manipal Academy of Higher Education, Manipal"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Micro-Expression Recognition (MER) plays a crucial role in understanding human emotions, yet its effectiveness is often hindered by the transient and subtle nature of micro-expressions. This article presents a novel MER framework integrating Calibrated Regression with Maximum Mean Discrepancy (MMD), Model-Agnostic Meta-Learning (MAML), and Meta-Reinforcement Learning (Meta-RL) to enhance recognition accuracy and adaptability. The 2D Convolutional Neural Network (2DCNN) is employed as the backbone for feature extraction, capturing fine-grained spatial details of Facial Expressions (FEs). To address challenges in feature alignment, a Heteroscedastic Neural Network (HNN) is introduced for predictive uncertainty estimation. A two-stage learning process is applied, where Negative Log-Likelihood (NLL) optimization refines model parameters, and MMD ensures better alignment between micro- and macro-expressions. Additionally, the Meta-RL framework optimizes feature learning through characterizing the optimal gap of the stationary points achieved using MAML and improving generalization. Extensive experiments on benchmark datasets like SAMM and CASME II shows the advantage of the introduced approach, achieving 96.74% accuracy on SAMM and 98.84% accuracy on CASME II, surpassing state-of-the-art models. The results highlight the model\u2019s robustness, adaptability, and effectiveness, making it well-suited for real-world micro-expression analysis applications.<\/jats:p>","DOI":"10.1007\/s44196-025-01108-8","type":"journal-article","created":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T07:23:41Z","timestamp":1766215421000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Meta-RL Based Micro-Expression Recognition Framework Using MAML with Calibrated Regression Function"],"prefix":"10.1007","volume":"19","author":[{"given":"N","family":"Shwetha","sequence":"first","affiliation":[]},{"given":"Aravind","family":"Jadhav","sequence":"additional","affiliation":[]},{"given":"Chandra","family":"Singh","sequence":"additional","affiliation":[]},{"given":"Virupaxi","family":"B.Dalal","sequence":"additional","affiliation":[]},{"given":"N","family":"Sangeetha","sequence":"additional","affiliation":[]},{"given":"Bhaskar","family":"Awadhiya","sequence":"additional","affiliation":[]},{"given":"Yashwanth","family":"Nanjappa","sequence":"additional","affiliation":[]},{"given":"Y","family":"Rangaswamy","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,12,20]]},"reference":[{"key":"1108_CR1","doi-asserted-by":"crossref","unstructured":"Swathi, A., Kumar, S., Rani, S., Jain, A., & MVNM, R. K. (2022, October). Emotion classification using feature extraction of facial expression. In\u00a02022 2nd International Conference on Technological Advancements in Computational Sciences (ICTACS)\u00a0(pp. 283\u2013288). IEEE.","DOI":"10.1109\/ICTACS56270.2022.9988544"},{"key":"1108_CR2","doi-asserted-by":"crossref","unstructured":"Lei, L., Chen, T., Li, S., & Li, J. (2021). Micro-expression recognition based on facial graph representation learning and facial action unit fusion. In\u00a0Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition\u00a0(pp. 1571\u20131580).","DOI":"10.1109\/CVPRW53098.2021.00173"},{"key":"1108_CR3","doi-asserted-by":"crossref","unstructured":"Bhukya, S., Devi, L. N., & Rao, A. N. (2025). A Fusion Framework for Micro-Expression Recognition Using Hierarchical Transformer Network with DEAC.\u00a0International Journal of Intelligent Engineering & Systems,\u00a018(3).","DOI":"10.22266\/ijies2025.0430.04"},{"key":"1108_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2024.128196","volume":"602","author":"Z Wang","year":"2024","unstructured":"Wang, Z., Zhang, K., Luo, W., Sankaranarayana, R.: Htnet for micro-expression recognition. Neurocomputing 602, 128196 (2024)","journal-title":"Neurocomputing"},{"key":"1108_CR5","unstructured":"Wang, J., Tian, Y., Yang, Y., Chen, X., Zheng, C., & Qiang, W. (2024). Meta-auxiliary learning for micro-expression recognition.\u00a0arXiv preprint arXiv:2404.12024."},{"key":"1108_CR6","doi-asserted-by":"crossref","unstructured":"Yap, C. H., Kendrick, C., & Yap, M. H. (2020, November). Samm long videos: A spontaneous facial micro-and macro-expressions dataset. In\u00a02020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)\u00a0(pp. 771\u2013776). IEEE.","DOI":"10.1109\/FG47880.2020.00029"},{"key":"1108_CR7","doi-asserted-by":"crossref","unstructured":"Nguyen, X. B., Duong, C. N., Li, X., Gauch, S., Seo, H. S., & Luu, K. (2023). Micron-bert: Bert-based facial micro-expression recognition. In\u00a0Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition\u00a0(pp. 1482\u20131492).","DOI":"10.1109\/CVPR52729.2023.00149"},{"key":"1108_CR8","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2025.3530114","author":"HK bin Talib","year":"2025","unstructured":"bin Talib, H.K., Xu, K., Cao, Y., Xu, Y.P., Xu, Z., Zaman, M., Akhunzada, A.: Micro-expression recognition using convolutional variational attention transformer (ConVAT) with multihead attention mechanism. IEEE Access (2025). https:\/\/doi.org\/10.1109\/ACCESS.2025.3530114","journal-title":"IEEE Access"},{"key":"1108_CR9","doi-asserted-by":"crossref","unstructured":"Bhukya, S., Devi, L. N., & Rao, A. N. (2025). Enhanced Micro-Expression Recognition Through Graph Convolutional Networks and Metric Learning.\u00a0Journal of Shanghai Jiaotong University (Science), 1\u201314.","DOI":"10.1007\/s12204-025-2821-9"},{"key":"1108_CR10","doi-asserted-by":"crossref","unstructured":"Xia, B., & Wang, S. (2021, August). Micro-Expression Recognition Enhanced by Macro-Expression from Spatial-Temporal Domain. In\u00a0IJCAI\u00a0(pp. 1186\u20131193).","DOI":"10.24963\/ijcai.2021\/164"},{"issue":"3","key":"1108_CR11","doi-asserted-by":"publisher","first-page":"2526","DOI":"10.1109\/TAFFC.2021.3135516","volume":"14","author":"Y Li","year":"2021","unstructured":"Li, Y., Shan, S.: Meta auxiliary learning for facial action unit detection. IEEE Trans. Affect. Comput. 14(3), 2526\u20132538 (2021)","journal-title":"IEEE Trans. Affect. Comput."},{"issue":"9","key":"1108_CR12","first-page":"5149","volume":"44","author":"T Hospedales","year":"2021","unstructured":"Hospedales, T., Antoniou, A., Micaelli, P., Storkey, A.: Meta-learning in neural networks: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44(9), 5149\u20135169 (2021)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"1108_CR13","unstructured":"Grant, E., Finn, C., Levine, S., Darrell, T., & Griffiths, T. (2018). Recasting gradient-based meta-learning as hierarchical bayes.\u00a0arXiv preprint arXiv:1801.08930."},{"issue":"8","key":"1108_CR14","doi-asserted-by":"publisher","first-page":"2461","DOI":"10.3390\/s24082461","volume":"24","author":"MN Al-Hamadani","year":"2024","unstructured":"Al-Hamadani, M.N., Fadhel, M.A., Alzubaidi, L., Harangi, B.: Reinforcement learning algorithms and applications in healthcare and robotics: a comprehensive and systematic review. Sensors 24(8), 2461 (2024)","journal-title":"Sensors"},{"key":"1108_CR15","unstructured":"Zhao, J., Wei, X., & Bo, L. (2025). R1-omni: Explainable omni-multimodal emotion recognition with reinforcement learning.\u00a0arXiv preprint arXiv:2503.05379."},{"issue":"3","key":"1108_CR16","doi-asserted-by":"publisher","first-page":"1034","DOI":"10.1109\/TCSVT.2021.3072412","volume":"32","author":"K Zhang","year":"2021","unstructured":"Zhang, K., Li, Y., Wang, J., Cambria, E., Li, X.: Real-time video emotion recognition based on reinforcement learning and domain knowledge. IEEE Trans. Circuits Syst. Video Technol. 32(3), 1034\u20131047 (2021)","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"issue":"2","key":"1108_CR17","doi-asserted-by":"publisher","first-page":"1431","DOI":"10.1109\/TAFFC.2021.3061967","volume":"14","author":"P Gupta","year":"2021","unstructured":"Gupta, P.: MERASTC: micro-expression recognition using effective feature encodings and 2D convolutional neural network. IEEE Trans. Affect. Comput. 14(2), 1431\u20131441 (2021)","journal-title":"IEEE Trans. Affect. Comput."},{"key":"1108_CR18","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.neucom.2020.10.082","volume":"427","author":"X Nie","year":"2021","unstructured":"Nie, X., Takalkar, M.A., Duan, M., Zhang, H., Xu, M.: GEME: Dual-stream multi-task GEnder-based micro-expression recognition. Neurocomputing 427, 13\u201328 (2021)","journal-title":"Neurocomputing"},{"key":"1108_CR19","doi-asserted-by":"crossref","unstructured":"Shukla, S., Rai, P. K., & Verlekar, T. T. (2022). Micro-expression recognition using a shallow ConvLSTM-based network. In\u00a0Proceedings of the Asian Conference on Computer Vision\u00a0(pp. 17\u201328).","DOI":"10.1007\/978-3-031-27066-6_2"},{"issue":"2","key":"1108_CR20","doi-asserted-by":"publisher","first-page":"023014","DOI":"10.1117\/1.JEI.33.2.023014","volume":"33","author":"Z Wang","year":"2024","unstructured":"Wang, Z., Fu, W., Zhang, Y., Li, J., Gong, W., Gonz\u00e0lez, J.: MCNet: meta-clustering learning network for micro-expression recognition. J. Electron. Imaging 33(2), 023014\u2013023014 (2024)","journal-title":"J. Electron. Imaging"},{"issue":"1","key":"1108_CR21","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1007\/s10489-024-05896-y","volume":"55","author":"H Wang","year":"2025","unstructured":"Wang, H., Zhou, J., Liu, X., Jia, Y., Chen, T.: A cross-database micro-expression recognition framework based on meta-learning. Appl. Intell. 55(1), 58 (2025)","journal-title":"Appl. Intell."},{"key":"1108_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106172","volume":"204","author":"H Li","year":"2020","unstructured":"Li, H., Xu, H.: Deep reinforcement learning for robust emotional classification in facial expression recognition. Knowledge Based Syst. 204, 106172 (2020)","journal-title":"Knowledge Based Syst."},{"key":"1108_CR23","doi-asserted-by":"crossref","unstructured":"Altaha, M. A., Jarraya, I., Haddad, L., Hamdani, T. M., Chabchoub, H., & Alimi, A. M. (2024). Rlga-fer: Reinforcement learning based on genetic algorithm for facial expression recognition enhancing.\u00a0International Journal of Machine Learning and Cybernetics, 1\u201314.","DOI":"10.2139\/ssrn.4421854"},{"key":"1108_CR24","first-page":"17164","volume":"33","author":"P Cui","year":"2020","unstructured":"Cui, P., Hu, W., Zhu, J.: Calibrated reliable regression using maximum mean discrepancy. Adv. Neural. Inf. Process. Syst. 33, 17164\u201317175 (2020)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"1108_CR25","unstructured":"Wang, L., Cai, Q., Yang, Z., & Wang, Z. (2020, November). On the global optimality of model-agnostic meta-learning. In\u00a0International conference on machine learning\u00a0(pp. 9837\u20139846). PMLR."},{"key":"1108_CR26","unstructured":"The samm v3 dataset is available at \u201chttps:\/\/www.kaggle.com\/datasets\/sadeeshameed\/samm-v3\u201d accessed on March 2025."},{"key":"1108_CR27","unstructured":"The CASME2 Preprocessed v2 dataset is available at \u201chttps:\/\/www.kaggle.com\/datasets\/muhammadzamancuiisb\/casme2-preprocessed-v2\u201d accessed on March 2025."},{"key":"1108_CR28","unstructured":"Kumar, A. J. R., & Bhanu, B. (2022). Three stream graph attention network using dynamic patch selection for the classification of micro-expressions. In\u00a0Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition\u00a0(pp. 2476\u20132485)."},{"key":"1108_CR29","doi-asserted-by":"crossref","unstructured":"Zhai, Z., Zhao, J., Long, C., Xu, W., He, S., & Zhao, H. (2023). Feature representation learning with adaptive displacement generation and transformer fusion for micro-expression recognition. In\u00a0Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition\u00a0(pp. 22086\u201322095).","DOI":"10.1109\/CVPR52729.2023.02115"},{"key":"1108_CR30","doi-asserted-by":"crossref","unstructured":"Verma, M., Lubal, P., Vipparthi, S. K., & Abdel-Mottaleb, M. (2023). Rnas-mer: A refined neural architecture search with hybrid spatiotemporal operations for micro-expression recognition. In\u00a0Proceedings of the IEEE\/CVF winter conference on applications of computer vision\u00a0(pp. 4770\u20134779).","DOI":"10.1109\/WACV56688.2023.00475"},{"issue":"31","key":"1108_CR31","doi-asserted-by":"publisher","first-page":"76833","DOI":"10.1007\/s11042-024-18645-7","volume":"83","author":"Z Xie","year":"2024","unstructured":"Xie, Z., Fan, J., Cheng, S.: Multi-channel capsule network for micro-expression recognition with multiscale fusion. Multimedia Tools Appl. 83(31), 76833\u201376850 (2024)","journal-title":"Multimedia Tools Appl."},{"issue":"4","key":"1108_CR32","doi-asserted-by":"publisher","first-page":"3761","DOI":"10.1007\/s11760-024-03039-x","volume":"18","author":"H Zhang","year":"2024","unstructured":"Zhang, H., Yin, L., Zhang, H., Wu, X.: Facial micro-expression recognition using three-stream vision transformer network with sparse sampling and relabeling. Signal Image Video Process. 18(4), 3761\u20133771 (2024)","journal-title":"Signal Image Video Process."},{"issue":"5","key":"1108_CR33","doi-asserted-by":"publisher","first-page":"1574","DOI":"10.3390\/s24051574","volume":"24","author":"Z Wang","year":"2024","unstructured":"Wang, Z., Yang, M., Jiao, Q., Xu, L., Han, B., Li, Y., Tan, X.: Two-level spatio-temporal feature fused two-stream network for micro-expression recognition. Sensors 24(5), 1574 (2024)","journal-title":"Sensors"},{"key":"1108_CR34","doi-asserted-by":"crossref","unstructured":"Kumar, A. J. R., & Bhanu, B. (2024). Uncovering Hidden Emotions with Adaptive Multi-Attention Graph Networks. In\u00a0Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition\u00a0(pp. 4822\u20134831).","DOI":"10.1109\/CVPRW63382.2024.00485"},{"key":"1108_CR35","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2022.108594","volume":"119","author":"L Cai","year":"2022","unstructured":"Cai, L., Li, H., Dong, W., Fang, H.: Micro-expression recognition using 3D DenseNet fused Squeeze-and-Excitation Networks. Appl. Soft Comput. 119, 108594 (2022)","journal-title":"Appl. Soft Comput."},{"key":"1108_CR36","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1016\/j.ins.2022.11.113","volume":"630","author":"S Thuseethan","year":"2023","unstructured":"Thuseethan, S., Rajasegarar, S., Yearwood, J.: Deep3DCANN: A Deep 3DCNN-ANN framework for spontaneous micro-expression recognition. Inf. Sci. 630, 341\u2013355 (2023)","journal-title":"Inf. Sci."},{"issue":"7","key":"1108_CR37","doi-asserted-by":"publisher","first-page":"3577","DOI":"10.3390\/s23073577","volume":"23","author":"Z Li","year":"2023","unstructured":"Li, Z., Zhang, Y., Xing, H., Chan, K.L.: Facial micro-expression recognition using double-stream 3D convolutional neural network with domain adaptation. Sensors 23(7), 3577 (2023)","journal-title":"Sensors"},{"key":"1108_CR38","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2024.3397701","author":"Y Bao","year":"2024","unstructured":"Bao, Y., Wu, C., Zhang, P., Shan, C., Qi, Y., Ben, X.: Boosting micro-expression recognition via self-expression reconstruction and memory contrastive learning. IEEE Trans. Affect. Comput. (2024). https:\/\/doi.org\/10.1109\/TAFFC.2024.3397701","journal-title":"IEEE Trans. Affect. Comput."},{"key":"1108_CR39","doi-asserted-by":"crossref","unstructured":"Wang, L., Huang, P., Cai, W., & Liu, X. (2024, April). Micro-expression recognition by fusing action unit detection and spatio-temporal features. In\u00a0ICASSP 2024\u20132024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)\u00a0(pp. 5595\u20135599). IEEE.","DOI":"10.1109\/ICASSP48485.2024.10446702"},{"issue":"3","key":"1108_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s40747-024-01660-4","volume":"11","author":"M Zhang","year":"2025","unstructured":"Zhang, M., Yang, W., Wang, L., Wu, Z., Chen, D.: HFA-Net: hierarchical feature aggregation network for micro-expression recognition. Complex & Intelligent Systems 11(3), 1\u201320 (2025)","journal-title":"Complex & Intelligent Systems"},{"key":"1108_CR41","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1016\/j.neucom.2021.03.058","volume":"448","author":"S Zhao","year":"2021","unstructured":"Zhao, S., Tao, H., Zhang, Y., Xu, T., Zhang, K., Hao, Z., Chen, E.: A two-stage 3D CNN based learning method for spontaneous micro-expression recognition. Neurocomputing 448, 276\u2013289 (2021)","journal-title":"Neurocomputing"},{"key":"1108_CR42","unstructured":"The SMIC dataset is available at \u201chttps:\/\/www.kaggle.com\/datasets\/aftabhussaincui\/smic-preprocessed\u201d accessed on October 2025."},{"key":"1108_CR43","unstructured":"The CAS(ME)2 dataset is available at \u201chttp:\/\/casme.psych.ac.cn\/casme\/e3\u201d accessed on October 2025."},{"key":"1108_CR44","unstructured":"The CAS(ME)3 dataset is available at \u201chttps:\/\/github.com\/jingtingEmmaLi\/CAS-ME-3\u201d accessed on October 2025."}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-025-01108-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-025-01108-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-025-01108-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T11:59:58Z","timestamp":1768478398000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-025-01108-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,20]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["1108"],"URL":"https:\/\/doi.org\/10.1007\/s44196-025-01108-8","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,20]]},"assertion":[{"value":"15 August 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 December 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 December 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This manuscript does not contain any studies with human participants or animals performed by the author.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"Not Applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Clinical Trial Number"}}],"article-number":"28"}}