{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T15:15:00Z","timestamp":1779203700720,"version":"3.51.4"},"reference-count":43,"publisher":"Fuji Technology Press Ltd.","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JACIII","J. Adv. Comput. Intell. Intell. Inform."],"published-print":{"date-parts":[[2026,5,20]]},"abstract":"<jats:p>A multimodal emotion recognition method based on a multi-scale vision Transformer and cross attention mechanism (MSFCA) is proposed. The proposed method integrates a multi-scale vision Transformer and a cross-attention mechanism to fully exploit the complementary information between facial expressions and speech modalities, thereby enabling more effective feature extraction and fusion. By incorporating L1 regularization, the sparsity and robustness of the fused features are enhanced, thereby improving the accuracy and generalization capability of multi-modal emotion recognition. Experimental results on the eNTERFACE\u201905 and RAVDESS multi-modal emotion recognition datasets demonstrate that the proposed MSFCA method achieves recognition accuracies of 86.16% and 87.14%, respectively, which satisfy the requirements for reliable multi-modal emotion recognition in practical applications.<\/jats:p>","DOI":"10.20965\/jaciii.2026.p0749","type":"journal-article","created":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T15:02:09Z","timestamp":1779202929000},"page":"749-760","source":"Crossref","is-referenced-by-count":0,"title":["Cross-Attention Audio\u2013Visual Fusion Based on Multi-Scale Vision Transformers for Emotion Recognition"],"prefix":"10.20965","volume":"30","author":[{"given":"Chengao","family":"Bao","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence and Automation, China University of Geosciences, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"},{"name":"Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, \tEngineering Research Center of Intelligent Technology for Geo-Exploration, Ministry of Education, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luefeng","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Automation, China University of Geosciences, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"},{"name":"Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, \tEngineering Research Center of Intelligent Technology for Geo-Exploration, Ministry of Education, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Li","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Automation, China University of Geosciences, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"},{"name":"Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, \tEngineering Research Center of Intelligent Technology for Geo-Exploration, Ministry of Education, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence and Automation, China University of Geosciences, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"},{"name":"Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, \tEngineering Research Center of Intelligent Technology for Geo-Exploration, Ministry of Education, No.388 Lumo Road, Hongshan District, Wuhan, Hubei 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Witold","family":"Pedrycz","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Alberta, 116 Street and 85 Avenue, Edmonton, Alberta T6R 2G7, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kaoru","family":"Hirota","sequence":"additional","affiliation":[{"name":"Tokyo Institute of Technology, 2-12-1 Ookayama, Meguro-ku, Tokyo 152-8550, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"8550","published-online":{"date-parts":[[2026,5,20]]},"reference":[{"key":"key-10.20965\/jaciii.2026.p0749-1","doi-asserted-by":"crossref","unstructured":"E. Sariyanidi, H. Gunes, and A. Cavallaro, \u201cAutomatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition,\u201d IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol.37, Issue 6, pp. 1113-1133, 2014. https:\/\/doi.org\/10.1109\/TPAMI.2014.2366127","DOI":"10.1109\/TPAMI.2014.2366127"},{"key":"key-10.20965\/jaciii.2026.p0749-2","doi-asserted-by":"crossref","unstructured":"J. A. Russell, \u201cA circumplex model of affect,\u201d J. of Personality and Social Psychology, Vol.39, No.6, pp. 1161-1178, 1980. https:\/\/doi.org\/10.1037\/h0077714","DOI":"10.1037\/h0077714"},{"key":"key-10.20965\/jaciii.2026.p0749-3","doi-asserted-by":"crossref","unstructured":"P. Ekman, \u201cAn argument for basic emotions,\u201d Cognition and Emotion, Vol.6, Issues 3-4, pp. 169-200, 1992. https:\/\/doi.org\/10.1080\/02699939208411068","DOI":"10.1080\/02699939208411068"},{"key":"key-10.20965\/jaciii.2026.p0749-4","doi-asserted-by":"crossref","unstructured":"A. Majumder, L. Behera, and V. K. Subramanian, \u201cAutomatic Facial Expression Recognition System Using Deep Network-Based Data Fusion,\u201d IEEE Trans. on Cybernetics, Vol.48, Issue 1, pp. 103-114, 2018. https:\/\/doi.org\/10.1109\/TCYB.2016.2625419","DOI":"10.1109\/TCYB.2016.2625419"},{"key":"key-10.20965\/jaciii.2026.p0749-5","doi-asserted-by":"crossref","unstructured":"Z.-T. Liu, X. Xu, J. She, Z. Yang, and D. Chen, \u201cElectroencephalography Emotion Recognition Based on Rhythm Information Entropy Extraction,\u201d J. Adv. Comput. Intell. Intell. Inform., Vol.28, No.5, pp. 1095-1106, 2024. https:\/\/doi.org\/10.20965\/jaciii.2024.p1095","DOI":"10.20965\/jaciii.2024.p1095"},{"key":"key-10.20965\/jaciii.2026.p0749-6","doi-asserted-by":"crossref","unstructured":"X. Ma, Z. Wu, J. Jia, M. Xu, H. Meng, and L. Cai, \u201cEmotion Recognition from Variable-Length Speech Segments Using Deep Learning on Spectrograms,\u201d Interspeech, pp. 3683-3687, 2018. https:\/\/doi.org\/10.21437\/Interspeech.2018-2228","DOI":"10.21437\/Interspeech.2018-2228"},{"key":"key-10.20965\/jaciii.2026.p0749-7","doi-asserted-by":"crossref","unstructured":"X. Liu, X. Yin, M. Wang, Y. Cai, and G. Qi, \u201cEmotion Recognition Based on Multi-Composition Deep Forest and Transferred Convolutional Neural Network,\u201d J. Adv. Comput. Intell. Intell. Inform., Vol.23, No.5, pp. 883-890, 2019. https:\/\/doi.org\/10.20965\/jaciii.2019.p0883","DOI":"10.20965\/jaciii.2019.p0883"},{"key":"key-10.20965\/jaciii.2026.p0749-8","doi-asserted-by":"crossref","unstructured":"D. Wang, T. Zhao, W. Yu, N. V. Chawla, and M. Jiang, \u201cDeep Multimodal Complementarity Learning,\u201d IEEE Trans. on Neural Networks and Learning Systems, Vol.34, Issue 12, pp. 10213-10224, 2022. https:\/\/doi.org\/10.1109\/TNNLS.2022.3165180","DOI":"10.1109\/TNNLS.2022.3165180"},{"key":"key-10.20965\/jaciii.2026.p0749-9","doi-asserted-by":"crossref","unstructured":"N. Saito, K. Maeda, T. Ogawa, S. Asamizu, and M. Haseyama, \u201cVisual Emotion Recognition Through Multimodal Cyclic-Label Dequantized Gaussian Process Latent Variable Model,\u201d J. Robot. Mechatron., Vol.35, No.5, pp. 1321-1330, 2023. https:\/\/doi.org\/10.20965\/jrm.2023.p1321","DOI":"10.20965\/jrm.2023.p1321"},{"key":"key-10.20965\/jaciii.2026.p0749-10","doi-asserted-by":"crossref","unstructured":"H. Zhou, J. Du, Y. Zhang, Q. Wang, Q.-F. Liu, and C.-H. Lee, \u201cInformation Fusion in Attention Networks Using Adaptive and Multi-Level Factorized Bilinear Pooling for Audio-Visual Emotion Recognition,\u201d IEEE\/ACM Trans. on Audio, Speech, and Language Processing, Vol.29, pp. 2617-2629, 2021. https:\/\/doi.org\/10.1109\/TASLP.2021.3096037","DOI":"10.1109\/TASLP.2021.3096037"},{"key":"key-10.20965\/jaciii.2026.p0749-11","doi-asserted-by":"crossref","unstructured":"J.-H. Hsu and C.-H. Wu, \u201cApplying Segment-Level Attention on Bi-Modal Transformer Encoder for Audio-Visual Emotion Recognition,\u201d IEEE Trans. on Affective Computing, Vol.14, Issue 4, pp. 3231-3243, 2023. https:\/\/doi.org\/10.1109\/TAFFC.2023.3258900","DOI":"10.1109\/TAFFC.2023.3258900"},{"key":"key-10.20965\/jaciii.2026.p0749-12","unstructured":"A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, \u0141. Kaiser, and I. Polosukhin, \u201cAttention is All You Need,\u201d Advances in Neural Information Processing Systems, Vol.30, 2017."},{"key":"key-10.20965\/jaciii.2026.p0749-13","doi-asserted-by":"crossref","unstructured":"M.-H. Yi, K.-C. Kwak, and J.-H. Shin, \u201cHyFusER: Hybrid Multimodal Transformer for Emotion Recognition Using Dual Cross Modal Attention,\u201d Applied Sciences, Vol.15, Issue 3, Article No.1053, 2025. https:\/\/doi.org\/10.3390\/app15031053","DOI":"10.3390\/app15031053"},{"key":"key-10.20965\/jaciii.2026.p0749-14","doi-asserted-by":"crossref","unstructured":"N. Dalal and B. Triggs, \u201cHistograms of oriented gradients for human detection,\u201d 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR\u201905), Vol.1, pp. 886-893, 2005. https:\/\/doi.org\/10.1109\/CVPR.2005.177","DOI":"10.1109\/CVPR.2005.177"},{"key":"key-10.20965\/jaciii.2026.p0749-15","doi-asserted-by":"crossref","unstructured":"W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg, \u201cSSD: Single Shot MultiBox Detector,\u201d B. Leibe, J. Matas, N. Sebe, and M. Welling (Eds.), \u201cComputer Vision \u2013 ECCV 2016: 14th European Conf.,\u201d Lecture Notes in Computer Science, Vol.9905, pp. 21-37, Springer, 2016. https:\/\/doi.org\/10.1007\/978-3-319-46448-0_2","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"key-10.20965\/jaciii.2026.p0749-16","doi-asserted-by":"crossref","unstructured":"P. O. Pinheiro, T.-Y. Lin, R. Collobert, and P. Doll\u00e1r, \u201cLearning to Refine Object Segments,\u201d B. Leibe, J. Matas, N. Sebe, and M. Welling (Eds.), \u201cComputer Vision \u2013 ECCV 2016: 14th European Conf.,\u201d Lecture Notes in Computer Science, Vol.9905, pp. 75-91, Springer, 2016. https:\/\/doi.org\/10.1007\/978-3-319-46448-0_5","DOI":"10.1007\/978-3-319-46448-0_5"},{"key":"key-10.20965\/jaciii.2026.p0749-17","doi-asserted-by":"crossref","unstructured":"T.-Y. Lin, P. Doll\u00e1r, R. Girshick, K. He, B. Hariharan, and S. Belongie, \u201cFeature Pyramid Networks for Object Detection,\u201d Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 936-944, 2017. https:\/\/doi.org\/10.1109\/CVPR.2017.106","DOI":"10.1109\/CVPR.2017.106"},{"key":"key-10.20965\/jaciii.2026.p0749-18","doi-asserted-by":"crossref","unstructured":"Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, \u201cGradient-based learning applied to document recognition,\u201d Proc. of the IEEE, Vol.86, Issue 11, pp. 2278-2324, 1998. https:\/\/doi.org\/10.1109\/5.726791","DOI":"10.1109\/5.726791"},{"key":"key-10.20965\/jaciii.2026.p0749-19","doi-asserted-by":"crossref","unstructured":"J. M. S. Souza, C. da S. M. Alves, J. de J. F. Cerqueira, W. L. A. de Oliveira, O. M. Pires, N. S. B. dos Santos, A. B. V. Wyzykowski, O. R. Pinheiro, D. G. de A. Filho, and J. D. V. Barbosa, \u201cFacial Biosignals Time-Series Dataset (FBioT): A Visual-Temporal Facial Expression Recognition (VT-FER) Approach,\u201d Electronics, Vol.13, Issue 24, Article No.4867, 2024. https:\/\/doi.org\/10.3390\/electronics13244867","DOI":"10.3390\/electronics13244867"},{"key":"key-10.20965\/jaciii.2026.p0749-20","doi-asserted-by":"crossref","unstructured":"K. He, X. Zhang, S. Ren, and J. Sun, \u201cDeep Residual Learning for Image Recognition,\u201d Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, 2016. https:\/\/doi.org\/10.1109\/CVPR.2016.90","DOI":"10.1109\/CVPR.2016.90"},{"key":"key-10.20965\/jaciii.2026.p0749-21","unstructured":"A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, \u201cAn Image is Worth 16\u00d716 Words: Transformers for Image Recognition at Scale,\u201d arXiv preprint, arXiv:2010.11929, 2020. https:\/\/doi.org\/10.48550\/arXiv.2010.11929"},{"key":"key-10.20965\/jaciii.2026.p0749-22","doi-asserted-by":"crossref","unstructured":"H. Fan, B. Xiong, K. Mangalam, Y. Li, Z. Yan, J. Malik, and C. Feichtenhofer, \u201cMultiscale Vision Transformers,\u201d Proc. of the IEEE\/CVF Int. Conf. on Computer Vision (ICCV), pp. 6804-6815, 2021. https:\/\/doi.org\/10.1109\/ICCV48922.2021.00675","DOI":"10.1109\/ICCV48922.2021.00675"},{"key":"key-10.20965\/jaciii.2026.p0749-23","doi-asserted-by":"crossref","unstructured":"W. Wang, E. Xie, X. Li, D.-P. Fan, K. Song, D. Liang, T. Lu, P. Luo, and L. Shao, \u201cPyramid Vision Transformer: A Versatile Backbone for Dense Prediction Without Convolutions,\u201d Proc. of the IEEE\/CVF Int. Conf. on Computer Vision (ICCV), pp. 548-558, 2021. https:\/\/doi.org\/10.1109\/ICCV48922.2021.00061","DOI":"10.1109\/ICCV48922.2021.00061"},{"key":"key-10.20965\/jaciii.2026.p0749-24","doi-asserted-by":"crossref","unstructured":"C.-F. R. Chen, Q. Fan, and R. Panda, \u201cCrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification,\u201d Proc. of the IEEE\/CVF Int. Conf. on Computer Vision (ICCV), pp. 347-356, 2021. https:\/\/doi.org\/10.1109\/ICCV48922.2021.00041","DOI":"10.1109\/ICCV48922.2021.00041"},{"key":"key-10.20965\/jaciii.2026.p0749-25","doi-asserted-by":"crossref","unstructured":"P. Tzirakis, G. Trigeorgis, M. A. Nicolaou, B. W. Schuller, and S. Zafeiriou, \u201cEnd-to-End Multimodal Emotion Recognition Using Deep Neural Networks,\u201d IEEE J. of Selected Topics in Signal Processing, Vol.11, Issue 8, pp. 1301-1309, 2017. https:\/\/doi.org\/10.1109\/JSTSP.2017.2764438","DOI":"10.1109\/JSTSP.2017.2764438"},{"key":"key-10.20965\/jaciii.2026.p0749-26","doi-asserted-by":"crossref","unstructured":"L. Schoneveld, A. Othmani, and H. Abdelkawy, \u201cLeveraging recent advances in deep learning for audio-visual emotion recognition,\u201d Pattern Recognition Letters, Vol.146, pp. 1-7, 2021. https:\/\/doi.org\/10.1016\/j.patrec.2021.03.007","DOI":"10.1016\/j.patrec.2021.03.007"},{"key":"key-10.20965\/jaciii.2026.p0749-27","doi-asserted-by":"crossref","unstructured":"H. Liu, Z. Sun, H. Li, Y. Li, W. Zhang, and T. Song, \u201cEAVFormer: An end-to-end audio and visual emotion recognition network based on transformers,\u201d Multimedia Systems, Vol.31, Article No.262, 2025. https:\/\/doi.org\/10.1007\/s00530-025-01845-y","DOI":"10.1007\/s00530-025-01845-y"},{"key":"key-10.20965\/jaciii.2026.p0749-28","doi-asserted-by":"crossref","unstructured":"Y.-H. Zhang, R. Huang, J. Zeng, and S. Shan, \u201cM\n                      3\n                      F: Multi-Modal Continuous Valence-Arousal Estimation in the Wild,\u201d 2020 15th IEEE Int. Conf. on Automatic Face and Gesture Recognition (FG 2020), pp. 632-636, 2020. https:\/\/doi.org\/10.1109\/FG47880.2020.00098","DOI":"10.1109\/FG47880.2020.00098"},{"key":"key-10.20965\/jaciii.2026.p0749-29","doi-asserted-by":"crossref","unstructured":"R. Liu, H. Zuo, Z. Lian, B. W. Schuller, and H. Li, \u201cContrastive Learning Based Modality-Invariant Feature Acquisition for Robust Multimodal Emotion Recognition with Missing Modalities,\u201d IEEE Trans. on Affective Computing, Vol.15, Issue 4, pp. 1856-1873, 2024. https:\/\/doi.org\/10.1109\/TAFFC.2024.3378570","DOI":"10.1109\/TAFFC.2024.3378570"},{"key":"key-10.20965\/jaciii.2026.p0749-30","doi-asserted-by":"crossref","unstructured":"E. Ghaleb, J. Niehues, and S. Asteriadis, \u201cMultimodal Attention-Mechanism For Temporal Emotion Recognition,\u201d 2020 IEEE Int. Conf. on Image Processing (ICIP), pp. 251-255, 2020. https:\/\/doi.org\/10.1109\/ICIP40778.2020.9191019","DOI":"10.1109\/ICIP40778.2020.9191019"},{"key":"key-10.20965\/jaciii.2026.p0749-31","doi-asserted-by":"crossref","unstructured":"J. Huang, J. Tao, B. Liu, Z. Lian, and M. Niu, \u201cMultimodal Transformer Fusion for Continuous Emotion Recognition,\u201d 2020 IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP 2020), pp. 3507-3511, 2020. https:\/\/doi.org\/10.1109\/ICASSP40776.2020.9053762","DOI":"10.1109\/ICASSP40776.2020.9053762"},{"key":"key-10.20965\/jaciii.2026.p0749-32","doi-asserted-by":"crossref","unstructured":"O. Martin, I. Kotsia, B. Macq, and I. Pitas, \u201cThe eNTERFACE\u2019 05 Audio-Visual Emotion Database,\u201d 22nd Int. Conf. on Data Engineering Workshops (ICDEW\u201906), p. 8, 2006. https:\/\/doi.org\/10.1109\/ICDEW.2006.145","DOI":"10.1109\/ICDEW.2006.145"},{"key":"key-10.20965\/jaciii.2026.p0749-33","doi-asserted-by":"crossref","unstructured":"S. R. Livingstone and F. A. Russo, \u201cThe Ryerson audio-visual database of emotional speech and song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English,\u201d PloS One, Vol.13, No.5, Article No.e0196391, 2018. https:\/\/doi.org\/10.1371\/journal.pone.0196391","DOI":"10.1371\/journal.pone.0196391"},{"key":"key-10.20965\/jaciii.2026.p0749-34","doi-asserted-by":"crossref","unstructured":"C. Busso, M. Bulut, C.-C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. N. Chang, S. Lee, and S. S. Narayanan, \u201cIEMOCAP: Interactive emotional dyadic motion capture database,\u201d Language Resources and Evaluation, Vol.42, No.4, pp. 335-359, 2008. https:\/\/doi.org\/10.1007\/s10579-008-9076-6","DOI":"10.1007\/s10579-008-9076-6"},{"key":"key-10.20965\/jaciii.2026.p0749-35","doi-asserted-by":"crossref","unstructured":"C. Lu, Y. Zong, W. Zheng, Y. Li, C. Tang, and B. W. Schuller, \u201cDomain Invariant Feature Learning for Speaker-Independent Speech Emotion Recognition,\u201d IEEE\/ACM Trans. on Audio, Speech, and Language Processing, Vol.30, pp. 2217-2230, 2022. https:\/\/doi.org\/10.1109\/TASLP.2022.3178232","DOI":"10.1109\/TASLP.2022.3178232"},{"key":"key-10.20965\/jaciii.2026.p0749-36","doi-asserted-by":"crossref","unstructured":"D. Nguyen, K. Nguyen, S. Sridharan, A. Ghasemi, D. Dean, and C. Fookes, \u201cDeep Spatio-Temporal Features for Multimodal Emotion Recognition,\u201d 2017 IEEE Winter Conf. on Applications of Computer Vision (WACV), pp. 1215-1223, 2017. https:\/\/doi.org\/10.1109\/WACV.2017.140","DOI":"10.1109\/WACV.2017.140"},{"key":"key-10.20965\/jaciii.2026.p0749-37","doi-asserted-by":"crossref","unstructured":"F. Ma, W. Zhang, Y. Li, S.-L. Huang, and L. Zhang, \u201cAn End-to-End Learning Approach for Multimodal Emotion Recognition: Extracting Common and Private Information,\u201d 2019 IEEE Int. Conf. on Multimedia and Expo (ICME), pp. 1144-1149, 2019. https:\/\/doi.org\/10.1109\/ICME.2019.00200","DOI":"10.1109\/ICME.2019.00200"},{"key":"key-10.20965\/jaciii.2026.p0749-38","doi-asserted-by":"crossref","unstructured":"Mustaqeem and S. Kwon, \u201cAtt-Net: Enhanced emotion recognition system using lightweight self-attention module,\u201d Applied Soft Computing, Vol.102, Article No.107101, 2021. https:\/\/doi.org\/10.1016\/j.asoc.2021.107101","DOI":"10.1016\/j.asoc.2021.107101"},{"key":"key-10.20965\/jaciii.2026.p0749-39","doi-asserted-by":"crossref","unstructured":"R. Fan, H. Liu, Y. Li, P. Guo, G. Wang, and T. Wang, \u201cAttA-NET: Attention Aggregation Network for Audio-Visual Emotion Recognition,\u201d 2024 IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP 2024), pp. 8030-8034, 2024. https:\/\/doi.org\/10.1109\/ICASSP48485.2024.10447640","DOI":"10.1109\/ICASSP48485.2024.10447640"},{"key":"key-10.20965\/jaciii.2026.p0749-40","doi-asserted-by":"crossref","unstructured":"A. I. Middya, B. Nag, and S. Roy, \u201cDeep learning based multimodal emotion recognition using model-level fusion of audio\u2013visual modalities,\u201d Knowledge-Based Systems, Vol.244, Article No.108580, 2022. https:\/\/doi.org\/10.1016\/j.knosys.2022.108580","DOI":"10.1016\/j.knosys.2022.108580"},{"key":"key-10.20965\/jaciii.2026.p0749-41","unstructured":"W. Wang, R. Arora, K. Livescu, and J. Bilmes, \u201cOn Deep Multi-View Representation Learning,\u201d Proc. of the 32nd Int. Conf. on Machine Learning, Vol.37, pp. 1083-1092, 2015."},{"key":"key-10.20965\/jaciii.2026.p0749-42","doi-asserted-by":"crossref","unstructured":"J. Zhao, R. Li, and Q. Jin, \u201cMissing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities,\u201d Proc. of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th Int. Joint Conf. on Natural Language Processing (Vol.1: Long Papers), pp. 2608-2618, 2021. https:\/\/doi.org\/10.18653\/v1\/2021.acl-long.203","DOI":"10.18653\/v1\/2021.acl-long.203"},{"key":"key-10.20965\/jaciii.2026.p0749-43","doi-asserted-by":"crossref","unstructured":"J. Ye, X.-C. Wen, Y. Wei, Y. Xu, K. Liu, and H. Shan, \u201cTemporal Modeling Matters: A Novel Temporal Emotional Modeling Approach for Speech Emotion Recognition,\u201d 2023 IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP 2023), 2023. https:\/\/doi.org\/10.1109\/ICASSP49357.2023.10096370","DOI":"10.1109\/ICASSP49357.2023.10096370"}],"container-title":["Journal of Advanced Computational Intelligence and Intelligent Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.fujipress.jp\/main\/wp-content\/themes\/Fujipress\/hyosetsu.php?ppno=jacii003000030011","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T15:03:42Z","timestamp":1779203022000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.fujipress.jp\/jaciii\/jc\/jacii003000030749"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,20]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,5,20]]},"published-print":{"date-parts":[[2026,5,20]]}},"URL":"https:\/\/doi.org\/10.20965\/jaciii.2026.p0749","relation":{},"ISSN":["1883-8014","1343-0130"],"issn-type":[{"value":"1883-8014","type":"electronic"},{"value":"1343-0130","type":"print"}],"subject":[],"published":{"date-parts":[[2026,5,20]]}}}