{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T17:36:17Z","timestamp":1774719377280,"version":"3.50.1"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T00:00:00Z","timestamp":1748304000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T00:00:00Z","timestamp":1748304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SIViP"],"published-print":{"date-parts":[[2025,8]]},"DOI":"10.1007\/s11760-025-04201-9","type":"journal-article","created":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T06:39:49Z","timestamp":1748327989000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A dynamic weighted fusion model for multimodal sentiment analysis"],"prefix":"10.1007","volume":"19","author":[{"given":"Liang","family":"Yang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,5,27]]},"reference":[{"issue":"2","key":"4201_CR1","first-page":"38","volume":"10","author":"R Kaur","year":"2019","unstructured":"Kaur, R., Kautish, S.: Multimodal sentiment analysis: a survey and comparison. Int. J. Service Sci. Manag. Eng. Technol. (IJSSMET) 10(2), 38\u201358 (2019)","journal-title":"Int. J. Service Sci. Manag. Eng. Technol. (IJSSMET)"},{"key":"4201_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2017.08.003","author":"M Soleymani","year":"2017","unstructured":"Soleymani, M., Garcia, D., JouBrendan, B.S., et al.: A survey of multimodal sentiment analysis. Image Vis. Comput. (2017). https:\/\/doi.org\/10.1016\/j.imavis.2017.08.003","journal-title":"Image Vis. Comput."},{"issue":"1","key":"4201_CR3","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1757\/1\/012038","volume":"1757","author":"X Guo","year":"2021","unstructured":"Guo, X., Yu, W., Wang, X.: An overview on fine-grained text sentiment analysis: survey and challenges. J. Phys. Conf. Ser. 1757(1), 012038 (2021). https:\/\/doi.org\/10.1088\/1742-6596\/1757\/1\/012038","journal-title":"J. Phys. Conf. Ser."},{"key":"4201_CR4","doi-asserted-by":"publisher","first-page":"1253","DOI":"10.1002\/widm.1253","volume":"8","author":"L Zhang","year":"2018","unstructured":"Zhang, L., Wang, S., Liu, B.: Deep learning for sentiment analysis: a survey. Wiley Int. Rev. Data Min. and Knowledge Discov. 8, 1253 (2018). https:\/\/doi.org\/10.1002\/widm.1253","journal-title":"Wiley Int. Rev. Data Min. and Knowledge Discov."},{"key":"4201_CR5","doi-asserted-by":"publisher","unstructured":"Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L. P. (2017). Tensor Fusion Network for Multimodal Sentiment Analysis, In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. https:\/\/doi.org\/10.18653\/v1\/D17-1115.","DOI":"10.18653\/v1\/D17-1115"},{"issue":"8","key":"4201_CR6","doi-asserted-by":"publisher","first-page":"9341","DOI":"10.1609\/aaai.v38i8.28787","volume":"38","author":"L Zhang","year":"2024","unstructured":"Zhang, L., Jin, L., Xu, G., Li, X., Xu, C., Wei, K., Liu, N., Liu, H.: CAMEL: capturing metaphorical alignment with context disentangling for multimodal emotion recognition. Proceed. AAAI Confer. on Artific. Intell. 38(8), 9341\u20139349 (2024). https:\/\/doi.org\/10.1609\/aaai.v38i8.28787","journal-title":"Proceed. AAAI Confer. on Artific. Intell."},{"key":"4201_CR7","doi-asserted-by":"publisher","unstructured":"S. Bai, J. Z. Kolter, V. Koltun. (2018). An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. https:\/\/doi.org\/10.48550\/arXiv.1803.01271","DOI":"10.48550\/arXiv.1803.01271"},{"key":"4201_CR8","unstructured":"Vaswani, A., Shazeer, N. M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., & Polosukhin, I. (2017). Attention is All you Need. Neural Information Processing Systems."},{"key":"4201_CR9","doi-asserted-by":"publisher","unstructured":"Chandrasekaran G, Nguyen T N, Jude H D. Multimodal sentimental analysis for social media applications: A comprehensive review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. https:\/\/https:\/\/doi.org\/10.1002\/widm.1415.","DOI":"10.1002\/widm.1415"},{"key":"4201_CR10","doi-asserted-by":"publisher","first-page":"111206","DOI":"10.1016\/j.asoc.2023.111206","volume":"152","author":"A Pandey","year":"2024","unstructured":"Pandey, A., Vishwakarma, D.K.: Progress, achievements, and challenges in multimodal sentiment analysis using deep learning: a survey. Appl. Soft Comput. 152, 111206 (2024). https:\/\/doi.org\/10.1016\/j.asoc.2023.111206","journal-title":"Appl. Soft Comput."},{"key":"4201_CR11","doi-asserted-by":"publisher","first-page":"102563","DOI":"10.1016\/j.displa.2023.102563","volume":"80","author":"S Lai","year":"2023","unstructured":"Lai, S., Hu, X., Xu, H., Ren, Z., Liu, Z.: Multimodal sentiment analysis: a survey. Displays 80, 102563 (2023). https:\/\/doi.org\/10.1016\/j.displa.2023.102563","journal-title":"Displays"},{"key":"4201_CR12","unstructured":"Malhotra, P., Vig, L., Shroff, G., & Agarwal, P. (2015). Long Short-Term Memory Networks for Anomaly Detection in Time Series. In: 23rd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2015."},{"key":"4201_CR13","doi-asserted-by":"publisher","unstructured":"Liu, Z., Shen, Y., Lakshminarasimhan, V. B., Liang, P. P., Zadeh, A., & Morency, L. P. (2018). Efficient low-rank multimodal fusion with modality-specific factors. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2247\u20132256, Melbourne, Australia. Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/P18-1209","DOI":"10.18653\/v1\/P18-1209"},{"issue":"01","key":"4201_CR14","doi-asserted-by":"publisher","first-page":"7216","DOI":"10.1609\/aaai.v33i01.33017216","volume":"33","author":"Y Wang","year":"2019","unstructured":"Wang, Y., Shen, Y., Liu, Z., Liang, P.P., Zadeh, A., Morency, L.-P.: Words can shift: dynamically adjusting word representations using nonverbal behaviors. Proceed. AAAI Confer. Artific. Intell. 33(01), 7216\u20137223 (2019). https:\/\/doi.org\/10.1609\/aaai.v33i01.33017216","journal-title":"Proceed. AAAI Confer. Artific. Intell."},{"key":"4201_CR15","doi-asserted-by":"publisher","unstructured":"Tsai, Y. H. H., Bai, S., Liang, P. P., Kolter, J. Z., & Salakhutdinov, R. (2019). Multimodal transformer for unaligned multimodal language sequences, In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 6558\u20136569. https:\/\/doi.org\/10.18653\/v1\/P19-1656","DOI":"10.18653\/v1\/P19-1656"},{"key":"4201_CR16","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1007\/s12559-022-10073-9","volume":"15","author":"F Wang","year":"2023","unstructured":"Wang, F., Tian, S., Yu, L., et al.: TEDT: transformer-based encoding\u2013decoding translation network for multimodal sentiment analysis. Cogn. Comput. 15, 289\u2013303 (2023). https:\/\/doi.org\/10.1007\/s12559-022-10073-9","journal-title":"Cogn. Comput."},{"key":"4201_CR17","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-023-04869-x","author":"Q Zhang","year":"2023","unstructured":"Zhang, Q., Shi, L., Liu, P., Zhu, Z., Xu, L.: ICDN: integrating consistency and difference networks by transformer for multimodal sentiment analysis. Appl. Intell. (2023). https:\/\/doi.org\/10.1007\/s10489-023-04869-x","journal-title":"Appl. Intell."},{"key":"4201_CR18","doi-asserted-by":"publisher","first-page":"109259","DOI":"10.1016\/j.patcog.2022.109259","volume":"136","author":"D Wang","year":"2023","unstructured":"Wang, D., Guo, X., Tian, Y., Liu, J., He, L., Luo, X.: TETFN: a text enhanced transformer fusion network for multimodal sentiment analysis. Pattern Recogn. 136, 109259 (2023). https:\/\/doi.org\/10.1016\/j.patcog.2022.109259","journal-title":"Pattern Recogn."},{"key":"4201_CR19","doi-asserted-by":"publisher","first-page":"111965","DOI":"10.1016\/j.knosys.2024.111965","volume":"297","author":"Y Fu","year":"2024","unstructured":"Fu, Y., Huang, B., Wen, Y., Zhang, P.: FDR-MSA: enhancing multimodal sentiment analysis through feature disentanglement and reconstruction. Knowledge-Based Syst. 297, 111965 (2024). https:\/\/doi.org\/10.1016\/j.knosys.2024.111965","journal-title":"Knowledge-Based Syst."},{"key":"4201_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.10.021","author":"Y Li","year":"2020","unstructured":"Li, Y., Zhang, K., Wang, J., Gao, X.: A cognitive brain model for multimodal sentiment analysis based on attention neural networks. Neurocomputing (2020). https:\/\/doi.org\/10.1016\/j.neucom.2020.10.021","journal-title":"Neurocomputing"},{"issue":"12","key":"4201_CR21","doi-asserted-by":"publisher","first-page":"10790","DOI":"10.1609\/aaai.v35i12.17289","volume":"35","author":"W Yu","year":"2021","unstructured":"Yu, W., Xu, H., Yuan, Z., Wu, J.: Learning modality-specific representations with self-supervised multi-task learning for multimodal sentiment analysis. Proceed. AAAI Confer. Artific. Intell. 35(12), 10790\u201310797 (2021). https:\/\/doi.org\/10.1609\/aaai.v35i12.17289","journal-title":"Proceed. AAAI Confer. Artific. Intell."},{"key":"4201_CR22","doi-asserted-by":"publisher","unstructured":"Zadeh, A., Liang, P. P., Poria, S., Vij, P., & Morency, L. P. (2018). Multi-attention recurrent network for human communication comprehension. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2018.https:\/\/doi.org\/10.48550\/arXiv.1802.00923","DOI":"10.48550\/arXiv.1802.00923"},{"issue":"5","key":"4201_CR23","doi-asserted-by":"publisher","first-page":"1901","DOI":"10.1109\/TCSVT.2020.3014889","volume":"31","author":"Y Ou","year":"2021","unstructured":"Ou, Y., Chen, Z., Wu, F.: Multimodal local-global attention network for affective video content analysis. IEEE Trans. Circuits Syst. Video Technol. 31(5), 1901\u20131914 (2021). https:\/\/doi.org\/10.1109\/TCSVT.2020.3014889","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"issue":"2019","key":"4201_CR24","first-page":"2","volume":"1","author":"J Devlin","year":"2018","unstructured":"Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. Proceed. NaacL-HLT 1(2019), 2 (2018)","journal-title":"Proceed. NaacL-HLT"},{"key":"4201_CR25","doi-asserted-by":"crossref","unstructured":"Baltrusaitis, T., Zadeh, A., Lim, Y. C., & Morency, L. P. (2018). OpenFace 2.0: Facial Behavior Analysis Toolkit. IEEE International Conference on Automatic Face & Gesture Recognition (pp.59\u201366). IEEE Computer Society.","DOI":"10.1109\/FG.2018.00019"},{"key":"4201_CR26","doi-asserted-by":"publisher","unstructured":"Yu, W., Xu, H., Meng, F., Zhu, Y., & Yang, K. (2020). CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of Modality. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.343","DOI":"10.18653\/v1\/2020.acl-main.343"},{"issue":"6","key":"4201_CR27","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1109\/MIS.2016.94","volume":"31","author":"A Zadeh","year":"2016","unstructured":"Zadeh, A., Zellers, R., Pincus, E., Morency, L.P.: Multimodal sentiment intensity analysis in videos: facial gestures and verbal messages. IEEE Intell. Syst. 31(6), 82\u201388 (2016)","journal-title":"IEEE Intell. Syst."},{"key":"4201_CR28","doi-asserted-by":"publisher","unstructured":"Zadeh A., Liang P.P., Poria S., Cambria E., & Morency L.-P. (2018) Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph, In: Proceedings of the 56th annual meeting of the association for computational linguistics. https:\/\/doi.org\/10.18653\/v1\/P18-1208.","DOI":"10.18653\/v1\/P18-1208"},{"key":"4201_CR29","doi-asserted-by":"crossref","unstructured":"Degottex, G., Kane, J., Drugman, T., Raitio, T., & Scherer, S. (2014). COVAREP: A Collaborative Voice Analysis Repository for Speech Technologies. Acoustics Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE.","DOI":"10.1109\/ICASSP.2014.6853739"},{"key":"4201_CR30","doi-asserted-by":"crossref","unstructured":"Mcfee, B., Raffel, C., Liang, D., Ellis, D., & Nieto, O. (2015). Librosa: Audio and Music Signal Analysis in Python, in: Proceedings of the 14th python in science conference, volume 8.","DOI":"10.25080\/Majora-7b98e3ed-003"},{"key":"4201_CR31","doi-asserted-by":"crossref","unstructured":"Li, R., Wu, Z., Jia, J., Li, J., Chen, W., & Meng, H. (2018). Inferring user emotive state changes in realistic human-computer conversational dialogs. In: 2018 ACM Multimedia Conference on Multimedia Conference, pages 136\u2013144. ACM.","DOI":"10.1145\/3240508.3240575"},{"key":"4201_CR32","doi-asserted-by":"crossref","unstructured":"Hazarika, D., Zimmermann, R., & Poria, S. (2020). Misa: modality-invariant and -specific representations for multimodal sentiment analysis, In: Proceedings of the 28th ACM International Conference on Multimedia, 2020, pp. 1122\u20131131.","DOI":"10.1145\/3394171.3413678"},{"key":"4201_CR33","doi-asserted-by":"publisher","unstructured":"Han, W., Chen, H., & Poria, S. (2021). Improving multimodal fusion with hierarchical mutual information maximization for multimodal sentiment analysis, in: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021, pp. 9180\u20139192. https:\/\/doi.org\/10.48550\/arXiv.2109.00412","DOI":"10.48550\/arXiv.2109.00412"},{"issue":"3","key":"4201_CR34","doi-asserted-by":"publisher","first-page":"2276","DOI":"10.1109\/TAFFC.2022.3172360","volume":"14","author":"S Mai","year":"2023","unstructured":"Mai, S., Zeng, Y., Zheng, S., Hu, H.: Hybrid contrastive learning of tri-modal representation for multimodal sentiment analysis. IEEE Trans. Affect. Comput. 14(3), 2276\u20132289 (2023)","journal-title":"IEEE Trans. Affect. Comput."},{"key":"4201_CR35","doi-asserted-by":"publisher","first-page":"37","DOI":"10.2139\/ssrn.4172043","volume":"92","author":"K Kim","year":"2022","unstructured":"Kim, K., Park, S.: Aobert: all-modalities-in-one bert for multimodal sentiment analysis. Inf. Fusion 92, 37\u201345 (2022). https:\/\/doi.org\/10.2139\/ssrn.4172043","journal-title":"Inf. Fusion"},{"key":"4201_CR36","first-page":"756","volume":"2023","author":"Z Haoyu","year":"2023","unstructured":"Haoyu, Z., Yu, W., Guanghao, Y., Kejun, L., Yuanyuan, L., Tianshu, Y.: Learning language-guided adaptive hyper-modality representation for multimodal sentiment analysis. EMNLP 2023, 756\u2013767 (2023)","journal-title":"EMNLP"},{"key":"4201_CR37","unstructured":"Jiehui H., Jun Z., Zhenchao T., Jiaying L., & Calvin Yu-Chian Chen (2024). TMBL: Transformer-based multimodal binding learning model for multimodal sentiment analysis, Knowledge-Based Systems, ISSN 0950\u20137051."},{"key":"4201_CR38","unstructured":"Goldberg, D. E. . (1989). Genetic Algorithm in Search, Optimization, and Machine Learning. Addison-Wesley Pub. Co."}],"container-title":["Signal, Image and Video Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11760-025-04201-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11760-025-04201-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11760-025-04201-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,11]],"date-time":"2025-06-11T03:14:10Z","timestamp":1749611650000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11760-025-04201-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,27]]},"references-count":38,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["4201"],"URL":"https:\/\/doi.org\/10.1007\/s11760-025-04201-9","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-5950230\/v1","asserted-by":"object"}]},"ISSN":["1863-1703","1863-1711"],"issn-type":[{"value":"1863-1703","type":"print"},{"value":"1863-1711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,27]]},"assertion":[{"value":"3 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 March 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 April 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 May 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The datasets used in this study were CMU-MOSI and CMU-MOSEI created by researchers from Carnegie Mellon University. These datasets are publicly accessible and designed for academic use in the field of multimodal sentiment analysis. They do not contain any personally identifiable information or sensitive data. The use of these datasets complies with the terms and conditions set forth by their respective publishers. No specific informed consent was required for this study as the data used were obtained from publicly accessible sources which do not contain information related to individual human subjects. These data sources are open for research purposes and are anonymized in such a manner that individual privacy is maintained.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical and informed consent"}}],"article-number":"609"}}