{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T16:00:00Z","timestamp":1784131200791,"version":"3.55.0"},"reference-count":27,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,12,5]],"date-time":"2020-12-05T00:00:00Z","timestamp":1607126400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>In recent years, with the popularity of social media, users are increasingly keen to express their feelings and opinions in the form of pictures and text, which makes multimodal data with text and pictures the con tent type with the most growth. Most of the information posted by users on social media has obvious sentimental aspects, and multimodal sentiment analysis has become an important research field. Previous studies on multimodal sentiment analysis have primarily focused on extracting text and image features separately and then combining them for sentiment classification. These studies often ignore the interaction between text and images. Therefore, this paper proposes a new multimodal sentiment analysis model. The model first eliminates noise interference in textual data and extracts more important image features. Then, in the feature-fusion part based on the attention mechanism, the text and images learn the internal features from each other through symmetry. Then the fusion features are applied to sentiment classification tasks. The experimental results on two common multimodal sentiment datasets demonstrate the effectiveness of the proposed model.<\/jats:p>","DOI":"10.3390\/sym12122010","type":"journal-article","created":{"date-parts":[[2020,12,10]],"date-time":"2020-12-10T22:15:36Z","timestamp":1607638536000},"page":"2010","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":50,"title":["Sentiment Analysis of Social Media via Multimodal Feature Fusion"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7148-6106","authenticated-orcid":false,"given":"Kang","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yushui","family":"Geng","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianxin","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenxiao","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,5]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Sentiment analysis and opinion mining","volume":"5","author":"Liu","year":"2012","journal-title":"Synth. Lect. Hum. Lang. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wilson, T., Wiebe, J., and Hoffmann, P. (2005, January 6\u20138). Recognizing contextual polarity in phrase-level sentiment analysis. Proceedings of the Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Vancouver, BC, Canada.","DOI":"10.3115\/1220575.1220619"},{"key":"ref_3","first-page":"22","article-title":"Assessing American Presidential Candidates Using Principles of Ontological Engineering, Word Sense Disambiguation, and Data Envelope Analysis","volume":"20","author":"Rodger","year":"2020","journal-title":"Management"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Fan, F., Feng, Y., and Zhao, D. (November, January 31). Multi-grained attention network for aspect-level sentiment classification. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1380"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Li, Z., Wei, Y., Zhang, Y., and Yang, Q. (2018, January 2\u20137). Hierarchical attention transfer network for cross-domain sentiment classification. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, Hilton, New Orleans Riverside, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12055"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and So Kweon, I. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.knosys.2014.04.022","article-title":"News impact on stock price return via sentiment analysis","volume":"69","author":"Li","year":"2014","journal-title":"Knowl.-Based Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xu, N., and Mao, W. (2017, January 6\u201310). Multisentinet: A deep semantic network for multimodal sentiment analysis. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore.","DOI":"10.1145\/3132847.3133142"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xu, N., Mao, W., and Chen, G. (2018, January 8\u201312). A co-memory network for multimodal sentiment analysis. Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA.","DOI":"10.1145\/3209978.3210093"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, B., and Zhang, L. (2012). A survey of opinion mining and sentiment analysis. Mining Text Data, Springer.","DOI":"10.1007\/978-1-4614-3223-4_13"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Borth, D., Ji, R., Chen, T., Breuel, T., and Chang, S.F. (2013, January 21\u201325). Large-scale visual sentiment ontology and detectors using adjective noun pairs. Proceedings of the 21st ACM International Conference on Multimedia, Barcelona, Spain.","DOI":"10.1145\/2502081.2502282"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/s00530-014-0407-8","article-title":"A cross-media public sentiment analysis system for microblog","volume":"22","author":"Cao","year":"2016","journal-title":"Multimed. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.neunet.2014.10.005","article-title":"Towards an intelligent framework for multimodal affective data analysis","volume":"63","author":"Poria","year":"2015","journal-title":"Neural Netw."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, M., Cao, D., Li, L., Li, S., and Ji, R. (2014, January 10\u201312). Microblog sentiment analysis based on cross-media bag-of-words model. Proceedings of the International Conference on Internet Multimedia Computing and Service, Xiamen, China.","DOI":"10.1145\/2632856.2632912"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1007\/s11042-015-2646-x","article-title":"A multimodal feature learning approach for sentiment analysis of social network multimedia","volume":"75","author":"Baecchi","year":"2016","journal-title":"Multimed. Tools Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"You, Q., Luo, J., Jin, H., and Yang, J. (2016, January 22\u201325). Cross-modality consistent regression for joint visual-textual sentiment analysis of social multimedia. Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, San Francisco, CA USA.","DOI":"10.1145\/2835776.2835779"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"You, Q., Cao, L., Jin, H., and Luo, J. (2016, January 15\u201319). Robust visual-textual sentiment analysis: When attention meets tree-structured recursive neural networks. Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands.","DOI":"10.1145\/2964284.2964288"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, Y., and Zhang, Z. (June, January 31). Research on text sentiment analysis based on CNNs and SVM. Proceedings of the 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA), Wuhan, China.","DOI":"10.1109\/ICIEA.2018.8398173"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yu, Y., Lin, H., Meng, J., and Zhao, Z. (2016). Visual and textual sentiment analysis of a microblog using deep convolutional neural networks. Algorithms, 9.","DOI":"10.3390\/a9020041"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cai, G., and Xia, B. (2015). Convolutional neural networks for multimedia sentiment analysis. Natural Language Processing and Chinese Computing, Springer.","DOI":"10.1007\/978-3-319-25207-0_14"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.neucom.2016.09.117","article-title":"Ensemble application of convolutional neural networks and multiple kernel learning for multimodal sentiment analysis","volume":"261","author":"Poria","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zadeh, A., Chen, M., Poria, S., Cambria, E., and Morency, L.P. (2017). Tensor fusion network for multimodal sentiment analysis. arXiv.","DOI":"10.18653\/v1\/D17-1115"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.A. (2008, January 5\u20139). Extracting and composing robust features with denoising autoencoders. Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390294"},{"key":"ref_24","unstructured":"Higgins, I., Matthey, L., Pal, A., Burgess, C., Glorot, X., Botvinick, M., Mohamed, S., and Lerchner, A. (2020, November 19). Beta-Vae: Learning Basic Visual Concepts with a Constrained Variational Framework. Available online: https:\/\/openreview.net\/forum?id=Sy2fzU9gl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","article-title":"Representation learning: A review and new perspectives","volume":"35","author":"Bengio","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Niu, T., Zhu, S., Pang, L., and El Saddik, A. (2016, January 4\u20136). Sentiment analysis on multi-view social data. Proceedings of the International Conference on Multimedia Modeling, Miami, FL, USA.","DOI":"10.1007\/978-3-319-27674-8_2"},{"key":"ref_27","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Maaten","year":"2008","journal-title":"J. Mach. Learn. Res."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/2010\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:42:00Z","timestamp":1760179320000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/2010"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,5]]},"references-count":27,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["sym12122010"],"URL":"https:\/\/doi.org\/10.3390\/sym12122010","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,5]]}}}