{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T23:11:20Z","timestamp":1783552280106,"version":"3.55.0"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"35","license":[{"start":{"date-parts":[[2023,3,11]],"date-time":"2023-03-11T00:00:00Z","timestamp":1678492800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,11]],"date-time":"2023-03-11T00:00:00Z","timestamp":1678492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Traditional sentiment analysis focuses on text-level sentiment mining, transforming sentiment mining into classification or regression problems, resulting in a sentiment analysis low accuracy rate. Sentiment analysis refers to the use of natural language processing, text analysis, and computational linguistics to systematically identify, extract, quantify, and study sentimental states. Therefore, more scholars have begun to focus on speech recognition and facial expression recognition research, and extracting and analysing people\u2019s sentiment tendencies can improve sentiment recognition accuracy. Traditional single-modal sentiment analysis can no longer meet people\u2019s needs. Therefore, this paper proposes a multimodal sentiment analysis method based on the multimodal sentiment analysis method that can obtain more sentimental information sources and help people make better decisions. The experimental results in this paper show that the highest recognition rates of CNN-SVM, RNN-SVM, and CRNN-SVM were 76.8%, 71.2%, and 93.5%, respectively. It can be seen that CRNN-SVM has the highest sentiment tendency recognition rate in deep learning, so it is suitable to apply CRNN-SVM to sentiment tendency analysis system design in this paper. The average accuracy rate of the system designed in this paper was 91%, and the stability was also very strong, which shows that the system designed in this paper is meaningful. The main contribution of this paper is based on the limitations of single-mode emotion analysis. It proposes a multimode emotion analysis method and introduces a convolutional neural network to help people obtain more emotional information sources to meet their needs.<\/jats:p>","DOI":"10.1007\/s00521-023-08366-7","type":"journal-article","created":{"date-parts":[[2023,3,11]],"date-time":"2023-03-11T13:02:55Z","timestamp":1678539775000},"page":"24713-24725","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Multimodal sentiment system and method based on CRNN-SVM"],"prefix":"10.1007","volume":"35","author":[{"given":"Yuxia","family":"Zhao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mahpirat","family":"Mamat","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alimjan","family":"Aysa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kurban","family":"Ubul","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,11]]},"reference":[{"key":"8366_CR1","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.jenvp.2018.10.012","volume":"60","author":"IF Young","year":"2018","unstructured":"Young IF, Sullivan D, Stewart S, Palitsky R (2018) The existential approach to place: consequences for sentimental experience. J Environ Psychol 60:100\u2013109","journal-title":"J Environ Psychol"},{"issue":"11","key":"8366_CR2","doi-asserted-by":"publisher","first-page":"3160","DOI":"10.1109\/TMM.2018.2820321","volume":"20","author":"Z Yuan","year":"2018","unstructured":"Yuan Z, Huang X, Zheng W, Zhen C, Zhao G (2018) Learning from hierarchical spatiotemporal descriptors for micro-expression recognition. IEEE Trans Multimed 20(11):3160\u20133172","journal-title":"IEEE Trans Multimed"},{"issue":"3","key":"8366_CR3","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1503\/jpn.170102","volume":"43","author":"K Bertsch","year":"2018","unstructured":"Bertsch K, Roelofs K, Roch PJ, Ma B, Hensel S, Herpertz SC (2018) Neural correlates of sentimental action control in anger-prone women with borderline personality disorder. J Psychiatry Neurosci 43(3):161\u2013170","journal-title":"J Psychiatry Neurosci"},{"key":"8366_CR4","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.neucom.2018.03.068","volume":"309","author":"J Yan","year":"2018","unstructured":"Yan J, Zheng W, Cui Z, Tang C, Zhang T, Zong Y (2018) Multi-cue fusion for sentiment recognition in the wild. Neurocomputing 309:27\u201335","journal-title":"Neurocomputing"},{"issue":"2","key":"8366_CR5","first-page":"554","volume":"10","author":"MF Alghifari","year":"2018","unstructured":"Alghifari MF, Gunawan TS, Kartiwi M (2018) Speech sentiment recognition using deep feedforward neural network. Indones J Electr Eng Comput Sci 10(2):554\u2013561","journal-title":"Indones J Electr Eng Comput Sci"},{"key":"8366_CR6","doi-asserted-by":"crossref","unstructured":"Mittal T, Bhattacharya U, Chandra R (2020) M3er: Multiplicative multimodal sentiment recognition using facial, textual, and speech cues. In: Proceedings of the AAAI conference on artificial intelligence. 34(02): 1359\u20131367","DOI":"10.1609\/aaai.v34i02.5492"},{"issue":"6","key":"8366_CR7","doi-asserted-by":"publisher","first-page":"8213","DOI":"10.1007\/s11042-020-10030-4","volume":"80","author":"RH Huan","year":"2021","unstructured":"Huan RH, Shu J, Bao SL (2021) Video multimodal sentiment recognition based on Bi-GRU and attention fusion. Multimed Tools Appl 80(6):8213\u20138240","journal-title":"Multimed Tools Appl"},{"issue":"4","key":"8366_CR8","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/MGRS.2017.2762307","volume":"5","author":"XX Zhu","year":"2018","unstructured":"Zhu XX, Tuia D, Mou L (2018) Deep learning in remote sensing: a comprehensive review and list of resources. IEEE Geosci Remote Sens Mag 5(4):8\u201336","journal-title":"IEEE Geosci Remote Sens Mag"},{"key":"8366_CR9","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.neucom.2018.03.030","volume":"299","author":"X Sun","year":"2018","unstructured":"Sun X, Wu P, Hoi S (2018) Face detection using deep learning: an improved faster RCNN approach. Neurocomputing 299:42\u201350","journal-title":"Neurocomputing"},{"issue":"2","key":"8366_CR10","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1109\/MNET.2018.1700268","volume":"32","author":"MS Elbamby","year":"2018","unstructured":"Elbamby MS, Perfecto C, Bennis M (2018) Towards low-latency and ultra-reliable virtual reality. IEEE Netw 32(2):78\u201384","journal-title":"IEEE Netw"},{"key":"8366_CR11","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1177\/0278364918770733","volume":"37","author":"N Sunderhauf","year":"2018","unstructured":"Sunderhauf N, Brock O, Scheirer W, Hadsell R, Fox D, Leitner J (2018) The limits and potentials of deep learning for robotics. Int J Robot Res 37:405\u2013420","journal-title":"Int J Robot Res"},{"issue":"5","key":"8366_CR12","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1109\/LWC.2018.2832128","volume":"7","author":"H He","year":"2018","unstructured":"He H, Wen CK, Shi J (2018) Deep learning-based channel estimation for beamspace mmWave massive MIMO systems. IEEE Wirel Commun Lett 7(5):852\u2013855","journal-title":"IEEE Wirel Commun Lett"},{"issue":"1","key":"8366_CR13","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1109\/MSP.2017.2749125","volume":"35","author":"J Han","year":"2018","unstructured":"Han J, Zhang D, Cheng G (2018) Advanced deep-learning techniques for salient and category-specific object detection: a survey. IEEE Signal Process Mag 35(1):84\u2013100","journal-title":"IEEE Signal Process Mag"},{"issue":"S1","key":"8366_CR14","doi-asserted-by":"publisher","first-page":"1028","DOI":"10.1017\/S1431927621003883","volume":"27","author":"R Palomino","year":"2021","unstructured":"Palomino R, Low KB, Ji C (2021) Micro computed tomography analysis of four-way conversion catalysts using artificial intelligence-enabled image processing. Microsc Microanal 27(S1):1028\u20131029","journal-title":"Microsc Microanal"},{"issue":"4","key":"8366_CR15","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1177\/0192623320981560","volume":"49","author":"MA Smith","year":"2021","unstructured":"Smith MA, Westerling-Bui T, Wilcox A (2021) Screening for bone marrow cellularity changes in cynomolgus macaques in toxicology safety studies using artificial intelligence models. Toxicol Pathol 49(4):905\u2013911","journal-title":"Toxicol Pathol"},{"issue":"8","key":"8366_CR16","first-page":"901","volume":"38","author":"J Lee","year":"2020","unstructured":"Lee J (2020) Integration of digital twin and deep learning in cyber-physical systems: towards smart manufacturing. IET Collab Intell Manuf 38(8):901\u2013910","journal-title":"IET Collab Intell Manuf"},{"issue":"5","key":"8366_CR17","doi-asserted-by":"crossref","first-page":"051411","DOI":"10.1117\/1.JEI.31.5.053003","volume":"31","author":"Xu Zheng","year":"2022","unstructured":"Zheng Xu, Kamruzzaman MM, Shi J (2022) Method of generating face image based on text description of generating adversarial network. J Electron Imaging 31(5):051411","journal-title":"J Electron Imaging"},{"key":"8366_CR18","doi-asserted-by":"publisher","first-page":"4003","DOI":"10.1007\/s00521-021-06660-w","volume":"34","author":"N Balaganesh","year":"2022","unstructured":"Balaganesh N, Muneeswaran K (2022) A novel aspect-based sentiment classifier using whale optimized adaptive neural network. Neural Comput Appl 34:4003\u20134012","journal-title":"Neural Comput Appl"},{"issue":"2","key":"8366_CR19","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1177\/0018720818804382","volume":"61","author":"JM Mittelstaedt","year":"2019","unstructured":"Mittelstaedt JM, Wacker J, Stelling D (2019) Sentimental and cognitive modulation of cybersickness: the role of pain catastrophizing and body awareness. Hum Factors 61(2):322\u2013336","journal-title":"Hum Factors"},{"issue":"11","key":"8366_CR20","first-page":"975","volume":"4","author":"R Kaldewaij","year":"2019","unstructured":"Kaldewaij R, Koch SB, Zhang W, Hashemi MM, Klumpers F, Roelofs K (2019) Frontal control over automatic sentimental action tendencies predicts acute stress responsivity. Biol Psychiatry: Cognit Neurosci Neuroimaging 4(11):975\u2013983","journal-title":"Biol Psychiatry: Cognit Neurosci Neuroimaging"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-08366-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-023-08366-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-08366-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T12:05:31Z","timestamp":1700136331000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-023-08366-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,11]]},"references-count":20,"journal-issue":{"issue":"35","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["8366"],"URL":"https:\/\/doi.org\/10.1007\/s00521-023-08366-7","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,11]]},"assertion":[{"value":"30 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The author(s) declared no potential conflicts of interest with respect to the research, authorship, and\/or publication of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}