{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T05:14:41Z","timestamp":1767676481116,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,4,11]],"date-time":"2019-04-11T00:00:00Z","timestamp":1554940800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61373148"],"award-info":[{"award-number":["61373148"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100019048","name":"Science Foundation of Ministry of Education of China","doi-asserted-by":"publisher","award":["14YJC860042"],"award-info":[{"award-number":["14YJC860042"]}],"id":[{"id":"10.13039\/501100019048","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shandong Provincial Social Science Planning Project","award":["18CXWJ01\/18BJYJ04\/17CHLJ33\/17CHLJ30\/17CHLJ18"],"award-info":[{"award-number":["18CXWJ01\/18BJYJ04\/17CHLJ33\/17CHLJ30\/17CHLJ18"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Text sentiment analysis is an important but challenging task. Remarkable success has been achieved along with the wide application of deep learning methods, but deep learning methods dealing with text sentiment classification tasks cannot fully exploit sentiment linguistic knowledge, which hinders the development of text sentiment analysis. In this paper, we propose a sentiment-feature-enhanced deep neural network (SDNN) to address the problem by integrating sentiment linguistic knowledge into a deep neural network via a sentiment attention mechanism. Specifically, first we introduce a novel sentiment attention mechanism to help select the crucial sentiment-word-relevant context words by leveraging the sentiment lexicon in an attention mechanism, which bridges the gap between traditional sentiment linguistic knowledge and current popular deep learning methods. Second, we develop an improved deep neural network to extract sequential correlation information and text local features by combining bidirectional gated recurrent units with a convolutional neural network, which further enhances the ability of comprehensive text representation learning. With this design, the SDNN model can generate a powerful semantic representation of text to improve the performance of text sentiment classification tasks. Extensive experiments were conducted to evaluate the effectiveness of the proposed SDNN model on two real-world datasets with a binary-sentiment-label and a multi-sentiment-label. The experimental results demonstrated that the SDNN achieved substantially better performance than the strong competitors for text sentiment classification tasks.<\/jats:p>","DOI":"10.3390\/fi11040096","type":"journal-article","created":{"date-parts":[[2019,4,12]],"date-time":"2019-04-12T12:55:04Z","timestamp":1555073704000},"page":"96","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["An Improved Approach for Text Sentiment Classification Based on a Deep Neural Network via a Sentiment Attention Mechanism"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5603-6422","authenticated-orcid":false,"given":"Wenkuan","family":"Li","sequence":"first","affiliation":[{"name":"School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peiyu","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7229-7200","authenticated-orcid":false,"given":"Qiuyue","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenfeng","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,11]]},"reference":[{"key":"ref_1","first-page":"167","article-title":"Sentiment Analysis and Opinion Mining","volume":"Volume 30","author":"Bing","year":"2012","journal-title":"Encyclopedia of Machine Learning and Data Mining"},{"key":"ref_2","unstructured":"Wang, S., and Manning, C.D. (2012, January 8\u201314). Baselines and bigrams: Simple, good sentiment and topic classification. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Jeju Island, Korea."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Jiang, Q.W., Wang, W., and Han, X. (2016, January 17\u201319). Deep feature weighting in naive Bayes for Chinese text classification. Proceedings of the 2016 Fourth International Conference on Cloud Computing and Intelligence Systems, Beijing, China.","DOI":"10.1109\/CCIS.2016.7790245"},{"key":"ref_4","first-page":"1","article-title":"Maximum entropy model for mobile text classification in cloud computing using improved information gain algorithm","volume":"76","author":"Yin","year":"2016","journal-title":"Multimed. Tools Appl."},{"key":"ref_5","unstructured":"Joachims, T. (1999, January 27\u201330). Transductive inference for text classification using support vector machines. Proceedings of the Sixteenth International Conference on Machine Learning, Bled, Slovenia."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kiritchenko, S., Zhu, X., Cherry, C., and Saif, M. (2014, January 23\u201324). Detecting aspects and sentiment in customer reviews. Proceedings of the 8th International Workshop on Semantic Evaluation, Dublin, Ireland.","DOI":"10.3115\/v1\/S14-2076"},{"key":"ref_7","first-page":"1","article-title":"Survey of the state of the art in natural language generation: core tasks, applications and evaluation","volume":"45","author":"Gatt","year":"2017","journal-title":"Vestn. Oftalmol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/MCI.2018.2840738","article-title":"Recent Trends in Deep Learning Based Natural Language Processing","volume":"13","author":"Young","year":"2017","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_9","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013, January 5\u201310). Distributed representations of words and phrases and their compositionality. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_10","unstructured":"Nal, K., Edward, G., and Phil, B. (2014, January 23\u201325). A convolutional neural network for modelling sentences. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, Baltimore, MD, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tai, K.S., Socher, R., and Manning, C.D. (2015, January 30\u201331). Improved semantic representations from tree-structured long short-term memory networks. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China.","DOI":"10.3115\/v1\/P15-1150"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cho, K., Merrienboer, B.V., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25\u201329). Learning phrase representations using rnn encoder-decoder for statistical machine translation. Proceedings of the Empirical Methods in Natural Language Processing, Doha, Qatar.","DOI":"10.3115\/v1\/D14-1179"},{"key":"ref_14","unstructured":"Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhou, X.J., Wan, X.J., and Xiao, J.G. (2016, January 1\u20135). Attention-based lstm network for cross-lingual sentiment classification. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1024"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhou, P., Shi, W., Tian, J., Qi, Z., Li, B., Hao, H., and Xu, B. (2016, January 7\u201312). Attention-based bidirectional long short-term memory networks for relation classification. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.","DOI":"10.18653\/v1\/P16-2034"},{"key":"ref_17","unstructured":"Du, J., Gui, L., Xu, R., and He, Y. (2017, January 8\u201312). A convolutional attention model for text classification. Proceedings of the National CCF Conference on Natural Language Processing and Chinese Computing, Dalian, China."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., and Manning, C. (2014, January 25\u201329). Glove: Global vectors for word representation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.","DOI":"10.3115\/v1\/D14-1162"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hu, M.Q., and Liu, B. (2004, January 22\u201325). Mining and summarizing customer reviews. Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, WA, USA.","DOI":"10.1145\/1014052.1014073"},{"key":"ref_20","unstructured":"Qian, Q., Huang, M., and Lei, J. (August, January 30). Linguistically Regularized LSTMs for Sentiment Classification. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Vancouver, BC, Canada."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Pang, B., and Lee, L. (2004, January 21\u201326). A Sentimental Education: Sentiment Analysis Using Subjectivity, Summarization Based on Minimum Cuts. Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, Barcelona, Spain.","DOI":"10.3115\/1218955.1218990"},{"key":"ref_22","unstructured":"Socher, R., Perelygin, A., Wu, J.Y., Chuang, J., Manning, C.D., Ng, A.Y., and Potts, C. (2013, January 18\u201321). Recursive deep models for semantic compositionality over a sentiment treebank. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, R., Lee, H., and Radev, D. (2016, January 12\u201317). Dependency Sensitive Convolutional Neural Networks for Modeling Sentences and Documents. Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational, San Diego, CA, USA.","DOI":"10.18653\/v1\/N16-1177"},{"key":"ref_24","unstructured":"Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M.W., Pfau, D., Schaul, T., Shillingford, B., and Freitas, N.D. (2016). Learning to learn by gradient descent by gradient descent. arXiv."},{"key":"ref_25","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kim, Y. (2014, January 25\u201329). Convolutional neural networks for sentence classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.","DOI":"10.3115\/v1\/D14-1181"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, Y., Wang, X., and Xu, P. (2018). Chinese Text Classification Model Based on Deep Learning. Future Internet, 10.","DOI":"10.3390\/fi10110113"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.knosys.2017.02.030","article-title":"Learning representations from heterogeneous network for sentiment classification of product re-views","volume":"124","author":"Gui","year":"2017","journal-title":"Knowl. Based Syst."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/4\/96\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:44:49Z","timestamp":1760186689000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/4\/96"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,11]]},"references-count":28,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["fi11040096"],"URL":"https:\/\/doi.org\/10.3390\/fi11040096","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2019,4,11]]}}}