{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:14:13Z","timestamp":1760213653968,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2016,8,11]],"date-time":"2016-08-11T00:00:00Z","timestamp":1470873600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61300114","61572151"],"award-info":[{"award-number":["61300114","61572151"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China Postdoctoral Science Special Foundation","award":["2014T70340"],"award-info":[{"award-number":["2014T70340"]}]},{"DOI":"10.13039\/501100013286","name":"Specialized Research Fund for the Doctoral Program of Higher Education","doi-asserted-by":"publisher","award":["20132302120047"],"award-info":[{"award-number":["20132302120047"]}],"id":[{"id":"10.13039\/501100013286","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Extracting opinion expressions from text is an essential task of sentiment analysis, which is usually treated as one of the word-level sequence labeling problems. In such problems, compositional models with multiplicative gating operations provide efficient ways to encode the contexts, as well as to choose critical information. Thus, in this paper, we adopt Long Short-Term Memory (LSTM) recurrent neural networks to address the task of opinion expression extraction and explore the internal mechanisms of the model. The proposed approach is evaluated on the Multi-Perspective Question Answering (MPQA) opinion corpus. The experimental results demonstrate improvement over previous approaches, including the state-of-the-art method based on simple recurrent neural networks. We also provide a novel micro perspective to analyze the run-time processes and gain new insights into the advantages of LSTM selecting the source of information with its flexible connections and multiplicative gating operations.<\/jats:p>","DOI":"10.3390\/e18080294","type":"journal-article","created":{"date-parts":[[2016,8,11]],"date-time":"2016-08-11T10:29:29Z","timestamp":1470911369000},"page":"294","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Understanding Gating Operations in Recurrent Neural Networks through Opinion Expression Extraction"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6330-2557","authenticated-orcid":false,"given":"Xin","family":"Wang","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, No. 92 West Da Zhi Street, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuanchao","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, No. 92 West Da Zhi Street, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ming","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, No. 92 West Da Zhi Street, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9081-1410","authenticated-orcid":false,"given":"Chengjie","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, No. 92 West Da Zhi Street, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaolong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, No. 92 West Da Zhi Street, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10579-005-7880-9","article-title":"Annotating expressions of opinions and emotions in language","volume":"39","author":"Wiebe","year":"2005","journal-title":"Lang. Resour. Eval."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"\u0130rsoy, O., and Cardie, C. (2014, January 25\u201329). Opinion mining with deep recurrent neural networks. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.","DOI":"10.3115\/v1\/D14-1080"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Socher, R., Perelygin, A., Wu, J.Y., Chuang, J., Manning, C.D., Ng, A.Y., and Potts, C. (2013, January 18\u201321). Recursive deep models for semantic compositionality over a sentiment treebank. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA.","DOI":"10.18653\/v1\/D13-1170"},{"key":"ref_4","unstructured":"\u0130rsoy, O., and Cardie, C. (2015, January 7\u20139). Modeling compositionality with multiplicative recurrent neural networks. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_6","unstructured":"Gers, F. (2001). Long Short-Term Memory in Recurrent Neural Networks. [Ph.D. Thesis, Universit\u00e4t Hannover]."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Choi, Y., Breck, E., and Cardie, C. (2006, January 22\u201323). Joint extraction of entities and relations for opinion recognition. Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, Sydeny, Australia.","DOI":"10.3115\/1610075.1610136"},{"key":"ref_8","first-page":"2683","article-title":"Identifying expressions of opinion in context","volume":"7","author":"Breck","year":"2007","journal-title":"IJCAI"},{"key":"ref_9","unstructured":"Johansson, R., and Moschitti, A. (2010, January 15\u201316). Syntactic and semantic structure for opinion expression detection. Proceedings of the Fourteenth Conference on Computational Natural Language Learning, Uppsala, Sweden."},{"key":"ref_10","unstructured":"Yang, B., and Cardie, C. (2012, January 12\u201314). Extracting opinion expressions with semi-markov conditional random fields. Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Jeju Island, Korea."},{"key":"ref_11","unstructured":"Choi, Y., and Cardie, C. (2010, January 11\u201316). Hierarchical sequential learning for extracting opinions and their attributes. Proceedings of Annual Meeting of the Association for Computational Linguistics, Uppsala, Sweden."},{"key":"ref_12","unstructured":"Johansson, R., and Moschitti, A. (2011, January 19\u201324). Extracting opinion expressions and their polarities\u2014Exploration of pipelines and joint models. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, OR, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1162\/COLI_a_00141","article-title":"Relational features in fine-grained opinion analysis","volume":"39","author":"Johansson","year":"2013","journal-title":"Comput. Linguist."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1162\/tacl_a_00199","article-title":"Joint modeling of opinion expression extraction and attribute classification","volume":"2","author":"Yang","year":"2014","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_15","unstructured":"Yang, B., and Cardie, C. (2013, January 4\u20139). Joint Inference for Fine-grained Opinion Extraction. Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, Sofia, Bulgaria."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, P., Joty, S., and Meng, H. (2015, January 17\u201321). Fine-grained opinion mining with recurrent neural networks and word embeddings. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1168"},{"key":"ref_17","unstructured":"Jozefowicz, R., Zaremba, W., and Sutskever, I. (2015, January 6\u201311). An empirical exploration of recurrent network architectures. Proceedings of the 32nd International Conference on Machine Learning, Lille, France."},{"key":"ref_18","unstructured":"Greff, K., Srivastava, R.K., Koutn\u00edk, J., Steunebrink, B.R., and Schmidhuber, J. (2015). LSTM: A Search Space Odyssey."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1207\/s15516709cog1402_1","article-title":"Finding structure in time","volume":"14","author":"Elman","year":"1990","journal-title":"Cognit. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1016\/j.neunet.2005.06.042","article-title":"Framewise phoneme classification with bidirectional LSTM and other neural network architectures","volume":"18","author":"Graves","year":"2005","journal-title":"Neural Netw."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Graves, A., Mohamed, A.R., and Hinton, G. (2013, January 26\u201331). Speech recognition with deep recurrent neural networks. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tai, K.S., Socher, R., and Manning, C.D. (2015, January 26\u201331). Improved semantic representations from tree-structured long short-term memory networks. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Beijing, China.","DOI":"10.3115\/v1\/P15-1150"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1093\/bioinformatics\/15.11.937","article-title":"Exploiting the past and the future in protein secondary structure prediction","volume":"15","author":"Baldi","year":"1999","journal-title":"Bioinformatics"},{"key":"ref_25","unstructured":"Graves, A. RNNLIB: A Recurrent Neural Network Library for Sequence Learning Problems. Available online: http:\/\/sourceforge.net\/projects\/rnnl."},{"key":"ref_26","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013, January 5\u201310). Distributed representations of words and phrases and their compositionality. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wiebe, J., and Riloff, E. (2005, January 13\u201319). Creating subjective and objective sentence classifiers from unannotated texts. Proceedings of the International Conference on Intelligent Text Processing and Computational Linguistics, Mexico City, Mexico.","DOI":"10.1007\/978-3-540-30586-6_53"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wilson, T., Wiebe, J., and Hoffmann, P. (2005, January 6\u20138). Recognizing contextual polarity in phrase-level sentiment analysis. Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Vancouver, BC, Canada.","DOI":"10.3115\/1220575.1220619"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hu, M., and Liu, B. (2004, January 22\u201325). Mining and summarizing customer reviews. Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, WA, USA.","DOI":"10.1145\/1014052.1014073"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/18\/8\/294\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:28:14Z","timestamp":1760210894000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/18\/8\/294"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8,11]]},"references-count":29,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2016,8]]}},"alternative-id":["e18080294"],"URL":"https:\/\/doi.org\/10.3390\/e18080294","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2016,8,11]]}}}