{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T19:42:58Z","timestamp":1769283778069,"version":"3.49.0"},"reference-count":73,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[2020,11,11]],"date-time":"2020-11-11T00:00:00Z","timestamp":1605052800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2021,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Sentiment analysis is directly affected by compositional phenomena in language that act on the prior polarity of the words and phrases found in the text.<jats:italic>Negation<\/jats:italic>is the most prevalent of these phenomena, and in order to correctly predict sentiment, a classifier must be able to identify negation and disentangle the effect that its scope has on the final polarity of a text. This paper proposes a multi-task approach to explicitly incorporate information about negation in sentiment analysis, which we show outperforms learning negation implicitly in an end-to-end manner. We describe our approach, a cascading and hierarchical neural architecture with selective sharing of Long Short-term Memory layers, and show that explicitly training the model with negation as an auxiliary task helps improve the main task of sentiment analysis. The effect is demonstrated across several different standard English-language data sets for both tasks, and we analyze several aspects of our system related to its performance, varying types and amounts of input data and different multi-task setups.<\/jats:p>","DOI":"10.1017\/s1351324920000510","type":"journal-article","created":{"date-parts":[[2020,11,11]],"date-time":"2020-11-11T06:00:41Z","timestamp":1605074441000},"page":"249-269","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":18,"title":["Improving sentiment analysis with multi-task learning of negation"],"prefix":"10.1017","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8043-8058","authenticated-orcid":false,"given":"Jeremy","family":"Barnes","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erik","family":"Velldal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lilja","family":"\u00d8vrelid","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2020,11,11]]},"reference":[{"key":"S1351324920000510_ref59","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-2038"},{"key":"S1351324920000510_ref12","unstructured":"Councill, I. , McDonald, R. and Velikovich, L. (2010). What\u2019s great and what\u2019s not: Learning to classify the scope of negation for improved sentiment analysis. In Proceedings of the Workshop on Negation and Speculation in Natural Language Processing, Uppsala, Sweden, pp. 51\u201359."},{"key":"S1351324920000510_ref45","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1007"},{"key":"S1351324920000510_ref57","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1177"},{"key":"S1351324920000510_ref71","unstructured":"Xu, H. , Liu, B. , Shu, L. and Yu, P.S. (2019). BERT post-training for review reading comprehension and aspect-based sentiment analysis. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, USA."},{"key":"S1351324920000510_ref22","doi-asserted-by":"publisher","DOI":"10.2200\/S00762ED1V01Y201703HLT037"},{"key":"S1351324920000510_ref4","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5202"},{"key":"S1351324920000510_ref5","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-4802"},{"key":"S1351324920000510_ref33","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2012.23"},{"key":"S1351324920000510_ref28","unstructured":"Jochim, C. , Bonin, F. , Bar-Haim, R. and Slonim, N. (2018). SLIDE \u2013 a sentiment lexicon of common idioms. In Proceedings of the 11th Language Resources and Evaluation Conference, Miyazaki, Japan, pp. 2387\u20132392."},{"key":"S1351324920000510_ref69","unstructured":"Wiegand, M. , Balahur, A. , Roth, B. , Klakow, D. and Montoyo, A. (2010). A survey on the role of negation in sentiment analysis. In Proceedings of the Workshop on Negation and Speculation in Natural Language Processing, Uppsala, Sweden, pp. 60\u201368."},{"key":"S1351324920000510_ref55","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33014822"},{"key":"S1351324920000510_ref1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6219"},{"key":"S1351324920000510_ref66","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1141"},{"key":"S1351324920000510_ref62","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1146"},{"key":"S1351324920000510_ref60","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00049"},{"key":"S1351324920000510_ref15","unstructured":"Devlin, J. , Chang, M.-W. , Lee, K. and Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. CoRR, abs\/1810.04805."},{"key":"S1351324920000510_ref24","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1031"},{"key":"S1351324920000510_ref26","first-page":"2096","volume-title":"Advances in Neural Information Processing Systems 27","author":"Irsoy","year":"2014"},{"key":"S1351324920000510_ref31","unstructured":"Konstantinova, N. , de Sousa, S.C. , Cruz, N.P. , Ma\u00f1a, M.J. , Taboada, M. and Mitkov, R. (2012). A review corpus annotated for negation, speculation and their scope. In Proceedings of the 8th International Conference on Language Resources and Evaluation, Istanbul, Turkey, pp. 3190\u20133195."},{"key":"S1351324920000510_ref58","unstructured":"Socher, R. , Perelygin, A. , Wu, J. , Chuang, J. , Manning, C. , Ng, A. and Potts, C. (2013). Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, USA, pp. 1631\u20131642."},{"key":"S1351324920000510_ref53","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1078"},{"key":"S1351324920000510_ref20","first-page":"113","author":"Farias","year":"2017"},{"key":"S1351324920000510_ref61","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1150"},{"key":"S1351324920000510_ref67","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-9-S11-S9"},{"key":"S1351324920000510_ref63","doi-asserted-by":"crossref","unstructured":"Turney, P. (2002). Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, USA.","DOI":"10.3115\/1073083.1073153"},{"key":"S1351324920000510_ref40","unstructured":"Morante, R. and Blanco, E. (2012). *SEM 2012 shared task: Resolving the scope and focus of negation. In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), Montr\u00e9al, Canada, pp. 265\u2013274."},{"key":"S1351324920000510_ref44","unstructured":"Nakov, P. , Rosenthal, S. , Kozareva, Z. , Stoyanov, V. , Ritter, A. and Wilson, T. (2013). Semeval-2013 task 2: Sentiment analysis in twitter. In Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval)."},{"key":"S1351324920000510_ref52","first-page":"1","volume-title":"Contextual Valence Shifters","author":"Polanyi","year":"2006"},{"key":"S1351324920000510_ref18","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2010"},{"key":"S1351324920000510_ref37","unstructured":"Liu, P. , Qiu, X. and Huang, X. (2016). Recurrent neural network for text classification with multi-task learning. In Proceedings of the 25th International Joint Conference on Artificial Intelligence, New York, USA, pp. 2873\u20132879."},{"key":"S1351324920000510_ref46","unstructured":"Pad\u00f3, S. (2006). User\u2019s guide to sigf: Significance testing by approximate randomisation. https:\/\/nlpado.de\/sebastian\/software\/sigf.shtml."},{"key":"S1351324920000510_ref54","unstructured":"Read, J. , Velldal, E. , \u00d8vrelid, L. and Oepen, S. (2012). UiO1: Constituent-based discriminative ranking for negation resolution. In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), Montreal, Canada."},{"key":"S1351324920000510_ref23","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.042"},{"key":"S1351324920000510_ref56","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016949"},{"key":"S1351324920000510_ref43","doi-asserted-by":"publisher","DOI":"10.3115\/1613715.1613805"},{"key":"S1351324920000510_ref65","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00126"},{"key":"S1351324920000510_ref25","doi-asserted-by":"crossref","unstructured":"Hu, M. and Liu, B. (2004). Mining opinion features in customer reviews. In Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, USA, pp. 168\u2013177.","DOI":"10.1145\/1014052.1014073"},{"key":"S1351324920000510_ref50","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"S1351324920000510_ref2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1172"},{"key":"S1351324920000510_ref8","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2026"},{"key":"S1351324920000510_ref73","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1029"},{"key":"S1351324920000510_ref21","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1169"},{"key":"S1351324920000510_ref39","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1005"},{"key":"S1351324920000510_ref6","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324920000510"},{"key":"S1351324920000510_ref17","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1047"},{"key":"S1351324920000510_ref38","unstructured":"Liu, Q. , Fancellu, F. and Webber, B. (2018). NegPar: A parallel corpus annotated for negation. In Proceedings of the 11th International Conference on Language Resources and Evaluation, Miyazaki, Japan, pp. 3464\u20133472."},{"key":"S1351324920000510_ref42","unstructured":"Morante, R. and Daelemans, W. (2012). ConanDoyle-neg: Annotation of negation cues and their scope in Conan Doyle stories. In Proceedings of the 8th International Conference on Language Resources and Evaluation, Istanbul, Turkey."},{"key":"S1351324920000510_ref34","unstructured":"Lapponi, E. , Velldal, E. , \u00d8vrelid, L. and Read, J. (2012b). UiO2: Sequence-labeling negation using dependency features. In Proceedings of the First Joint Conference on Lexical and Computational Semantics, Montreal, Canada, pp. 319\u2013327."},{"key":"S1351324920000510_ref16","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1810"},{"key":"S1351324920000510_ref10","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-307-3.50012-5"},{"key":"S1351324920000510_ref35","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-2120"},{"key":"S1351324920000510_ref41","doi-asserted-by":"publisher","DOI":"10.3115\/1596374.1596381"},{"key":"S1351324920000510_ref51","unstructured":"Plank, B. (2016). Keystroke dynamics as signal for shallow syntactic parsing. In Proceedings of the 26th International Conference on Computational Linguistics, Osaka, Japan, pp. 609\u2013619."},{"key":"S1351324920000510_ref64","first-page":"5998","volume-title":"Advances in Neural Information Processing Systems 30","author":"Vaswani","year":"2017"},{"key":"S1351324920000510_ref30","unstructured":"Kingma, D. and Ba, J. (2014). Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations."},{"key":"S1351324920000510_ref48","doi-asserted-by":"crossref","unstructured":"Pang, B. , Lee, L. and Vaithyanathan, S. (2002). Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, Philadelphia, USA, pp. 79\u201386.","DOI":"10.3115\/1118693.1118704"},{"key":"S1351324920000510_ref3","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-2054"},{"key":"S1351324920000510_ref19","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1178"},{"key":"S1351324920000510_ref13","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23533"},{"key":"S1351324920000510_ref14","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1070.0704"},{"key":"S1351324920000510_ref72","doi-asserted-by":"publisher","DOI":"10.3115\/992730.992783"},{"key":"S1351324920000510_ref29","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.2006.00277.x"},{"key":"S1351324920000510_ref47","doi-asserted-by":"publisher","DOI":"10.1561\/1500000011"},{"key":"S1351324920000510_ref32","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-2036"},{"key":"S1351324920000510_ref11","first-page":"2493","article-title":"Natural language processing (almost) from scratch","volume":"12","author":"Collobert","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"S1351324920000510_ref9","unstructured":"Bjerva, J. (2017). Will my auxiliary tagging task help? Estimating auxiliary tasks effectivity in multi-task learning. In Proceedings of the 21st Nordic Conference on Computational Linguistics, Gothenburg, Sweden, pp. 216\u2013220."},{"key":"S1351324920000510_ref27","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1162"},{"key":"S1351324920000510_ref36","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1124"},{"key":"S1351324920000510_ref68","unstructured":"White, J. (2012). UWashington: Negation resolution using machine learning methods. In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), Montreal, Canada."},{"key":"S1351324920000510_ref49","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-2612"},{"key":"S1351324920000510_ref7","unstructured":"Bies, A. , Mott, J. , Warner, C. and Kulick, S. (2012). English web treebank. In Technical Report LDC2012T13, Linguistic Data Consortium, Philidelphia, PA, USA."},{"key":"S1351324920000510_ref70","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.05.039"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324920000510","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,12]],"date-time":"2023-10-12T01:05:57Z","timestamp":1697072757000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324920000510\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,11]]},"references-count":73,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,3]]}},"alternative-id":["S1351324920000510"],"URL":"https:\/\/doi.org\/10.1017\/s1351324920000510","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,11]]},"assertion":[{"value":"\u00a9 The Author(s), 2020. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}}]}}