{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T22:00:11Z","timestamp":1747173611563,"version":"3.40.5"},"reference-count":64,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[2020,7,9]],"date-time":"2020-07-09T00:00:00Z","timestamp":1594252800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2021,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Alleviating pain is good and abandoning hope is bad. We instinctively understand how words like <jats:italic>alleviate<\/jats:italic> and <jats:italic>abandon<\/jats:italic> affect the polarity of a phrase, inverting or weakening it. When these words are content words, such as verbs, nouns, and adjectives, we refer to them as <jats:italic>polarity shifters<\/jats:italic>. Shifters are a frequent occurrence in human language and an important part of successfully modeling negation in sentiment analysis; yet research on negation modeling has focused almost exclusively on a small handful of closed-class negation words, such as <jats:italic>not<\/jats:italic>, <jats:italic>no<\/jats:italic>, and <jats:italic>without<\/jats:italic>. A major reason for this is that shifters are far more lexically diverse than negation words, but no resources exist to help identify them. We seek to remedy this lack of shifter resources by introducing a large lexicon of polarity shifters that covers English verbs, nouns, and adjectives. Creating the lexicon entirely by hand would be prohibitively expensive. Instead, we develop a bootstrapping approach that combines automatic classification with human verification to ensure the high quality of our lexicon while reducing annotation costs by over 70%. Our approach leverages a number of linguistic insights; while some features are based on textual patterns, others use semantic resources or syntactic relatedness. The created lexicon is evaluated both on a polarity shifter gold standard and on a polarity classification task.<\/jats:p>","DOI":"10.1017\/s135132492000039x","type":"journal-article","created":{"date-parts":[[2020,7,9]],"date-time":"2020-07-09T06:01:12Z","timestamp":1594274472000},"page":"153-179","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":5,"title":["Automatic generation of lexica for sentiment polarity shifters"],"prefix":"10.1017","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4183-8489","authenticated-orcid":false,"given":"Marc","family":"Schulder","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Wiegand","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Josef","family":"Ruppenhofer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2020,7,9]]},"reference":[{"key":"S135132492000039X_ref23","unstructured":"Hasan, K.S. and Ng, V. (2013). Frame semantics for stance classification. In Proceedings of CoNLL. Sofia, Bulgaria: ACL, pp. 124\u2013132."},{"key":"S135132492000039X_ref27","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1145"},{"key":"S135132492000039X_ref55","unstructured":"Stoyanov, V. and Cardie, C. (2011). Automatically creating general-purpose opinion summaries from text. In Proceedings of RANLP. Hissar, Bulgaria: ACL."},{"key":"S135132492000039X_ref57","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00049"},{"volume-title":"Outstanding Dissertations in Linguistics","year":"1980","author":"Ladusaw","key":"S135132492000039X_ref31"},{"key":"S135132492000039X_ref15","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/E14-1040"},{"key":"S135132492000039X_ref53","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1226"},{"key":"S135132492000039X_ref8","doi-asserted-by":"publisher","DOI":"10.3115\/1613715.1613816"},{"key":"S135132492000039X_ref56","doi-asserted-by":"publisher","DOI":"10.3115\/1572306.1572314"},{"key":"S135132492000039X_ref18","unstructured":"Fillmore, C.J. (1967). The case for case. In Bach E. and Harms R. (eds), Proceedings of the Texas Symposium on Language Universals. New York, NY, USA: Holt, Rinehart and Winston, pp. 1\u201390."},{"key":"S135132492000039X_ref21","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-2501"},{"key":"S135132492000039X_ref17","doi-asserted-by":"publisher","DOI":"10.1145\/1099554.1099713"},{"key":"S135132492000039X_ref10","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2618"},{"key":"S135132492000039X_ref50","unstructured":"Schulder, M. , Wiegand, M. , Ruppenhofer, J. and Roth, B. (2017). Towards bootstrapping a polarity shifter lexicon using linguistic features. In Proceedings of IJCNLP. Taipei, Taiwan: Asian Federation of NLP, pp. 624\u2013633."},{"key":"S135132492000039X_ref24","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1120"},{"key":"S135132492000039X_ref46","first-page":"1","volume":"20","author":"Polanyi","year":"2006"},{"key":"S135132492000039X_ref7","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1082"},{"key":"S135132492000039X_ref49","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1084"},{"key":"S135132492000039X_ref34","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-54903-8_1"},{"key":"S135132492000039X_ref4","first-page":"169","article-title":"Double negatives","volume":"1","author":"Baker","year":"1970","journal-title":"Linguistic Inquiry"},{"key":"S135132492000039X_ref37","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5010"},{"key":"S135132492000039X_ref32","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"S135132492000039X_ref51","unstructured":"Schulder, M. , Wiegand, M. and Ruppenhofer, J. (2018a). Automatically creating a lexicon of verbal polarity shifters: Mono- and cross-lingual methods for German. In Proceedings of COLING. Santa Fe, NM, USA: ICCL, pp. 2516\u20132528."},{"key":"S135132492000039X_ref52","unstructured":"Schulder, M. , Wiegand, M. , Ruppenhofer, J. and K\u00f6ser, S. (2018b). Introducing a lexicon of verbal polarity shifters for English. In Proceedings of LREC. Miyazaki, Japan: ELRA, pp. 1393\u20131397."},{"key":"S135132492000039X_ref40","unstructured":"Mitchell, M. (2013). Overview of the TAC2013 knowledge base population evaluation: English sentiment slot filling. In Proceedings of TAC. NIST."},{"key":"S135132492000039X_ref63","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220619"},{"key":"S135132492000039X_ref29","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806551"},{"volume-title":"Negative Contexts: Collocation, Polarity and Multiple Negation","year":"1997","author":"van der Wouden","key":"S135132492000039X_ref59"},{"key":"S135132492000039X_ref11","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"S135132492000039X_ref2","unstructured":"Anand, P. and Reschke, K. (2010). Verb classes as evaluativity functor classes. In Proceedings of VERB. Pisa, Italy: Scuola Normale Superiore, pp. 98\u2013103."},{"key":"S135132492000039X_ref35","doi-asserted-by":"publisher","DOI":"10.2200\/S00416ED1V01Y201204HLT016"},{"key":"S135132492000039X_ref39","doi-asserted-by":"publisher","DOI":"10.1093\/ijl\/3.4.235"},{"key":"S135132492000039X_ref41","unstructured":"Moilanen, K. and Pulman, S. (2007). Sentiment construction. In Proceedings of RANLP. Borovets, Bulgaria: ACL."},{"key":"S135132492000039X_ref33","unstructured":"Linebarger, M.C. (1980). The Grammar of Negative Polarity."},{"key":"S135132492000039X_ref22","first-page":"1660","volume":"2","author":"Giannakidou","year":"2011"},{"key":"S135132492000039X_ref1","doi-asserted-by":"publisher","DOI":"10.3115\/1609067.1609070"},{"key":"S135132492000039X_ref9","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1125"},{"key":"S135132492000039X_ref20","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1191"},{"key":"S135132492000039X_ref19","unstructured":"Firth, J.R. (1957). A synopsis of linguistic theory, 1930\u20131955. In Studies in Linguistic Analysis, pp. 1\u201332."},{"key":"S135132492000039X_ref25","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341560"},{"key":"S135132492000039X_ref42","doi-asserted-by":"publisher","DOI":"10.3115\/1596374.1596381"},{"key":"S135132492000039X_ref30","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-0410"},{"key":"S135132492000039X_ref60","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K15-1022"},{"key":"S135132492000039X_ref43","unstructured":"Morante, R. (2010). Descriptive analysis of negation cues in biomedical texts. In Proceedings of LREC. Valletta, Malta: ELRA, pp. 1429\u20131436."},{"key":"S135132492000039X_ref44","unstructured":"Nairn, R. , Condoravdi, C. and Karttunen, L. (2006). Computing relative polarity for textual inference. In Proceedings of the International Workshop on Inference in Computational Semantics. Buxton, UK, pp. 67\u201376."},{"key":"S135132492000039X_ref14","doi-asserted-by":"crossref","unstructured":"de Marneffe, M.-C. and Manning, C.D. (2008). Stanford Typed Dependencies Manual. Technical report. Stanford University.","DOI":"10.3115\/1608858.1608859"},{"key":"S135132492000039X_ref28","doi-asserted-by":"publisher","DOI":"10.3115\/1654641.1654642"},{"key":"S135132492000039X_ref54","unstructured":"Socher, R. , Perelygin, A. , Wu, J.Y. , Chuang, J. , Manning, C.D. , Ng, A.Y. and Potts, C. (2013). Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of EMNLP. Seattle, WA, USA: ACL, pp. 1631\u20131642."},{"key":"S135132492000039X_ref12","doi-asserted-by":"crossref","unstructured":"Danescu-Niculescu-Mizil, C. , Lee, L. and Ducott, R. (2009). Without a \u2018doubt\u2019? Unsupervised discovery of downward-entailing operators. In Proceedings of NAACL-HLT. Boulder, CO, USA: ACL, pp. 137\u2013145.","DOI":"10.3115\/1620754.1620775"},{"key":"S135132492000039X_ref58","doi-asserted-by":"publisher","DOI":"10.3115\/1613715.1613787"},{"key":"S135132492000039X_ref48","unstructured":"Ruppenhofer, J. and Brandes, J. (2016). Verifying the robustness of opinion inference. In Proceedings of KONVENS. Bochum, Germany, pp. 226\u2013235."},{"key":"S135132492000039X_ref13","unstructured":"Dang, H.T. (2008). Overview of the TAC 2008 opinion question answering and summarization tasks. In Proceedings of TAC. Gaithersburg, MD, USA: NIST."},{"key":"S135132492000039X_ref47","doi-asserted-by":"publisher","DOI":"10.1108\/eb046814"},{"key":"S135132492000039X_ref61","unstructured":"Wiegand, M. , Balahur, A. , Roth, B. , Klakow, D. and Montoyo, A. (2010). A survey on the role of negation in sentiment analysis. In Proceedings of the Workshop on Negation and Speculation in NLP. Uppsala, Sweden, pp. 60\u201368."},{"key":"S135132492000039X_ref16","unstructured":"Deng, L. , Choi, Y. and Wiebe, J. (2013). Benefactive\/Malefactive event and writer attitude annotation. In Proceedings of ACL. Sofia, Bulgaria: ACL, pp. 120\u2013125."},{"key":"S135132492000039X_ref5","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367618"},{"key":"S135132492000039X_ref3","doi-asserted-by":"crossref","unstructured":"Baker, C.F. , Fillmore, C.J. and Lowe, J.B. (1998). The Berkeley FrameNet project. In Proceedings of COLING. Vancouver, Canada: ACL, pp. 86\u201390.","DOI":"10.3115\/980451.980860"},{"key":"S135132492000039X_ref38","unstructured":"Mikolov, T. , Chen, K. , Corrado, G. and Dean, J. (2013). Efficient estimation of word representations in vector space. In Proceedings of ICLR. Scottsdale, AZ, USA."},{"key":"S135132492000039X_ref36","unstructured":"Macleod, C. , Grishman, R. , Meyers, A. , Barrett, L. and Reeves, R. (1998). NOMLEX: A lexicon of nominalizations. In Proceedings of EURALEX. Li\u00e8ge, Belgium: Euralex, pp. 187\u2013193."},{"volume-title":"The Psycho-Biology of Language: An Introdution to Dynamic Philology","year":"1935","author":"Zipf","key":"S135132492000039X_ref64"},{"key":"S135132492000039X_ref26","unstructured":"Joachims, T. (1999). Making large-scale SVM learning practical. In Sch\u00f6lkopf B., Burges C. and Smola A. (eds), Advances in Kernel Methods: Support Vector Learning. MIT Press, pp. 169\u2013184."},{"key":"S135132492000039X_ref45","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"S135132492000039X_ref6","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9582.1985.tb00750.x"},{"key":"S135132492000039X_ref62","unstructured":"Wiegand, M. , Loda, S. and Ruppenhofer, J. (2018). Disambiguation of verbal shifters. In Proceedings of LREC. Miyazaki, Japan: ELRA, pp. 608\u2013612."}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S135132492000039X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,12]],"date-time":"2021-05-12T11:07:42Z","timestamp":1620817662000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S135132492000039X\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,9]]},"references-count":64,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,3]]}},"alternative-id":["S135132492000039X"],"URL":"https:\/\/doi.org\/10.1017\/s135132492000039x","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"type":"print","value":"1351-3249"},{"type":"electronic","value":"1469-8110"}],"subject":[],"published":{"date-parts":[[2020,7,9]]},"assertion":[{"value":"\u00a9 The Author(s) 2020. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:\/\/creativecommons.org\/licenses\/by\/4.0\/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}