{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T03:47:18Z","timestamp":1777434438251,"version":"3.51.4"},"reference-count":71,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2018,6,29]],"date-time":"2018-06-29T00:00:00Z","timestamp":1530230400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Argument &amp; Computation"],"published-print":{"date-parts":[[2018,7,16]]},"abstract":"<jats:p>There is a driving need computationally to interrogate large bodies of text for a range of non-denotative meaning (e.g., to plot chains of reasoning, detect sentiment, diagnose genre, and so forth). But such meaning has always proven computationally allusive. It is often implicit, \u2018hidden\u2019 meaning, evoked by linguistic cues, stylistic arrangement, or conceptual structure \u2013 features that have hitherto been difficult for Natural Language Processing systems to recognize and use. Non-denotative textual effects are the historical concern of rhetorical studies, and we have turned to rhetoric in order to find new ways to advance NLP, especially for sophisticated tasks like Argument Mining. This paper highlights certain rhetorical devices that encode levels of meaning that have been overlooked in Computational Linguistics generally and Argument Mining particularly, and yet lend themselves to automated detection. These devices are the linguistic configurations known as Rhetorical Figures. We argue for the importance of these devices for Argument Mining, especially in collocations, and we present an XML annotation scheme for Rhetorical Figures to make figuration more tractable for computational approaches, particularly with an eye on the improvements they offer Argument Mining. We also discuss the intellectual and technical challenges involved in figure annotation and the implications for Machine Learning.<\/jats:p>","DOI":"10.3233\/aac-180037","type":"journal-article","created":{"date-parts":[[2018,6,29]],"date-time":"2018-06-29T16:36:53Z","timestamp":1530290213000},"page":"155-175","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["An annotation scheme for Rhetorical Figures"],"prefix":"10.1177","volume":"9","author":[{"given":"Randy Allen","family":"Harris","sequence":"first","affiliation":[{"name":"Department of English Language and Literature, University of Waterloo, Canada"}]},{"given":"Chrysanne","family":"Di Marco","sequence":"additional","affiliation":[{"name":"Cheriton School of Computer Science, University of Waterloo, Canada"}]},{"given":"Sebastian","family":"Ruan","sequence":"additional","affiliation":[{"name":"Cheriton School of Computer Science, University of Waterloo, Canada"}]},{"given":"Cliff","family":"O\u2019Reilly","sequence":"additional","affiliation":[{"name":"Anglia Ruskin University, UK"}]}],"member":"179","published-online":{"date-parts":[[2018,6,29]]},"reference":[{"key":"ref001","unstructured":"A.\u00a0Alexis, Fifteen Dogs, Coach House Books, Toronto, 2015."},{"key":"ref002","unstructured":"M.\u00a0Alliheedi, Multi-document summarization system using rhetorical information, Master\u2019s thesis, 2012, supervised by Chrysanne DiMarco, Randy Allen Harris, second reader."},{"key":"ref003","doi-asserted-by":"crossref","unstructured":"M.\u00a0Alliheedi and C.\u00a0DiMarco, Rhetorical figuration as a metric in text summarization, in: Proceedings, 2014 Canadian Artificial Intelligence Conference, 2014 May 6\u20139, Montreal, QC, 2014.","DOI":"10.1007\/978-3-319-06483-3_2"},{"key":"ref004","doi-asserted-by":"crossref","unstructured":"K.\u00a0Burke, The Grammar of Motives, University of California Press, Berkeley, CA, 1969.","DOI":"10.1525\/9780520341715"},{"key":"ref005","unstructured":"G.W.\u00a0Bush, [Frum, D.], Address before a joint session of the congress on the United States response to the terrorist attacks of September 11. 2001 Sep 20 [cited 2018 Jan 25], in: The American Presidency Project [Internet], G.\u00a0Peters and J.T.\u00a0Woolley, eds, available at: http:\/\/www.presidency.ucsb.edu\/ws\/?pid=64731."},{"key":"ref006","doi-asserted-by":"crossref","unstructured":"C.\u00a0Cacciari, R.\u00a0Gibbs, A.\u00a0Katz and M.\u00a0Turner\u00a0(eds), Turner M. Figure, in: Figurative Language and Thought, Oxford University Press, New York, 1997, pp.\u00a044\u201387.","DOI":"10.1093\/oso\/9780195109627.003.0002"},{"key":"ref007","unstructured":"B.\u00a0Chatwin, In Patagonia, Vintage, London, 2005."},{"key":"ref008","doi-asserted-by":"publisher","DOI":"10.3726\/81610_155"},{"key":"ref009","unstructured":"H.\u00a0Clinton, Statement for the Americans for Marriage Equality campaign [Internet], [place unknown]: Human Rights Campaign, 2013 March 18 [cited 2018 Jan 25], Video: 6 min, available at: http:\/\/www.hrc.org\/videos\/videos-hillary-clinton-supports-marriage-equality#.UXAbPys4Xvl."},{"key":"ref010","unstructured":"J.\u00a0Crosswhite, Rhetoric and computation. Symposium on Argument and Computation, 2000 June 27, Bonskeid House, Perthshire, Scotland."},{"key":"ref011","unstructured":"C.\u00a0Dickens, Great Expectations, R. Worthington, London, 1884."},{"key":"ref012","doi-asserted-by":"crossref","unstructured":"M.\u00a0Dubremetz, Detecting Rhetorical Figures based on repetition of words: Chiasmus, epanaphora, epiphora, PhD dissertation, Uppsala (Studia Linguistica Upsaliensia 18), 2017.","DOI":"10.3389\/fdigh.2018.00010"},{"key":"ref013","doi-asserted-by":"crossref","unstructured":"M.\u00a0Dubremetz and J.\u00a0Nivre, Rhetorical figure detection: The case of chiasmus, in: NAACL-HLT Fourth Workshop on Computational Linguistics for Literature, 2014 June 4, Denver, CO [Internet], Curran Associates, New York, 2015, pp.\u00a023\u201331, available at: http:\/\/www.aclweb.org\/website\/old_anthology\/W\/W15\/W15-07.pdf#page=37.","DOI":"10.3115\/v1\/W15-0703"},{"key":"ref014","unstructured":"M.\u00a0Dubremetz and J.\u00a0Nivre, Machine learning for rhetorical figure detection: More chiasmus with less annotation, in: Proceedings of the 21st Nordic Conference of Computational Linguistics, 2017 May 23\u201324, Gothenburg, Sweden, 2017, pp.\u00a037\u201345."},{"key":"ref015","doi-asserted-by":"crossref","unstructured":"M.\u00a0Dubremetz and J.\u00a0Nivre, Syntax matters for rhetorical structure: The case of chiasmus, in:\n                      Proceedings of the Fifth Workshop on Computational Linguistics for Literature, NAACL-HLT\n                      , 2016 June 1, San Diego, CA, pp.\u00a047\u201353.","DOI":"10.18653\/v1\/W16-0206"},{"key":"ref016","doi-asserted-by":"crossref","unstructured":"A.\u00a0Dumas, The Three Musketeers, Simon & Schuster, New York, 2010(translation anonymous).","DOI":"10.1093\/owc\/9780199538461.001.0001"},{"key":"ref017","doi-asserted-by":"crossref","unstructured":"J.\u00a0Fahnestock, Rhetorical Figures in Scientific Argumentation, Oxford University Press, New York, 1999.","DOI":"10.1093\/oso\/9780195117509.001.0001"},{"key":"ref018","unstructured":"S.\u00a0Fuller, Thomas Kuhn: A Philosophical History for Our Times, Chicago University Press, Chicago, 2001."},{"key":"ref019","unstructured":"J.J.\u00a0Gawryjo\u0142ek, Automated annotation and visualization of Rhetorical Figures, Master\u2019s thesis, 2009, supervised by Chrysanne DiMarco, Randy Allen Harris, second reader."},{"key":"ref020","unstructured":"J.J.\u00a0Gawryjo\u0142ek, R.A.\u00a0Harris and C.\u00a0DiMarco, An annotation tool for automatically detecting Rhetorical Figures, in: Proceedings, CMNA IX (Computational Models of Natural Argument), Held with IJCAI-09, 2009 July 13, Pasadena, CA."},{"key":"ref021","unstructured":"F.\u00a0Grasso, Towards a framework for rhetorical argumentation, in: EDILOG 2002 \u2013 Proceedings of the 6th Workshop on the Semantics and Pragmatics of Dialogue, 2002 September 4\u20136, Edinburgh, UK, J.\u00a0Bos, M.E.\u00a0Foster and C.\u00a0Matheson, eds, 2002, pp.\u00a053\u201360."},{"issue":"3","key":"ref022","first-page":"195","volume":"29","author":"Grasso F.","year":"2002","journal-title":"Informal Logic"},{"key":"ref023","doi-asserted-by":"publisher","DOI":"10.1007\/s10503-009-9169-4"},{"key":"ref024","doi-asserted-by":"crossref","unstructured":"N.\u00a0Green, Identifying argumentation schemes in genetics research articles, in: Proceedings of the Second Workshop on Argumentation Mining, North American Conference of the Association for Computational Linguistics, NAACL, Denver, CO, 2015, pp.\u00a012\u201321.","DOI":"10.3115\/v1\/W15-0502"},{"key":"ref025","unstructured":"G.\u00a0Greer, The proper study of womankind,\n                      Times Literary Supplement\n                      9\n                      1988 June 3."},{"key":"ref026","doi-asserted-by":"publisher","DOI":"10.5325\/philrhet.46.4.0570"},{"key":"ref027","unstructured":"R.A.\u00a0Harris, The fourth master trope, antithesis,\n                      Advances in the History of Rhetoric\n                      21\n                      (2) (2018)."},{"key":"ref028","doi-asserted-by":"crossref","unstructured":"R.A.\u00a0Harris and C.\u00a0DiMarco\u00a0(eds), Special issue on Rhetorical Figures,\n                      Argument & Computation\n                      8\n                      (3) (2017).","DOI":"10.3233\/AAC-170030"},{"key":"ref029","doi-asserted-by":"publisher","DOI":"10.3233\/AAC-170030"},{"key":"ref030","unstructured":"R.A.\u00a0Harris and C.\u00a0DiMarco, Constructing a rhetorical figuration ontology, in:\n                      Symposium on Persuasive Technology and Digital Behaviour Intervention, Convention of the Society for the Study of Artificial Intelligence and Simulation of Behaviour (AISB)\n                      , 2009 April, Edinburgh, Scotland."},{"key":"ref031","unstructured":"H.\u00a0Hertzberg, The spat,\n                      New Yorker\n                      , 2008 Feb 11."},{"key":"ref032","doi-asserted-by":"crossref","unstructured":"T.\u00a0Hoffmann and G.\u00a0Trousdale\u00a0(eds), The Oxford Handbook of Construction Grammar, Oxford University Press, New York, 2013.","DOI":"10.1093\/oxfordhb\/9780195396683.001.0001"},{"key":"ref033","unstructured":"D.D.\u00a0Hromada, Initial experiments with multilingual extraction of rhetoric figures by means of PERL-compatible regular expressions, in:\n                      Proceedings of the Second Student Research Workshop associated with RANLP 2011\n                      , Hissar, Bulgaria, 2011."},{"key":"ref034","unstructured":"J.F.\u00a0Kennedy, [T. Sorensen], Inaugural Address, 1961 Jan 20 [cited 2018 Jan 25]. Jan 20 [cited 2018 Jan 25], in: The American Presidency Project [Internet], G. Peters and J.T. Woolley, eds, available at: http:\/\/www.presidency.ucsb.edu\/ws\/index.php?pid=8032."},{"key":"ref035","unstructured":"G.\u00a0Lakoff and M.\u00a0Johnson, Metaphors We Live by, University of Chicago Press, Chicago, 1980."},{"key":"ref036","doi-asserted-by":"crossref","unstructured":"R.\u00a0Lanham, A Handlist of Rhetorical Terms, University of California Press, Berkeley, CA, 1991.","DOI":"10.1525\/9780520912045"},{"key":"ref037","doi-asserted-by":"publisher","DOI":"10.3233\/AAC-170026"},{"key":"ref038","unstructured":"S.Lee, Malcolm X, Warner Bros, 1992."},{"key":"ref039","unstructured":"L.\u00a0Magid, Zuckerberg claims we don\u2019t build services to make money, 2012 Feb 1, Forbes [Internet], 2012 Feb 1 [cited 2018 Jan 25], available at: http:\/\/www.forbes.com\/sites\/larrymagid\/2012\/02\/01\/zuckerberg-claims-we-dont-build-services-to-make-money\/."},{"key":"ref040","unstructured":"N.\u00a0Mandela, The Long Walk to Freedom, Little, Brown and Company, New York, 1994."},{"key":"ref041","doi-asserted-by":"publisher","DOI":"10.1515\/text.1.1988.8.3.243"},{"key":"ref042","unstructured":"D.\u00a0Margolicklos, Simpson\u2019s lawyer tells jury that evidence \u2018doesn\u2019t fit\u2019, New York Times [Internet], 1995 September 28 [cited 2018 Jan 25], available at: http:\/\/www.nytimes.com\/1995\/09\/28\/us\/simpson-s-lawyer-tells-jury-that-evidence-doesn-t-fit.html?pagewanted=all."},{"key":"ref043","unstructured":"P.H.\u00a0Matthews, Syntactic Relations: A Critical Survey, Cambridge Studies in Linguistics, Vol.\u00a0114, Cambridge University Press, Cambridge, 2007."},{"key":"ref044","unstructured":"R.\u00a0Maxwell, Jane: The Woman Who Loved Tarzan, Macmillan, New York, 2012."},{"key":"ref045","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9280.00282"},{"key":"ref046","doi-asserted-by":"publisher","DOI":"10.3233\/AAC-170028"},{"key":"ref047","unstructured":"I.\u00a0Newton, The mathematical principles of natural philosophy, Three volumes, H.D. Symonds, London, 1803, 1687, translated by Andrew Motte."},{"key":"ref048","unstructured":"Oklahoma Department of Wildlife Conservation,\n                      Outdoor Oklahoma\n                      , Vol. 51\u201352, 1995."},{"key":"ref049","unstructured":"C.\u00a0O\u2019Reilly, Lassoing rhetoric with OWL and SWRL [Internet], [unpublished MSc dissertation], 2010 [cited 2018 Jan 25], available at: http:\/\/computationalrhetoricworkshop.uwaterloo.ca\/wp-content\/uploads\/2016\/06\/LassoingRhetoricWithOWLAndSWRL.pdf."},{"key":"ref050","unstructured":"C.\u00a0O\u2019Reilly and S.\u00a0Paurobally, Lassoing rhetoric with OWL and SWRL, Unpublished [Internet], 2010 [cited 2018 Jan 25], available at: http:\/\/www.academia.edu\/2095469\/Lassoing_Rhetoric_with_OWL_and_SWRL."},{"key":"ref051","unstructured":"C.\u00a0Perelman and L.\u00a0Olbrecht-Tyteca, The New Rhetoric: A Treatise on Argumentation, Notre Dame University Press, Notre Dame, 1969, translated by John Wilkinson."},{"key":"ref052","unstructured":"C.\u00a0Porter,\n                      Anything goes\n                      , in: G. Bolton and P.G. Woodhouse, eds, 1934."},{"key":"ref053","doi-asserted-by":"crossref","unstructured":"C.\u00a0Reed and T.J.\u00a0Norman, eds,\n                      Argumentation machines: New frontiers in argument and computation\n                      , Kluwer, Dordrecht, The Netherlands, 2003.","DOI":"10.1007\/978-94-017-0431-1"},{"key":"ref054","doi-asserted-by":"publisher","DOI":"10.1142\/S0218213004001922"},{"key":"ref055","unstructured":"S.\u00a0Ruan, C.\u00a0DiMarco and R.A.\u00a0Harris, Rhetorical figure annotation with XML, in:\n                      Computational Models of Natural Argumentation (CMNA) 16, a Workshop at the 2016 International Joint Conference on Artificial Intelligence (IJCAI)\n                      , New York, NY, 2016."},{"key":"ref056","unstructured":"C.\u00a0Sartwell, The left-right political spectrum is bogus,\n                      The Atlantic\n                      [Internet], 2014 June 20 [cited 2018 Jan 25], available at: http:\/\/www.theatlantic.com\/politics\/archive\/2014\/06\/the-left-right-political-spectrum-is-bogus\/373139\/."},{"key":"ref057","unstructured":"M.L.\u00a0Schagrin, The Language of Logic: A Programed Text, Random House, New York, 1968."},{"key":"ref058","unstructured":"D.\u00a0Seuss and T.S.\u00a0Geisel, Horton Hatches the Egg, Random House, New York, 1940."},{"key":"ref059","doi-asserted-by":"publisher","DOI":"10.1080\/00138388208598156"},{"key":"ref060","unstructured":"C.\u00a0Strommer, Using Rhetorical Figures and shallow attributes as a metric of intent in text, PhD dissertation, University of Waterloo, Waterloo, 2011, Supervised by Chrysanne DiMarco, Randy Allen Harris, Second Reader, Chris Reed, External Examiner."},{"key":"ref061","unstructured":"S.\u00a0Teufel, The Structure of Scientific Articles: Applications to Citation Indexing and Summarization, CSLI Publications, San Francisco, 2010."},{"key":"ref062","doi-asserted-by":"crossref","unstructured":"S.J.\u00a0Teufel, C.\u00a0Moens and M.\u00a0Moens, An annotation scheme for discourse-level argumentation in research articles, in: Proceedings of the Ninth Conference on European Chapter of the Association for Computational Linguistics, Stroudsburg, PA, 1999, pp.\u00a0110\u2013117. doi:10.3115\/977035.977051.","DOI":"10.3115\/977035.977051"},{"key":"ref063","unstructured":"C.W.\u00a0Tindale, Acts of Arguing: A Rhetorical Model of Argument, State University of New York Press, Albany, NY, 2000."},{"key":"ref064","unstructured":"Unknown, Ultrabooks vs Laptops, Java [Internet], 2013 Jan 26 [cited 2018 Jan 25], available at: http:\/\/java-maheshyadav.blogspot.ca\/2013\/01\/ultrabooks-vs-laptops.html."},{"key":"ref065","unstructured":"Unknown, Western Spanglish language: The United States unofficial language. Western women in leadership and innovation: Discovering the wellsprings of metaphorical voices [Internet], Unknown date, previously available at: http:\/\/westernwomenleadershipinnovation.net\/western-spanglish-language.html."},{"key":"ref066","doi-asserted-by":"crossref","unstructured":"B.\u00a0Vickers, In defence of rhetoric, Oxford University Press, Toronto, 1989. doi:10.1093\/acprof:oso\/9780198117919.001.0001.","DOI":"10.1093\/acprof:oso\/9780198117919.001.0001"},{"key":"ref067","unstructured":"P.E.\u00a0Volpe, Man, Nature, and Society: An Introduction to Biology, W. C. Brown Company, Dubuque, IA, 1975."},{"key":"ref068","unstructured":"D.\u00a0Walker, God in a Brothel: An Undercover Journey Into Sex Trafficking and Rescue, InterVarsity Press, Downers Grove, IL, 2011."},{"key":"ref069","unstructured":"W.\u00a0Waller, War and the Family, The Dryden Press, Hinsdale, IL, 1940."},{"key":"ref070","unstructured":"M[alcolm] X., 2002 [1964], I\u2019m not an American, I\u2019m a victim of Americanism, Delivered at the University of Ghana, May 13, 1964, The Militant [Internet], 2002 February 11 [cited 2018 Jan 25]\n                      66\n                      (6), available at: http:\/\/www.themilitant.com\/2002\/6606\/660649.html."},{"key":"ref071","unstructured":"M[alcolm] X., It shall be the ballot or the bullet, Delivered in Washington Heights, NY, March 29, 1964, AMDOCS: Documents for the Study of American History [Internet], [cited 2018 Jan 25], available at: http:\/\/www.vlib.us\/amdocs\/texts\/malcolmx0364.html."}],"container-title":["Argument &amp; Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/AAC-180037","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/AAC-180037","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/AAC-180037","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T11:53:52Z","timestamp":1777377232000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/AAC-180037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,29]]},"references-count":71,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,7,16]]}},"alternative-id":["10.3233\/AAC-180037"],"URL":"https:\/\/doi.org\/10.3233\/aac-180037","relation":{},"ISSN":["1946-2166","1946-2174"],"issn-type":[{"value":"1946-2166","type":"print"},{"value":"1946-2174","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,29]]}}}