{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T18:27:24Z","timestamp":1776882444987,"version":"3.51.2"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,7,9]],"date-time":"2017-07-09T00:00:00Z","timestamp":1499558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["101777"],"award-info":[{"award-number":["101777"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/N014871\/1"],"award-info":[{"award-number":["EP\/N014871\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1314778"],"award-info":[{"award-number":["1314778"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2017,8,31]]},"abstract":"<jats:p>Governments around the world are increasingly utilising online platforms and social media to engage with, and ascertain the opinions of, their citizens. Whilst policy makers could potentially benefit from such enormous feedback from society, they first face the challenge of making sense out of the large volumes of data produced. In this article, we show how the analysis of argumentative and dialogical structures allows for the principled identification of those issues that are central, controversial, or popular in an online corpus of debates. Although areas such as controversy mining work towards identifying issues that are a source of disagreement, by looking at the deeper argumentative structure, we show that a much richer understanding can be obtained. We provide results from using a pipeline of argument-mining techniques on the debate corpus, showing that the accuracy obtained is sufficient to automatically identify those issues that are key to the discussion, attracting proportionately more support than others, and those that are divisive, attracting proportionately more conflicting viewpoints.<\/jats:p>","DOI":"10.1145\/3032989","type":"journal-article","created":{"date-parts":[[2017,7,10]],"date-time":"2017-07-10T12:16:44Z","timestamp":1499689004000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Using Argumentative Structure to Interpret Debates in Online Deliberative Democracy and eRulemaking"],"prefix":"10.1145","volume":"17","author":[{"given":"John","family":"Lawrence","sequence":"first","affiliation":[{"name":"Centre for Argument Technology, University of Dundee, Dundee, UK"}]},{"given":"Joonsuk","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Williams College, Williamstown, USA"}]},{"given":"Katarzyna","family":"Budzynska","sequence":"additional","affiliation":[{"name":"Centre for Argument Technology, University of Dundee, UK 8 Polish Academy of Sciences, Poland"}]},{"given":"Claire","family":"Cardie","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Cornell University, USA"}]},{"given":"Barbara","family":"Konat","sequence":"additional","affiliation":[{"name":"Centre for Argument Technology, University of Dundee, UK"}]},{"given":"Chris","family":"Reed","sequence":"additional","affiliation":[{"name":"Centre for Argument Technology, University of Dundee, UK"}]}],"member":"320","published-online":{"date-parts":[[2017,7,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0514"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888906001044"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13601-6_16"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-2805"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0009-2614(00)00158-5"},{"key":"e_1_2_1_7_1","volume-title":"Newhart","author":"Farina Cynthia R.","year":"2013","unstructured":"Cynthia R. Farina and Mary J . Newhart . 2013 . Rulemaking 2.0: Understanding and getting better public participation. Cornell e-Rulemaking Initiative Publications ( 2013). Cynthia R. Farina and Mary J. Newhart. 2013. Rulemaking 2.0: Understanding and getting better public participation. Cornell e-Rulemaking Initiative Publications (2013)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/2002472.2002597"},{"key":"e_1_2_1_9_1","volume-title":"Quantitative Corpus Linguistics with R. A Practical Introduction","author":"Gries Stefan","unstructured":"Stefan Gries . 2009. Quantitative Corpus Linguistics with R. A Practical Introduction . Routledge . Stefan Gries. 2009. Quantitative Corpus Linguistics with R. A Practical Introduction. Routledge."},{"key":"e_1_2_1_10_1","first-page":"6","article-title":"e-Government across the globe: How will \u2018e\u2019 change government","volume":"17","author":"Howard Mark","year":"2001","unstructured":"Mark Howard . 2001 . e-Government across the globe: How will \u2018e\u2019 change government . Government Finance Review 17 , 4 (2001), 6 -- 9 . Mark Howard. 2001. e-Government across the globe: How will \u2018e\u2019 change government. Government Finance Review 17, 4 (2001), 6--9.","journal-title":"Government Finance Review"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 5th International Conference on Computational Models of Argument (COMMA\u201914)","author":"Janier Mathilde","year":"2014","unstructured":"Mathilde Janier , John Lawrence , and Chris Reed . 2014 . OVA+: An argument analysis interface . In Proceedings of the 5th International Conference on Computational Models of Argument (COMMA\u201914) . 463--464. Mathilde Janier, John Lawrence, and Chris Reed. 2014. OVA+: An argument analysis interface. In Proceedings of the 5th International Conference on Computational Models of Argument (COMMA\u201914). 463--464."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/30.1-2.81"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240698"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-1609"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 4th International Conference on Computational Models of Argument (COMMA\u201912)","author":"Lawrence John","year":"2012","unstructured":"John Lawrence , Floris Bex , Chris Reed , and Mark Snaith . 2012 . AIFdb: Infrastructure for the argument web . In Proceedings of the 4th International Conference on Computational Models of Argument (COMMA\u201912) . 515--516. John Lawrence, Floris Bex, Chris Reed, and Mark Snaith. 2012. AIFdb: Infrastructure for the argument web. In Proceedings of the 4th International Conference on Computational Models of Argument (COMMA\u201912). 515--516."},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"John Lawrence and Chris Reed. 2015a. In Argument Mining using Argumentation Scheme Structures. (In review) John Lawrence and Chris Reed. 2015a. In Argument Mining using Argumentation Scheme Structures. (In review)","DOI":"10.3233\/978-1-61499-686-6-379"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0516"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2111"},{"key":"e_1_2_1_19_1","first-page":"1188","article-title":"Distributed representations of sentences and documents","volume":"14","author":"Le Quoc V.","year":"2014","unstructured":"Quoc V. Le and Tomas Mikolov . 2014 . Distributed representations of sentences and documents . In ICML , Vol. 14. 1188 -- 1196 . Quoc V. Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In ICML, Vol. 14. 1188--1196.","journal-title":"ICML"},{"key":"e_1_2_1_20_1","volume-title":"English verb classes and alternations: A preliminary investigation","author":"Levin Beth","unstructured":"Beth Levin . 1993. English verb classes and alternations: A preliminary investigation . University of Chicago press. Beth Levin. 1993. English verb classes and alternations: A preliminary investigation. University of Chicago press."},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Ziheng Lin Min-Yen Kan and Hwee Tou Ng. 2009. Recognizing implicit discourse relations in the penn discourse treebank. In EMNLP. 343--351. Ziheng Lin Min-Yen Kan and Hwee Tou Ng. 2009. Recognizing implicit discourse relations in the penn discourse treebank. In EMNLP. 343--351.","DOI":"10.3115\/1699510.1699555"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073145"},{"key":"e_1_2_1_23_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S. Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111--3119. Tomas Mikolov Ilya Sutskever Kai Chen Greg S. Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111--3119."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1046"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276318.1276362"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/0033-3352.00196"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1568234.1568246"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2746090.2746118"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2392800.2392818"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2105"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2307729.2307757"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2112"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 1st European Conference on Argumentation.","author":"Peldszus Andreas","year":"2015","unstructured":"Andreas Peldszus and Manfred Stede . 2015 a. An annotated corpus of argumentative microtexts . In Proceedings of the 1st European Conference on Argumentation. Andreas Peldszus and Manfred Stede. 2015a. An annotated corpus of argumentative microtexts. In Proceedings of the 1st European Conference on Argumentation."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0513"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Emily Pitler Annie Louis and Ani Nenkova. 2009. Automatic sense prediction for implicit discourse relations in text. In ACL\/AFNLP. 683--691. Emily Pitler Annie Louis and Ani Nenkova. 2009. Automatic sense prediction for implicit discourse relations in text. In ACL\/AFNLP. 683--691.","DOI":"10.3115\/1690219.1690241"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871751"},{"key":"e_1_2_1_38_1","volume-title":"Webber","author":"Prasad Rashmi","year":"2008","unstructured":"Rashmi Prasad , Nikhil Dinesh , Alan Lee , Eleni Miltsakaki , Livio Robaldo , Aravind K. Joshi , and Bonnie L . Webber . 2008 . The penn discourse treebank 2.0. In LREC. Citeseer . Rashmi Prasad, Nikhil Dinesh, Alan Lee, Eleni Miltsakaki, Livio Robaldo, Aravind K. Joshi, and Bonnie L. Webber. 2008. The penn discourse treebank 2.0. In LREC. Citeseer."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2007.04.015"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4625"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 25th International Conference on Computational Linguistics (COLING","author":"Stab Christian","year":"2014","unstructured":"Christian Stab and Iryna Gurevych . 2014 . Annotating argument components and relations in persuasive essays . In Proceedings of the 25th International Conference on Computational Linguistics (COLING 2014). 1501--1510. Christian Stab and Iryna Gurevych. 2014. Annotating argument components and relations in persuasive essays. In Proceedings of the 25th International Conference on Computational Linguistics (COLING 2014). 1501--1510."},{"key":"e_1_2_1_42_1","unstructured":"Simone Teufel. 1999. Argumentative Zoning: Information Extraction from Scientific Text. Ph.D. Dissertation. University of Edinburgh. Simone Teufel. 1999. Argumentative Zoning: Information Extraction from Scientific Text. Ph.D. Dissertation. University of Edinburgh."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1162\/089120102762671936"},{"key":"e_1_2_1_44_1","volume-title":"Argumentative Indicators in Discourse: A Pragma-dialectical Study","author":"van Eemeren Frans H.","unstructured":"Frans H. van Eemeren , Peter Houtlosser , and Arnolda Francisca Snoeck Henkemans . 2007. Argumentative Indicators in Discourse: A Pragma-dialectical Study . Vol. 12 . Springer Science 8 Business Media. Frans H. van Eemeren, Peter Houtlosser, and Arnolda Francisca Snoeck Henkemans. 2007. Argumentative Indicators in Discourse: A Pragma-dialectical Study. Vol. 12. Springer Science 8 Business Media."},{"key":"e_1_2_1_45_1","unstructured":"Marilyn A. Walker Jean E. Fox Tree Pranav Anand Rob Abbott and Joseph King. 2012. A corpus for research on deliberation and debate. In LREC. 812--817. Marilyn A. Walker Jean E. Fox Tree Pranav Anand Rob Abbott and Joseph King. 2012. A corpus for research on deliberation and debate. In LREC. 812--817."},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Douglas N. Walton Chris Reed and Fabrizio Macagno. 2008. Argumentation Schemes. Cambridge University Press. Douglas N. Walton Chris Reed and Fabrizio Macagno. 2008. Argumentation Schemes. Cambridge University Press.","DOI":"10.1017\/CBO9780511802034"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324911000337"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324905004018"}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3032989","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3032989","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3032989","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,21]],"date-time":"2025-06-21T19:13:02Z","timestamp":1750533182000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3032989"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,9]]},"references-count":48,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,8,31]]}},"alternative-id":["10.1145\/3032989"],"URL":"https:\/\/doi.org\/10.1145\/3032989","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"value":"1533-5399","type":"print"},{"value":"1557-6051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7,9]]},"assertion":[{"value":"2016-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}