{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:24:42Z","timestamp":1750220682921,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T00:00:00Z","timestamp":1622678400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Centre for Doctoral Training in Cross Disciplinary Approaches to Non-Equilibrium Systems","award":["EP\/L015854\/1"],"award-info":[{"award-number":["EP\/L015854\/1"]}]},{"name":"Space for Sharing (S4S) project","award":["ES\/M00354X\/1"],"award-info":[{"award-number":["ES\/M00354X\/1"]}]},{"name":"King\u2019s India scholarship offered by the KCL Centre for Doctoral Studies"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>In online debates, as in offline ones, individual utterances or arguments support or attack each other, leading to some subset of arguments (potentially from different sides of the debate) being considered more relevant than others. However, online conversations are much larger in scale than offline ones, with often hundreds of thousands of users weighing in, collaboratively forming large trees of comments by starting from an original post and replying to each other. In large discussions, readers are often forced to sample a subset of the arguments being put forth. Since such sampling is rarely done in a principled manner, users may not read all the relevant arguments to get a full picture of the debate from a sample. This article is interested in answering the question of how users should sample online conversations to selectively favour the currently justified or accepted positions in the debate. We apply techniques from argumentation theory and complex networks to build a model that predicts the probabilities of the normatively justified arguments given their location in idealised online discussions of comments and replies, which we represent as trees. Our model shows that the proportion of replies that are supportive, the distribution of the number of replies that comments receive, and the locations of comments that do not receive replies (i.e., the \u201cleaves\u201d of the reply tree) all determine the probability that a comment is a justified argument given its location. We show that when the distribution of the number of replies is homogeneous along the tree length, for acrimonious discussions (with more attacking comments than supportive ones), the distribution of justified arguments depends on the parity of the tree level, which is the distance from the root expressed as number of edges. In supportive discussions, which have more supportive comments than attacks, the probability of having justified comments increases as one moves away from the root. For discussion trees that have a non-homogeneous in-degree distribution, for supportive discussions we observe the same behaviour as before, while for acrimonious discussions we cannot observe the same parity-based distribution. This is verified with data obtained from the online debating platform Kialo. By predicting the locations of the justified arguments in reply trees, we can therefore suggest which arguments readers should sample, to grasp the currently accepted opinions in such discussions. Our models have important implications for the design of future online debating platforms.<\/jats:p>","DOI":"10.1145\/3452936","type":"journal-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T19:49:59Z","timestamp":1622749799000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Who Has the Last Word? Understanding How to Sample Online Discussions"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1314-9480","authenticated-orcid":false,"given":"Gioia","family":"Boschi","sequence":"first","affiliation":[{"name":"Department of Mathematics, King\u2019s College London, London, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0747-3866","authenticated-orcid":false,"given":"Anthony P.","family":"Young","sequence":"additional","affiliation":[{"name":"Department of Informatics, King\u2019s College London, London, UK"}]},{"given":"Sagar","family":"Joglekar","sequence":"additional","affiliation":[{"name":"Department of Informatics, King\u2019s College London, London, UK"}]},{"given":"Chiara","family":"Cammarota","sequence":"additional","affiliation":[{"name":"Department of Physics, Sapienza Universit\u00e0 di Roma, Italy and Department of Mathematics, King\u2019s College London, London, UK"}]},{"given":"Nishanth","family":"Sastry","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Surrey, UK and Department of Informatics, King\u2019s College London, London, UK"}]}],"member":"320","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372923.3404817"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media. 26\u201337","author":"Agarwal Pushkal","year":"2019","unstructured":"Pushkal Agarwal , Nishanth Sastry , and Edward Wood . 2019 . Tweeting MPs: Digital engagement between citizens and members of parliament in the UK . Proceedings of the International AAAI Conference on Web and Social Media. 26\u201337 . Retrieved from https:\/\/www.aaai.org\/ojs\/index.php\/ICWSM\/article\/view\/3359. Pushkal Agarwal, Nishanth Sastry, and Edward Wood. 2019. Tweeting MPs: Digital engagement between citizens and members of parliament in the UK. Proceedings of the International AAAI Conference on Web and Social Media. 26\u201337. Retrieved from https:\/\/www.aaai.org\/ojs\/index.php\/ICWSM\/article\/view\/3359."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.31.2.211"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021603608656"},{"key":"e_1_2_1_5_1","volume-title":"Emergence of scaling in random networks. Science 286, 5439","author":"Barab\u00e1si Albert-L\u00e1szl\u00f3","year":"1999","unstructured":"Albert-L\u00e1szl\u00f3 Barab\u00e1si and R\u00e9ka Albert . 1999. Emergence of scaling in random networks. Science 286, 5439 ( 1999 ), 509\u2013512. Albert-L\u00e1szl\u00f3 Barab\u00e1si and R\u00e9ka Albert. 1999. Emergence of scaling in random networks. Science 286, 5439 (1999), 509\u2013512."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the International Conference on Computational Models of Argument (COMMA\u201916)","author":"Bosc Tom","year":"2016","unstructured":"Tom Bosc , Elena Cabrio , and Serena Villata . 2016 . Tweeties squabbling: Positive and negative results in applying argument mining on social media . In Proceedings of the International Conference on Computational Models of Argument (COMMA\u201916) . 21\u201332. Tom Bosc, Elena Cabrio, and Serena Villata. 2016. Tweeties squabbling: Positive and negative results in applying argument mining on social media. In Proceedings of the International Conference on Computational Models of Argument (COMMA\u201916). 21\u201332."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/2390665.2390717"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1080\/19462166.2013.862303"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/11518655_33"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2013.03.001"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1144"},{"key":"e_1_2_1_12_1","volume-title":"CEUR Workshop Proceedings. RWTH Aachen University.","author":"Cramer Marcos","year":"2018","unstructured":"Marcos Cramer and Mathieu Guillaume . 2018 . Directionality of attacks in natural language argumentation . In CEUR Workshop Proceedings. RWTH Aachen University. Marcos Cramer and Mathieu Guillaume. 2018. Directionality of attacks in natural language argumentation. In CEUR Workshop Proceedings. RWTH Aachen University."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-19570-0_7"},{"volume-title":"Proceedings of the 8th Workshop on Dynamics of Knowledge and Belief (DKB\u201919) and the 7th Workshop KI and Kognition (KIK\u201919)","author":"Cramer Marcos","key":"e_1_2_1_14_1","unstructured":"Marcos Cramer and Leon van der Torre. 2019. SCF2-an argumentation semantics for rational human judgments on argument acceptability . In Proceedings of the 8th Workshop on Dynamics of Knowledge and Belief (DKB\u201919) and the 7th Workshop KI and Kognition (KIK\u201919) co-located with 44nd German Conference on Artificial Intelligence (KI\u201919). 24\u201335. Marcos Cramer and Leon van der Torre. 2019. SCF2-an argumentation semantics for rational human judgments on argument acceptability. In Proceedings of the 8th Workshop on Dynamics of Knowledge and Belief (DKB\u201919) and the 7th Workshop KI and Kognition (KIK\u201919) co-located with 44nd German Conference on Artificial Intelligence (KI\u201919). 24\u201335."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.2200\/S00509ED1V01Y201305HLT023"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1108\/13563281211253539"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958844"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(94)00041-X"},{"key":"e_1_2_1_19_1","volume-title":"Dunne and Michael Wooldridge","author":"Paul","year":"2009","unstructured":"Paul E. Dunne and Michael Wooldridge . 2009 . Complexity of abstract argumentation. In Argumentation in Artificial Intelligence. Springer , 85\u2013104. Paul E. Dunne and Michael Wooldridge. 2009. Complexity of abstract argumentation. In Argumentation in Artificial Intelligence. Springer, 85\u2013104."},{"key":"e_1_2_1_20_1","first-page":"219","article-title":"Usenet\u2014A bulletin board for Unix users","volume":"8","author":"Emerson L.","year":"1983","unstructured":"Sandra. L. Emerson . 1983 . Usenet\u2014A bulletin board for Unix users . Byte 8 , 10 (1983), 219 . Sandra. L. Emerson. 1983. Usenet\u2014A bulletin board for Unix users. Byte 8, 10 (1983), 219.","journal-title":"Byte"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3023924.3023952"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/3171642.3171715"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/1931243114567565"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1995966.1995992"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-012-0162-8"},{"key":"e_1_2_1_26_1","unstructured":"Jeffery Gottfried and Elisa Shearer. 2017. News Use Across Social Media Platforms. Retrieved from http:\/\/www.journalism.org\/2017\/09\/07\/news-use-across-social-media-platforms-2017\/.  Jeffery Gottfried and Elisa Shearer. 2017. News Use Across Social Media Platforms. Retrieved from http:\/\/www.journalism.org\/2017\/09\/07\/news-use-across-social-media-platforms-2017\/."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47880-7_16"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1148466.1148473"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/288155.288184"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Konat Barbara","year":"2016","unstructured":"Barbara Konat , John Lawrence , Joonsuk Park , Katarzyna Budzynska , and Chris Reed . 2016 . A corpus of argument networks: Using graph properties to analyse divisive issues . In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC\u201916) . 3899\u20133906. Barbara Konat, John Lawrence, Joonsuk Park, Katarzyna Budzynska, and Chris Reed. 2016. A corpus of argument networks: Using graph properties to analyse divisive issues. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC\u201916). 3899\u20133906."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.63.066123"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835875"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00364"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/2283696.2283779"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2850417"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1093\/comnet\/cny010"},{"volume-title":"Methods and Models in Mathematical Biology","author":"M\u00fcller Johannes","key":"e_1_2_1_37_1","unstructured":"Johannes M\u00fcller and Christina Kuttler . 2015. Methods and Models in Mathematical Biology . Springer . Johannes M\u00fcller and Christina Kuttler. 2015. Methods and Models in Mathematical Biology. Springer."},{"key":"e_1_2_1_38_1","unstructured":"Julia Murphy and Max Roser. 2019. Internet. Our World in Data. Retrieved from https:\/\/ourworldindata.org\/internet.  Julia Murphy and Max Roser. 2019. Internet. Our World in Data. Retrieved from https:\/\/ourworldindata.org\/internet."},{"key":"e_1_2_1_39_1","first-page":"365","article-title":"If I want it, it\u2019s ok\u201d: Usenet and the (outer) limits of free speech. Info","volume":"12","author":"Pfaffenberger Bryan","year":"1996","unstructured":"Bryan Pfaffenberger . 1996 . \u201c If I want it, it\u2019s ok\u201d: Usenet and the (outer) limits of free speech. Info . Soc. 12 , 4 (1996), 365 \u2013 386 . Bryan Pfaffenberger. 1996. \u201cIf I want it, it\u2019s ok\u201d: Usenet and the (outer) limits of free speech. Info. Soc. 12, 4 (1996), 365\u2013386.","journal-title":"Soc."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 1st International Workshop on Systems and Algorithms for Formal Argumentation (SAFA\u201916)","volume":"1672","author":"Rago Antonio","year":"2016","unstructured":"Antonio Rago , Kristijonas Cyras , and Francesca Toni . 2016 . Adapting the DF-QuAD Algorithm\u00a0to Bipolar Argumentation . In Proceedings of the 1st International Workshop on Systems and Algorithms for Formal Argumentation (SAFA\u201916) , Vol. 1672 . CEUR-WS.org, 34\u201339. Antonio Rago, Kristijonas Cyras, and Francesca Toni. 2016. Adapting the DF-QuAD Algorithm\u00a0to Bipolar Argumentation. In Proceedings of the 1st International Workshop on Systems and Algorithms for Formal Argumentation (SAFA\u201916), Vol. 1672. CEUR-WS.org, 34\u201339."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2010.01123.x"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/1594368"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772781"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the AAAI Spring Symposium: Analyzing Microtext.","author":"Strnadov\u00e1-Neeley Veronika","year":"2013","unstructured":"Veronika Strnadov\u00e1-Neeley , David Jurgens , and Tsai-Ching Lu . 2013 . Characterizing online discussions in microblogs using network analysis . In Proceedings of the AAAI Spring Symposium: Analyzing Microtext. Veronika Strnadov\u00e1-Neeley, David Jurgens, and Tsai-Ching Lu. 2013. Characterizing online discussions in microblogs using network analysis. In Proceedings of the AAAI Spring Symposium: Analyzing Microtext."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1089\/1094931041291295"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883081"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/0894439314537886"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12275-0_19"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-2032"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/1695886"},{"key":"e_1_2_1_51_1","unstructured":"Anthony P. Young. 2018. Notes on abstract argumentation theory. Retrieved from https:\/\/arXiv:1806.07709.  Anthony P. Young. 2018. Notes on abstract argumentation theory. Retrieved from https:\/\/arXiv:1806.07709."},{"key":"e_1_2_1_52_1","unstructured":"Anthony P. Young Sagar Joglekar Gioia Boschi and Nishanth Sastry. 2020. Ranking comment sorting policies in online debates. Argu. & Comput. 1\u201321.  Anthony P. Young Sagar Joglekar Gioia Boschi and Nishanth Sastry. 2020. Ranking comment sorting policies in online debates. Argu. & Comput. 1\u201321."},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the Workshop on Argumentation and Society at the 7th International Conference on Computational Models of Argument.","author":"Young Anthony P.","year":"2018","unstructured":"Anthony P. Young , Sagar Joglekar , Kiran Garimella , and Nishanth Sastry . 2018 . Approximations to truth in online comment networks . In Proceedings of the Workshop on Argumentation and Society at the 7th International Conference on Computational Models of Argument. Anthony P. Young, Sagar Joglekar, Kiran Garimella, and Nishanth Sastry. 2018. Approximations to truth in online comment networks. In Proceedings of the Workshop on Argumentation and Society at the 7th International Conference on Computational Models of Argument."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274467"}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3452936","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3452936","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:26Z","timestamp":1750197806000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3452936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,3]]},"references-count":54,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3452936"],"URL":"https:\/\/doi.org\/10.1145\/3452936","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"type":"print","value":"1559-1131"},{"type":"electronic","value":"1559-114X"}],"subject":[],"published":{"date-parts":[[2021,6,3]]},"assertion":[{"value":"2020-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}