{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T23:36:44Z","timestamp":1780961804683,"version":"3.54.1"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Moderators are at the core of maintaining healthy online communities. For these moderators, who are often volunteers from the community, filtering through content and responding to misbehavior on time has become increasingly challenging as online communities continue to grow. To address such challenges of scale, recent research has looked into designing better tools for moderators of various platforms (e.g. Reddit, Twitch, Facebook, and Twitter). In this paper, we focus on Discord, a platform where communities are typically involved in large, synchronous group chats, creating an environment with a faster pace and a lack of structure compared to previously studied platforms. To tackle the unique challenges presented by Discord, we developed a new human-AI system called ConvEx for exploring online conversations. ConvEx is an AI-augmented version of the standard Discord interface designed to help moderators be proactive in identifying and preventing potential problems. It provides visual embeddings of conversational metrics, such as activity and toxicity levels, and can be extended to visualize other metrics. Through a user study with eight active moderators of Discord servers, we found that ConvEx supported several high-level strategies in monitoring a server and analyzing conversations. ConvEx allowed moderators to obtain a holistic view of activity across multiple channels on the server while guiding their attention towards problematic conversations and messages in a channel, helping them identify important contextual information to obtain reliable information from the AI analysis while also being able to pick up on contextual nuances which the AI missed. We conclude with design considerations for integrating AI into future interfaces for moderating synchronous, unstructured online conversations.<\/jats:p>","DOI":"10.1145\/3610053","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T15:54:10Z","timestamp":1696434850000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["ConvEx: A Visual Conversation Exploration System for Discord Moderators"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8818-2456","authenticated-orcid":false,"given":"Frederick","family":"Choi","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0585-1966","authenticated-orcid":false,"given":"Tanvi","family":"Bajpai","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8887-1525","authenticated-orcid":false,"given":"Sowmya","family":"Pratipati","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7473-1418","authenticated-orcid":false,"given":"Eshwar","family":"Chandrasekharan","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n. d.]. Discord Moderator Academy. https:\/\/discord.com\/moderation"},{"key":"e_1_2_1_2_1","unstructured":"[n. d.]. Perspective API. https:\/\/www.perspectiveapi.com\/"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447535.3462637"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555110"},{"key":"e_1_2_1_5_1","volume-title":"Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversations. arXiv preprint arXiv:2102.08368","author":"Bao Jiajun","year":"2021","unstructured":"Jiajun Bao, Junjie Wu, Yiming Zhang, Eshwar Chandrasekharan, and David Jurgens. 2021. Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversations. arXiv preprint arXiv:2102.08368 (2021)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.4018\/IJICST.2019070103"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452918.3458796"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7282"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819963"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359276"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490499"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134666"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274301"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v8i1.14518"},{"key":"e_1_2_1_15_1","volume-title":"A computational approach to politeness with application to social factors. arXiv preprint arXiv:1306.6078","author":"Danescu-Niculescu-Mizil Cristian","year":"2013","unstructured":"Cristian Danescu-Niculescu-Mizil, Moritz Sudhof, Dan Jurafsky, Jure Leskovec, and Christopher Potts. 2013. A computational approach to politeness with application to social factors. arXiv preprint arXiv:1306.6078 (2013)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v11i1.14955"},{"key":"e_1_2_1_17_1","unstructured":"Maeve Duggan. 2020. Online harassment. https:\/\/www.pewresearch.org\/internet\/2014\/10\/22\/online-harassment\/"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441866"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392822"},{"key":"e_1_2_1_20_1","volume-title":"Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19290"},{"key":"e_1_2_1_22_1","volume-title":"arXiv preprint arXiv:1904.07372","author":"Hessel Jack","year":"2019","unstructured":"Jack Hessel and Lillian Lee. 2019. Something's Brewing! Early Prediction of Controversy-causing Posts from Discussion Features. arXiv preprint arXiv:1904.07372 (2019)."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 5, CSCW2","author":"Ribeiro Manoel Horta","year":"2021","unstructured":"Manoel Horta Ribeiro, Shagun Jhaver, Savvas Zannettou, Jeremy Blackburn, Gianluca Stringhini, Emiliano De Cristofaro, and Robert West. 2021. Do platform migrations compromise content moderation? evidence from r\/the_donald and r\/incels. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--24."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_2_1_25_1","volume-title":"Rahat Ibn Rafiq, Richard Han, Qin Lv, and Shivakant Mishra.","author":"Hosseinmardi Homa","year":"2015","unstructured":"Homa Hosseinmardi, Sabrina Arredondo Mattson, Rahat Ibn Rafiq, Richard Han, Qin Lv, and Shivakant Mishra. 2015. Detection of cyberbullying incidents on the instagram social network. arXiv preprint arXiv:1503.03909 (2015)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394231.3397889"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376383"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338243"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359252"},{"key":"e_1_2_1_30_1","volume-title":"Designing Word Filter Tools for Creator-led Comment Moderation. In CHI Conference on Human Factors in Computing Systems. 1--21","author":"Jhaver Shagun","year":"2022","unstructured":"Shagun Jhaver, Quan Ze Chen, Detlef Knauss, and Amy X Zhang. 2022. Designing Word Filter Tools for Creator-led Comment Moderation. In CHI Conference on Human Factors in Computing Systems. 1--21."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185593"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359157"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1357"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359146"},{"key":"e_1_2_1_35_1","volume-title":"Regulating behavior in online communities. Evidence based social design: Mining the social sciences to build online communities","author":"Kiesler Sara","year":"2010","unstructured":"Sara Kiesler, Robert Kraut, Paul Resnick, and Aniket Kittur. 2010. Regulating behavior in online communities. Evidence based social design: Mining the social sciences to build online communities (2010), 125--179."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186141"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/2900423.2900614"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19314"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19318"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305119836778"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11109-016-9373-5"},{"key":"e_1_2_1_43_1","volume-title":"Tenth International AAAI Conference on Web and Social Media.","author":"Newell Edward","year":"2016","unstructured":"Edward Newell, David Jurgens, Haji Mohammad Saleem, Hardik Vala, Jad Sassine, Caitrin Armstrong, and Derek Ruths. 2016. User migration in online social networks: A case study on reddit during a period of community unrest. In Tenth International AAAI Conference on Web and Social Media."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctt1fq9wdp"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7323"},{"key":"e_1_2_1_46_1","unstructured":"Sarah T Roberts. 2016. Commercial content moderation: Digital laborers' dirty work. (2016)."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/0267323120922066"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274424"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479512"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media","author":"Schmidt Anna","year":"2019","unstructured":"Anna Schmidt and Michael Wiegand. 2019. A survey on hate speech detection using natural language processing. In Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media, April 3, 2017, Valencia, Spain. Association for Computational Linguistics, 1--10."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444820964968"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998277"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818821316"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376783"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449130"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998337"},{"key":"e_1_2_1_57_1","volume-title":"The state of online harassment","author":"Vogels Emily A","year":"2021","unstructured":"Emily A Vogels. 2021. The state of online harassment. Pew Research Center 13 (2021)."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300390"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052591"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415858"},{"key":"e_1_2_1_61_1","volume-title":"Conversations gone awry: Detecting early signs of conversational failure. arXiv preprint arXiv:1805.05345","author":"Zhang Justine","year":"2018","unstructured":"Justine Zhang, Jonathan P Chang, Cristian Danescu-Niculescu-Mizil, Lucas Dixon, Yiqing Hua, Nithum Thain, and Dario Taraborelli. 2018. Conversations gone awry: Detecting early signs of conversational failure. arXiv preprint arXiv:1805.05345 (2018)."},{"key":"e_1_2_1_62_1","first-page":"3952","article-title":"Content-Driven Detection of Cyberbullying on the Instagram Social Network","volume":"16","author":"Zhong Haoti","year":"2016","unstructured":"Haoti Zhong, Hao Li, Anna Cinzia Squicciarini, Sarah Michele Rajtmajer, Christopher Griffin, David J Miller, and Cornelia Caragea. 2016. Content-Driven Detection of Cyberbullying on the Instagram Social Network.. In IJCAI, Vol. 16. 3952--3958.","journal-title":"IJCAI"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610053","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610053","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T04:19:20Z","timestamp":1755749960000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610053"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":62,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2023,9,28]]}},"alternative-id":["10.1145\/3610053"],"URL":"https:\/\/doi.org\/10.1145\/3610053","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2023-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}