{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T00:32:16Z","timestamp":1760661136853,"version":"build-2065373602"},"reference-count":96,"publisher":"Association for Computing Machinery (ACM)","issue":"7","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,18]]},"abstract":"<jats:p>Content creators face heightened risks of online harm due to their public visibility and the increasing hostility in digital spaces. Traditional moderation tools, such as reporting and deletion, often fall short in addressing the emotional and reputational impact of online hate. In this study, we explore how community-driven approaches like counterspeech may support creators in navigating hateful comments, and how AI-powered tools could assist in this process. We conducted qualitative interviews and concept testing with 15 active content creators from Chinese social media platforms to understand their experiences and expectations. Our findings reveal that creators' approaches to counterspeech are shaped by their professional roles, the need to maintain authenticity, and the pressures of audience management. While creators saw value in AI-assisted counterspeech for improving efficiency and tone, they expressed concerns about misrepresentation, loss of control, and unintended harm. They preferred AI tools that augmented their voice rather than replaced it, and emphasized the importance of balancing emotional nuance with scalability. These insights inform the design of creator-centered AI moderation tools that integrate human agency and context sensitivity, contributing to healthier and more sustainable online environments.<\/jats:p>","DOI":"10.1145\/3757589","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:32:00Z","timestamp":1760635920000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Empowering Creators in the Fight Against Online Hate: A Qualitative Exploration of AI-Mediated Counterspeech Tools"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-1495-7534","authenticated-orcid":false,"given":"Phoebe Yiqing","family":"Huang","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6292-2377","authenticated-orcid":false,"given":"Jiaming","family":"Deng","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-1684-2622","authenticated-orcid":false,"given":"Yingchen","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3672-1294","authenticated-orcid":false,"given":"Spencer","family":"Williams","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"75","article-title":"Detection of Offensive Tweets: A Comparative Study","volume":"1","author":"Aggrawal N.","year":"2018","unstructured":"N. Aggrawal. 2018. Detection of Offensive Tweets: A Comparative Study. Computer Reviews Journal, Vol. 1, 1 (2018), 75-89. https:\/\/www.purkh.com\/abstract\/detection-of-offensive-tweets-a-comparative-study-61798.html","journal-title":"Computer Reviews Journal"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1108\/jrim-03-2022-0082"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.34190\/ejel.22.2.3250"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10677-022-10332-6"},{"key":"e_1_2_1_5_1","unstructured":"Dennys Antonialli. 2019. Drag Queen vs. David Duke: Whose Tweets Are More 'Toxic? https:\/\/www.wired.com\/story\/drag-queens-vs-far-right-toxic-tweets\/ Accessed: 2024-10-28."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","unstructured":"P. Badjatiya S. Gupta M. Gupta and V. Varma. 2017. deep learning for hate speech detection in tweets. (2017) 759-760. https:\/\/doi.org\/10.1145\/3041021.3054223","DOI":"10.1145\/3041021.3054223"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444820912724"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","unstructured":"S. Benesch H. M. S. Saleem K. Dillon L. W. Wright and D. R. Ruths. 2016. Counterspeech on twitter: a field study. (2016). https:\/\/doi.org\/10.15868\/socialsector.34066","DOI":"10.15868\/socialsector.34066"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2021.4126"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","unstructured":"M. Bilewicz and W. Soral. 2020. Hate speech epidemic. the dynamic effects of derogatory language on intergroup relations and political radicalization. political Psychology Vol. 41 (2020) 3-33. Issue S1. https:\/\/doi.org\/10.1111\/pops.12670","DOI":"10.1111\/pops.12670"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134659"},{"key":"e_1_2_1_12_1","volume-title":"A web app intended to help cope with harassment and abuse on Twitter. https:\/\/blocktogether.org\/. Accessed","author":"Together Block","year":"2019","unstructured":"Block Together. 2019. A web app intended to help cope with harassment and abuse on Twitter. https:\/\/blocktogether.org\/. Accessed: 2019."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3701206"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/20563051211063843"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/10776990221148987"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/phc3.12890"},{"key":"e_1_2_1_17_1","volume-title":"Towards A More Holistic Approach On Online Abuse and Antisemitism. Master's thesis","author":"Chandra Mohit","unstructured":"Mohit Chandra. 2021. Towards A More Holistic Approach On Online Abuse and Antisemitism. Master's thesis. International Institute of Information Technology, Hyderabad, Hyderabad, India. Advisor(s) Ponnurangam Kumaraguru and Manish Shrivastava. https:\/\/web2py.iiit.ac.in\/research_centres\/publications\/download\/mastersthesis.pdf.a06899c2e49b7fc7.5468657369735f4d6f6869745f66696e616c5f636f70792e706466.pdf Report no: IIIT\/TH\/2021\/5."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.24843\/lkjiti.2022.v13.i01.p05"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305121999660"},{"key":"e_1_2_1_20_1","unstructured":"Data & Society. 2016. Online Harassment Digital Abuse and Cyberstalking in America. https:\/\/datasociety.net\/output\/online-harassment-digital-abuse-cyberstalking\/ Accessed: 2024-10-28."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","unstructured":"N. Deshpande N. Farris and V. Kumar. 2022. highly generalizable models for multilingual hate speech detection. (2022). https:\/\/doi.org\/10.48550\/arxiv.2201.11294","DOI":"10.48550\/arxiv.2201.11294"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","unstructured":"L. Dixon J. Li J. Sorensen N. Thain and L. Vasserman. 2018. measuring and mitigating unintended bias in text classification. (2018). https:\/\/doi.org\/10.1145\/3278721.3278729","DOI":"10.1145\/3278721.3278729"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2007.00394.x"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300372"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2018.07.015"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/10584609.2020.1830322"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/0090591720984724"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14742\/ajet.2882"},{"key":"e_1_2_1_29_1","volume-title":"Content Moderation, and the Hidden Decisions That Shape Social Media","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. Yale University Press, London."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.woah-1.6"},{"key":"e_1_2_1_31_1","volume-title":"Anchor Books","author":"Hall Edward T.","unstructured":"Edward T. Hall. 1981. Beyond Culture (reprint ed.). Anchor Books, Garden City, NY."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1093\/jcmc\/zmz022"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2116310118"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.ijcnlp-main.28"},{"key":"e_1_2_1_35_1","volume-title":"The world's largest structured repository of regionalized, multilingual hate speech. https:\/\/hatebase.org\/. Accessed","year":"2024","unstructured":"Hatebase. 2019. The world's largest structured repository of regionalized, multilingual hate speech. https:\/\/hatebase.org\/. Accessed: 2024."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/01968599221124309"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2019.106190"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555174"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300469"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2208839120"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","unstructured":"G. Jd and J. Bright. 2021. hate contagion: measuring the spread and trajectory of hate on social media. (2021). https:\/\/doi.org\/10.31234\/osf.io\/b9qhd","DOI":"10.31234\/osf.io\/b9qhd"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610080"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305120969877"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67744-6_25"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","unstructured":"R. Kowalski A. Toth and M. Morgan. 2017. bullying and cyberbullying in adulthood and the workplace. the journal of social psychology Vol. 158 (2017) 64-81. Issue 1. https:\/\/doi.org\/10.1080\/00224545.2017.1302402","DOI":"10.1080\/00224545.2017.1302402"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10677-022-10336-2"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2020.00003"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1108\/imds-12-2023-0951"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3701189"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","unstructured":"P. Leerssen. 2022. an end to shadow banning? transparency rights in the digital services act between content moderation and curation. (2022). https:\/\/doi.org\/10.31219\/osf.io\/7jg45","DOI":"10.31219\/osf.io\/7jg45"},{"key":"e_1_2_1_51_1","first-page":"1166","article-title":"Refractive Surveillance: Monitoring Customers to Manage Workers","volume":"12","author":"Levy Karen","year":"2018","unstructured":"Karen Levy and Solon Barocas. 2018. Refractive Surveillance: Monitoring Customers to Manage Workers. International Journal of Communication, Vol. 12 (2018), 1166-1188. https:\/\/ijoc.org\/index.php\/ijoc\/article\/view\/7041","journal-title":"International Journal of Communication"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","unstructured":"R. Lewis A. Marwick and W. Partin. 2020. 'we dissect stupidity and respond to it: response videos and networked harassment on youtube. (2020). https:\/\/doi.org\/10.31235\/osf.io\/veqyj","DOI":"10.31235\/osf.io\/veqyj"},{"key":"e_1_2_1_53_1","volume-title":"Everything Is for Sale. The New York Times (March 10","author":"Lorenz Taylor","year":"2021","unstructured":"Taylor Lorenz. 2021. For Creators, Everything Is for Sale. The New York Times (March 10 2021). https:\/\/www.nytimes.com\/2021\/03\/10\/style\/creators-selling-selves.html Updated March 11, 2021."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174190"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","unstructured":"B. Mathew R. Dutt P. Goyal and A. Mukherjee. 2019. spread of hate speech in online social media. (2019). https:\/\/doi.org\/10.1145\/3292522.3326034","DOI":"10.1145\/3292522.3326034"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.359"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.3844\/jssp.2024.12.16"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/10591478241283839"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642025"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1111\/ADD.13314"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579618"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1177\/14773708231156328"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1177\/20539517221115666"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","unstructured":"H. Park. 2023. uncovering the root of hate speech: a dataset for identifying hate instigating speech. (2023). https:\/\/doi.org\/10.18653\/v1\/2023.findings-emnlp.412","DOI":"10.18653\/v1\/2023.findings-emnlp.412"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","unstructured":"J. Pater M. Kim E. Mynatt and C. Fiesler. 2016. characterizations of online harassment. (2016). https:\/\/doi.org\/10.1145\/2957276.2957297","DOI":"10.1145\/2957276.2957297"},{"key":"e_1_2_1_66_1","unstructured":"Kaike Ping Anisha Kumar Xiaohan Ding and Eugenia Rho. 2024. Behind the Counter: Exploring the Motivations and Barriers of Online Counterspeech Writing. arXiv:2403.17116 [cs.HC] https:\/\/arxiv.org\/abs\/2403.17116"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.4108\/eai.8-12-2018.2283930"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.47191\/ijsshr\/v7-i03-29"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1177\/20563051231180628"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvhrcz0v"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1177\/20563051211042397"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929x.2022.2027013"},{"key":"e_1_2_1_73_1","volume-title":"Russell and Peter Norvig","author":"Stuart","year":"2010","unstructured":"Stuart J. Russell and Peter Norvig. 2010. Artificial Intelligence: A Modern Approach (3 ed.). Pearson, Upper Saddle River, NJ."},{"key":"e_1_2_1_74_1","volume-title":"The creator economy could approach half-a-trillion dollars by","author":"Sachs Goldman","year":"2027","unstructured":"Goldman Sachs. 2023. The creator economy could approach half-a-trillion dollars by 2027. https:\/\/www.goldmansachs.com\/intelligence\/pages\/the-creator-economy-could-approach-half-a-trillion-dollars-by-2027.html. Retrieved October 1, 2024."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","unstructured":"P. Saha K. Singh A. Kumar B. Mathew and A. Mukherjee. 2022. Countergedi: a controllable approach to generate polite detoxified and emotional counterspeech. (2022). https:\/\/doi.org\/10.48550\/arxiv.2205.04304","DOI":"10.48550\/arxiv.2205.04304"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.5.2.45"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1101"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444820964968"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998277"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1177\/20563051241244674"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","unstructured":"P. Tewari and S. Mehendale. 2023. Persisting misogyny: a gendered analysis of online harassment of indian content creators on instagram and its impact on mental health. Cardiometry (2023) 493-501. Issue 25. https:\/\/doi.org\/10.18137\/cardiometry.2022.25.493501","DOI":"10.18137\/cardiometry.2022.25.493501"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448221109804"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","unstructured":"K. Thomas P. Kelley S. Consolvo P. Samermit and E. Bursztein. 2022. 'it's common and a part of being a content creator': understanding how creators experience and cope with hate and harassment online. (2022). https:\/\/doi.org\/10.1145\/3491102.3501879","DOI":"10.1145\/3491102.3501879"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-024-00791-3"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1177\/0265407510384895"},{"key":"e_1_2_1_86_1","volume-title":"Hateful conduct policy. https:\/\/help.twitter.com\/en\/rules-and-policies\/hate. Retrieved","year":"2020","unstructured":"Twitter. 2020. Hateful conduct policy. https:\/\/help.twitter.com\/en\/rules-and-policies\/hate. Retrieved September 9, 2020."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1177\/20563051221104749"},{"key":"e_1_2_1_88_1","first-page":"9131","volume-title":"Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024","author":"Wang Haiyang","year":"2024","unstructured":"Haiyang Wang, Zhiliang Tian, Xin Song, Yue Zhang, Yuchen Pan, Hongkui Tu, Minlie Huang, and Bin Zhou. 2024. Intent-Aware and Hate-Mitigating Counterspeech Generation via Dual-Discriminator Guided LLMs. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, and Nianwen Xue (Eds.). ELRA and ICCL, Torino, Italia, 9131-9142. https:\/\/aclanthology.org\/2024.lrec-main.800"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818773059"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10677-023-10409-w"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2006.00313.x"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300390"},{"key":"e_1_2_1_93_1","volume-title":"Hate speech policy. https:\/\/support.google.com\/youtube\/answer\/2801939?hl=en. Retrieved","year":"2020","unstructured":"YouTube. 2020. Hate speech policy. https:\/\/support.google.com\/youtube\/answer\/2801939?hl=en. Retrieved September 9, 2020."},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.36941\/ajis-2023-0120"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","unstructured":"W. Zhu and S. Bhat. 2021. Generate prune select: a pipeline for counterspeech generation against online hate speech. (2021). https:\/\/doi.org\/10.48550\/arxiv.2106.01625","DOI":"10.48550\/arxiv.2106.01625"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1093\/esr\/jcy005"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757589","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:37:57Z","timestamp":1760636277000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3757589"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":96,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,10,18]]}},"alternative-id":["10.1145\/3757589"],"URL":"https:\/\/doi.org\/10.1145\/3757589","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2025-10-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}