{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T14:19:11Z","timestamp":1784211551635,"version":"3.55.0"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T00:00:00Z","timestamp":1681430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,4,14]]},"abstract":"<jats:p>Volunteer moderators have the power to shape society through their influence on online discourse. However, the growing scale of online interactions increasingly presents significant hurdles for meaningful moderation. Furthermore, there are only limited tools available to assist volunteers with their work. Our work aims to meaningfully explore the potential of AI-driven, automated moderation tools for social media to assist volunteer moderators. One key aspect is to investigate the degree to which tools must become personalizable and context-sensitive in order to not just delete unsavory content and ban trolls, but to adapt to the millions of online communities on social media mega-platforms that rely on volunteer moderation. In this study, we conduct semi-structured interviews with 26 Facebook Group moderators in order to better understand moderation tasks and their associated challenges. Through qualitative analysis of the interview data, we identify and address the most pressing themes in the challenges they face daily. Using interview insights, we conceptualize three tools with automated features that assist them in their most challenging tasks and problems. We then evaluate the tools for usability and acceptance using a survey drawing on the technology acceptance literature with 22 of the same moderators. Qualitative and descriptive analyses of the survey data show that context-sensitive, agency-maintaining tools in addition to trial experience are key to mass adoption by volunteer moderators in order to build trust in the validity of the moderation technology.<\/jats:p>","DOI":"10.1145\/3579530","type":"journal-article","created":{"date-parts":[[2023,4,16]],"date-time":"2023-04-16T17:23:07Z","timestamp":1681665787000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["The Unsung Heroes of Facebook Groups Moderation: A Case Study of Moderation Practices and Tools"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1995-5937","authenticated-orcid":false,"given":"Tina","family":"Kuo","sequence":"first","affiliation":[{"name":"Technical University of Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4807-0919","authenticated-orcid":false,"given":"Alicia","family":"Hernani","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1093-1282","authenticated-orcid":false,"given":"Jens","family":"Grossklags","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,4,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-020--10405--7"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380074"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1120.0470"},{"key":"e_1_2_1_4_1","unstructured":"Debolina Biswas. 2021. Understanding the technology behind content moderation system of tech giants. https:\/\/analyticsindiamag.com\/understanding-the-technology-behind-content-moderation-system-of-tech-giants\/"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CBI.2019.00056"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.4018\/IJICST.2019070103"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479554"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517628"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359276"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274301"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049732315613982"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-020-00429-0"},{"key":"e_1_2_1_13_1","unstructured":"Cambridge Consultants. 2019. Use of AI in online content moderation. https:\/\/www.ofcom.org.uk\/__data\/assets\/pdf_file\/0028\/157249\/cambridge-consultants-ai-content-moderation.pdf"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/STAST.2011.6059256"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444814543163"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512958"},{"key":"e_1_2_1_17_1","volume-title":"Intervening against online hate speech: A case for automated counterspeech. Research Brief","author":"Cypris Niklas F.","year":"2022","unstructured":"Niklas F. Cypris, Severin Engelmann, Julia Sasse, Jens Grossklags, and Anna Baumert. 2022. Intervening against online hate speech: A case for automated counterspeech. Research Brief. TUM Institute for Ethics in Artificial Intelligence. https:\/\/ieai.sot.tum.de\/wp-content\/uploads\/2022\/05\/Research-Brief_Intervening-Against-Online-Hate-Speech_April2022_FINAL.pdf"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.2307\/249008"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2003.12.006"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300372"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415226"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365--2648.2007.04569.x"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1479--3709(07)11003--7"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.12987\/9780300235029"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719897945"},{"key":"e_1_2_1_26_1","volume-title":"Wexelblat","author":"Greening Daniel R.","year":"1988","unstructured":"Daniel R. Greening and Alan D. Wexelblat. 1988. Experiences with cooperative moderation of a Usenet newsgroup. Technical Report. UCLA, Computer Science Department. http:\/\/ftp.cs.ucla.edu\/tech-report\/198_-reports\/880028.pdf"},{"key":"e_1_2_1_27_1","first-page":"42","article-title":"The virtues of moderation","volume":"17","author":"Grimmelmann James","year":"2015","unstructured":"James Grimmelmann. 2015. The virtues of moderation. Yale Journal of Law and Technology, Vol. 17 (2015), 42--109. https:\/\/yjolt.org\/virtues-moderation","journal-title":"Yale Journal of Law and Technology"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 55th Hawaii International Conference on System Sciences (HICSS). 5963--5972","author":"He Qinglai","unstructured":"Qinglai He, Kevin Hong, and T. S. Raghu. 2022. The effects of machine-powered platform governance: An empirical study of content moderation. In Proceedings of the 55th Hawaii International Conference on System Sciences (HICSS). 5963--5972. http:\/\/hdl.handle.net\/10125\/80064"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.24"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1177\/1049732305276687"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2005.137"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479606"},{"key":"e_1_2_1_33_1","unstructured":"Charlotte Jee. 2020. Facebook needs 30 000 of its own content moderators says a new report. https:\/\/www.technologyreview.com\/2020\/06\/08\/1002894\/facebook-needs-30000-of-its-own-content-moderators-says-a-new-report\/"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338243"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517505"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185593"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359157"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19307"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382960"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359146"},{"key":"e_1_2_1_41_1","first-page":"1598","article-title":"The new governors: The people, rules, and processes governing online speech","volume":"131","author":"Klonick Kate","year":"2018","unstructured":"Kate Klonick. 2018. The new governors: The people, rules, and processes governing online speech. Harvard Law Review, Vol. 131, 6 (2018), 1598--1670. https:\/\/www.jstor.org\/stable\/44865879","journal-title":"Harvard Law Review"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445279"},{"key":"e_1_2_1_43_1","volume-title":"Kraut and Paul Resnick","author":"Robert","year":"2012","unstructured":"Robert E. Kraut and Paul Resnick. 2012. Building successful online communities: Evidence-based social design. MIT Press. https:\/\/mitpress.mit.edu\/9780262528917\/building-successful-online-communities\/"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2013.11.005"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529786"},{"key":"e_1_2_1_47_1","volume-title":"European Conference on Information Systems (ECIS). Article 70","author":"Keri","year":"2013","unstructured":"Keri M. Larson and Richard T. Watson. 2013. The impact of natural language processing-based textual analysis of social media interactions on decision making. In European Conference on Information Systems (ECIS). Article 70. https:\/\/aisel.aisnet.org\/ecis2013_cr\/70"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50_30392"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718756684"},{"key":"e_1_2_1_50_1","volume-title":"When all you have is a banhammer: The social and communicative work of volunteer moderators. S.M. Thesis","author":"Yu Lo Claudia Wai","unstructured":"Claudia Wai Yu Lo. 2018. When all you have is a banhammer: The social and communicative work of volunteer moderators. S.M. Thesis. Massachusetts Institute of Technology."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305119836778"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173583"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359174"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2016-0009"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1111\/joca.12111"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818773059"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.5771\/2192--4007--2017--4--395"},{"key":"e_1_2_1_58_1","unstructured":"Casey Newton. 2019. The trauma floor. https:\/\/www.theverge.com\/2019\/2\/25\/18229714\/cognizant-facebook-content-moderator-interviews-trauma-working-conditions-arizona"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444804041444"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957276.2957297"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0020859003001329"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0278-0984(02)11030--3"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7105.001.0001"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2020.106262"},{"key":"e_1_2_1_65_1","volume-title":"The Intersectional Internet: Race, Sex, Class, and Culture Online, Safiya Umoja Noble and Brendesha M","author":"Roberts Sarah","unstructured":"Sarah Roberts. 2016. Commercial content moderation: Digital laborers' dirty work. In The Intersectional Internet: Race, Sex, Class, and Culture Online, Safiya Umoja Noble and Brendesha M. Tynes (Eds.). Peter Lang Publishing. https:\/\/ir.lib.uwo.ca\/commpub\/12\/"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444819875990"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479512"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415178"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300836"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444820964968"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818821316"},{"key":"e_1_2_1_72_1","volume-title":"Davis' technology acceptance model (TAM)","author":"Silva Patricia","year":"1989","unstructured":"Patricia Silva. 2015. Davis' technology acceptance model (TAM) (1989). In Information Seeking Behavior and Technology Adoption: Theories and Trends, Mohammed Nasser Al-Suqri and Ali Saif Al-Aufi (Eds.). IGI Global, 205--219."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359265"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445092"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-021-00442-x"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2011.943583"},{"key":"e_1_2_1_77_1","first-page":"1526","article-title":"What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation","volume":"13","author":"Suzor Nicolas P.","year":"2019","unstructured":"Nicolas P. Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation. International Journal of Communication, Vol. 13 (2019), 1526--1543. https:\/\/ijoc.org\/index.php\/ijoc\/article\/view\/9736","journal-title":"International Journal of Communication"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2018.1493936"},{"key":"e_1_2_1_79_1","first-page":"19","volume-title":"First Workshop on Text Analytics for Cybersecurity and Online Safety (TA-COS). 11--17","author":"Tulkens St\u00e9phan","year":"2016","unstructured":"St\u00e9phan Tulkens, Lisa Hilte, Elise Lodewyckx, Ben Verhoeven, and Walter Daelemans. 2016. A dictionary-based approach to racism detection in Dutch social media. In First Workshop on Text Analytics for Cybersecurity and Online Safety (TA-COS). 11--17. http:\/\/www.lrec-conf.org\/proceedings\/lrec2016\/workshops\/LREC2016Workshop-TA-COS_Proceedings.pdf#page=19"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415238"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3383009"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579530","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579530","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:25Z","timestamp":1750182685000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579530"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,14]]},"references-count":81,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2023,4,14]]}},"alternative-id":["10.1145\/3579530"],"URL":"https:\/\/doi.org\/10.1145\/3579530","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,14]]},"assertion":[{"value":"2023-04-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}