{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:11:43Z","timestamp":1776107503716,"version":"3.50.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T00:00:00Z","timestamp":1730937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2031951, 2016061"],"award-info":[{"award-number":["2031951, 2016061"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:p>Content moderation practices and technologies need to change over time as requirements and community expectations shift. However, attempts to restructure the existing moderation practices can be difficult, especially for platforms that rely on their communities to moderate, because changes can transform the workflow and workload participants' reward systems. By examining the extensive archival discussions around a prepublication moderation technology on Wikipedia named Flagged Revisions, complemented by seven semi-structured interviews, we identify various challenges in restructuring community-based moderation practices. Thus, we find that while a new system might sound good in theory and perform well in terms of quantitative metrics, it may conflict with existing social norms. Furthermore, our findings underscore how the relationship between platforms and self-governed communities can hinder the ability to assess the performance of any new system and introduce considerable costs related to maintaining, overhauling, or scrapping any piece of infrastructure.<\/jats:p>","DOI":"10.1145\/3686954","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T15:52:40Z","timestamp":1731081160000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Challenges in Restructuring Community-based Moderation"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2992-3728","authenticated-orcid":false,"given":"Chau","family":"Tran","sequence":"first","affiliation":[{"name":"New York University, Brooklyn, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-1915-1834","authenticated-orcid":false,"given":"Kejsi","family":"Take","sequence":"additional","affiliation":[{"name":"New York University, Brooklyn, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6196-942X","authenticated-orcid":false,"given":"Kaylea","family":"Champion","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8588-7429","authenticated-orcid":false,"given":"Benjamin Mako","family":"Hill","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1831-1785","authenticated-orcid":false,"given":"Rachel","family":"Greenstadt","sequence":"additional","affiliation":[{"name":"New York University, Brooklyn, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2008. [Wikide-l] FlaggedRevs in der deutschsprachigen Wikipedia. https:\/\/lists.wikimedia.org\/pipermail\/wikidel\/2008-June\/020734.html."},{"key":"e_1_2_1_2_1","unstructured":"2008. Wikipedia:Meinungsbilder\/Weiterf\u00fchrung der gesichteten Versionen. https:\/\/de.wikipedia.org\/wiki\/Wikipedia:Meinungsbilder\/Weiterf%C3%BChrung_der_gesichteten_Versionen."},{"key":"e_1_2_1_3_1","unstructured":"2009. Wikipedia:Flagged revisions petition. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Flagged_revisions_petition."},{"key":"e_1_2_1_4_1","unstructured":"2012. Wikipedia:Pending changes\/Request for Comment 2012. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Pending_changes\/Request_for_Comment_2012."},{"key":"e_1_2_1_5_1","unstructured":"2017. FlaggedRevs for Norwegian (bokm\u00e5l) Wikipedia. https:\/\/phabricator.wikimedia.org\/T66726."},{"key":"e_1_2_1_6_1","unstructured":"2019. Szerkeszt?:Tgr\/Jel\u00f6lt v\u00e1ltozatok hat\u00e1s\u00e1nak elemz\u00e9se\/en. https:\/\/hu.wikipedia.org\/wiki\/Szerkeszt%C5%91:Tgr\/Jel%C3%B6lt_v%C3%A1ltozatok_hat%C3%A1s%C3%A1nak_elemz%C3%A9se\/en."},{"key":"e_1_2_1_7_1","unstructured":"2020. Reconfigure FlaggedRevs at the Indonesian Wikipedia. https:\/\/phabricator.wikimedia.org\/T268317."},{"key":"e_1_2_1_8_1","volume-title":"Community Wishlist Survey","year":"2023","unstructured":"2023. Community Wishlist Survey 2023. https:\/\/meta.wikimedia.org\/wiki\/Community_Wishlist_Survey_2023."},{"key":"e_1_2_1_9_1","unstructured":"2023. Hilfe:Gesichtete Versionen. https:\/\/de.wikipedia.org\/wiki\/Hilfe:Gesichtete_Versionen."},{"key":"e_1_2_1_10_1","unstructured":"2023. Moderator Code of Conduct. https:\/\/www.redditinc.com\/policies\/moderator-code-of-conduct."},{"key":"e_1_2_1_11_1","unstructured":"2023. Wikipedia:Automated moderation. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Automated_moderation."},{"key":"e_1_2_1_12_1","unstructured":"2023. Wikipedia:Protection policy. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Protection_policy."},{"key":"e_1_2_1_13_1","unstructured":"2023. Wikipedia:Welcome unregistered editing. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Welcome_unregistered_editing."},{"key":"e_1_2_1_14_1","unstructured":"2024. Flagged Revisions. https:\/\/meta.wikimedia.org\/wiki\/Flagged_Revisions."},{"key":"e_1_2_1_15_1","unstructured":"2024. Page review statistics. https:\/\/pl.wikipedia.org\/wiki\/Specjalna:Statystyki_oznaczania."},{"key":"e_1_2_1_16_1","unstructured":"2024. Statistiken zu gesichteten Versionen. https:\/\/de.wikipedia.org\/wiki\/Spezial:Sichtungsstatistik."},{"key":"e_1_2_1_17_1","unstructured":"2024. Wikimedia Deutschland. https:\/\/meta.wikimedia.org\/wiki\/Wikimedia_Deutschland."},{"key":"e_1_2_1_18_1","unstructured":"2024. Wikipedia:Bot policy. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Bot_policy."},{"key":"e_1_2_1_19_1","unstructured":"2024. Wikipedia:Flagged protection and patrolled revisions. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Flagged_protection_and_patrolled_revisions."},{"key":"e_1_2_1_20_1","volume-title":"Managing the flow of technology: Technology transfer and the dissemination of technological information within the R&D organization","author":"Allen Thomas J.","year":"1984","unstructured":"Thomas J. Allen. 1984. Managing the flow of technology: Technology transfer and the dissemination of technological information within the R&D organization. MIT Press Books Volume 1 (1984)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1100.0639"},{"key":"e_1_2_1_22_1","volume-title":"Coase's penguin, or, Linux and the nature of the firm. Yale Law Journal","author":"Benkler Yochai","year":"2002","unstructured":"Yochai Benkler. 2002. Coase's penguin, or, Linux and the nature of the firm. Yale Law Journal (2002), 369--446."},{"key":"e_1_2_1_23_1","volume-title":"Peer production: A form of collective intelligence. Handbook of collective intelligence 175","author":"Benkler Yochai","year":"2015","unstructured":"Yochai Benkler, Aaron Shaw, and Benjamin Mako Hill. 2015. Peer production: A form of collective intelligence. Handbook of collective intelligence 175 (2015)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099203.1099205"},{"key":"e_1_2_1_25_1","unstructured":"Robyn Caplan Lauren Hanson and Joan Donovan. 2018. Dead reckoning: Navigating content moderation after 'fake news'. (2018)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359155"},{"key":"e_1_2_1_27_1","unstructured":"Kathy Charmaz. 2014. Constructing Grounded Theory. SAGE."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.23919\/CISTI.2017.7975786"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/0162243915579283"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-012-9289-7"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274313"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359328"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.2753\/MIS0742-1222260103"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3568491"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2013.873069"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718941"},{"key":"e_1_2_1_37_1","volume-title":"Content Moderation, and the Hidden Decisions That Shape Social Media","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. Yale University Press, New Haven, Connecticut."},{"key":"e_1_2_1_38_1","volume-title":"AI, and the question of scale","author":"Gillespie Tarleton","year":"2020","unstructured":"Tarleton Gillespie. 2020. Content moderation, AI, and the question of scale. Big Data & Society Volume 7 (2020)."},{"key":"e_1_2_1_39_1","first-page":"42","article-title":"The virtues of moderation","volume":"17","author":"Grimmelmann James","year":"2015","unstructured":"James Grimmelmann. 2015. The virtues of moderation. Yale Journal of Law & Technology 17 (2015), 42.","journal-title":"Yale Journal of Law & Technology"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415219"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764212469365"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2038558.2038585"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/0093650220910345"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338243"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338243"},{"key":"e_1_2_1_46_1","volume-title":"Decentralizing platform power: A design space of multi-level governance in online social platforms","author":"Jhaver Shagun","year":"2023","unstructured":"Shagun Jhaver, Seth Frey, and Amy X Zhang. 2023. Decentralizing platform power: A design space of multi-level governance in online social platforms. Social Media Society 9, 4 (2023)."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534929"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/0163443720957562"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2141512.2141609"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311957.3359443"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382960"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359146"},{"key":"e_1_2_1_53_1","volume-title":"Sociological Forum","author":"Konieczny Piotr","unstructured":"Piotr Konieczny. 2009. Governance, organization, and democracy on the Internet: The iron law and the evolution of Wikipedia. In Sociological Forum, Vol. 24. Wiley Online Library, 162--192."},{"key":"e_1_2_1_54_1","volume-title":"Building successful online communities: Evidence-based social design","author":"Kraut Robert E","unstructured":"Robert E Kraut and Paul Resnick. 2012. Building successful online communities: Evidence-based social design. MIT Press."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1142\/9789814295505_0019"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305119836778"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145266"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2729.2011.00406.x"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/143457.143549"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.7.1.63"},{"key":"e_1_2_1_62_1","volume-title":"Gash","author":"Orlikowski Wanda J.","year":"1991","unstructured":"Wanda J. Orlikowski and Debra C. Gash. 1991. Changing frames: Understanding technological change in organizations. (1991)."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/196734.196745"},{"key":"e_1_2_1_64_1","volume-title":"Governing the commons: The evolution of institutions for collective action","author":"Ostrom Elinor","unstructured":"Elinor Ostrom. 1990. Governing the commons: The evolution of institutions for collective action. Cambridge University Press."},{"key":"e_1_2_1_65_1","article-title":"Mechanisms of an online public sphere: The website Slashdot","volume":"10","author":"Poor Nathaniel","year":"2005","unstructured":"Nathaniel Poor. 2005. Mechanisms of an online public sphere: The website Slashdot. Journal of Computer-Mediated Communication 10, 2 (2005), JCMC1028.","journal-title":"Journal of Computer-Mediated Communication"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415178"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818821316"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/1641309.1641322"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173929"},{"key":"e_1_2_1_70_1","volume-title":"A digital ethnography of marginalized users and content moderation on Twitch and Reddit","author":"Thach Hibby","year":"2022","unstructured":"Hibby Thach, Samuel Mayworm, Daniel Delmonaco, and Oliver Haimson. 2022. (In) visible moderation: A digital ethnography of marginalized users and content moderation on Twitch and Reddit. New Media & Society (2022)."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555225"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998232"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3412569.3412580"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686954","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686954","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:26:49Z","timestamp":1755768409000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686954"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,7]]},"references-count":73,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2024,11,7]]}},"alternative-id":["10.1145\/3686954"],"URL":"https:\/\/doi.org\/10.1145\/3686954","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,7]]},"assertion":[{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}