{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T06:02:43Z","timestamp":1775023363040,"version":"3.50.1"},"reference-count":112,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,2,28]],"date-time":"2023-02-28T00:00:00Z","timestamp":1677542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2023,2,28]]},"abstract":"<jats:p>Content moderation research typically prioritizes representing and addressing challenges for one group of stakeholders or communities in one type of context. While taking a focused approach is reasonable or even favorable for empirical case studies, it does not address how content moderation works in multiple contexts. Through a systematic literature review of 86 content moderation articles that document empirical studies, we seek to uncover patterns and tensions within past content moderation research. We find that content moderation can be characterized as a series of tradeoffs around moderation actions, styles, philosophies, and values. We discuss how facilitating cooperation and preventing abuse, two key elements in Grimmelmann\u2019s definition of moderation, are inherently dialectical in practice. We close by showing how researchers, designers, and moderators can use our framework of tradeoffs in their own work, and arguing that tradeoffs should be of central importance in investigating and designing content moderation.<\/jats:p>","DOI":"10.1145\/3534929","type":"journal-article","created":{"date-parts":[[2023,3,7]],"date-time":"2023-03-07T12:06:35Z","timestamp":1678190795000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":62,"title":["A Trade-off-centered Framework of Content Moderation"],"prefix":"10.1145","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8951-5750","authenticated-orcid":false,"given":"Jialun Aaron","family":"Jiang","sequence":"first","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7617-4045","authenticated-orcid":false,"given":"Peipei","family":"Nie","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4826-8324","authenticated-orcid":false,"given":"Jed R.","family":"Brubaker","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8743-4201","authenticated-orcid":false,"given":"Casey","family":"Fiesler","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO"}]}],"member":"320","published-online":{"date-parts":[[2023,3,7]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"[n.d.]. automoderator - reddit.com. Retrieved September 2020 from https:\/\/www.reddit.com\/wiki\/automoderator."},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203194959-16"},{"key":"e_1_3_3_4_2","unstructured":"2020. Paleolithic Diet. Retrieved September 2020 from https:\/\/en.wikipedia.org\/w\/index.php?title=Paleolithic_diet&oldid=979608774. Page Version ID: 979608774."},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444820912724"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v12i1.15036"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3134659"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359202"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_3_10_2","unstructured":"Robyn Caplan. 2018. Content or Context Moderation? Retrieved June 2020 from https:\/\/datasociety.net\/output\/content-or-context-moderation\/."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858516"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359249"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174240"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025985"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819963"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359276"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3134666"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3274301"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998213"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3217"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753625"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300372"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1080\/14680777.2018.1458746"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1177\/1354856518781530"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1080\/13600834.2016.1236428"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.239"},{"key":"e_1_3_3_27_2","unstructured":"Facebook. [n.d.]. Community Standards. Retrieved September 2020 from https:\/\/www.facebook.com\/communitystandards\/."},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376293"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3392845"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3361122"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v12i1.15033"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12528-016-9124-y"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818776611"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPC.2016.2527259"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1177\/2056305119832588"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3392822"},{"key":"e_1_3_3_37_2","volume-title":"Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media","author":"Gillespie Tarleton","year":"2018","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. Yale University Press."},{"key":"e_1_3_3_38_2","unstructured":"Tarleton Gillespie. 2019. Content Moderation: A Reading List. Retrieved September 2020 from https:\/\/socialmediacollective.org\/reading-lists\/content-moderation-reading-list\/."},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719897945"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720919963"},{"issue":"1","key":"e_1_3_3_41_2","article-title":"The virtues of moderation","volume":"17","author":"Grimmelmann James","year":"2015","unstructured":"James Grimmelmann. 2015. The virtues of moderation. Yale Journal of Law and Technology 17, 1 (2015), 42. Retrieved from https:\/\/digitalcommons.law.yale.edu\/yjolt\/vol17\/iss1\/2.","journal-title":"Yale Journal of Law and Technology"},{"key":"e_1_3_3_42_2","unstructured":"Michael L. Benedikt. 1991. Cyberspace: First Steps. MIT Press."},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3221"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/1531674.1531727"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.2501\/IJMR-2013-066"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1080\/01972240290108186"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJWBC.2011.041205"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376548"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359294"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338243"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359252"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3185593"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3274349"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359157"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3406865.3418312"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3229"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3375197"},{"issue":"1","key":"e_1_3_3_58_2","article-title":"Online user misconduct and an evolving infrastructure of practices: A practice-based study of information infrastructure and social practices","volume":"24","author":"Junestr\u00f6m Amalia","year":"2019","unstructured":"Amalia Junestr\u00f6m. 2019. Online user misconduct and an evolving infrastructure of practices: A practice-based study of information infrastructure and social practices. Information Research: An International Electronic Journal 24, 1 (2019). Retrieved from http:\/\/informationr.net\/ir\/24-1\/isic2018\/isic1825.html.","journal-title":"Information Research: An International Electronic Journal"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5270"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1080\/08874417.2013.11645652"},{"key":"e_1_3_3_61_2","volume-title":"Proceedings of the AAAI International Conference on Web and Social Media","author":"Keegan Brian C.","year":"2017","unstructured":"Brian C. Keegan and Casey Fiesler. 2017. The evolution and consequences of peer producing wikipedia\u2019 s rules. In Proceedings of the AAAI International Conference on Web and Social Media. Montreal, Quebec, Canada."},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359146"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858356"},{"key":"e_1_3_3_64_2"},{"key":"e_1_3_3_65_2","volume-title":"Building Successful Online Communities: Evidence-Based Social Design","author":"Kraut Robert E.","year":"2011","unstructured":"Robert E. Kraut, Paul Resnick, Sara Kiesler, Moira Burke, Yan Chen, Niki Kittur, Joseph Konstan, Yuqing Ren, and John Riedl. 2011. Building Successful Online Communities: Evidence-Based Social Design. MIT Press. Retrieved from https:\/\/www.jstor.org\/stable\/j.ctt5hhgvw."},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/1099203.1099206"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2013.11.005"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753658"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1000100"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3392853"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858391"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1177\/2056305119836778"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173583"},{"issue":"0","key":"e_1_3_3_75_2","first-page":"17","article-title":"Picketing the virtual storefront: Content moderation and political criticism of businesses on yelp","volume":"13","author":"Medeiros Ben","year":"2019","unstructured":"Ben Medeiros. 2019. Picketing the virtual storefront: Content moderation and political criticism of businesses on yelp. International Journal of Communication 13, 0 (2019), 17. Retrieved from https:\/\/ijoc.org\/index.php\/ijoc\/article\/view\/10451. Number: 0.","journal-title":"International Journal of Communication"},{"key":"e_1_3_3_76_2","volume-title":"Proceedings of the 10th International AAAI Conference on Web and Social Media","author":"Newell Edward","year":"2016","unstructured":"Edward Newell, David Jurgens, Haji Mohammad Saleem, Hardik Vala, Jad Sassine, Caitrin Armstrong, and Derek Ruths. 2016. User migration in online social networks: A case study on reddit during a period of community unrest. In Proceedings of the 10th International AAAI Conference on Web and Social Media. Retrieved from https:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM16\/paper\/view\/13137."},{"key":"e_1_3_3_77_2","unstructured":"Casey Newton. 2019. The Secret Lives of Facebook Moderators in America. Retrieved September 2020 from https:\/\/www.theverge.com\/2019\/2\/25\/18229714\/cognizant-facebook-content-moderator-interviews-trauma-working-conditions-arizona."},{"issue":"0","key":"e_1_3_3_78_2","first-page":"21","article-title":"\u201cMen are scum\u201d: Self-regulation, hate speech, and gender-based censorship on Facebook","volume":"13","author":"Nurik Chloe","year":"2019","unstructured":"Chloe Nurik. 2019. \u201cMen are scum\u201d: Self-regulation, hate speech, and gender-based censorship on Facebook. International Journal of Communication 13, 0 (2019), 21. Retrieved from https:\/\/ijoc.org\/index.php\/ijoc\/article\/view\/9608.","journal-title":"International Journal of Communication"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2018.1486870"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858389"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3274406"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025854"},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1108\/OIR-04-2013-0083"},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376456"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPC.2019.2946942"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1086\/704763"},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1177\/20563051211019004"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7323"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3356"},{"key":"e_1_3_3_90_2","volume-title":"Communities in Cyberspace","year":"1999","unstructured":"Reid. 1999. Communities in Cyberspace. Routledge, London & New York. Pages: 107\u2013133."},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2020.106262"},{"key":"e_1_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444819875990"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208701"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444820913122"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444820964968"},{"key":"e_1_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998277"},{"key":"e_1_3_3_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3274771"},{"key":"e_1_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818821316"},{"key":"e_1_3_3_99_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-3507"},{"key":"e_1_3_3_100_2","unstructured":"Jonathan Shieber. 2020. Zuckerberg Explains Why Facebook Won\u2019t Take Action on Trump\u2019s Recent Posts. Retrieved from https:\/\/social.techcrunch.com\/2020\/05\/29\/zuckerberg-explains-why-facebook-wont-take-action-on-trumps-recent-posts\/."},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.2196\/15983"},{"key":"e_1_3_3_102_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444819834317"},{"key":"e_1_3_3_103_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359265"},{"issue":"0","key":"e_1_3_3_104_2","first-page":"18","article-title":"What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation","volume":"13","author":"Suzor Nicolas P.","year":"2019","unstructured":"Nicolas P. Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation. International Journal of Communication 13, 0 (2019), 18. Retrieved from https:\/\/ijoc.org\/index.php\/ijoc\/article\/view\/9736.","journal-title":"International Journal of Communication"},{"key":"e_1_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11292-019-09392-z"},{"key":"e_1_3_3_106_2","doi-asserted-by":"publisher","DOI":"10.1145\/3415238"},{"key":"e_1_3_3_107_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702191"},{"key":"e_1_3_3_108_2","doi-asserted-by":"publisher","DOI":"10.1145\/2663716.2663728"},{"key":"e_1_3_3_109_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818773059"},{"key":"e_1_3_3_110_2","doi-asserted-by":"publisher","DOI":"10.53637\/IPMC9544"},{"key":"e_1_3_3_111_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300390"},{"key":"e_1_3_3_112_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300574"},{"key":"e_1_3_3_113_2","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.155"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534929","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3534929","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:54Z","timestamp":1750186974000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534929"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,28]]},"references-count":112,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,2,28]]}},"alternative-id":["10.1145\/3534929"],"URL":"https:\/\/doi.org\/10.1145\/3534929","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,28]]},"assertion":[{"value":"2021-07-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-29","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}