{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T14:19:13Z","timestamp":1784211553080,"version":"3.55.0"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"GROUP","license":[{"start":{"date-parts":[[2020,1,4]],"date-time":"2020-01-04T00:00:00Z","timestamp":1578096000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2020,1,4]]},"abstract":"<jats:p>Transparency in moderation practices is crucial to the success of an online community. To meet the growing demands of transparency and accountability, several academics came together and proposed the Santa Clara Principles on Transparency and Accountability in Content Moderation (SCP). In 2018, Reddit, home to uniquely moderated communities called subreddits, announced in its transparency report that the company is aligning its content moderation practices with the SCP. But do the moderators of subreddit communities follow these guidelines too? In this paper, we answer this question by employing a mixed-methods approach on public moderation logs collected from 204 subreddits over a period of five months, containing more than 0.5M instances of removals by both human moderators and AutoModerator. Our results reveal a lack of transparency in moderation practices. We find that while subreddits often rely on AutoModerator to sanction newcomer posts based on karma requirements and moderate uncivil content based on automated keyword lists, users are neither notified of these sanctions, nor are these practices formally stated in any of the subreddits' rules. We interviewed 13 Reddit moderators to hear their views on different facets of transparency and to determine why a lack of transparency is a widespread phenomenon. The interviews reveal that moderators' stance on transparency is divided, there is a lack of standardized process to appeal against content removal and Reddit's app and platform design often impede moderators' ability to be transparent in their moderation practices.<\/jats:p>","DOI":"10.1145\/3375197","type":"journal-article","created":{"date-parts":[[2020,1,4]],"date-time":"2020-01-04T22:05:18Z","timestamp":1578175518000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":64,"title":["Through the Looking Glass"],"prefix":"10.1145","volume":"4","author":[{"given":"Prerna","family":"Juneja","sequence":"first","affiliation":[{"name":"Virginia Tech, Blacksburg, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deepika","family":"Rama Subramanian","sequence":"additional","affiliation":[{"name":"Virginia Tech, Blacksburg, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tanushree","family":"Mitra","sequence":"additional","affiliation":[{"name":"Virginia Tech, Blacksburg, VA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,1,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357227"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/pra2.2016.14505301058"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134666"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274301"},{"key":"e_1_2_1_7_1","unstructured":"Kathy Charmaz. 2006. Constructing grounded theory: A practical guide through qualitative analysis .sage.  Kathy Charmaz. 2006. Constructing grounded theory: A practical guide through qualitative analysis .sage."},{"key":"e_1_2_1_8_1","unstructured":"Adrian Chen. 2014. The Laborers Who Keep Dick Pics and Beheadings Out of Your Facebook Feed. (2014). https:\/\/www.wired.com\/2014\/10\/content-moderation\/  Adrian Chen. 2014. The Laborers Who Keep Dick Pics and Beheadings Out of Your Facebook Feed. (2014). https:\/\/www.wired.com\/2014\/10\/content-moderation\/"},{"key":"e_1_2_1_9_1","volume-title":"Social Media Reporting Tools and the Vocabulary of Complaint. New Media & Society","volume":"18","author":"Crawford Kate","year":"2014"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3217"},{"key":"e_1_2_1_11_1","unstructured":"John P Davis. 2002. The experience of `bad'behavior in online social spaces: A survey of online users. Social Computing Group Microsoft Research (2002).  John P Davis. 2002. The experience of `bad'behavior in online social spaces: A survey of online users. Social Computing Group Microsoft Research (2002)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Paul B de Laat. 2012. Coercion or empowerment? Moderation of content in Wikipedia as 'essentially contested' bureaucratic rules. Ethics and information technology Vol. 14 2 (2012) 123--135.  Paul B de Laat. 2012. Coercion or empowerment? Moderation of content in Wikipedia as 'essentially contested' bureaucratic rules. Ethics and information technology Vol. 14 2 (2012) 123--135.","DOI":"10.1007\/s10676-012-9289-7"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2844110"},{"key":"e_1_2_1_14_1","unstructured":"Allen L Edwards. 1957. The social desirability variable in personality assessment and research. (1957).  Allen L Edwards. 1957. The social desirability variable in personality assessment and research. (1957)."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 777--786","author":"Ferschke Oliver","year":"2012"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819931"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v12i1.15033"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.7312\/flor14158"},{"key":"e_1_2_1_19_1","unstructured":"Genny Gebhart. 2019. Social Media Platforms Increase Transparency About Content Removal Requests But Many Keep Users in the Dark When Their Speech Is Censored EFF Report Shows. (2019). https:\/\/www.eff.org\/press\/releases\/social-media-platforms-increase-transparency-about-content-removal-requests-many-keep  Genny Gebhart. 2019. Social Media Platforms Increase Transparency About Content Removal Requests But Many Keep Users in the Dark When Their Speech Is Censored EFF Report Shows. (2019). https:\/\/www.eff.org\/press\/releases\/social-media-platforms-increase-transparency-about-content-removal-requests-many-keep"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Tarleton Gillespie. 2010. The politics of `platforms'. New media & society Vol. 12 3 (2010) 347--364.  Tarleton Gillespie. 2010. The politics of `platforms'. New media & society Vol. 12 3 (2010) 347--364.","DOI":"10.1177\/1461444809342738"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms content moderation and the hidden decisions that shape social media .Yale University Press.  Tarleton Gillespie. 2018. Custodians of the Internet: Platforms content moderation and the hidden decisions that shape social media .Yale University Press.","DOI":"10.12987\/9780300235029"},{"key":"e_1_2_1_22_1","unstructured":"David Gilmour. 2019. Reddit mods restore Tiananmen Square image after censorship claims. (2019). https:\/\/www.dailydot.com\/layer8\/tiananmen-square-image-reddit-takedown\/  David Gilmour. 2019. Reddit mods restore Tiananmen Square image after censorship claims. (2019). https:\/\/www.dailydot.com\/layer8\/tiananmen-square-image-reddit-takedown\/"},{"key":"e_1_2_1_23_1","unstructured":"Nelson Granados and Alok Gupta. 2013. Transparency strategy: competing with information in a digital world. MIS quarterly (2013) 637--641.  Nelson Granados and Alok Gupta. 2013. Transparency strategy: competing with information in a digital world. MIS quarterly (2013) 637--641."},{"key":"e_1_2_1_24_1","unstructured":"The Guardian. 2019. Revealed: how TikTok censors videos that do not please Beijing. (2019). https:\/\/www.theguardian.com\/technology\/2019\/sep\/25\/revealed-how-tiktok-censors-videos-that-do-not-please-beijing  The Guardian. 2019. Revealed: how TikTok censors videos that do not please Beijing. (2019). https:\/\/www.theguardian.com\/technology\/2019\/sep\/25\/revealed-how-tiktok-censors-videos-that-do-not-please-beijing"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"James J Heckman. 1979. Sample selection bias as a specification error. Econometrica: Journal of the econometric society (1979).  James J Heckman. 1979. Sample selection bias as a specification error. Econometrica: Journal of the econometric society (1979).","DOI":"10.2307\/1912352"},{"key":"e_1_2_1_26_1","unstructured":"Steve (submitter) Huffman. 2018. Reddit's Transparency Report. (2018). https:\/\/www.redditinc.com\/policies\/transparency-report-2018  Steve (submitter) Huffman. 2018. Reddit's Transparency Report. (2018). https:\/\/www.redditinc.com\/policies\/transparency-report-2018"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359294"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Shagun Jhaver Iris Birman Eric Gilbert and Amy Bruckman. 2019 b. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. TOCHI (2019).  Shagun Jhaver Iris Birman Eric Gilbert and Amy Bruckman. 2019 b. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. TOCHI (2019).","DOI":"10.1145\/3338243"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359252"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.31235\/osf.io\/28sgr"},{"key":"e_1_2_1_31_1","unstructured":"Sara Kiesler Robert Kraut Paul Resnick and Aniket Kittur. 2012. Regulating behavior in online communities. Building successful online communities: Evidence-based social design (2012) 125--178.  Sara Kiesler Robert Kraut Paul Resnick and Aniket Kittur. 2012. Regulating behavior in online communities. Building successful online communities: Evidence-based social design (2012) 125--178."},{"key":"e_1_2_1_32_1","unstructured":"Jason Koebler and Joseph Cox. 2018. The Impossible Job: Inside Facebook's Struggle to Moderate Two Billion People. (2018). https:\/\/www.vice.com\/en_us\/article\/xwk9zd\/how-facebook-content-moderation-works  Jason Koebler and Joseph Cox. 2018. The Impossible Job: Inside Facebook's Struggle to Moderate Two Billion People. (2018). https:\/\/www.vice.com\/en_us\/article\/xwk9zd\/how-facebook-content-moderation-works"},{"key":"e_1_2_1_33_1","unstructured":"Yubo Kou and Bonnie A Nardi. 2014. Governance in League of Legends: A hybrid system.. In FDG .  Yubo Kou and Bonnie A Nardi. 2014. Governance in League of Legends: A hybrid system.. In FDG ."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939874"},{"key":"e_1_2_1_35_1","unstructured":"Himabindu Lakkaraju and Cynthia Rudin. 2017. Learning cost-effective and interpretable treatment regimes. In Artificial Intelligence and Statistics. 166--175.  Himabindu Lakkaraju and Cynthia Rudin. 2017. Learning cost-effective and interpretable treatment regimes. In Artificial Intelligence and Statistics. 166--175."},{"key":"e_1_2_1_36_1","unstructured":"K. Leetaru. 2018. Without transparency democracy dies in the darkness of social media. Forbes. (2018). https:\/\/www.forbes.com\/sites\/kalevleetaru\/2018\/01\/25\/without-transparency-democracy-dies-in-the-darkness-of-social-media\/#694732567221  K. Leetaru. 2018. Without transparency democracy dies in the darkness of social media. Forbes. (2018). https:\/\/www.forbes.com\/sites\/kalevleetaru\/2018\/01\/25\/without-transparency-democracy-dies-in-the-darkness-of-social-media\/#694732567221"},{"key":"e_1_2_1_37_1","volume-title":"Code: And other laws of cyberspace .ReadHowYouWant. com.","author":"Lessig Lawrence","year":"2009"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/1005332.1005345"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Sorin Adam Matei Martha G Russell and Elisa Bertino. 2015. Transparency in social media .Springer.  Sorin Adam Matei Martha G Russell and Elisa Bertino. 2015. Transparency in social media .Springer.","DOI":"10.1007\/978-3-319-18552-1"},{"key":"e_1_2_1_40_1","unstructured":"J Nathan Matias. 2016. Posting rules in online discussions prevents problems & increases participation.  J Nathan Matias. 2016. Posting rules in online discussions prevents problems & increases participation."},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"J Nathan Matias. 2019. The civic labor of volunteer moderators online. Social Media  J Nathan Matias. 2019. The civic labor of volunteer moderators online. Social Media","DOI":"10.1177\/2056305119836778"},{"key":"e_1_2_1_42_1","unstructured":"Society Vol. 5 2 (2019) 2056305119836778.  Society Vol. 5 2 (2019) 2056305119836778."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/0020852309104175"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/2145432.2145462"},{"key":"e_1_2_1_45_1","unstructured":"Internet Policy Observatory. 2017. The Santa Clara Principles on Transparency and Accountability of Content Moderation Practices. http:\/\/globalnetpolicy.org\/research\/the-santa-clara-principles-on-transparency-and-accountability-of-content-moderation-practices\/. (2017).  Internet Policy Observatory. 2017. The Santa Clara Principles on Transparency and Accountability of Content Moderation Practices. http:\/\/globalnetpolicy.org\/research\/the-santa-clara-principles-on-transparency-and-accountability-of-content-moderation-practices\/. (2017)."},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Elinor Ostrom. 1990. Governing the commons: The evolution of institutions for collective action .Cambridge university press.  Elinor Ostrom. 1990. Governing the commons: The evolution of institutions for collective action .Cambridge university press.","DOI":"10.1017\/CBO9780511807763"},{"key":"e_1_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Albert Park Mike Conway and Annie T Chen. 2018. Examining thematic similarity difference and membership in three online mental health communities from Reddit: a text mining and visualization approach. Computers in human behavior Vol. 78 (2018) 98--112.  Albert Park Mike Conway and Annie T Chen. 2018. Examining thematic similarity difference and membership in three online mental health communities from Reddit: a text mining and visualization approach. Computers in human behavior Vol. 78 (2018) 98--112.","DOI":"10.1016\/j.chb.2017.09.001"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957276.2957297"},{"key":"e_1_2_1_49_1","unstructured":"Radha Iyengar Plumb. 2019. Exploring feedback from data and governance experts: A research-based response to the Data Transparency Advisory Group report. https:\/\/research.fb.com\/exploring-feedback-from-data-and-governance-experts-a-research-based-response-to-the-data-transparency-advisory-group-report\/. (2019).  Radha Iyengar Plumb. 2019. Exploring feedback from data and governance experts: A research-based response to the Data Transparency Advisory Group report. https:\/\/research.fb.com\/exploring-feedback-from-data-and-governance-experts-a-research-based-response-to-the-data-transparency-advisory-group-report\/. (2019)."},{"key":"e_1_2_1_50_1","unstructured":"Santa Clara Principles. 2018. The Santa Clara Principles: On Transparency and Accountability in Content Moderation. (2018). https:\/\/santaclaraprinciples.org\/  Santa Clara Principles. 2018. The Santa Clara Principles: On Transparency and Accountability in Content Moderation. (2018). https:\/\/santaclaraprinciples.org\/"},{"key":"e_1_2_1_51_1","unstructured":"Reddit. 2019 a. Moderator guidelines for healthy communities. (2019). https:\/\/www.redditinc.com\/policies\/moderator-guidelines-for-healthy-communities  Reddit. 2019 a. Moderator guidelines for healthy communities. (2019). https:\/\/www.redditinc.com\/policies\/moderator-guidelines-for-healthy-communities"},{"key":"e_1_2_1_52_1","unstructured":"Reddit. 2019 b. Reddit Content Policy. (2019). https:\/\/www.redditinc.com\/policies\/content-policy  Reddit. 2019 b. Reddit Content Policy. (2019). https:\/\/www.redditinc.com\/policies\/content-policy"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_54_1","unstructured":"Sarah Roberts. 2016a. Commercial Content Moderation: Digital Laborers' Dirty Work .  Sarah Roberts. 2016a. Commercial Content Moderation: Digital Laborers' Dirty Work ."},{"key":"e_1_2_1_55_1","unstructured":"Sarah T Roberts. 2016b. Commercial content moderation: digital laborers' dirty work. (2016).  Sarah T Roberts. 2016b. Commercial content moderation: digital laborers' dirty work. (2016)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/1036843.1036902"},{"key":"e_1_2_1_57_1","doi-asserted-by":"crossref","unstructured":"Michael Schudson. 2015. The rise of the right to know: Politics and the culture of transparency 1945--1975 .Harvard University Press.  Michael Schudson. 2015. The rise of the right to know: Politics and the culture of transparency 1945--1975 .Harvard University Press.","DOI":"10.4159\/9780674915787"},{"key":"e_1_2_1_58_1","unstructured":"Joseph Seering Tony Wang Jina Yoon and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society (2019) 1461444818821316.  Joseph Seering Tony Wang Jina Yoon and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society (2019) 1461444818821316."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/2390948.2391052"},{"key":"e_1_2_1_60_1","first-page":"15","article-title":"Digital age| managing opacity: Information visibility and the paradox of transparency in the digital age","volume":"10","author":"Stohl Cynthia","year":"2016","journal-title":"International Journal of Communication"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1177\/1748048518757142"},{"key":"e_1_2_1_62_1","first-page":"18","article-title":"What Do We Mean When We Talk About Transparency? Toward Meaningful Transparency in Commercial Content Moderation","volume":"13","author":"Suzor Nicolas P","year":"2019","journal-title":"International Journal of Communication"},{"key":"e_1_2_1_63_1","unstructured":"Twitter. 2019. Twitter's Platform manipulation and spam policy. (2019). https:\/\/help.twitter.com\/en\/rules-and-policies\/platform-manipulation  Twitter. 2019. Twitter's Platform manipulation and spam policy. (2019). https:\/\/help.twitter.com\/en\/rules-and-policies\/platform-manipulation"},{"key":"e_1_2_1_64_1","unstructured":"Hanna M Wallach David M Mimno and Andrew McCallum. 2009. Rethinking LDA: Why priors matter. In Advances in neural information processing systems. 1973--1981.  Hanna M Wallach David M Mimno and Andrew McCallum. 2009. Rethinking LDA: Why priors matter. In Advances in neural information processing systems. 1973--1981."},{"key":"e_1_2_1_65_1","unstructured":"S.M West. 2018a. Policing the Digital Semicommons: Researching Content Moderation Practices by Social Media Companies. Paper presented at the International Communication Association Conference San Diego CA (2018).  S.M West. 2018a. Policing the Digital Semicommons: Researching Content Moderation Practices by Social Media Companies. Paper presented at the International Communication Association Conference San Diego CA (2018)."},{"key":"e_1_2_1_66_1","unstructured":"S. M West. 2018b. Policing the digital semicommons: Researching content moderation practices by social media companies. Paper presented at the International Communication Association Conference San Diego CA (05 2018).  S. M West. 2018b. Policing the digital semicommons: Researching content moderation practices by social media companies. Paper presented at the International Communication Association Conference San Diego CA (05 2018)."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/1296951.1296968"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375197","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3375197","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:32:48Z","timestamp":1750199568000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3375197"}},"subtitle":["Study of Transparency in Reddit's Moderation Practices"],"short-title":[],"issued":{"date-parts":[[2020,1,4]]},"references-count":67,"journal-issue":{"issue":"GROUP","published-print":{"date-parts":[[2020,1,4]]}},"alternative-id":["10.1145\/3375197"],"URL":"https:\/\/doi.org\/10.1145\/3375197","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,4]]},"assertion":[{"value":"2020-01-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}