{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:22:33Z","timestamp":1776115353818,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100004705","name":"Capital One","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100004705","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Social media sites like Reddit, Discord, and Clubhouse utilize a community-reliant approach to content moderation. Under this model, volunteer moderators are tasked with setting and enforcing content rules within the platforms' sub-communities. However, few mechanisms exist to ensure that the rules set by moderators reflect the values of their community. Misalignments between users and moderators can be detrimental to community health. Yet little quantitative work has been done to evaluate the prevalence or nature of user-moderator misalignment. Through a survey of 798 users on r\/ChangeMyView, we evaluate user-moderator alignment at the level of policy-awareness (does users know what the rules are?), practice-awareness (do users know how the rules are applied?) and policy-\/practice-support (do users agree with the rules and how they are applied?). We find that policy-support is high, while practice-support is low -- using a hierarchical Bayesian model we estimate the correlation between community opinion and moderator decisions to range from .14 to .45 across subreddit rules. Surprisingly, these correlations were only slightly higher when users were asked to predict moderator actions, demonstrating low awareness of moderation practices. Our findings demonstrate the need for careful analysis of user-moderator alignment at multiple levels. We argue that future work should focus on building tools to empower communities to conduct these analyses themselves.<\/jats:p>","DOI":"10.1145\/3610077","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T15:54:10Z","timestamp":1696434850000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Measuring User-Moderator Alignment on r\/ChangeMyView"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1410-3911","authenticated-orcid":false,"given":"Vinay","family":"Koshy","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0585-1966","authenticated-orcid":false,"given":"Tanvi","family":"Bajpai","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7473-1418","authenticated-orcid":false,"given":"Eshwar","family":"Chandrasekharan","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3315-6055","authenticated-orcid":false,"given":"Hari","family":"Sundaram","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8788-3405","authenticated-orcid":false,"given":"Karrie","family":"Karahalios","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"What is the Will of the People? Moderation Preferences for Misinformation. arXiv preprint arXiv:2202.00799","author":"Atreja Shubham","year":"2022","unstructured":"Shubham Atreja, Libby Hemphill, and Paul Resnick. 2022. What is the Will of the People? Moderation Preferences for Misinformation. arXiv preprint arXiv:2202.00799 (2022)."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.3172\/JIE.15.2.82"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0740-8188(03)00033-1"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359276"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274301"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300372"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376293"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v12i1.15033"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691614551642"},{"key":"e_1_2_2_10_1","unstructured":"Andrew Gelman and Thomas C Little. 1997. Poststratification into many categories using hierarchical logistic regression. (1997)."},{"key":"e_1_2_2_11_1","volume-title":"Posterior predictive assessment of model fitness via realized discrepancies. Statistica sinica","author":"Gelman Andrew","year":"1996","unstructured":"Andrew Gelman, Xiao-Li Meng, and Hal Stern. 1996. Posterior predictive assessment of model fitness via realized discrepancies. Statistica sinica (1996), 733--760."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392822"},{"key":"e_1_2_2_13_1","volume-title":"Towards digital constitutionalism? Mapping attempts to craft an internet bill of rights. Mapping Attempts to Craft an Internet Bill of Rights (November 9","author":"Gill Lex","year":"2015","unstructured":"Lex Gill, Dennis Redeker, and Urs Gasser. 2015. Towards digital constitutionalism? Mapping attempts to craft an internet bill of rights. Mapping Attempts to Craft an Internet Bill of Rights (November 9, 2015). Berkman Center Research Publication 2015--15 (2015)."},{"key":"e_1_2_2_14_1","volume-title":"Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502004"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445423"},{"key":"e_1_2_2_17_1","first-page":"2","article-title":"The Virtues of Moderation","volume":"17","author":"Grimmelmann James","year":"2015","unstructured":"James Grimmelmann. 2015. The Virtues of Moderation. Yale Journal of Law and Technology 17 (2015), 2.","journal-title":"Yale Journal of Law and Technology"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445433"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479606"},{"key":"e_1_2_2_20_1","volume-title":"Proceedings of the ACM on human-computer interaction 3, CSCW","author":"Jhaver Shagun","year":"2019","unstructured":"Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019. \" Did you suspect the post would be removed?\" Understanding user reactions to content removals on Reddit. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1--33."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359252"},{"key":"e_1_2_2_22_1","volume-title":"Designing for Multiple Centers of Power: A Taxonomy of Multi-level Governance in Online Social Platforms. arXiv preprint arXiv:2108.12529","author":"Jhaver Shagun","year":"2021","unstructured":"Shagun Jhaver, Seth Frey, and Amy Zhang. 2021. Designing for Multiple Centers of Power: A Taxonomy of Multi-level Governance in Online Social Platforms. arXiv preprint arXiv:2108.12529 (2021)."},{"key":"e_1_2_2_23_1","volume-title":"A Trade-off-centered Framework of Content Moderation. arXiv preprint arXiv:2206.03450","author":"Jiang Jialun Aaron","year":"2022","unstructured":"Jialun Aaron Jiang, Peipei Nie, Jed R Brubaker, and Casey Fiesler. 2022. A Trade-off-centered Framework of Content Moderation. arXiv preprint arXiv:2206.03450 (2022)."},{"key":"e_1_2_2_24_1","volume-title":"Casey Fiesler, and Jed R. Brubaker.","author":"Jiang Jialun Aaron","year":"2021","unstructured":"Jialun Aaron Jiang, Morgan Klaus Scheuerman, Casey Fiesler, and Jed R. Brubaker. 2021. Understanding international perceptions of the severity of harmful content online. PLoS ONE 16 (2021)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3375197"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858465"},{"key":"e_1_2_2_27_1","volume-title":"Regulating behavior in online communities. Building successful online communities: Evidence-based social design 1","author":"Kiesler Sara","year":"2012","unstructured":"Sara Kiesler, Robert Kraut, Paul Resnick, and Aniket Kittur. 2012. Regulating behavior in online communities. Building successful online communities: Evidence-based social design 1 (2012), 4--2."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19318"},{"key":"e_1_2_2_30_1","volume-title":"A technique for the measurement of attitudes. Archives of psychology","author":"Likert Rensis","year":"1932","unstructured":"Rensis Likert. 1932. A technique for the measurement of attitudes. Archives of psychology (1932)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305119836778"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1813486116"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173583"},{"key":"e_1_2_2_34_1","volume-title":"Statistical rethinking: A Bayesian course with examples in R and Stan","author":"McElreath Richard","unstructured":"Richard McElreath. 2020. Statistical rethinking: A Bayesian course with examples in R and Stan. Chapman and Hall\/CRC."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512929"},{"key":"e_1_2_2_36_1","volume-title":"Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro. arXiv preprint arXiv:1912.11554","author":"Phan Du","year":"2019","unstructured":"Du Phan, Neeraj Pradhan, and Martin Jankowiak. 2019. Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro. arXiv preprint arXiv:1912.11554 (2019)."},{"key":"e_1_2_2_37_1","volume-title":"Informed crowds can effectively identify misinformation. arXiv preprint arXiv:2108.07898","author":"Resnick Paul","year":"2021","unstructured":"Paul Resnick, Aljohara Alfayez, Jane Im, and Eric Gilbert. 2021. Informed crowds can effectively identify misinformation. arXiv preprint arXiv:2108.07898 (2021)."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415178"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818821316"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/1748048518757142"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2014.06.001"},{"key":"e_1_2_2_42_1","volume-title":"Making Online Communities' Better': A Taxonomy of Community Values on Reddit. arXiv preprint arXiv:2109.05152","author":"Weld Galen","year":"2021","unstructured":"Galen Weld, Amy X Zhang, and Tim Althoff. 2021. Making Online Communities' Better': A Taxonomy of Community Values on Reddit. arXiv preprint arXiv:2109.05152 (2021)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300390"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415858"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610077","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610077","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T04:18:42Z","timestamp":1755749922000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610077"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":44,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2023,9,28]]}},"alternative-id":["10.1145\/3610077"],"URL":"https:\/\/doi.org\/10.1145\/3610077","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2023-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}