{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:45:58Z","timestamp":1776109558473,"version":"3.50.1"},"reference-count":120,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":5,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100004705","name":"Capital One Financial Corporation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004705","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1564041"],"award-info":[{"award-number":["1564041"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,13]]},"abstract":"<jats:p>Content moderation systems for social media have had numerous issues of bias, in terms of race, gender, and ability among many others. One proposal for addressing such issues in automated decision making is by designing for contestability, whereby users can shape and influence how decisions are made. In this study, we conduct a series of participatory design workshops with participants from communities that have experienced problems with social media content moderation in the past. Together with participants, we explore the idea of designing for contestability in content moderation and find that users' designs suggest three fruitful, practical avenues: adding representation, improving communication, and designing with compassion. We conclude with design recommendations drawn from participants' proposals, and reflect on the challenges that remain.<\/jats:p>","DOI":"10.1145\/3476059","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T02:46:19Z","timestamp":1634611579000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":71,"title":["Contestability For Content Moderation"],"prefix":"10.1145","volume":"5","author":[{"given":"Kristen","family":"Vaccaro","sequence":"first","affiliation":[{"name":"University of California San Diego, San Diego, CA, USA"}]},{"given":"Ziang","family":"Xiao","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]},{"given":"Kevin","family":"Hamilton","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]},{"given":"Karrie","family":"Karahalios","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376690"},{"key":"e_1_2_2_2_1","volume-title":"\u201cdecency\u201d. The Guardian (March","author":"Alexander Leigh","year":"2016","unstructured":"Leigh Alexander. 2016. Facebook's censorship of Aboriginal bodies raises troubling ideas of \u201cdecency\u201d. The Guardian (March 2016). https:\/\/www.theguardian.com\/technology\/2016\/mar\/23\/facebook-censorship-topless-aboriginal-women"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3322640.3326699"},{"key":"e_1_2_2_4_1","volume-title":"Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. new media & society","author":"Ananny Mike","year":"2018","unstructured":"Mike Ananny and Kate Crawford. 2018. Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. new media & society (2018)."},{"key":"e_1_2_2_5_1","unstructured":"Julia Angwin and Hannes Grassegger. 2017. Facebook's Secret Censorship Rules Protect White Men From Hate Speech But Not Black Children. https:\/\/www.propublica.org\/article\/facebook-hate-speech-censorship-internal-documents-algorithms. ProPublica."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753521"},{"key":"e_1_2_2_7_1","volume-title":"Paulo Victor Ribeiro, and Tatiana Dias","author":"Biddle Sam","year":"2020","unstructured":"Sam Biddle, Paulo Victor Ribeiro, and Tatiana Dias. 2020. TikTok Told Moderators: Suppress Posts by the \"Ugly\" and Poor. https:\/\/theintercept.com\/2020\/03\/16\/tiktok-app-moderators-users-discrimination"},{"key":"e_1_2_2_8_1","unstructured":"Danielle Blunt Ariel Wolf Emily Coombes and Shanelle Mullin. 2020. Posting Into the Void: Studying the Impact of Shadowbanning on Sex Workers and Activists. https:\/\/hackinghustling.org\/posting-into-the-void-content-moderation\/"},{"key":"e_1_2_2_9_1","unstructured":"Ariel Bogle. 2019. Aussie sex workers were kicked off American websites so they built their own. https:\/\/www.abc.net.au\/news\/science\/2019-06--22\/fosta-sesta-laws-impact-australian-sex-workers-one-year-later\/11229724"},{"key":"e_1_2_2_10_1","volume-title":"TikTok Admits It Suppressed Videos by Disabled, Queer, and Fat Creators. Slate","author":"Botella Elena","year":"2019","unstructured":"Elena Botella. 2019. TikTok Admits It Suppressed Videos by Disabled, Queer, and Fat Creators. Slate (2019)."},{"key":"e_1_2_2_11_1","volume-title":"International Journal of Computer, Information, and Systems Science, and Engineering","author":"Boufoy-Bastick Zach-Amaury","year":"2007","unstructured":"Zach-Amaury Boufoy-Bastick and Lenandlar Singh. 2007. The Socio-Technical Indicator Model: Socially-Sensitive CMC Technology, with an Implementation of Representative Moderation. International Journal of Computer, Information, and Systems Science, and Engineering, Vol. 1 (2007), 1."},{"key":"e_1_2_2_12_1","unstructured":"Richard E Boyatzis. 1998. Transforming qualitative information: Thematic analysis and code development .sage."},{"key":"e_1_2_2_13_1","volume-title":"Proc. Participatory Design Conference.","author":"Bratteteig Tone","year":"2018","unstructured":"Tone Bratteteig and Guri Verne. 2018. Does AI Make PD Obsolete? Exploring Challenges From Artificial Intelligence To Participatory Design. In Proc. Participatory Design Conference."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300271"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359240"},{"key":"e_1_2_2_16_1","unstructured":"Online Censorship. [n.d.]. OFFLINE-ONLINE: data visuals exploring how content moderation practices impact marginalized communities. https:\/\/onlinecensorship.org\/content\/infographics."},{"key":"e_1_2_2_17_1","unstructured":"@cfiesler (Casey Fiesler). 2020. \u201cOK I'm going to weigh in on the tagging\/content moderation conversation happening right now\u201d. https:\/\/twitter.com\/cfiesler\/status\/1273300997801041920"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359276"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.2196\/12235"},{"key":"e_1_2_2_20_1","volume-title":"The Dangerous Trend of LGBTQ Censorship on the Internet. Out Magazine","author":"Cheves Alexander","year":"2018","unstructured":"Alexander Cheves. 2018. The Dangerous Trend of LGBTQ Censorship on the Internet. Out Magazine (2018). http:\/\/www.out.com\/out-exclusives\/2018\/12\/06\/dangerous-trend-lgbtq-censorship-internet"},{"key":"e_1_2_2_21_1","volume-title":"a community-based approach to misinformation. Twitter Blog","author":"Coleman Keith","year":"2021","unstructured":"Keith Coleman. 2021. Introducing Birdwatch, a community-based approach to misinformation. Twitter Blog (2021)."},{"key":"e_1_2_2_22_1","volume-title":"Inclusive design","author":"Coleman Roger","year":"1999","unstructured":"Roger Coleman and Cherie Lebbon. 1999. Inclusive design. Helen Hamlyn Research Centre, Royal College of Art (1999)."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444814543163"},{"key":"e_1_2_2_24_1","volume-title":"Designerly ways of knowing. Design studies","author":"Cross Nigel","year":"1982","unstructured":"Nigel Cross. 1982. Designerly ways of knowing. Design studies, Vol. 3, 4 (1982)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025659"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2016.1208053"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557359"},{"key":"e_1_2_2_28_1","volume-title":"The Facebook Oversight Board's First Decisions: Ambitious, and Perhaps Impractical. Lawfare Blog","author":"Douek Evelyn","year":"2021","unstructured":"Evelyn Douek. 2021. The Facebook Oversight Board's First Decisions: Ambitious, and Perhaps Impractical. Lawfare Blog (2021)."},{"key":"e_1_2_2_29_1","unstructured":"Maximiliano Duron. 2019. Instagram Holds Closed-Door Roundtable with Artists on Art and Nudity. (2019). https:\/\/www.artnews.com\/art-news\/news\/instagram-censorship-roundtable-13431\/"},{"key":"e_1_2_2_30_1","unstructured":"Elizabeth Dwoskin Jeanne Whalen and Regine Cabato. 2019. Content moderators at YouTube Facebook and Twitter see the worst of the web and suffer silently. https:\/\/www.washingtonpost.com\/technology\/2019\/07\/25\/social-media-companies-are-outsourcing-their-dirty-work-philippines-generation-workers-is-paying-price"},{"key":"e_1_2_2_31_1","volume-title":"Thinking About the Coding Process in Qualitative Data Analysis. The Qualitative Report","author":"Elliott Victoria","year":"2018","unstructured":"Victoria Elliott. 2018. Thinking About the Coding Process in Qualitative Data Analysis. The Qualitative Report (2018)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376293"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392845"},{"key":"e_1_2_2_34_1","volume-title":"Shadowbans: Secret Policies Depriving Sex Workers of Income and Community. https:\/\/titsandsass.com\/shadowbans-secret-policies-depriving-sex-workers-of-income-and-community\/","author":"Fitzgerald Juniper","year":"2019","unstructured":"Juniper Fitzgerald and Jessie Sage. 2019. Shadowbans: Secret Policies Depriving Sex Workers of Income and Community. https:\/\/titsandsass.com\/shadowbans-secret-policies-depriving-sex-workers-of-income-and-community\/"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300799"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0404_1"},{"key":"e_1_2_2_37_1","volume-title":"TikTok admits restricting some LGBT hashtags. BBC News (September","author":"Fox Chris","year":"2020","unstructured":"Chris Fox. 2020. TikTok admits restricting some LGBT hashtags. BBC News (September 2020). https:\/\/www.bbc.com\/news\/technology-54102575"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2856465"},{"key":"e_1_2_2_39_1","volume-title":"Proc. ACHI.","author":"Gasparini Andrea","year":"2015","unstructured":"Andrea Gasparini. 2015. Perspective and use of empathy in design thinking. In Proc. ACHI."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173683"},{"key":"e_1_2_2_41_1","volume-title":"Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media .Yale University Press."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0038-1636093"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376142"},{"key":"e_1_2_2_44_1","volume-title":"Out in the country: Youth, media, and queer visibility in rural America","author":"Gray Mary L","unstructured":"Mary L Gray. 2009. Out in the country: Youth, media, and queer visibility in rural America .NYU Press."},{"key":"e_1_2_2_45_1","volume-title":"Pinterest Has an Anorexia Problem Now. The Atlantic (March","author":"Greenfield Rebecca","year":"2012","unstructured":"Rebecca Greenfield. 2012. Pinterest Has an Anorexia Problem Now. The Atlantic (March 2012). https:\/\/www.theatlantic.com\/technology\/archive\/2012\/03\/pinterest-has-anorexia-problem-now-too\/330315\/"},{"key":"e_1_2_2_46_1","volume-title":"Facebook apologizes to black activist who was censored for calling out racism. USA Today (August","author":"Guynn Jessica","year":"2017","unstructured":"Jessica Guynn. 2017. Facebook apologizes to black activist who was censored for calling out racism. USA Today (August 2017). https:\/\/www.usatoday.com\/story\/tech\/2017\/08\/03\/facebook-ijeoma-oluo-hate-speech\/537682001\/"},{"key":"e_1_2_2_47_1","volume-title":"Tumblr was a trans technology: the meaning, importance, history, and future of trans technologies. Feminist Media Studies","author":"Haimson Oliver L","year":"2019","unstructured":"Oliver L Haimson, Avery Dame-Griff, Elias Capello, and Zahari Richter. 2019. Tumblr was a trans technology: the meaning, importance, history, and future of trans technologies. Feminist Media Studies (2019), 1--17."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376669"},{"key":"e_1_2_2_49_1","volume-title":"Constructing and enforcing\" authentic\" identity online: Facebook, real names, and non-normative identities. First Monday","author":"Haimson Oliver L","year":"2016","unstructured":"Oliver L Haimson and Anna Lauren Hoffmann. 2016. Constructing and enforcing\" authentic\" identity online: Facebook, real names, and non-normative identities. First Monday (2016)."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301019.3323894"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359318"},{"key":"e_1_2_2_52_1","volume-title":"Proc. Participatory Design Conference.","author":"Choi Jaz","year":"2020","unstructured":"Jaz Hee-jeong Choi, Laura Forlano, and Denisa Kera. 2020. Situated Automation: Algorithmic Creatures in Participatory Design. In Proc. Participatory Design Conference."},{"key":"e_1_2_2_53_1","volume-title":"To empathise or not to empathise? Empathy and its limits in design. Design Studies","author":"Heylighen Ann","year":"2019","unstructured":"Ann Heylighen and Andy Dong. 2019. To empathise or not to empathise? Empathy and its limits in design. Design Studies (2019)."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064703"},{"key":"e_1_2_2_55_1","unstructured":"Vivian Ho. 2018. Tumblr's adult content ban dismays some users: 'It was a safe space'. https:\/\/www.theguardian.com\/technology\/2018\/dec\/03\/tumblr-adult-content-ban-lgbt-community-gender?__s=abutgqgfq3qtwvi5gq42"},{"key":"e_1_2_2_56_1","volume-title":"Facebook still suspending Native Americans over `real name' policy. The Guardian (February","author":"Holpuch Amanda","year":"2015","unstructured":"Amanda Holpuch. 2015. Facebook still suspending Native Americans over `real name' policy. The Guardian (February 2015). https:\/\/www.theguardian.com\/technology\/2015\/feb\/16\/facebook-real-name-policy-suspends-native-americans"},{"key":"e_1_2_2_57_1","unstructured":"Tracy Jan and Elizabeth Dwoskin. 2017. A white man called her kids the n-word. Facebook stopped her from sharing it. https:\/\/www.washingtonpost.com\/business\/economy\/for-facebook-erasing-hate-speech-proves-a-daunting-challenge\/2017\/07\/31\/922d9bc6--6e3b-11e7--9c15--177740635e83_story.html The Washington Post."},{"key":"e_1_2_2_58_1","unstructured":"Chantal Jandard. 2015. The \u201cWhat Should I Design\u201d Generator. http:\/\/www.whatshouldidesign.com\/"},{"key":"e_1_2_2_59_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"2","author":"Jhaver Shagun","year":"2018","unstructured":"Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2018. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. Proceedings of the ACM on Human-Computer Interaction, Vol. 2 (2018)."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372874"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710882.2018.1502324"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300569"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392063.3394395"},{"key":"e_1_2_2_64_1","first-page":"1598","article-title":"The new governors: The people, rules, and processes governing online speech","volume":"131","author":"Klonick Kate","year":"2017","unstructured":"Kate Klonick. 2017. The new governors: The people, rules, and processes governing online speech. Harvard Law Review, Vol. 131 (2017), 1598.","journal-title":"Harvard Law Review"},{"key":"e_1_2_2_65_1","first-page":"853","article-title":"Automated Decision Support Technologies And The Legal Profession","volume":"34","author":"Kluttz Daniel N","year":"2019","unstructured":"Daniel N Kluttz and Deirdre K Mulligan. 2019. Automated Decision Support Technologies And The Legal Profession. Berkeley Tech. Law Journal, Vol. 34 (2019), 853.","journal-title":"Berkeley Tech. Law Journal"},{"key":"e_1_2_2_66_1","volume-title":"The Impossible Job: Inside Facebook's Struggle to Moderate Two Billion People. (August","author":"Koebler Jason","year":"2018","unstructured":"Jason Koebler and Joseph Cox. 2018. The Impossible Job: Inside Facebook's Struggle to Moderate Two Billion People. (August 2018). https:\/\/www.vice.com\/en_us\/article\/xwk9zd\/how-facebook-content-moderation-works"},{"key":"e_1_2_2_67_1","volume-title":"Play It My Way: Participatory Mobile Game Design with Children in Rural Nepal. In International Conference on Human-Computer Interaction. Springer, 325--336","author":"Lamichhane Dev Raj","year":"2020","unstructured":"Dev Raj Lamichhane and Janet C Read. 2020. Play It My Way: Participatory Mobile Game Design with Children in Rural Nepal. In International Conference on Human-Computer Interaction. Springer, 325--336."},{"key":"e_1_2_2_68_1","first-page":"1353","article-title":"Regulating Online Content Moderation","volume":"106","author":"Langvardt Kyle","year":"2017","unstructured":"Kyle Langvardt. 2017. Regulating Online Content Moderation. Georgetown Law Journal, Vol. 106 (2017), 1353.","journal-title":"Georgetown Law Journal"},{"key":"e_1_2_2_69_1","unstructured":"Iris Latour. 2020. The guide to mastering online brainstorming: 20 Brainstorming Techniques That Work. https:\/\/miro.com\/guides\/online-brainstorming\/techniques-methods#20-crazy-eights"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998230"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359284"},{"key":"e_1_2_2_72_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"3","author":"Noothigattu Ritesh","year":"2019","unstructured":"Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al. 2019 b. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--35."},{"key":"e_1_2_2_73_1","volume-title":"Is Social Media Making Self-Harm Worse for Teens? US News (May","author":"Leonard Kimberly","year":"2015","unstructured":"Kimberly Leonard. 2015. Is Social Media Making Self-Harm Worse for Teens? US News (May 2015). https:\/\/www.usnews.com\/news\/articles\/2015\/05\/29\/is-social-media-making-self-harm-worse-for-teens"},{"key":"e_1_2_2_74_1","volume-title":"As Facebook blocks the names of trans users and drag queens, this burlesque performer is fighting back. The Guardian (June","author":"Levin Sam","year":"2017","unstructured":"Sam Levin. 2017. As Facebook blocks the names of trans users and drag queens, this burlesque performer is fighting back. The Guardian (June 2017). https:\/\/www.theguardian.com\/world\/2017\/jun\/29\/facebook-real-name-trans-drag-queen-dottie-lux"},{"key":"e_1_2_2_75_1","volume-title":"Facebook Apologizes For 'Real Name' Policy That Forced Drag Queens To Change Their Profiles. Business Insider","author":"Levy Karyne","year":"2014","unstructured":"Karyne Levy. 2014. Facebook Apologizes For 'Real Name' Policy That Forced Drag Queens To Change Their Profiles. Business Insider (2014). https:\/\/www.businessinsider.com\/facebook-apologizes-for-real-name-policy-2014--10"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376590"},{"key":"e_1_2_2_77_1","unstructured":"Shannon Liao. 2019. After the porn ban Tumblr users have ditched the platform as promised. The Verge. https:\/\/www.theverge.com\/2019\/3\/14\/18266013\/tumblr-porn-ban-lost-users-down-traffic."},{"key":"e_1_2_2_78_1","volume-title":"Facebook's Hate Speech Policies Censor Marginalized Users. Wired (August","author":"Lux Dottie","year":"2017","unstructured":"Dottie Lux and Little Miss Hot Mess. 2017. Facebook's Hate Speech Policies Censor Marginalized Users. Wired (August 2017). https:\/\/www.wired.com\/story\/facebooks-hate-speech-policies-censor-marginalized-users\/"},{"key":"e_1_2_2_79_1","unstructured":"Amber Madison. 2015. When Social-Media Companies Censor Sex Education. https:\/\/www.theatlantic.com\/health\/archive\/2015\/03\/when-social-media-censors-sex-education\/385576\/. The Atlantic."},{"key":"e_1_2_2_80_1","unstructured":"Aaron Mak. 2018. Facebook content moderation rules: How company decides what to remove. https:\/\/slate.com\/technology\/2018\/04\/facebook-content-moderation-rules-how-company-decides-what-to-remove.html. Slate."},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2017.1293130"},{"key":"e_1_2_2_82_1","volume-title":"Brian Keegan, Jaclyn Friedman, and Charlie DeTar.","author":"Matias J","year":"2015","unstructured":"J Matias, Amy Johnson, Whitney Erin Boesel, Brian Keegan, Jaclyn Friedman, and Charlie DeTar. 2015. Reporting, reviewing, and responding to harassment on Twitter. Available at SSRN 2602018 (2015)."},{"key":"e_1_2_2_83_1","unstructured":"Louise Matsakis and Paris Martineau. 2020. Coronavirus Disrupts Social Media's First Line of Defense. Wired. https:\/\/www.wired.com\/story\/coronavirus-social-media-automated-content-moderation\/."},{"key":"e_1_2_2_84_1","volume-title":"Participatory Design: The Third Space In Human-Computer Interaction. In Human Computer Interaction Handbook","author":"Muller Michael J","year":"2012","unstructured":"Michael J Muller and Allison Druin. 2012. Participatory Design: The Third Space In Human-Computer Interaction. In Human Computer Interaction Handbook. CRC Press, 1125--1153."},{"key":"e_1_2_2_85_1","volume-title":"Shaping Our Tools: Contestability as a Means to Promote Responsible Algorithmic Decision Making in the Professions. Available at SSRN 3311894","author":"Mulligan Deirdre K","year":"2019","unstructured":"Deirdre K Mulligan, Daniel Kluttz, and Nitin Kohli. 2019. Shaping Our Tools: Contestability as a Means to Promote Responsible Algorithmic Decision Making in the Professions. Available at SSRN 3311894 (2019)."},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818773059"},{"key":"e_1_2_2_87_1","volume-title":"Proc. AAAI Spring Symposium","volume":"2","author":"Novick David G","year":"1997","unstructured":"David G Novick and Stephen Sutton. 1997. What is Mixed-Initiative Interaction. In Proc. AAAI Spring Symposium, Vol. 2. 12."},{"key":"e_1_2_2_88_1","volume-title":"Journal on Telecommunications and High Technology Law","author":"Pasquale Frank A","year":"2011","unstructured":"Frank A Pasquale. 2011. Restoring transparency to automated authority. Journal on Telecommunications and High Technology Law, (2011)."},{"key":"e_1_2_2_89_1","unstructured":"Delia Paunescu. 2019. Inside Instagram's nudity ban. (2019). https:\/\/www.vox.com\/recode\/2019\/10\/27\/20932915\/instagram-free-the-nipple-photo-facebook-nudity-ban-art-reset-podcast"},{"key":"e_1_2_2_90_1","volume-title":"Online 'authenticity' and how Facebook's 'real name' policy hurts Native Americans. The Washington Post (February","author":"Phillip Abby","year":"2015","unstructured":"Abby Phillip. 2015. Online 'authenticity' and how Facebook's 'real name' policy hurts Native Americans. The Washington Post (February 2015). https:\/\/www.washingtonpost.com\/news\/morning-mix\/wp\/2015\/02\/10\/online-authenticity-and-how-facebooks-real-name-policy-hurts-native-americans\/"},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376299"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1086\/704763"},{"key":"e_1_2_2_93_1","volume-title":"Susan C Stokes, and Bernard Manin.","author":"Przeworski Adam","year":"1999","unstructured":"Adam Przeworski, Susan Carol Stokes Stokes, Susan C Stokes, and Bernard Manin. 1999. Democracy, accountability, and representation. Vol. 2. Cambridge University Press."},{"key":"e_1_2_2_94_1","volume-title":"Young Shopkeeper's Suicide After WeChat Ban Highlights App's Influence Over 1.2 Billion Lives. Caixin Global (August","author":"Qian Tong Anniek Bao","year":"2020","unstructured":"Anniek Bao Qian Tong and Flynn Murphy. 2020. Young Shopkeeper's Suicide After WeChat Ban Highlights App's Influence Over 1.2 Billion Lives. Caixin Global (August 2020). https:\/\/www.caixinglobal.com\/2020-08--28\/young-shopkeepers-suicide-after-wechat-ban-highlights-apps-influence-over-12-billion-lives-101598510.html"},{"key":"e_1_2_2_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173677"},{"key":"e_1_2_2_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_2_97_1","volume-title":"Rachel Ormston, et al.","author":"Ritchie Jane","year":"2013","unstructured":"Jane Ritchie, Jane Lewis, Carol McNaughton Nicholls, Rachel Ormston, et al. 2013. Qualitative research practice: A guide for social science students and researchers. Sage."},{"key":"e_1_2_2_98_1","volume-title":"The Intersectional Internet: Race, Sex, Class and Culture Online","author":"Roberts Sarah","unstructured":"Sarah Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work. In The Intersectional Internet: Race, Sex, Class and Culture Online, S. U. Noble and B. Tynes (Eds.). Peter Lang Publishing."},{"key":"e_1_2_2_99_1","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v23i3.8283"},{"key":"e_1_2_2_100_1","volume-title":"TikTok prevented disabled users? videos from showing up in feeds. The Verge","author":"Robertson Adi","year":"2019","unstructured":"Adi Robertson. 2019. TikTok prevented disabled users? videos from showing up in feeds. The Verge (2019). https:\/\/www.theverge.com\/2019\/12\/2\/20991843\/tiktok-bytedance-platform-disabled-autism-lgbt-fat-user-algorithm-reach-limit"},{"key":"e_1_2_2_101_1","volume-title":"Tumblr is banning adult content. It's about so much more than porn. Vox","author":"Romano Aja","year":"2018","unstructured":"Aja Romano. 2018. Tumblr is banning adult content. It's about so much more than porn. Vox (2018)."},{"key":"e_1_2_2_102_1","volume-title":"Convivial Toolbox: Generative Research for the Front End of Design","author":"Sanders Elizabeth B-N","year":"2012","unstructured":"Elizabeth B-N Sanders and Pieter Jan Stappers. 2012. Convivial Toolbox: Generative Research for the Front End of Design. BIS Publishers."},{"key":"e_1_2_2_103_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818821316"},{"key":"e_1_2_2_104_1","unstructured":"Claire Selvin. 2019. Betty Tompkins Ousted from Instagram for Posting Classic Painting of Penetration. https:\/\/www.artnews.com\/art-news\/news\/betty-tompkins-expelled-from-instagram-12463\/"},{"key":"e_1_2_2_105_1","volume-title":"Memes in digital culture","author":"Shifman Limor","unstructured":"Limor Shifman. 2014. Memes in digital culture. MIT press."},{"key":"e_1_2_2_106_1","volume-title":"Rule-based Expert Systems: the MYCIN Experiments of the Stanford Heuristic Programming Project","author":"Shortliffe Edward Hance","unstructured":"Edward Hance Shortliffe and Bruce G Buchanan. 1985. Rule-based Expert Systems: the MYCIN Experiments of the Stanford Heuristic Programming Project. Addison-Wesley Publishing Company."},{"key":"e_1_2_2_107_1","volume-title":"Hard Questions: Who Reviews Objectionable Content on Facebook? And Is the Company Doing Enough to Support Them? https:\/\/newsroom.fb.com\/news\/2018\/07\/hard-questions-content-reviewers\/","author":"Silver Ellen","year":"2018","unstructured":"Ellen Silver. 2018. Hard Questions: Who Reviews Objectionable Content on Facebook? And Is the Company Doing Enough to Support Them? https:\/\/newsroom.fb.com\/news\/2018\/07\/hard-questions-content-reviewers\/"},{"key":"e_1_2_2_108_1","volume-title":"Routledge International Handbook Of Participatory Design","author":"Simonsen Jesper","unstructured":"Jesper Simonsen and Toni Robertson. 2012. Routledge International Handbook Of Participatory Design .Routledge."},{"key":"e_1_2_2_109_1","unstructured":"Olivia Solon. 2017a. Facebook is hiring moderators. But is the job too gruesome to handle? https:\/\/www.theguardian.com\/technology\/2017\/may\/04\/facebook-content-moderators-ptsd-psychological-dangers"},{"key":"e_1_2_2_110_1","volume-title":"Underpaid and overburdened: the life of a Facebook moderator. The Guardian (May","author":"Solon Olivia","year":"2017","unstructured":"Olivia Solon. 2017b. Underpaid and overburdened: the life of a Facebook moderator. The Guardian (May 2017). https:\/\/www.theguardian.com\/news\/2017\/may\/25\/facebook-moderator-underpaid-overburdened-extreme-content"},{"key":"e_1_2_2_111_1","volume-title":"Facebook ignored racial bias research, employees say. NBC News","author":"Solon Olivia","year":"2020","unstructured":"Olivia Solon. 2020. Facebook ignored racial bias research, employees say. NBC News (2020). https:\/\/www.nbcnews.com\/tech\/tech-news\/facebook-management-ignored-internal-research-showing-racial-bias-current-former-n1234746"},{"key":"e_1_2_2_112_1","volume-title":"Twitter criticized for suspending popular LGBTQ academic @meakoopa. The Verge (June","author":"Tiffany Kaitlyn","year":"2017","unstructured":"Kaitlyn Tiffany. 2017. Twitter criticized for suspending popular LGBTQ academic @meakoopa. The Verge (June 2017). https:\/\/www.theverge.com\/2017\/6\/13\/15794296\/twitter-suspended-meakoopa-anthony-oliveira-controversy"},{"key":"e_1_2_2_113_1","volume-title":"Tumblr's First Year Without Porn. The Atlantic","author":"Tiffany Kaitlyn","year":"2019","unstructured":"Kaitlyn Tiffany. 2019. Tumblr's First Year Without Porn. The Atlantic (2019)."},{"key":"e_1_2_2_114_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445590"},{"key":"e_1_2_2_115_1","volume-title":"Proc. CSCW Workshops. ACM.","author":"Vaccaro Kristen","year":"2019","unstructured":"Kristen Vaccaro, Karrie Karahalios, Deirdre Mulligan, Daniel Kluttz, and Tad Hirsch. 2019. Contestability in Algorithmic Decision Making. In Proc. CSCW Workshops. ACM."},{"key":"e_1_2_2_116_1","volume-title":"Proc. CSCW. ACM.","author":"Vaccaro Kristen","year":"2020","unstructured":"Kristen Vaccaro, Christian Sandvig, and Karrie Karahalios. 2020. \u201cAt the End of the Day Facebook Does What It Wants\u201d: How Users Experience Contesting Algorithmic Content Moderation. In Proc. CSCW. ACM."},{"key":"e_1_2_2_117_1","first-page":"215","article-title":"Participatory design and design for values","volume":"11","author":"der Velden Maja Van","year":"2014","unstructured":"Maja Van der Velden, C M\u00f6rtberg, J Van den Hoven, PE Vermaas, and I Van de Poel. 2014. Participatory design and design for values. Development, Vol. 11, 3 (2014), 215--236.","journal-title":"Development"},{"key":"e_1_2_2_118_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134746"},{"key":"e_1_2_2_119_1","volume-title":"10 things you should know about algorithmic fairness. interactions","author":"Woodruff Allison","year":"2019","unstructured":"Allison Woodruff. 2019. 10 things you should know about algorithmic fairness. interactions, Vol. 26, 4 (2019), 47--51."},{"key":"e_1_2_2_120_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357156"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476059","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3476059","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3476059","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T05:01:16Z","timestamp":1752469276000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476059"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":120,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2021,10,13]]}},"alternative-id":["10.1145\/3476059"],"URL":"https:\/\/doi.org\/10.1145\/3476059","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]},"assertion":[{"value":"2021-10-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}