{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T16:20:30Z","timestamp":1789057230373,"version":"build-2803163510"},"reference-count":48,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2025,6,11]],"date-time":"2025-06-11T00:00:00Z","timestamp":1749600000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Applied Philosophy"],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:title>ABSTRACT<\/jats:title><jats:p>This paper explores the morality of human content moderation. It focuses on content moderation of Child Sexual Abuse Material (CSAM) as it takes place in commercial digital platforms, broadly understood. I select CSAM for examination because there is a widespread and uncontroversial consensus around the need to remove it, which furnishes the strongest possible argument for human content moderation. The paper makes the case that, even if we grant that social media platforms or chatbots are a valuable\u2014or inevitable\u2014 force in current societies, and even if moderation plays an important role in protecting users and society more generally from the detrimental effects of these digital tools, it is far from clear that tasking humans to conduct such moderation is permissible without constraints, given the psychic toll of the practice on moderators. While a blanket prohibition of human moderation would be objectionable, given the benefits of the practice, it behooves us to identify the fundamental interests affected by the harms of human moderation, the obligations that platforms acquire to protect such interests, and the conditions under which their realization is in fact possible. I argue that the failure to comply with certain standards renders human moderation impermissible.<\/jats:p>","DOI":"10.1111\/japp.70024","type":"journal-article","created":{"date-parts":[[2025,6,11]],"date-time":"2025-06-11T06:49:02Z","timestamp":1749624542000},"page":"1285-1300","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Against Human Content Moderation: Algorithms without Trauma"],"prefix":"10.1111","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8681-9284","authenticated-orcid":false,"given":"Juan","family":"Esp\u00edndola","sequence":"first","affiliation":[{"name":"Institute for Philosophical Research National Autonomous University of Mexico  Mexico City Mexico"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2025,6,11]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.5206\/fpq\/2022.3\/4.14295"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10551-019-04299-1"},{"key":"e_1_2_8_4_1","unstructured":"Berthelot Benoit andHenryRen.\u201cTikTok's Moderators Still Review Child Abuse Despite Vow to Exit.\u201d Bloomberg.com March 19 2023https:\/\/www.bloomberg.com\/news\/articles\/2023-03-20\/tiktok-s-moderators-still-review-child-abuse-despite-vow-to-exit."},{"key":"e_1_2_8_5_1","unstructured":"Biddle Sam.\u201cTrauma Counselors were Pressured to Divulge Confidential Information about Facebook Moderators Internal Letter Claims.\u201d The Intercept August 16 2019https:\/\/theintercept.com\/2019\/08\/16\/facebook-moderators-mental-health-accenture\/."},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/jopp.12233"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2017.09.016"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12103-017-9417-3"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10892-014-9186-x"},{"key":"e_1_2_8_10_1","unstructured":"Cat\u00e0 Figuls Josep.\u201cLos Horrores que Viven los Moderadores de Meta: \u2018No Sab\u00eda de lo que son Capaces los Humanos\u2019.\u201dEl Pa\u00eds January 25 2024https:\/\/elpais.com\/economia\/2024\u201001\u201025\/los\u2010horrores\u2010que\u2010viven\u2010los\u2010moderadores\u2010de\u2010meta\u2010no\u2010sabia\u2010de\u2010lo\u2010que\u2010son\u2010capaces\u2010los\u2010humanos.html."},{"key":"e_1_2_8_11_1","unstructured":"Chen Adrian.\u201cThe Laborers who Keep Dick Pics and Beheadings out of Your Facebook Feed.\u201dWired October 23 2014https:\/\/www.wired.com\/2014\/10\/content-moderation\/."},{"key":"e_1_2_8_12_1","unstructured":"Conti Paul.\u201cTrauma: The Invisible Epidemic: How Trauma Works and How We Can Heal From It.\u201d Sounds True Adult 2020 Kindle"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.159.9.1570"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780190089184.001.0001"},{"key":"e_1_2_8_15_1","volume-title":"Custodians of the Internet: Platforms, Content Moderation, and the Information Society and Culture Hidden Decisions that Shape Social Media","author":"Gillespie Tarleton","year":"2018"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720943234"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719897945"},{"key":"e_1_2_8_18_1","unstructured":"Greenberg Andy.\u201cInside the Bitcoin Bust that Took Down the Web's Biggest Child Abuse Site.\u201dWired April 7 2022https:\/\/www.wired.com\/story\/tracers-in-the-dark-welcome-to-video-crypto-anonymity-myth\/."},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10677-014-9537-5"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-orgpsych-012119-044932"},{"key":"e_1_2_8_21_1","unstructured":"Milmo Dan.\u201cPaedophiles Using Open Source AI to Create Child Sexual Abuse Content Says Watchdog.\u201dGuardian September 13 2023https:\/\/www.theguardian.com\/society\/2023\/sep\/12\/paedophiles\u2010using\u2010open\u2010source\u2010ai\u2010to\u2010create\u2010child\u2010sexual\u2010abuse\u2010content\u2010says\u2010watchdog."},{"key":"e_1_2_8_22_1","volume-title":"AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference","author":"Narayanan Arvind","year":"2024"},{"key":"e_1_2_8_23_1","unstructured":"Newton Casey.\u201cBodies in Seats.\u201dThe Verge June 19 2019https:\/\/www.theverge.com\/2019\/6\/19\/18681845\/facebook-moderator-interviews-video-trauma-ptsd-cognizant-tampa."},{"key":"e_1_2_8_24_1","unstructured":"Newton Casey.\u201cThe Terror Queue.\u201dThe Verge December 16 2019https:\/\/www.theverge.com\/2019\/12\/16\/21021005\/google\u2010youtube\u2010moderators\u2010ptsd\u2010accenture\u2010violent\u2010disturbing\u2010content\u2010interviews\u2010video."},{"key":"e_1_2_8_25_1","unstructured":"Newton Casey.\u201cThe Trauma Floor. The Secret Lives of Facebook Moderators in America.\u201dThe Verge February 25 2019https:\/\/www.theverge.com\/2019\/2\/25\/18229714\/cognizant-facebook-content-moderator-interviews-trauma-working-conditions-arizona."},{"key":"e_1_2_8_26_1","unstructured":"Newton Casey.\u201cYouTube Moderators Are Being Forced to Sign a Statement Acknowledging the Job Can Give Them PTSD.\u201dThe Verge January 24 2020https:\/\/www.theverge.com\/2020\/1\/24\/21075830\/youtube-moderators-ptsd-accenture-statement-lawsuits-mental-health."},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.4159\/harvard.9780674736061"},{"key":"e_1_2_8_28_1","unstructured":"Perrigo Billy.\u201c\u2018I Sold My Soul\u2019. WhatsApp Content Moderators Review the Worst Material on the Internet. Now They're Alleging Pay Discrimination.\u201dTime September 23 2021https:\/\/time.com\/6080450\/facebook-whatsapp-content-moderators\/."},{"key":"e_1_2_8_29_1","unstructured":"Perrigo Billy.\u201cOpenAI Used Kenyan Workers on Less than $2 per Hour to Make ChatGPT Less Toxic.\u201dTime January 18 2023https:\/\/time.com\/6247678\/openai-chatgpt-kenya-workers\/?mc_cid=7b2f7f31b4&mc_eid=9352836baf."},{"key":"e_1_2_8_30_1","unstructured":"Perrigo Billy.\u201cInside Facebook's African Sweatshop.\u201dTime February 17 2022https:\/\/time.com\/6147458\/facebook-africa-content-moderation-employee-treatment\/."},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/01634437221122226"},{"key":"e_1_2_8_32_1","volume-title":"Behind the Screen","author":"Roberts Sarah T.","year":"2021"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.23943\/princeton\/9780691163451.001.0001"},{"key":"e_1_2_8_34_1","unstructured":"Rowe Niamh.\u201cUnderage Workers Are Training AI.\u201dWired November 15 2023https:\/\/www.wired.com\/story\/artificial\u2010intelligence\u2010data\u2010labeling\u2010children\/#intcid=_wired\u2010article\u2010bottom\u2010recirc_c42169e0\u201076f5\u201040f5\u20108d33\u201064c57ec0b45d_text2vec1."},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444819875990"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1111\/jpm.12264"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1086\/292272"},{"key":"e_1_2_8_38_1","unstructured":"Solon Olivia.\u201cUnderpaid and Overburdened: The Life of a Facebook Moderator.\u201dGuardian May 23 2017https:\/\/www.theguardian.com\/news\/2017\/may\/25\/facebook-moderator-underpaid-overburdened-extreme-content."},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.5817\/CP2023-4-8"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445092"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11896\u2010021\u201009463\u2010w"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720919776"},{"key":"e_1_2_8_43_1","unstructured":"Weiss Ben.\u201cCan AI Porn be Ethical?\u201dGuardian February 18 2024https:\/\/www.theguardian.com\/technology\/2024\/feb\/18\/ethics-ai-porn."},{"key":"e_1_2_8_44_1","unstructured":"Weiss Ben andAlexandraSternlicht.\u201cMeta and OpenAI Have Spawned a Wave of AI Sex Companions and Some of Them are Children.\u201dFortune January 8 2024https:\/\/fortune.com\/longform\/meta-openai-uncensored-ai-companions-child-pornography\/amp."},{"key":"e_1_2_8_45_1","doi-asserted-by":"publisher","DOI":"10.1515\/9780691214511"},{"key":"e_1_2_8_46_1","volume-title":"The Collected Works of Oscar Wilde","author":"Wilde Oscar","year":"1993"},{"key":"e_1_2_8_47_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0265052500004702"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.5840\/beq20071745"},{"key":"e_1_2_8_49_1","volume-title":"The Stanford Encyclopedia of Philosophy (Winter 2022 Edition)","author":"Zwolinski Matt","year":"2012"}],"container-title":["Journal of Applied Philosophy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/japp.70024","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,26]],"date-time":"2025-08-26T03:51:44Z","timestamp":1756180304000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/japp.70024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,11]]},"references-count":48,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["10.1111\/japp.70024"],"URL":"https:\/\/doi.org\/10.1111\/japp.70024","archive":["Portico"],"relation":{},"ISSN":["0264-3758","1468-5930"],"issn-type":[{"value":"0264-3758","type":"print"},{"value":"1468-5930","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,11]]},"assertion":[{"value":"2024-10-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-06","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}