{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T12:56:48Z","timestamp":1780059408910,"version":"3.54.0"},"reference-count":89,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"<jats:p>Internet users highly rely on and trust web search engines, such as Google, to find relevant information online. However, scholars have documented numerous biases and inaccuracies in search outputs. To improve the quality of search results, search engines employ various content moderation practices such as interface elements informing users about potentially dangerous websites and algorithmic mechanisms for downgrading or removing low-quality search results. While the reliance of the public on web search engines and their use of moderation practices is well-established, user attitudes towards these practices have not yet been explored in detail. To address this gap, we first conducted an overview of content moderation practices used by search engines, and then surveyed a representative sample of the US adult population (N=398) to examine the levels of support for different moderation practices applied to potentially misleading and\/or potentially offensive content in web search. We also analyzed the relationship between user characteristics and their support for specific moderation practices. We find that the most supported practice is informing users about potentially misleading or offensive content, and the least supported one is the complete removal of search results. More conservative users and users with lower levels of trust in web search results are more likely to be against content moderation in web search.<\/jats:p>","DOI":"10.1145\/3637423","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T10:05:31Z","timestamp":1714385131000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["User Attitudes to Content Moderation in Web Search"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3332-9294","authenticated-orcid":false,"given":"Aleksandra","family":"Urman","sequence":"first","affiliation":[{"name":"University of Zurich, Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0612-6320","authenticated-orcid":false,"given":"Aniko","family":"Hannak","sequence":"additional","affiliation":[{"name":"University of Zurich, Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7143-5317","authenticated-orcid":false,"given":"Mykola","family":"Makhortykh","sequence":"additional","affiliation":[{"name":"University of Bern, Bern, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.51685\/jqd.2022.023"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124199028002003"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2019.112692"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","unstructured":"Shubham Atreja Libby Hemphill and Paul Resnick. 2022. What is the Will of the People? Moderation Preferences for Misinformation. https:\/\/doi.org\/10.48550\/arXiv.2202.00799 arXiv:2202.00799 [cs].","DOI":"10.48550\/arXiv.2202.00799"},{"key":"e_1_2_1_5_1","unstructured":"Jamie Ballard. 2019. Most conservatives believe removing content and comments on social media is suppressing free speech textbar YouGov. https:\/\/today.yougov.com\/topics\/technology\/articles-reports\/2019\/04\/29\/content-moderation-social-media-free-speech-poll"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716652159"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.2307\/2532457"},{"key":"e_1_2_1_8_1","unstructured":"Erik Calleberg. 2021. Making Content Moderation Less Frustrating : How Do Users Experience Explanatory Human and AI Moderation Messages. https:\/\/urn.kb.se\/resolve?urn=urn:nbn:se:sh:diva-46050"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.avb.2018.05.003"},{"key":"e_1_2_1_10_1","unstructured":"R core team. 2023. stats-package: The R Stats Package. https:\/\/rdrr.io\/r\/stats\/stats-package.html"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.2196\/18444"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1186\/1475--2891--10--124"},{"key":"e_1_2_1_13_1","unstructured":"DuckDuckGo. 2022. News Rankings. https:\/\/help.duckduckgo.com\/duckduckgo-help-pages\/results\/news-rankings\/"},{"key":"e_1_2_1_14_1","unstructured":"DuckDuckGo. 2023 a. Did DuckDuckGo censor search results about the Russia-Ukraine war? https:\/\/duckduckgo.com\/duckduckgo-help-pages\/misconceptions\/did-duckduckgo-censor-russian-ukraine-war-search-results\/"},{"key":"e_1_2_1_15_1","unstructured":"DuckDuckGo. 2023 b. Does DuckDuckGo censor or otherwise politically bias their search results? https:\/\/duckduckgo.com\/duckduckgo-help-pages\/misconceptions\/does-duckduckgo-censor-search-results\/"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1177\/01634437221111923"},{"key":"e_1_2_1_17_1","unstructured":"Edelman. 2021. 2021 Edelman Trust Barometer. https:\/\/www.edelman.com\/trust\/2021-trust-barometer"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1419828112"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/1536867X1701700308"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000070"},{"key":"e_1_2_1_21_1","unstructured":"Aaron French Marcelo Macedo John Poulsen Tyler Waterson and Angela Yu. 2008. Multivariate Analysis of Variance (MANOVA). (2008)."},{"key":"e_1_2_1_22_1","unstructured":"Gabriel Weinberg [@yegg]. 2022. Like so many others I am sickened by Russia's invasion of Ukraine and the gigantic humanitarian crisis it continues to create. StandWithUkraine At DuckDuckGo we've been rolling out search updates that down-rank sitess associated with Russian disinformation. https:\/\/twitter.com\/yegg\/status\/1501716484761997318"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.236"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818776611"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3079452.3079483"},{"key":"e_1_2_1_26_1","volume-title":"Content Moderation, and the Hidden Decisions That Shape Social Media illustrated edition ed.)","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media illustrated edition ed.). Yale University Press, New Haven."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720943234"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/20563051221117552"},{"key":"e_1_2_1_29_1","unstructured":"Google. 2020. Information Quality & Content Moderation. Technical Report. https:\/\/blog.google\/documents\/83\/information_quality_content_moderation_white_paper.pdf\/"},{"key":"e_1_2_1_30_1","unstructured":"Google. 2022a. General Search Quality Rating Guidelines. Technical Report. https:\/\/static.googleusercontent.com\/media\/guidelines.raterhub.com\/en\/\/searchqualityevaluatorguidelines.pdf"},{"key":"e_1_2_1_31_1","unstructured":"Google. 2022b. Manage warnings about unsafe sites - Android - Google Chrome Help. https:\/\/support.google.com\/chrome\/answer\/99020?hl=en"},{"key":"e_1_2_1_32_1","unstructured":"Google. 2022c. Rigorous Testing -- How Google Search Works. https:\/\/www.google.com\/search\/howsearchworks\/how-search-works\/rigorous-testing\/"},{"key":"e_1_2_1_33_1","unstructured":"Google. 2022d. Search Quality Rater Guidelines: An Overview. Technical Report. https:\/\/services.google.com\/fh\/files\/misc\/hsw-sqrg.pdf"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719897945"},{"key":"e_1_2_1_35_1","first-page":"0","article-title":"Trust Online: Young Adults' Evaluation of Web Content","volume":"4","author":"Hargittai Eszter","year":"2010","unstructured":"Eszter Hargittai, Lindsay Fullerton, Ericka Menchen-Trevino, and Kristin Yates Thomas. 2010. Trust Online: Young Adults' Evaluation of Web Content. International Journal of Communication, Vol. 4, 0 (April 2010), 27. https:\/\/ijoc.org\/index.php\/ijoc\/article\/view\/636 Number: 0.","journal-title":"International Journal of Communication"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cptl.2015.08.001"},{"key":"e_1_2_1_37_1","unstructured":"Reuters Institute. 2016. Resources and Charts for the 2016 Digital News Report. https:\/\/www.digitalnewsreport.org\/survey\/2016\/resources-2016\/"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359294"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2011.633820"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702520"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.spl.2003.07.017"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcc4.12105"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","unstructured":"Anastasia Kozyreva Stefan Herzog Stephan Lewandowsky Ralph Hertwig Philipp Lorenz-Spreen Mark Leiser and Jason Reifler. 2022. Free speech vs. harmful misinformation: Moral dilemmas in online content moderation. https:\/\/doi.org\/10.31234\/osf.io\/2pc3a","DOI":"10.31234\/osf.io\/2pc3a"},{"key":"e_1_2_1_44_1","volume-title":"Measuring Left-Right Political Orientation: The Choice of Response Format. The Public Opinion Quarterly","author":"Kroh Martin","year":"2007","unstructured":"Martin Kroh. 2007. Measuring Left-Right Political Orientation: The Choice of Response Format. The Public Opinion Quarterly, Vol. 71, 2 (2007), 204--220. https:\/\/www.jstor.org\/stable\/4500371 Publisher: [Oxford University Press, American Association for Public Opinion Research]."},{"key":"e_1_2_1_45_1","unstructured":"Natasha Lomas. 2022. Russian tech giant Yandex removes national borders from Maps app. https:\/\/techcrunch.com\/2022\/06\/09\/yandex-maps-no-borders\/"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5210\/fm.v26i10.11562"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1177\/17506980221133732"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","unstructured":"Mykola Makhortykh Aleksandra Urman and Mari\u00eblle Wijermars. 2022b. A story of (non)compliance bias and conspiracies: How Google and Yandex represented Smart Voting during the 2021 parliamentary elections in Russia. Harvard Kennedy School Misinformation Review (March 2022). https:\/\/doi.org\/10.37016\/mr-2020--94","DOI":"10.37016\/mr-2020--94"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448211063860"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449100"},{"key":"e_1_2_1_51_1","unstructured":"Microsoft. 2022. How Bing delivers search results - Microsoft Support. https:\/\/support.microsoft.com\/en-us\/topic\/how-bing-delivers-search-results-d18fc815-ac37--4723-bc67--9229ce3eb6a3"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448221103534"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24637"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818773059"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.18574\/9781479833641"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1177\/20539517221115666"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083--6101.2007.00351.x"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512929"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.2307\/2347760"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","unstructured":"Franziska Pradel Jan Zilinsky Spyros Kosmidis and Yannis Theocharis. 2022. Do Users Ever Draw a Line? Offensiveness and Content Moderation Preferences on Social Media. https:\/\/doi.org\/10.31219\/osf.io\/y4xft","DOI":"10.31219\/osf.io\/y4xft"},{"key":"e_1_2_1_61_1","unstructured":"Prolific. 2022. Representative samples. https:\/\/researcher-help.prolific.co\/hc\/en-gb\/articles\/360019236753-Representative-samples"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2021.1874040"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102127"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451807"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2022.2097017"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444818801010"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449076"},{"key":"e_1_2_1_68_1","volume-title":"We Still Trust in Google, but Less than 10 Years Ago: An Eye-Tracking Study. Information Research: An International Electronic Journal","author":"Schulthei\u00df Sebastian","year":"2018","unstructured":"Sebastian Schulthei\u00df, Sebastian S\u00fcnkler, and Dirk Lewandowski. 2018. We Still Trust in Google, but Less than 10 Years Ago: An Eye-Tracking Study. Information Research: An International Electronic Journal, Vol. 23, 3 (Sept. 2018). https:\/\/eric.ed.gov\/?id=EJ1196314 Publisher: Thomas D."},{"key":"e_1_2_1_69_1","unstructured":"Statcounter. 2022. Search Engine Market Share Worldwide. https:\/\/gs.statcounter.com\/search-engine-market-share"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1080\/23808985.2020.1755338"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1080\/01973533.2016.1277529"},{"key":"e_1_2_1_72_1","volume-title":"Conspiracy Theorists Turn to DuckDuckGo. The New York Times (Feb.","author":"Thompson Stuart A.","year":"2022","unstructured":"Stuart A. Thompson. 2022. Fed Up With Google, Conspiracy Theorists Turn to DuckDuckGo. The New York Times (Feb. 2022). https:\/\/www.nytimes.com\/2022\/02\/23\/technology\/duckduckgo-conspiracy-theories.html"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2022.2065213"},{"key":"e_1_2_1_74_1","volume-title":"Searching for Alternative Facts","author":"Tripodi Francesca","year":"2022","unstructured":"Francesca Tripodi. 2022a. Searching for Alternative Facts. Data & Society (2022)."},{"key":"e_1_2_1_75_1","volume-title":"The propagandists' playbook: how conservative elites manipulate search and threaten democracy","author":"Tripodi Francesca Bolla","unstructured":"Francesca Bolla Tripodi. 2022b. The propagandists' playbook: how conservative elites manipulate search and threaten democracy. Yale University Press, New Haven. OCLC: on1305434359."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448221100699"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","unstructured":"Aleksandra Urman and Mykola Makhortykh. 2021. You Are How (and Where) You Search? Comparative Analysis of Web Search Behaviour Using Web Tracking Data. https:\/\/doi.org\/10.48550\/arXiv.2105.04961 arXiv:2105.04961 [cs].","DOI":"10.48550\/arXiv.2105.04961"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448221099536"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.telpol.2022.102477"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tele.2022.101860"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415238"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2204529119"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","unstructured":"John Wihbey Garrett Morrow Myojung Chung and Mike Peacey. 2021. The Bipartisan Case for Labeling as a Content Moderation Method: Findings from a National Survey. https:\/\/doi.org\/10.2139\/ssrn.3923905","DOI":"10.2139\/ssrn.3923905"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450613.3456824"},{"key":"e_1_2_1_85_1","unstructured":"Yahoo! 2022a. Remove search results from Yahoo Search textbar Yahoo Help - SLN4530. https:\/\/help.yahoo.com\/kb\/SLN4530.html"},{"key":"e_1_2_1_86_1","unstructured":"Yahoo! 2022b. Search Services textbar Yahoo. https:\/\/legal.yahoo.com\/in\/en\/yahoo\/privacy\/products\/searchservices\/index.html#yahoosearch"},{"key":"e_1_2_1_87_1","unstructured":"Yandex. 2022a. Signs of a low-quality site - Webmaster. Help. https:\/\/yandex.com\/support\/webmaster\/yandex-indexing\/webmaster-advice.html"},{"key":"e_1_2_1_88_1","unstructured":"Yandex. 2022b. Why are pages excluded from the search? https:\/\/yandex.com\/support\/webmaster\/site-indexing\/excluded-pages.html"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23311"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637423","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3637423","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:23:49Z","timestamp":1755883429000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637423"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":89,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2024,4,17]]}},"alternative-id":["10.1145\/3637423"],"URL":"https:\/\/doi.org\/10.1145\/3637423","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,17]]},"assertion":[{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}