{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T16:18:21Z","timestamp":1776097101922,"version":"3.50.1"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation programme","award":["860621"],"award-info":[{"award-number":["860621"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2024,5,31]]},"abstract":"<jats:p>When people use web search engines to find information on debated topics, the search results they encounter can influence opinion formation and practical decision-making with potentially far-reaching consequences for the individual and society. However, current web search engines lack support for information-seeking strategies that enable responsible opinion formation, e.g., by mitigating confirmation bias and motivating engagement with diverse viewpoints. We conducted two preregistered user studies to test the benefits and risks of an intervention aimed at confirmation bias mitigation. In the first study, we tested the effect of warning labels, warning of the risk of confirmation bias, combined with obfuscations, hiding selected search results per default. We observed that obfuscations with warning labels effectively reduce engagement with search results. These initial findings did not allow conclusions about the extent to which the reduced engagement was caused by the warning label (reflective nudging element) versus the obfuscation (automatic nudging element). If obfuscation was the primary cause, this would raise concerns about harming user autonomy. We thus conducted a follow-up study to test the effect of warning labels and obfuscations separately.<\/jats:p>\n          <jats:p>According to our findings, obfuscations run the risk of manipulating behavior instead of guiding it, while warning labels without obfuscations (purely reflective) do not exhaust processing capacities but encourage users to actively choose to decrease engagement with attitude-confirming search results. Therefore, given the risks and unclear benefits of obfuscations and potentially other automatic nudging elements to guide engagement with information, we call for prioritizing interventions that aim to enhance human cognitive skills and agency instead.<\/jats:p>","DOI":"10.1145\/3635034","type":"journal-article","created":{"date-parts":[[2023,11,30]],"date-time":"2023-11-30T11:49:32Z","timestamp":1701344972000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Nudges to Mitigate Confirmation Bias during Web Search on Debated Topics: Support vs. Manipulation"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2274-1606","authenticated-orcid":false,"given":"Alisa","family":"Rieger","sequence":"first","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5053-4674","authenticated-orcid":false,"given":"Tim","family":"Draws","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8258-2029","authenticated-orcid":false,"given":"Mari\u00ebt","family":"Theune","sequence":"additional","affiliation":[{"name":"University of Twente, Enschede, Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1663-1627","authenticated-orcid":false,"given":"Nava","family":"Tintarev","sequence":"additional","affiliation":[{"name":"Maastricht University, Maastricht, Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2024,3,12]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531711"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3406522.3446023"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.4230\/DagRep.9.11.117"},{"key":"e_1_3_3_5_2","article-title":"Non-normal data: Is ANOVA still a valid option?","author":"Mena M. Jos\u00e9 Blanca","year":"2017","unstructured":"M. Jos\u00e9 Blanca Mena, Rafael Alarc\u00f3n Postigo, Jaume Arnau Gras, Roser Bono Cabr\u00e9, and Rebecca Bendayan. 2017. Non-normal data: Is ANOVA still a valid option? Psicothema 29, 4 (2017), 552\u2013557.","journal-title":"Psicothema"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3449287"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327752jpa4803_13"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.45.4.805"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300733"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.4018\/ijksr.2014010102"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2022.107643"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0042761"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.5897\/ERR.9000373"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1080\/17439760.2015.1048818"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1419828112"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1257\/089533005775196732"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3176349.3176381"},{"key":"e_1_3_3_18_2","volume-title":"It\u2019s All about \u2018me\u2019\u2014How People are Taking Search Personally","author":"Gevelber Lisa","year":"2018","unstructured":"Lisa Gevelber. 2018. It\u2019s All about \u2018me\u2019\u2014How People are Taking Search Personally. Technical Report. Retrieved from https:\/\/www.thinkwithgoogle.com\/marketing-strategies\/search\/personal-needs-search-trends\/"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13164-015-0248-1"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1756-8765.2008.01006.x"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240691"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.5709\/acp-0193-5"},{"key":"e_1_3_3_23_2","volume-title":"Search Engine Society","author":"Halavais Alexander","year":"2017","unstructured":"Alexander Halavais. 2017. Search Engine Society. John Wiley & Sons."},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1017\/S1867299X00002762"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1108\/info-05-2015-0034"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1177\/1745691617702496"},{"key":"e_1_3_3_27_2","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1177\/1745691618803647","article-title":"The dark side of information proliferation","volume":"14","author":"Hills Thomas T.","year":"2019","unstructured":"Thomas T. Hills. 2019. The dark side of information proliferation. Perspectives on Psychological Science 14, 3 (2019), 323\u2013330.","journal-title":"Perspectives on Psychological Science"},{"key":"e_1_3_3_28_2","unstructured":"High-Level Expert Group on Artificial Intelligence. 2019. Ethics guidelines for trustworthy AI. European Commission. https:\/\/ec.europa.eu\/digital-single-market\/en\/news\/ethics-guidelines-trustworthy-ai"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3130332.3130334"},{"key":"e_1_3_3_30_2","first-page":"1163","volume-title":"Proceedings of the 30th USENIX Security Symposium","author":"Kaiser Ben","year":"2021","unstructured":"Ben Kaiser, Jerry Wei, Eli Lucherini, Kevin Lee, J. Nathan Matias, and Jonathan Mayer. 2021. Adapting security warnings to counter online disinformation. In Proceedings of the 30th USENIX Security Symposium. 1163\u20131180."},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441923"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.2307\/2184520"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1177\/1529100620946707"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","unstructured":"Anastasia Kozyreva Philipp Lorenz-Spreen Stefan M. Herzog Ullrich K. H. Ecker Stephan Lewandowsky Ralph Hertwig Ayesha Ali Joseph B. Bak-Coleman Sarit Barzilai Melisa Basol Adam Berinsky Cornelia Betsch John Cook Lisa Fazio Michael Geers Andrew M. Guess Haifeng Huang Horacio Larreguy Rakoen Maertens Folco Panizza Gordon Pennycook David G. Rand Steve Rathje Jason Reifler Philipp Schmid Mark Smith Briony Swire-Thompson Paula Szewach Sander van der Linden and Sam Wineburg. 2022. Toolbox of interventions against online misinformation. DOI:10.31234\/osf.io\/x8ejt","DOI":"10.31234\/osf.io\/x8ejt"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1080\/17439760.2019.1579359"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1177\/0146167217697695"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531711"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-020-0889-7"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/1121949.1121979"},{"key":"e_1_3_3_40_2","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1145\/3343413.3377975","volume-title":"Proceedings of the 2020 Conference on Human Information Interaction and Retrieval","author":"McKay Dana","year":"2020","unstructured":"Dana McKay, Stephann Makri, Marisela Gutierrez-Lopez, Andrew MacFarlane, Sondess Missaoui, Colin Porlezza, and Glenda Cooper. 2020. We are the change that we seek: Information interactions during a change of viewpoint. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval. 173\u2013182."},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.214"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1017\/epi.2013.11"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-20043-0"},{"key":"e_1_3_3_44_2","volume-title":"Proceedings of the 7th International AAAI Conference on Weblogs and Social Media","author":"Munson Sean A.","year":"2013","unstructured":"Sean A. Munson, Stephanie Y. Lee, and Paul Resnick. 2013. Encouraging reading of diverse political viewpoints with a browser widget. In Proceedings of the 7th International AAAI Conference on Weblogs and Social Media."},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.2.2.175"},{"key":"e_1_3_3_46_2","volume-title":"Responsible Belief: A Theory in Ethics and Epistemology","author":"Peels Rik","year":"2016","unstructured":"Rik Peels. 2016. Responsible Belief: A Theory in Ethics and Epistemology. Oxford University Press."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2018.06.011"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-4964-1_1"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1080\/12460125.2020.1768680"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1038\/s44159-022-00081-9"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1080\/15298868.2017.1361861"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3372923.3404786"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2020.2957"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544549.3585693"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3465336.3475101"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511047.3537692"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2012.06.035"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3498366.3505816"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.24059\/olj.v26i2.2725"},{"key":"e_1_3_3_60_2","first-page":"44","volume-title":"Proceedings of the 16th ACM Conference on Recommender Systems. CEUR Workshop Proceedings","author":"Smets Annelien","year":"2022","unstructured":"Annelien Smets, Lien Michiels, Toine Bogers, and Lennart Bj\u00f6rneborn. 2022. Serendipity in recommender systems beyond the algorithm: A feature repository and experimental design. In Proceedings of the 16th ACM Conference on Recommender Systems. CEUR Workshop Proceedings. 44\u201366."},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3295750.3298940"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.lisr.2005.01.005"},{"key":"e_1_3_3_63_2","unstructured":"Richard H. Thaler and Cass R. Sunstein. 2008. Nudge: Improving Decisions about Health Wealth and Happiness. Penguin 14\u201338."},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1037\/t49856-000"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1207\/S1532785XMEP0703_2"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.185.4157.1124"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1080\/13546783.2021.1891967"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1016\/0092-6566(92)90049-A"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935839"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484053"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","unstructured":"Ryen W. White and Resa A. Roth. 2009. Exploratory Search: Beyond the Query-Response Paradigm. Synthesis Lectures on Information Concepts Retrieval and Services Morgan & Claypool Publishers 1\u201398. DOI:10.2200\/S00174ED1V01Y200901ICR003","DOI":"10.2200\/S00174ED1V01Y200901ICR003"},{"key":"e_1_3_3_72_2","unstructured":"Wikipedia. 2021. Confirmation bias. Retrieved 01 May 2021 from https:\/\/en.wikipedia.org\/wiki\/Confirmation_bias"},{"key":"e_1_3_3_73_2","volume-title":"Statistical Principles in Experimental Design","year":"1971","unstructured":"Ben James Winer, Donald R. Brown, and Kenneth M. Michels. 1971. Statistical Principles in Experimental Design. Vol. 2. McGraw-Hill, New York, NY."},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450613.3456824"},{"key":"e_1_3_3_75_2","first-page":"30","volume-title":"Proceedings of the 1st Workshop on Bridging the Gap between Information Science, Information Retrieval and Data Science (BIRDS 2020), Co-Located with 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval","volume":"2741","author":"Zimmerman Steven","year":"2020","unstructured":"Steven Zimmerman, Stefan M. Herzog, David Elsweiler, Jon Chamberlain, and Udo Kruschwitz. 2020. Towards a framework for harm prevention in web search. In Proceedings of the 1st Workshop on Bridging the Gap between Information Science, Information Retrieval and Data Science (BIRDS 2020), Co-Located with 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. Ingo Frommholz, Haiming Liu, and Massimo Melucci (Eds.), Vol. 2741, CEUR Workshop Proceedings, Xi\u2019an, 30\u201346."}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3635034","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3635034","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:51:07Z","timestamp":1750287067000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3635034"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":74,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,5,31]]}},"alternative-id":["10.1145\/3635034"],"URL":"https:\/\/doi.org\/10.1145\/3635034","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"value":"1559-1131","type":"print"},{"value":"1559-114X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,12]]},"assertion":[{"value":"2023-05-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-09","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}