{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T12:05:18Z","timestamp":1753877118664,"version":"3.41.2"},"reference-count":58,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2024,11,15]],"date-time":"2024-11-15T00:00:00Z","timestamp":1731628800000},"content-version":"vor","delay-in-days":51,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100022497","name":"Amsterdam School of Communication Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100022497","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,9,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Search engines, as key sources of political information, have sparked concerns regarding selective exposure driven by user choices based on political beliefs and filter bubbles created by algorithms. This study focuses on the most influential yet often-overlooked user choice: search queries. We investigate the extent to which user choices (search queries) and algorithmic personalization (search history) lead to divergent search results. Building on research linking immigration- and climate-related search queries to political characteristics, we conduct an experiment on Google Search employing agent-based testing. Using computational methods, we examine variations in search results by source (type) and search result page features. Our findings show that it is the specific search queries made by users, not algorithmic personalization, that lead to substantially divergent information sources in search results. This suggests future research should prioritize user choices in information search rather than control for them.<\/jats:p>","DOI":"10.1093\/jcmc\/zmae020","type":"journal-article","created":{"date-parts":[[2024,11,15]],"date-time":"2024-11-15T11:01:26Z","timestamp":1731668486000},"source":"Crossref","is-referenced-by-count":2,"title":["It matters how you google it? Using agent-based testing to assess the impact of user choices in search queries and algorithmic personalization on political Google Search results"],"prefix":"10.1093","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4117-837X","authenticated-orcid":false,"given":"Marieke","family":"van Hoof","sequence":"first","affiliation":[{"name":"Amsterdam School of Communication Research, University of Amsterdam , Amsterdam,","place":["The Netherlands"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2586-0352","authenticated-orcid":false,"given":"Damian","family":"Trilling","sequence":"additional","affiliation":[{"name":"Department of Language, Literature and Communication, Vrije Universiteit Amsterdam , Amsterdam,","place":["The Netherlands"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7491-1155","authenticated-orcid":false,"given":"Judith","family":"Moeller","sequence":"additional","affiliation":[{"name":"University of Hamburg\u2014Leibniz Institute for Media Research | Hans Bredow Institute , Hamburg,","place":["Germany"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2375-9565","authenticated-orcid":false,"given":"Corine S","family":"Meppelink","sequence":"additional","affiliation":[{"name":"Amsterdam School of Communication Research, University of Amsterdam , Amsterdam,","place":["The Netherlands"]}]}],"member":"286","published-online":{"date-parts":[[2024,11,14]]},"reference":[{"year":"2020","author":"Araujo","key":"2024111511003126700_zmae020-B1","doi-asserted-by":"publisher","DOI":"10.17605\/OSF.IO\/YU64R"},{"key":"2024111511003126700_zmae020-B2","doi-asserted-by":"publisher","first-page":"112692","DOI":"10.1016\/j.socscimed.2019.112692","article-title":"Investigating Google\u2019s suicide-prevention efforts in celebrity suicides using agent-based testing: A cross-national study in four European countries","volume":"262","author":"Arendt","year":"2020","journal-title":"Social Science & Medicine"},{"issue":"CSCW1","key":"2024111511003126700_zmae020-B3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3449148","article-title":"Problematic machine behavior: A systematic literature review of algorithm audits","volume":"5","author":"Bandy","year":"2021","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"issue":"1","key":"2024111511003126700_zmae020-B4","doi-asserted-by":"publisher","first-page":"19","DOI":"10.17645\/mac.v11i1.6030","article-title":"Googling referendum campaigns: Analyzing online search patterns regarding Swiss direct-democratic votes","volume":"11","author":"Blassnig","year":"2023","journal-title":"Media and Communication"},{"issue":"2","key":"2024111511003126700_zmae020-B5","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1016\/j.electstud.2006.10.018","article-title":"Explaining the rise of anti-immigrant parties: The role of news media content","volume":"26","author":"Boomgaarden","year":"2007","journal-title":"Electoral Studies"},{"issue":"4","key":"2024111511003126700_zmae020-B6","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1177\/1940161219862988","article-title":"Digital Technologies and Selective Exposure: How Choice and Filter Bubbles Shape News Media Exposure","volume":"24","author":"Cardenal","year":"2019","journal-title":"The International Journal of Press\/Politics"},{"issue":"7","key":"2024111511003126700_zmae020-B7","doi-asserted-by":"publisher","first-page":"2006","DOI":"10.1016\/j.tele.2018.07.004","article-title":"Challenging Google Search filter bubbles in social and political information: Disconforming evidence from a digital methods case study","volume":"35","author":"Courtois","year":"2018","journal-title":"Telematics and Informatics"},{"key":"2024111511003126700_zmae020-B8","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1007\/978-3-319-46963-8_8","volume-title":"Current Trends in Web Engineering","author":"Cozza","year":"2016"},{"key":"2024111511003126700_zmae020-B9","first-page":"320","volume-title":"Digital Dominance: The Power of Google, Amazon, Facebook, and Apple","author":"Diakopoulos","year":"2018"},{"issue":"6","key":"2024111511003126700_zmae020-B10","doi-asserted-by":"publisher","first-page":"e0268081","DOI":"10.1371\/journal.pone.0268081","article-title":"The Answer Bot Effect (ABE): A powerful new form of influence made possible by intelligent personal assistants and search engines","volume":"17","author":"Epstein","year":"2022","journal-title":"PLOS ONE"},{"issue":"33","key":"2024111511003126700_zmae020-B11","doi-asserted-by":"publisher","first-page":"E4512","DOI":"10.1073\/pnas.1419828112","article-title":"The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections","volume":"112","author":"Epstein","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"S1","key":"2024111511003126700_zmae020-B12","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1093\/poq\/nfw006","article-title":"Filter bubbles, echo chambers, and online news consumption","volume":"80","author":"Flaxman","year":"2016","journal-title":"Public Opinion Quarterly"},{"issue":"7","key":"2024111511003126700_zmae020-B13","doi-asserted-by":"publisher","first-page":"2450","DOI":"10.1177\/1461444817724170","article-title":"Are people incidentally exposed to news on social media? A comparative analysis","volume":"20","author":"Fletcher","year":"2018","journal-title":"New Media & Society"},{"issue":"4","key":"2024111511003126700_zmae020-B14","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1111\/j.1460-2466.2009.01452.x","article-title":"Politically motivated reinforcement seeking: Reframing the selective exposure debate","volume":"59","author":"Garrett","year":"2009","journal-title":"Journal of Communication"},{"issue":"1","key":"2024111511003126700_zmae020-B15","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1609\/icwsm.v17i1.22142","article-title":"Google the gatekeeper: How search components affect clicks and attention","volume":"17","author":"Gleason","year":"2023","journal-title":"Proceedings of the International AAAI Conference on Web and Social Media"},{"year":"2023","author":"Google","key":"2024111511003126700_zmae020-B16"},{"year":"2024","author":"Google","key":"2024111511003126700_zmae020-B17"},{"issue":"7","key":"2024111511003126700_zmae020-B18","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1080\/1461670X.2019.1702892","article-title":"Agent-based testing: An Automated approach toward artificial reactions to human behavior","volume":"21","author":"Haim","year":"2020","journal-title":"Journalism Studies"},{"issue":"2","key":"2024111511003126700_zmae020-B19","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1080\/10410236.2015.1113484","article-title":"Abyss or shelter? On the relevance of web search engines\u2019 search results when people google for suicide","volume":"32","author":"Haim","year":"2017","journal-title":"Health Communication"},{"issue":"3","key":"2024111511003126700_zmae020-B20","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1080\/21670811.2017.1338145","article-title":"Burst of the filter bubble?: Effects of personalization on the diversity of Google News","volume":"6","author":"Haim","year":"2018","journal-title":"Digital Journalism"},{"key":"2024111511003126700_zmae020-B21","doi-asserted-by":"publisher","first-page":"108874","DOI":"10.1016\/j.drugalcdep.2021.108874","article-title":"How search engines may help reduce drug-related suicides","volume":"226","author":"Haim","year":"2021","journal-title":"Drug and Alcohol Dependence"},{"key":"2024111511003126700_zmae020-B22","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1145\/2488388.2488435","author":"Hannak","year":"2013"},{"issue":"50","key":"2024111511003126700_zmae020-B23","doi-asserted-by":"publisher","first-page":"e2213020120","DOI":"10.1073\/pnas.2213020120","article-title":"Auditing YouTube\u2019s recommendation system for ideologically congenial, extreme, and problematic recommendations","volume":"120","author":"Haroon","year":"2023","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"8","key":"2024111511003126700_zmae020-B24","doi-asserted-by":"publisher","first-page":"993","DOI":"10.1080\/21670811.2019.1623700","article-title":"On the democratic role of news recommenders","volume":"7","author":"Helberger","year":"2019","journal-title":"Digital Journalism"},{"key":"2024111511003126700_zmae020-B25","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1145\/3308558.3313654","author":"Hu","year":"2019"},{"key":"2024111511003126700_zmae020-B26","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1145\/2815675.2815714","author":"Kliman-Silver","year":"2015"},{"issue":"2","key":"2024111511003126700_zmae020-B27","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1111\/jcc4.12105","article-title":"Confirmation bias in online searches: Impacts of selective exposure before an election on political attitude strength and shifts","volume":"20","author":"Knobloch-Westerwick","year":"2015","journal-title":"Journal of Computer-Mediated Communication"},{"key":"2024111511003126700_zmae020-B28","doi-asserted-by":"publisher","first-page":"2957","DOI":"10.1145\/3308558.3313682","author":"Le","year":"2019"},{"year":"2023","author":"Loecherbach","key":"2024111511003126700_zmae020-B29"},{"key":"2024111511003126700_zmae020-B30","doi-asserted-by":"publisher","DOI":"10.37016\/mr-2020-017","article-title":"How search engines disseminate information about COVID-19 and why they should do better","author":"Makhortykh","year":"2020","journal-title":"Harvard Kennedy School Misinformation Review."},{"issue":"2","key":"2024111511003126700_zmae020-B31","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1080\/01972243.2022.2152915","article-title":"Searching for politics: Using real-world web search behavior and surveys to see political information searching in context","volume":"39","author":"Menchen-Trevino","year":"2023","journal-title":"The Information Society"},{"key":"2024111511003126700_zmae020-B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/15205436.2023.2173609","article-title":"More of the same? Homogenization in news recommendations when users search on Google, YouTube, Facebook, and Twitter","author":"Nechushtai","year":"2023","journal-title":"Mass Communication and Society"},{"key":"2024111511003126700_zmae020-B33","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1145\/3576840.3578320","author":"Oliveira","year":"2023"},{"issue":"3","key":"2024111511003126700_zmae020-B34","doi-asserted-by":"publisher","first-page":"801","DOI":"10.1111\/j.1083-6101.2007.00351.x","article-title":"In google we trust: Users\u2019 decisions on rank, position, and relevance","volume":"12","author":"Pan","year":"2007","journal-title":"Journal of Computer-Mediated Communication"},{"volume-title":"The Filter Bubble: What The Internet Is Hiding From You","year":"2011","author":"Pariser","key":"2024111511003126700_zmae020-B35"},{"issue":"6","key":"2024111511003126700_zmae020-B36","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1080\/21670811.2018.1539626","article-title":"Beyond the bubble: Assessing the diversity of political search results","volume":"7","author":"Puschmann","year":"2019","journal-title":"Digital Journalism"},{"issue":"7964","key":"2024111511003126700_zmae020-B38","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1038\/s41586-023-06078-5","article-title":"Users choose to engage with more partisan news than they are exposed to on Google Search","volume":"618","author":"Robertson","year":"2023","journal-title":"Nature"},{"key":"2024111511003126700_zmae020-B39","doi-asserted-by":"publisher","first-page":"955","DOI":"10.1145\/3178876.3186143","author":"Robertson","year":"2018"},{"year":"2020","author":"Robertson","key":"2024111511003126700_zmae020-B40"},{"first-page":"1","year":"2014","author":"Sandvig","key":"2024111511003126700_zmae020-B41"},{"key":"2024111511003126700_zmae020-B42","doi-asserted-by":"publisher","DOI":"10.1007\/s42001-024-00283-6","article-title":"Aligning agent-based testing (ABT) with the experimental research paradigm: A literature review and best practices","author":"Schwabl","year":"2024","journal-title":"Journal of Computational Social Science."},{"issue":"8","key":"2024111511003126700_zmae020-B43","doi-asserted-by":"publisher","first-page":"1039","DOI":"10.1177\/00936502211012154","article-title":"Adapting the selective exposure perspective to algorithmically governed platforms: The case of Google Search","volume":"49","author":"Slechten","year":"2022","journal-title":"Communication Research"},{"issue":"2","key":"2024111511003126700_zmae020-B44","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1080\/1369118X.2020.1776367","article-title":"Seek and you shall find? A content analysis on the diversity of five search engines\u2019 results on political queries","volume":"25","author":"Steiner","year":"2022","journal-title":"Information, Communication & Society"},{"issue":"3","key":"2024111511003126700_zmae020-B45","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1007\/s11109-007-9050-9","article-title":"Media use and political predispositions: Revisiting the concept of selective exposure","volume":"30","author":"Stroud","year":"2008","journal-title":"Political Behavior"},{"volume-title":"Republic.com","year":"2001","author":"Sunstein","key":"2024111511003126700_zmae020-B46"},{"issue":"5\u20136","key":"2024111511003126700_zmae020-B47","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1080\/1461670X.2012.664341","article-title":"The Future of personalization at news websites","volume":"13","author":"Thurman","year":"2012","journal-title":"Journalism Studies"},{"key":"2024111511003126700_zmae020-B48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3290605.3300683","author":"Trielli","year":"2019"},{"issue":"1","key":"2024111511003126700_zmae020-B49","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1080\/1369118X.2020.1764605","article-title":"Partisan search behavior and Google results in the 2018 U.S. midterm elections","volume":"25","author":"Trielli","year":"2022","journal-title":"Information, Communication & Society"},{"key":"2024111511003126700_zmae020-B50","doi-asserted-by":"publisher","DOI":"10.1177\/14614448231154926","article-title":"Search engine effects on news consumption: Ranking and representativeness outweigh familiarity in news selection","author":"Ulloa","year":"2023","journal-title":"New Media & Society"},{"issue":"5","key":"2024111511003126700_zmae020-B51","doi-asserted-by":"publisher","first-page":"844","DOI":"10.1177\/0894439319881634","article-title":"Googling politics: Parties, sources, and issue ownerships on google in the 2017 German federal election campaign","volume":"39","author":"Unkel","year":"2021","journal-title":"Social Science Computer Review"},{"issue":"2","key":"2024111511003126700_zmae020-B52","doi-asserted-by":"publisher","first-page":"741","DOI":"10.1007\/s42001-023-00208-9","article-title":"You are how (and where) you search? Comparative analysis of web search behavior using web tracking data","volume":"6","author":"Urman","year":"2023","journal-title":"Journal of Computational Social Science"},{"issue":"5","key":"2024111511003126700_zmae020-B53","doi-asserted-by":"publisher","first-page":"1323","DOI":"10.1177\/08944393211006863","article-title":"The matter of chance: Auditing web search results related to the 2020 U.S. presidential primary elections across six search engines","volume":"40","author":"Urman","year":"2022","journal-title":"Social Science Computer Review"},{"issue":"7","key":"2024111511003126700_zmae020-B54","doi-asserted-by":"publisher","first-page":"3728","DOI":"10.1177\/14614448221104405","article-title":"Searching differently? How political attitudes impact search queries about political issues","volume":"26","author":"van Hoof","year":"2024","journal-title":"New Media & Society"},{"issue":"4","key":"2024111511003126700_zmae020-B55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1852102.1852106","article-title":"A similarity measure for indefinite rankings","volume":"28","author":"Webber","year":"2010","journal-title":"ACM Transactions on Information Systems"},{"issue":"3","key":"2024111511003126700_zmae020-B56","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1111\/jcom.12028","article-title":"Turn a blind eye if you care: Impacts of attitude consistency, importance, and credibility on seeking of political information and implications for attitudes","volume":"63","author":"Westerwick","year":"2013","journal-title":"Journal of Communication"},{"issue":"4","key":"2024111511003126700_zmae020-B57","doi-asserted-by":"publisher","first-page":"860","DOI":"10.1177\/19401612211009160","article-title":"Avenues to news and diverse news exposure online: comparing direct navigation, social media, news aggregators, search queries, and article hyperlinks","volume":"27","author":"Wojcieszak","year":"2022","journal-title":"The International Journal of Press\/Politics"},{"issue":"2","key":"2024111511003126700_zmae020-B58","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1177\/0963662519886474","article-title":"Shifting public engagement: How media coverage of climate change conferences affects climate change audience segments","volume":"29","author":"Wonneberger","year":"2020","journal-title":"Public Understanding of Science"},{"issue":"1","key":"2024111511003126700_zmae020-B59","doi-asserted-by":"crossref","DOI":"10.14763\/2016.1.401","article-title":"Should we worry about filter bubbles?","volume":"5","author":"Zuiderveen Borgesius","year":"2016","journal-title":"Internet Policy Review"}],"container-title":["Journal of Computer-Mediated Communication"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jcmc\/article-pdf\/29\/6\/zmae020\/60680661\/zmae020.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcmc\/article-pdf\/29\/6\/zmae020\/60680661\/zmae020.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,15]],"date-time":"2024-11-15T11:01:30Z","timestamp":1731668490000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcmc\/article\/doi\/10.1093\/jcmc\/zmae020\/7900879"}},"subtitle":[],"editor":[{"given":"Cuihua","family":"Shen","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,9,25]]},"references-count":58,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,9,25]]}},"URL":"https:\/\/doi.org\/10.1093\/jcmc\/zmae020","relation":{},"ISSN":["1083-6101"],"issn-type":[{"type":"electronic","value":"1083-6101"}],"subject":[],"published-other":{"date-parts":[[2024,11]]},"published":{"date-parts":[[2024,9,25]]},"article-number":"zmae020"}}