{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T21:14:47Z","timestamp":1780607687217,"version":"3.54.1"},"reference-count":60,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T00:00:00Z","timestamp":1709769600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T00:00:00Z","timestamp":1709769600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010665","name":"H2020 Marie Sk\u0142odowska-Curie Actions","doi-asserted-by":"publisher","award":["101026507"],"award-info":[{"award-number":["101026507"]}],"id":[{"id":"10.13039\/100010665","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EPJ Data Sci."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we engage with and expand on the keynote talk about the \u201cRight to Audit\u201d given by Prof. Christian Sandvig at the International Conference on Computational Social Science 2021 through a critical reflection on power asymmetries in the algorithm auditing field. We elaborate on the challenges and asymmetries mentioned by Sandvig\u00a0\u2014 such as those related to legal issues and the disparity between early-career and senior researchers. We also contribute a discussion of the asymmetries that were not covered by Sandvig but that we find critically important: those related to other disparities between researchers, incentive structures related to the access to data from companies, targets of auditing and users and their rights. We also discuss the implications these asymmetries have for algorithm auditing research such as the Western-centrism and the lack of the diversity of perspectives. While we focus on the field of algorithm auditing specifically, we suggest some of the discussed asymmetries affect Computational Social Science more generally and need to be reflected on and addressed.<\/jats:p>","DOI":"10.1140\/epjds\/s13688-024-00454-5","type":"journal-article","created":{"date-parts":[[2024,3,7]],"date-time":"2024-03-07T18:25:09Z","timestamp":1709835909000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["The right to audit and power asymmetries in algorithm auditing"],"prefix":"10.1140","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3332-9294","authenticated-orcid":false,"given":"Aleksandra","family":"Urman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ivan","family":"Smirnov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jana","family":"Lasser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,7]]},"reference":[{"key":"454_CR1","doi-asserted-by":"crossref","unstructured":"Columbia. Sandvig v. Barr. Global Freedom of Expression. https:\/\/globalfreedomofexpression.columbia.edu\/cases\/sandvig-v-barr\/. Accessed 16 Dec 2022","DOI":"10.3389\/fncir.2022.1041250"},{"key":"454_CR2","unstructured":"Sanvdig C (2021) Keynote: computational social science and the right to audit. https:\/\/video.ethz.ch\/events\/2021\/ic2s2\/c3472ec5-d2a0-46f9-9e33-53dd6cd3cc51.html. Accessed 16 Dec 2022"},{"key":"454_CR3","first-page":"4991","volume":"10","author":"B Mittelstadt","year":"2016","unstructured":"Mittelstadt B (2016) Automation, algorithms, and politics | auditing for transparency in content personalization systems. Int J Commun 10:4991\u201350002","journal-title":"Int J Commun"},{"key":"454_CR4","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1145\/2488388.2488435","volume-title":"Proceedings of the 22nd international conference on world wide web","author":"A Hannak","year":"2013","unstructured":"Hannak A et al. (2013) Measuring personalization of web search. In: Proceedings of the 22nd international conference on world wide web, New York, NY, USA, pp\u00a0527\u2013538. https:\/\/doi.org\/10.1145\/2488388.2488435"},{"issue":"CSCW1","key":"454_CR5","doi-asserted-by":"publisher","first-page":"74:1","DOI":"10.1145\/3449148","volume":"5","author":"J Bandy","year":"2021","unstructured":"Bandy J (2021) Problematic machine behavior: a systematic literature review of algorithm audits. Proc ACM Hum-Comput Interact 5(CSCW1):74:1\u201374:34. https:\/\/doi.org\/10.1145\/3449148","journal-title":"Proc ACM Hum-Comput Interact"},{"key":"454_CR6","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-319-71153-9_1","volume-title":"Audit studies: behind the scenes with theory, method, and nuance","author":"SM Gaddis","year":"2018","unstructured":"Gaddis SM (2018) An introduction to audit studies in the social sciences. In: Gaddis SM (ed) Audit studies: behind the scenes with theory, method, and nuance. Springer, Cham, pp\u00a03\u201344. https:\/\/doi.org\/10.1007\/978-3-319-71153-9_1"},{"issue":"4","key":"454_CR7","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1111\/j.1559-1816.1971.tb00373.x","volume":"1","author":"DA Johnson","year":"1971","unstructured":"Johnson DA, Porter RJ, Mateljan PL (1971) Racial discrimination in apartment rentals. J Appl Soc Psychol 1(4):364\u2013377. https:\/\/doi.org\/10.1111\/j.1559-1816.1971.tb00373.x","journal-title":"J Appl Soc Psychol"},{"issue":"41","key":"454_CR8","doi-asserted-by":"publisher","first-page":"16474","DOI":"10.1073\/pnas.1211286109","volume":"109","author":"CA Moss-Racusin","year":"2012","unstructured":"Moss-Racusin CA, Dovidio JF, Brescoll VL, Graham MJ, Handelsman J (2012) Science faculty\u2019s subtle gender biases favor male students. Proc Natl Acad Sci 109(41):16474\u201316479. https:\/\/doi.org\/10.1073\/pnas.1211286109","journal-title":"Proc Natl Acad Sci"},{"issue":"1","key":"454_CR9","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1093\/esr\/jcz045","volume":"36","author":"A Bessudnov","year":"2020","unstructured":"Bessudnov A, Shcherbak A (2020) Ethnic discrimination in multi-ethnic societies: evidence from Russia. Eur Sociol Rev 36(1):104\u2013120. https:\/\/doi.org\/10.1093\/esr\/jcz045","journal-title":"Eur Sociol Rev"},{"issue":"1","key":"454_CR10","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1177\/0002716206294796","volume":"609","author":"D Pager","year":"2007","unstructured":"Pager D (2007) The use of field experiments for studies of employment discrimination: contributions, critiques, and directions for the future. Ann Am Acad Polit Soc Sci 609(1):104\u2013133. https:\/\/doi.org\/10.1177\/0002716206294796","journal-title":"Ann Am Acad Polit Soc Sci"},{"key":"454_CR11","doi-asserted-by":"publisher","first-page":"2298","DOI":"10.1145\/3485447.3512102","volume-title":"Proceedings of the ACM web conference 2022","author":"M Boeker","year":"2022","unstructured":"Boeker M, Urman A (2022) An empirical investigation of personalization factors on TikTok. In: Proceedings of the ACM web conference 2022, New York, NY, USA, pp\u00a02298\u20132309. https:\/\/doi.org\/10.1145\/3485447.3512102"},{"key":"454_CR12","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1145\/2663716.2663744","volume-title":"Proceedings of the 2014 conference on Internet measurement conference","author":"A Hannak","year":"2014","unstructured":"Hannak A, Soeller G, Lazer D, Mislove A, Wilson C (2014) Measuring price discrimination and steering on E-commerce web sites. In: Proceedings of the 2014 conference on Internet measurement conference, New York, NY, USA, pp\u00a0305\u2013318. https:\/\/doi.org\/10.1145\/2663716.2663744"},{"issue":"14","key":"454_CR13","doi-asserted-by":"publisher","first-page":"2690","DOI":"10.1080\/1369118X.2022.2097017","volume":"26","author":"S Scherr","year":"2023","unstructured":"Scherr S, Arendt F, Haim M (2023) Algorithms without frontiers? How language-based algorithmic information disparities for suicide crisis information sustain digital divides over time in 17 countries. Inf Commun Soc 26(14):2690\u20132706. https:\/\/doi.org\/10.1080\/1369118X.2022.2097017","journal-title":"Inf Commun Soc"},{"issue":"CSCW1","key":"454_CR14","doi-asserted-by":"publisher","first-page":"83:1","DOI":"10.1145\/3449157","volume":"5","author":"HK Dambanemuya","year":"2021","unstructured":"Dambanemuya HK, Diakopoulos N (2021) Auditing the information quality of news-related queries on the Alexa voice assistant. Proc ACM Hum-Comput Interact 5(CSCW1):83:1\u201383:21. https:\/\/doi.org\/10.1145\/3449157","journal-title":"Proc ACM Hum-Comput Interact"},{"issue":"3","key":"454_CR15","doi-asserted-by":"publisher","DOI":"10.1177\/20563051211041648","volume":"7","author":"J Bandy","year":"2021","unstructured":"Bandy J, Diakopoulos N (2021) Curating quality? How Twitter\u2019s timeline algorithm treats different types of news. Soc Media Soc 7(3):20563051211041650. https:\/\/doi.org\/10.1177\/20563051211041648","journal-title":"Soc Media Soc"},{"key":"454_CR16","doi-asserted-by":"publisher","DOI":"10.18574\/nyu\/9781479833641.001.0001","volume-title":"Algorithms of oppression: how search engines reinforce racism","author":"SU Noble","year":"2018","unstructured":"Noble SU (2018) Algorithms of oppression: how search engines reinforce racism. NYU Press, New York"},{"key":"454_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.tele.2022.101860","volume":"72","author":"A Urman","year":"2022","unstructured":"Urman A, Makhortykh M, Ulloa R, Kulshrestha J (2022) Where the Earth is flat and 9\/11 is an inside job: a comparative algorithm audit of conspiratorial information in web search results. Telemat Inform 72:101860. https:\/\/doi.org\/10.1016\/j.tele.2022.101860","journal-title":"Telemat Inform"},{"issue":"1","key":"454_CR18","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1007\/s43681-021-00117-5","volume":"2","author":"P Ugwudike","year":"2022","unstructured":"Ugwudike P (2022) AI audits for assessing design logics and building ethical systems: the case of predictive policing algorithms. AI Ethics 2(1):199\u2013208. https:\/\/doi.org\/10.1007\/s43681-021-00117-5","journal-title":"AI Ethics"},{"key":"454_CR19","volume-title":"The sociology of debt","author":"F Mark","year":"2020","unstructured":"Mark F (2020) The sociology of debt. Policy Press, Bristol"},{"issue":"3","key":"454_CR20","doi-asserted-by":"publisher","DOI":"10.3390\/jintelligence9030046","volume":"9","author":"E Kazim","year":"2021","unstructured":"Kazim E, Koshiyama AS, Hilliard A, Polle R (2021) Systematizing audit in algorithmic recruitment. J Intell 9(3):Art. no. 3. https:\/\/doi.org\/10.3390\/jintelligence9030046","journal-title":"J Intell"},{"key":"454_CR21","unstructured":"Maxwell A. Spotify threatened researchers who revealed \u2018pirate\u2019 history * TorrentFreak. https:\/\/torrentfreak.com\/spotify-threatened-researchers-who-revealed-pirate-history-171006\/. Accessed 18 Nov 2022"},{"key":"454_CR22","unstructured":"Wei P (2020) Remembering Aaron Swartz\u2019s legacy in light of JSTOR opening access. The Stanford Daily. https:\/\/stanforddaily.com\/2020\/03\/27\/remembering-aaron-swartzs-legacy-in-light-of-jstor-opening-access\/. Accessed 18 Nov 2022"},{"key":"454_CR23","unstructured":"Scott M (2021) Facebook\u2019s attempt to ban academics runs into trouble. POLITICO. https:\/\/www.politico.eu\/article\/facebook-nyu-laura-edelson-political-ads\/. Accessed 18 Nov 2022"},{"key":"454_CR24","unstructured":"Claburn T. Once again, Facebook champions privacy \u2026 of its algorithms: independent probe into Instagram shut down. https:\/\/www.theregister.com\/2021\/08\/13\/algorithmwatch_shut_down\/. Accessed 18 Nov 2022"},{"key":"454_CR25","unstructured":"Vaughan-Nichols S (2022) Court rules that data scraping is legal in LinkedIn appeal. ZDNET. https:\/\/www.zdnet.com\/article\/court-rules-that-data-scraping-is-legal-in-linkedin-appeal\/. Accessed 18 Nov 2022"},{"key":"454_CR26","unstructured":"Gilens N, Williams J (2020) Federal judge rules it is not a crime to violate a website\u2019s terms of service. Electronic Frontier Foundation. https:\/\/www.eff.org\/deeplinks\/2020\/04\/federal-judge-rules-it-not-crime-violate-websites-terms-service. Accessed 18 Nov 2022"},{"issue":"1","key":"454_CR27","first-page":"385","volume":"37","author":"BZ Mund","year":"2018","unstructured":"Mund BZ (2018) Protecting deceptive academic research under the computer fraud and abuse act. Yale Law Policy Rev 37(1):385\u2013403","journal-title":"Yale Law Policy Rev"},{"key":"454_CR28","unstructured":"Patel KS. Testing the limits of the first amendment: how online civil rights testing is protected speech activity. Columbia Law Review. https:\/\/columbialawreview.org\/content\/testing-the-limits-of-the-first-amendment-how-online-civil-rights-testing-is-protected-speech-activity\/. Accessed 06 Feb 2024"},{"key":"454_CR29","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/978-94-6265-523-2_10","volume-title":"Law and artificial intelligence: regulating AI and applying AI in legal practice","author":"C Laupman","year":"2022","unstructured":"Laupman C, Schippers L-M, Papal\u00e9o Gagliardi M (2022) Biased algorithms and the discrimination upon immigration policy. In: Custers B, Fosch-Villaronga E (eds) Law and artificial intelligence: regulating AI and applying AI in legal practice. T.M.C. Asser Press, The Hague, pp\u00a0187\u2013204. https:\/\/doi.org\/10.1007\/978-94-6265-523-2_10"},{"key":"454_CR30","unstructured":"ResearchGate. Terms of service. ResearchGate. https:\/\/www.researchgate.net\/terms-of-service. Accessed 24 Nov 2022"},{"key":"454_CR31","unstructured":"Google. Requirements for third-party ad serving\u00a0\u2014 advertising policies help. https:\/\/support.google.com\/adspolicy\/answer\/94230?#zippy=%2Cresearch. Accessed 06 Feb 2024"},{"key":"454_CR32","unstructured":"Tosdr. Frontpage\u00a0\u2014 terms of service; didn\u2019t read. https:\/\/tosdr.org\/. Accessed 06 Feb 2024"},{"key":"454_CR33","unstructured":"TikTok. Terms of service | TikTok. https:\/\/www.tiktok.com\/legal\/page\/eea\/terms-of-service\/en. Accessed 24 Nov 2022"},{"key":"454_CR34","unstructured":"European Commission. The Digital Services Act package | Shaping Europe\u2019s digital future. https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/digital-services-act-package. Accessed 24 Nov 2022"},{"issue":"2","key":"454_CR35","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1093\/sf\/sox052","volume":"96","author":"K Weisshaar","year":"2017","unstructured":"Weisshaar K (2017) Publish and perish? An assessment of gender gaps in promotion to tenure in academia. Soc Forces 96(2):529\u2013560. https:\/\/doi.org\/10.1093\/sf\/sox052","journal-title":"Soc Forces"},{"issue":"4","key":"454_CR36","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1002\/soej.12567","volume":"88","author":"J Chen","year":"2022","unstructured":"Chen J, Liu Q, Kim M (2022) Gender gap in tenure and promotion: evidence from the economics Ph.D. class of 2008. South Econ J 88(4):1277\u20131312. https:\/\/doi.org\/10.1002\/soej.12567","journal-title":"South Econ J"},{"key":"454_CR37","unstructured":"Social Science One (2021) Social science one URLs RFP. Google Docs. https:\/\/docs.google.com\/document\/d\/1zu6NdHM_KXoOskCt32W4Zp_t9QL_o4depOUxwV15pOw\/edit?usp=sharing&usp=embed_facebook. Accessed 24 Nov 2022"},{"issue":"2","key":"454_CR38","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1080\/07294360.2019.1666257","volume":"39","author":"FS Stein\u00fe\u00f3rsd\u00f3ttir","year":"2020","unstructured":"Stein\u00fe\u00f3rsd\u00f3ttir FS, Einarsd\u00f3ttir \u00de, P\u00e9tursd\u00f3ttir GM, Himmelweit S (2020) Gendered inequalities in competitive grant funding: an overlooked dimension of gendered power relations in academia. High Educ Res Dev 39(2):362\u2013375. https:\/\/doi.org\/10.1080\/07294360.2019.1666257","journal-title":"High Educ Res Dev"},{"key":"454_CR39","unstructured":"Nelson A, Rhody J. The Social Science Research Council announces the first recipients of the social media and democracy research grants. Items. https:\/\/items.ssrc.org\/from-our-programs\/social-media-and-democracy-research-grants-grantees\/. Accessed 24 Nov 2022"},{"key":"454_CR40","unstructured":"Reuters (2023) Musk\u2019s X sues nonprofit that fights hate-speech. Reuters. https:\/\/www.reuters.com\/legal\/musks-x-sues-nonprofit-that-fights-hate-speech-2023-08-01\/. Accessed 11 Jan 2024"},{"issue":"6656","key":"454_CR41","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1126\/science.ade7138","volume":"381","author":"S Gonz\u00e1lez-Bail\u00f3n","year":"2023","unstructured":"Gonz\u00e1lez-Bail\u00f3n S et al. (2023) Asymmetric ideological segregation in exposure to political news on Facebook. Science 381(6656):392\u2013398. https:\/\/doi.org\/10.1126\/science.ade7138","journal-title":"Science"},{"issue":"6656","key":"454_CR42","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1126\/science.adi2430","volume":"381","author":"MW Wagner","year":"2023","unstructured":"Wagner MW (2023) Independence by permission. Science 381(6656):388\u2013391. https:\/\/doi.org\/10.1126\/science.adi2430","journal-title":"Science"},{"issue":"6","key":"454_CR43","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1080\/21670811.2018.1539626","volume":"7","author":"C Puschmann","year":"2019","unstructured":"Puschmann C (2019) Beyond the bubble: assessing the diversity of political search results. Dig Journal 7(6):824\u2013843. https:\/\/doi.org\/10.1080\/21670811.2018.1539626","journal-title":"Dig Journal"},{"issue":"3","key":"454_CR44","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1080\/21670811.2017.1338145","volume":"6","author":"M Haim","year":"2018","unstructured":"Haim M, Graefe A, Brosius H-B (2018) Burst of the filter bubble?: effects of personalization on the diversity of Google news. Dig Journal 6(3):330\u2013343. https:\/\/doi.org\/10.1080\/21670811.2017.1338145","journal-title":"Dig Journal"},{"issue":"5","key":"454_CR45","doi-asserted-by":"publisher","first-page":"844","DOI":"10.1177\/0894439319881634","volume":"39","author":"J Unkel","year":"2021","unstructured":"Unkel J, Haim M (2021) Googling politics: parties, sources, and issue ownerships on Google in the 2017 German federal election campaign. Soc Sci Comput Rev 39(5):844\u2013861. https:\/\/doi.org\/10.1177\/0894439319881634","journal-title":"Soc Sci Comput Rev"},{"key":"454_CR46","doi-asserted-by":"publisher","unstructured":"Makhortykh M, Urman A, Ulloa R (2021) Hey, Google, is it what the Holocaust looked like?: auditing algorithmic curation of visual historical content on web search engines. First Monday. https:\/\/doi.org\/10.5210\/fm.v26i10.11562","DOI":"10.5210\/fm.v26i10.11562"},{"key":"454_CR47","doi-asserted-by":"publisher","unstructured":"Makhortykh M, Urman A, Wijermars M (2022) A story of (non)compliance, bias, and conspiracies: how Google and Yandex represented Smart Voting during the 2021 parliamentary elections in Russia. Harv Kennedy Sch Misinformation Rev. https:\/\/doi.org\/10.37016\/mr-2020-94","DOI":"10.37016\/mr-2020-94"},{"key":"454_CR48","doi-asserted-by":"publisher","unstructured":"Makhortykh M, Urman A, Ulloa R (2022) This is what a pandemic looks like: visual framing of COVID-19 on search engines. https:\/\/doi.org\/10.48550\/arXiv.2209.11120","DOI":"10.48550\/arXiv.2209.11120"},{"issue":"2","key":"454_CR49","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1177\/1461444813481196","volume":"16","author":"M Jiang","year":"2014","unstructured":"Jiang M (2014) The business and politics of search engines: a comparative study of Baidu and Google\u2019s search results of Internet events in China. New Media Soc 16(2):212\u2013233. https:\/\/doi.org\/10.1177\/1461444813481196","journal-title":"New Media Soc"},{"issue":"15","key":"454_CR50","doi-asserted-by":"publisher","first-page":"2207","DOI":"10.1080\/1369118X.2021.1933563","volume":"25","author":"D Kravets","year":"2022","unstructured":"Kravets D, Toepfl F (2022) Gauging reference and source bias over time: how Russia\u2019s partially state-controlled search engine Yandex mediated an anti-regime protest event. Inf Commun Soc 25(15):2207\u20132223. https:\/\/doi.org\/10.1080\/1369118X.2021.1933563","journal-title":"Inf Commun Soc"},{"issue":"10","key":"454_CR51","doi-asserted-by":"publisher","first-page":"2033","DOI":"10.1080\/1369118X.2022.2065213","volume":"26","author":"F Toepfl","year":"2023","unstructured":"Toepfl F, Kravets D, Ryzhova A, Beseler A (2023) Who are the plotters behind the pandemic? Comparing Covid-19 conspiracy theories in Google search results across five key target countries of Russia\u2019s foreign communication. Inf Commun Soc 26(10):2033\u20132051. https:\/\/doi.org\/10.1080\/1369118X.2022.2065213","journal-title":"Inf Commun Soc"},{"issue":"1","key":"454_CR52","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1177\/0163443718764565","volume":"41","author":"A Zavadski","year":"2019","unstructured":"Zavadski A, Toepfl F (2019) Querying the Internet as a mnemonic practice: how search engines mediate four types of past events in Russia. Media Cult Soc 41(1):21\u201337. https:\/\/doi.org\/10.1177\/0163443718764565","journal-title":"Media Cult Soc"},{"key":"454_CR53","unstructured":"Nguyen N, Scurato C (2021) Facebook and YouTube\u2019s refusal to moderate misinformation in global languages harms communities of color. Prism. http:\/\/prismreports.org\/2021\/11\/02\/facebook-and-youtubes-refusal-to-moderate-misinformation-in-global-languages-harms-communities-of-color\/. Accessed 24 Nov 2022"},{"issue":"6656","key":"454_CR54","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1126\/science.abp9364","volume":"381","author":"AM Guess","year":"2023","unstructured":"Guess AM et al. (2023) How do social media feed algorithms affect attitudes and behavior in an election campaign? Science 381(6656):398\u2013404. https:\/\/doi.org\/10.1126\/science.abp9364","journal-title":"Science"},{"issue":"7972","key":"454_CR55","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-023-06297-w","volume":"620","author":"B Nyhan","year":"2023","unstructured":"Nyhan B et al. (2023) Like-minded sources on Facebook are prevalent but not polarizing. Nature 620(7972):Art. no. 7972. https:\/\/doi.org\/10.1038\/s41586-023-06297-w","journal-title":"Nature"},{"key":"454_CR56","unstructured":"Sandvig C, Hamilton K, Karahalios K, Langbort C. Auditing algorithms: research methods for detecting discrimination on Internet platforms, p\u00a023"},{"issue":"7","key":"454_CR57","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1080\/1461670X.2019.1702892","volume":"21","author":"M Haim","year":"2020","unstructured":"Haim M (2020) Agent-based testing: an automated approach toward artificial reactions to human behavior. J Stud 21(7):895\u2013911. https:\/\/doi.org\/10.1080\/1461670X.2019.1702892","journal-title":"J Stud"},{"key":"454_CR58","doi-asserted-by":"publisher","unstructured":"Ulloa R, Makhortykh M, Urman A (2022) Scaling up search engine audits: practical insights for algorithm auditing. J Inf Sci, 01655515221093029. https:\/\/doi.org\/10.1177\/01655515221093029","DOI":"10.1177\/01655515221093029"},{"key":"454_CR59","unstructured":"Leyden J (2021) Ill-advised research on Linux kernel lands computer scientists in hot water. The Daily Swig | Cybersecurity news and views. https:\/\/portswigger.net\/daily-swig\/ill-advised-research-on-linux-kernel-lands-computer-scientists-in-hot-water. Accessed 24 Nov 2022"},{"key":"454_CR60","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3491102.3517441","volume-title":"Proceedings of the 2022 CHI conference on human factors in computing systems","author":"A DeVos","year":"2022","unstructured":"DeVos A, Dhabalia A, Shen H, Holstein K, Eslami M (2022) Toward user-driven algorithm auditing: investigating users\u2019 strategies for uncovering harmful algorithmic behavior. In: Proceedings of the 2022 CHI conference on human factors in computing systems, New York, NY, USA, pp\u00a01\u201319. https:\/\/doi.org\/10.1145\/3491102.3517441"}],"container-title":["EPJ Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-024-00454-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1140\/epjds\/s13688-024-00454-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1140\/epjds\/s13688-024-00454-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,10]],"date-time":"2024-03-10T20:01:47Z","timestamp":1710100907000},"score":1,"resource":{"primary":{"URL":"https:\/\/epjdatascience.springeropen.com\/articles\/10.1140\/epjds\/s13688-024-00454-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,7]]},"references-count":60,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["454"],"URL":"https:\/\/doi.org\/10.1140\/epjds\/s13688-024-00454-5","relation":{},"ISSN":["2193-1127"],"issn-type":[{"value":"2193-1127","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,7]]},"assertion":[{"value":"21 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"19"}}