{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T07:45:12Z","timestamp":1782287112285,"version":"3.54.5"},"reference-count":103,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T00:00:00Z","timestamp":1681430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSF grant","award":["1916153, 1943584"],"award-info":[{"award-number":["1916153, 1943584"]}]},{"DOI":"10.13039\/100001825","name":"The Rose Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100001825","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,4,14]]},"abstract":"<jats:p>Social media platforms curate access to information and opportunities, and so play a critical role in shaping public discourse today. The opaque nature of the algorithms these platforms use to curate content raises societal questions. Prior studies have used black-box methods led by experts or collaborative audits driven by everyday users to show that these algorithms can lead to biased or discriminatory outcomes. However, existing auditing methods face fundamental limitations because they function independent of the platforms. Concerns of potential harmful outcomes have prompted proposal of legislation in both the U.S. and the E.U. to mandate a new form of auditing where vetted external researchers get privileged access to social media platforms. Unfortunately, to date there have been no concrete technical proposals to provide such auditing, because auditing at scale risks disclosure of users' private data and platforms' proprietary algorithms. We propose a new method for platform-supported auditing that can meet the goals of the proposed legislation. The first contribution of our work is to enumerate the challenges and the limitations of existing auditing methods to implement these policies at scale. Second, we suggest that limited, privileged access to relevance estimators is the key to enabling generalizable platform-supported auditing of social media platforms by external researchers. Third, we show platform-supported auditing need not risk user privacy nor disclosure of platforms' business interests by proposing an auditing framework that protects against these risks. For a particular fairness metric, we show that ensuring privacy imposes only a small constant factor increase (6.34x as an upper bound, and 4\u00d7 for typical parameters) in the number of samples required for accurate auditing. Our technical contributions, combined with ongoing legal and policy efforts, can enable public oversight into how social media platforms affect individuals and society by moving past the privacy-vs-transparency hurdle.<\/jats:p>","DOI":"10.1145\/3579610","type":"journal-article","created":{"date-parts":[[2023,4,16]],"date-time":"2023-04-16T17:23:07Z","timestamp":1681665787000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Having your Privacy Cake and Eating it Too: Platform-supported Auditing of Social Media Algorithms for Public Interest"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6645-7850","authenticated-orcid":false,"given":"Basileal","family":"Imana","sequence":"first","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8237-9058","authenticated-orcid":false,"given":"Aleksandra","family":"Korolova","sequence":"additional","affiliation":[{"name":"Princeton University, Princeton, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1225-7562","authenticated-orcid":false,"given":"John","family":"Heidemann","sequence":"additional","affiliation":[{"name":"University of Southern California, Marina del Rey, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,4,16]]},"reference":[{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359301"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441801"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445888"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7276"},{"key":"e_1_2_1_6_1","volume-title":"November","author":"Austin R. L.","year":"2021","unstructured":"Austin, R. L. Race Data Measurement and Meta's Commitment to Fair and Inclusive Products. Meta blog. https:\/\/about.fb.com\/news\/2021\/11\/inclusive-products-through-race-data-measurement, November 2021."},{"key":"e_1_2_1_7_1","volume-title":"June","author":"Austin R. L.","year":"2022","unstructured":"Austin, R. L. Expanding our work on ads fairness. https:\/\/about.fb.com\/news\/2022\/06\/expanding-our-work-on-ads-fairness\/, June 2022."},{"key":"e_1_2_1_8_1","volume-title":"January","author":"Austin R. L.","year":"2023","unstructured":"Austin, R. L. An update on our ads fairness efforts. https:\/\/about.fb.com\/news\/2023\/01\/an-update-on-our-ads-fairness-efforts\/, January 2023."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449148"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447535.3462491"},{"key":"e_1_2_1_11_1","volume-title":"September","author":"Twitter","year":"2020","unstructured":"BBC. Twitter investigates racial bias in image previews. https:\/\/www.bbc.com\/news\/technology-54234822, September 2020."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343038"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV51458.2022.00158"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372877"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372877"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2011.40"},{"key":"e_1_2_1_17_1","volume-title":"July","author":"Chowdhury R.","year":"2021","unstructured":"Chowdhury, R., and Williams, J. Introducing Twitter's first algorithmic bias bounty challenge. https:\/\/blog.twitter.com\/engineering\/en_us\/topics\/insights\/2021\/algorithmic-bias-bounty-challenge, July 2021."},{"key":"e_1_2_1_18_1","volume-title":"August","author":"Clark M.","year":"2021","unstructured":"Clark, M. Research cannot be the justification for compromising people's privacy. https:\/\/about.fb.com\/news\/2021\/08\/research-cannot-be-the-justification-for-compromising-peoples-privacy\/, August 2021."},{"key":"e_1_2_1_19_1","volume-title":"Algorithmic Accountability Act of","author":"Clarke Y.","year":"2019","unstructured":"Clarke, Y. Algorithmic Accountability Act of 2019. https:\/\/www.congress.gov\/bill\/116th-congress\/house-bill\/2231, April 2021."},{"key":"e_1_2_1_20_1","volume-title":"Platform Accountability and Transparency Act. https:\/\/www.coons.senate.gov\/imo\/media\/doc\/text_pata_117.pdf","author":"Coons C.","year":"2021","unstructured":"Coons, C., Portman, R., and Klobuchar, A. Platform Accountability and Transparency Act. https:\/\/www.coons.senate.gov\/imo\/media\/doc\/text_pata_117.pdf, 2021."},{"key":"e_1_2_1_21_1","volume-title":"December","author":"Coons C.","year":"2022","unstructured":"Coons, C., Portman, R., Klobuchar, A., and Cassidy, B. Platform Accountability and Transparency Act. https:\/\/www.coons.senate.gov\/news\/press-releases\/senator-coons-colleagues-introduce-legislation-to-provide-public-with-transparency-of-social-media-platforms, December 2022."},{"key":"e_1_2_1_22_1","volume-title":"Discrimination in online personalization: A multidisciplinary inquiry. FAT","author":"Datta A.","year":"2018","unstructured":"Datta, A., Datta, A., Makagon, J., Mulligan, D. K., and Tschantz, M. C. Discrimination in online personalization: A multidisciplinary inquiry. FAT (2018)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2015-0007"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517441"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i6.20606"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/11681878_14"},{"key":"e_1_2_1_27_1","volume-title":"The algorithmic foundations of differential privacy. Foundations and Trends in Theoretical Computer Science","author":"Dwork C.","year":"2014","unstructured":"Dwork, C., and Roth, A. The algorithmic foundations of differential privacy. Foundations and Trends in Theoretical Computer Science (2014)."},{"key":"e_1_2_1_28_1","volume-title":"Universal digital ad transparency. Available at SSRN 3898214","author":"Edelson L.","year":"2021","unstructured":"Edelson, L., Chuang, J., Franklin Fowler, E., Franz, M., and Ridout, T. N. Universal digital ad transparency. Available at SSRN 3898214 (2021)."},{"key":"e_1_2_1_29_1","volume-title":"An analysis of United States online political advertising transparency. arXiv preprint arXiv:1902.04385","author":"Edelson L.","year":"2019","unstructured":"Edelson, L., Sakhuja, S., Dey, R., and McCoy, D. An analysis of United States online political advertising transparency. arXiv preprint arXiv:1902.04385 (2019)."},{"key":"e_1_2_1_30_1","volume-title":"29 c.f.r. \u00a71607.4(d)","author":"Uniform","year":"2018","unstructured":"EEOC. Uniform guidelines on employment selection procedures, 29 c.f.r. \u00a71607.4(d), 2018."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300724"},{"key":"e_1_2_1_32_1","volume-title":"April","author":"European Commission","year":"2021","unstructured":"European Commission. Artificial intelligence act. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A52021PC0206, April 2021."},{"key":"e_1_2_1_33_1","volume-title":"October","author":"European Commission","year":"2022","unstructured":"European Commission. The Digital Services Act (DSA). https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A32022R2065&qid=1666857835014, October 2022."},{"key":"e_1_2_1_34_1","volume-title":"October","author":"European Commission","year":"2022","unstructured":"European Commission. The Digital Services Act package. https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/digital-services-act-package, October 2022."},{"key":"e_1_2_1_35_1","unstructured":"Facebook. How Facebook distributes content. https:\/\/www.facebook.com\/business\/help\/718033381901819?id=208060977200861."},{"key":"e_1_2_1_36_1","volume-title":"October","author":"Facebook","year":"2021","unstructured":"Facebook. About ad auctions. https:\/\/www.facebook.com\/business\/help\/430291176997542?id=561906377587030, October 2021."},{"key":"e_1_2_1_37_1","volume-title":"Facebook Open Research & Transparency. https:\/\/fort.fb.com\/","author":"Facebook","year":"2022","unstructured":"Facebook. Facebook Open Research & Transparency. https:\/\/fort.fb.com\/, 2022."},{"key":"e_1_2_1_38_1","volume-title":"Privacy aware experimentation over sensitive groups: A general chi square approach. arXiv preprint arXiv:2208.08564","author":"Friedberg R.","year":"2022","unstructured":"Friedberg, R., and Rogers, R. Privacy aware experimentation over sensitive groups: A general chi square approach. arXiv preprint arXiv:2208.08564 (2022)."},{"key":"e_1_2_1_39_1","volume-title":"Advertising for demographically fair outcomes","author":"Gelauff L.","year":"2020","unstructured":"Gelauff, L., Goel, A., Munagala, K., and Yandamuri, S. Advertising for demographically fair outcomes, 2020."},{"key":"e_1_2_1_40_1","volume-title":"Facebook Knows Instagram Is Toxic for Teen Girls","author":"Georgia Wells J. H.","year":"2073","unstructured":"Georgia Wells, J. H., and Seetharaman, D. Facebook Knows Instagram Is Toxic for Teen Girls, Company Documents Show. https:\/\/www.wsj.com\/articles\/facebook-knows-instagram-is-toxic-for-teen-girls-company-documents-show-11631620739, September 2021."},{"key":"e_1_2_1_41_1","volume-title":"January","author":"Goodwin D.","year":"2023","unstructured":"Goodwin, D. Yandex ?leak' reveals 1,922 search ranking factors. https:\/\/searchengineland.com\/yandex-search-ranking-factors-leak-392323, January 2023."},{"key":"e_1_2_1_42_1","volume-title":"February","author":"Graham M.","year":"2021","unstructured":"Graham, M. Facebook knew ad metrics were inflated, but ignored the problem to make more money, lawsuit claims. https:\/\/www.cnbc.com\/2021\/02\/18\/facebook-knew-ad-metrics-were-inflated-but-ignored-the-problem-lawsuit-claims.html, February 2021."},{"key":"e_1_2_1_43_1","volume-title":"Neural Information Processing Systems (NIPS)","author":"Hardt M.","year":"2016","unstructured":"Hardt, M., Price, E., and Srebro, N. Equality of opportunity in supervised learning. In Neural Information Processing Systems (NIPS) (2016)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASONAM.2018.8508659"},{"key":"e_1_2_1_45_1","volume-title":"Youtube, the great radicalizer? auditing and mitigating ideological biases in youtube recommendations","author":"Haroon M.","year":"2022","unstructured":"Haroon, M., Chhabra, A., Liu, X., Mohapatra, P., Shafiq, Z., and Wojcieszak, M. Youtube, the great radicalizer? auditing and mitigating ideological biases in youtube recommendations, 2022."},{"key":"e_1_2_1_46_1","volume-title":"February","author":"Hill K.","year":"2012","unstructured":"Hill, K. How Target figured out a teen girl was pregnant before her father did. https:\/\/www.forbes.com\/sites\/kashmirhill\/2012\/02\/16\/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did\/, February 2012."},{"key":"e_1_2_1_47_1","volume-title":"August","author":"Hill K.","year":"2018","unstructured":"Hill, K. 'People You May Know:' A Controversial Facebook Feature's 10-Year History. https:\/\/gizmodo.com\/people-you-may-know-a-controversial-facebook-features-1827981959, August 2018."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1963.10500830"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_2_1_50_1","volume-title":"October","author":"Horwitz J.","year":"2020","unstructured":"Horwitz, J. Facebook seeks shutdown of nyu research project into political ad targeting. https:\/\/www.wsj.com\/articles\/facebook-seeks-shutdown-of-nyu-research-project-into-political-ad-targeting-11603488533, October 2020."},{"key":"e_1_2_1_51_1","volume-title":"May","author":"Horwitz J.","year":"2020","unstructured":"Horwitz, J., and Seetharaman, D. Facebook executives shut down efforts to make the site less divisive. https:\/\/www.wsj.com\/articles\/facebook-knows-it-encourages-division-top-executives-nixed-solutions-11590507499, May 2020."},{"key":"e_1_2_1_52_1","volume-title":"Integration of social media into hrm practices: a bibliometric overview. PSU Research Review (April","author":"Hosain M. S.","year":"2021","unstructured":"Hosain, M. S. Integration of social media into hrm practices: a bibliometric overview. PSU Research Review (April 2021)."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2025334119"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3450077"},{"key":"e_1_2_1_55_1","volume-title":"Algorithmic Fairness through the Lens of Causality and Privacy: A hybrid NeurIPS 2022 Workshop","author":"Juarez M.","year":"2022","unstructured":"Juarez, M., and Korolova, A. \"You Can't Fix What You Can't Measure\": Privately Measuring Demographic Performance Disparities in Federated Learning. In Algorithmic Fairness through the Lens of Causality and Privacy: A hybrid NeurIPS 2022 Workshop (2022)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1002\/joe.21930"},{"key":"e_1_2_1_57_1","volume-title":"September","author":"Kalley Huang Z","year":"2022","unstructured":"Kalley Huang. For Gen Z, TikTok Is the New Search Engine. https:\/\/www.nytimes.com\/2022\/09\/16\/technology\/gen-z-tiktok-search-engine.html, September 2022."},{"key":"e_1_2_1_58_1","volume-title":"Digital 2021: Global overview report. https:\/\/datareportal.com\/reports\/digital-2021-global-overview-report","author":"Kemp S.","year":"2021","unstructured":"Kemp, S. Digital 2021: Global overview report. https:\/\/datareportal.com\/reports\/digital-2021-global-overview-report, 2021."},{"key":"e_1_2_1_59_1","volume-title":"October","author":"Kiberd R.","year":"2021","unstructured":"Kiberd, R. Why 2016 was the year of the algorithmic timeline. https:\/\/www.vice.com\/en\/article\/bmvbaw\/why-2016-was-the-year-of-the-algorithmic-timeline, October 2021."},{"key":"e_1_2_1_60_1","volume-title":"February","author":"King G.","year":"2020","unstructured":"King, G., and Persily, N. Unprecedented Facebook URLs Dataset now Available for Academic Research through Social Science One. https:\/\/socialscience.one\/blog\/unprecedented-facebook-urls-dataset-now-available-research-through-social-science-one, February 2020."},{"key":"e_1_2_1_61_1","volume-title":"Using deep learning at scale in Twitter's timelines. https:\/\/blog.twitter.com\/engineering\/en_us\/topics\/insights\/2017\/using-deep-learning-at-scale-in-twitters-timelines","author":"Koumchatzky N.","year":"2017","unstructured":"Koumchatzky, N., and Andryeyev, A. Using deep learning at scale in Twitter's timelines. https:\/\/blog.twitter.com\/engineering\/en_us\/topics\/insights\/2017\/using-deep-learning-at-scale-in-twitters-timelines, 2017."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2018.3093"},{"key":"e_1_2_1_63_1","first-page":"554","volume-title":"Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security (New York, NY, USA, 2015), CCS '15, Association for Computing Machinery","author":"Lecuyer M.","unstructured":"Lecuyer, M., Spahn, R., Spiliopolous, Y., Chaintreau, A., Geambasu, R., and Hsu, D. Sunlight: Fine-grained targeting detection at scale with statistical confidence. In Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security (New York, NY, USA, 2015), CCS '15, Association for Computing Machinery, p. 554--566."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.2478\/popets-2020-0004"},{"key":"e_1_2_1_65_1","volume-title":"October","author":"LinkedIn","year":"2021","unstructured":"LinkedIn. How the LinkedIn ads auction works - and how you can benefit. https:\/\/www.linkedin.com\/business\/marketing\/blog\/linkedin-ads\/how-the-linkedin-ads-auction-works-and-how-you-can-benefit, October 2021."},{"key":"e_1_2_1_66_1","volume-title":"Together we can improve equal access to opportunity. https:\/\/members.linkedin.com\/equal-access","author":"LinkedIn","year":"2022","unstructured":"LinkedIn. Together we can improve equal access to opportunity. https:\/\/members.linkedin.com\/equal-access, 2022."},{"key":"e_1_2_1_67_1","volume-title":"Algorithmic justice and online platform transparency act of","author":"Markey E.","year":"2021","unstructured":"Markey, E., and Matsui, D. Algorithmic justice and online platform transparency act of 2021. https:\/\/www.markey.senate.gov\/imo\/media\/doc\/ajopta.pdf, 2021."},{"key":"e_1_2_1_68_1","volume-title":"The 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing","author":"Matias J. N.","year":"2021","unstructured":"Matias, J. N., Hounsel, A., and Feamster, N. Software-supported audits of decision-making systems: Testing google and facebook's political advertising policies. In The 25th ACM Conference on Computer-Supported Cooperative Work and Social Computing (2021)."},{"key":"e_1_2_1_69_1","volume-title":"January","author":"Merrill J. B.","year":"2019","unstructured":"Merrill, J. B., and Tobin, A. Facebook moves to block ad transparency tools - including ours. https:\/\/www.propublica.org\/article\/facebook-blocks-ad-transparency-tools, January 2019."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000083"},{"key":"e_1_2_1_71_1","volume-title":"Community-focused feed optimization. https:\/\/engineering.linkedin.com\/blog\/2019\/06\/community-focused-feed-optimization","author":"Mohamed A.","year":"2021","unstructured":"Mohamed, A., and Li, Z. Community-focused feed optimization. https:\/\/engineering.linkedin.com\/blog\/2019\/06\/community-focused-feed-optimization, 2021."},{"key":"e_1_2_1_72_1","volume-title":"September","author":"Mohan P.","year":"2016","unstructured":"Mohan, P. Facebook's news feed just turned 10. https:\/\/www.fastcompany.com\/4018352\/facebooks-news-feed-just-turned-10, September 2016."},{"key":"e_1_2_1_73_1","volume-title":"Shedding More Light on How Instagram Works. https:\/\/about.instagram.com\/blog\/announcements\/shedding-more-light-on-how-instagram-works","author":"Mosseri A.","year":"2021","unstructured":"Mosseri, A. Shedding More Light on How Instagram Works. https:\/\/about.instagram.com\/blog\/announcements\/shedding-more-light-on-how-instagram-works, 2021."},{"key":"e_1_2_1_74_1","unstructured":"Mozilla. Mozilla rally. https:\/\/rally.mozilla.org\/."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1111\/ijsa.12067"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.abl8537"},{"key":"e_1_2_1_77_1","unstructured":"NYU Ad Observatory. Explore Facebook political ads. https:\/\/adobservatory.org\/."},{"key":"e_1_2_1_78_1","volume-title":"How Algorithms Shape the Distribution of Political Advertising: Case Studies of Facebook, Google, and TikTok. arXiv preprint arXiv:2206.04720","author":"Papakyriakopoulos O.","year":"2022","unstructured":"Papakyriakopoulos, O., Tessono, C., Narayanan, A., and Kshirsagar, M. How Algorithms Shape the Distribution of Political Advertising: Case Studies of Facebook, Google, and TikTok. arXiv preprint arXiv:2206.04720 (2022)."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.54501\/jots.v1i1.22"},{"key":"e_1_2_1_80_1","volume-title":"October","author":"Purnell N.","year":"2021","unstructured":"Purnell, N., and Horwitz, J. Facebook services are used to spread religious hatred in india, internal documents show. https:\/\/www.wsj.com\/articles\/facebook-services-are-used-to-spread-religious-hatred-in-india-internal-documents-show-11635016354, October 2021."},{"key":"e_1_2_1_81_1","volume-title":"Stop discrimination by algorithms act of","author":"Racine K.","year":"2021","unstructured":"Racine, K. Stop discrimination by algorithms act of 2021. https:\/\/oag.dc.gov\/sites\/default\/files\/2021--12\/DC-Bill-SDAA-FINAL-to-file-.pdf, 2021."},{"key":"e_1_2_1_82_1","volume-title":"Algorithmic impact assessments: A practical framework for public agency accountability. AI Now","author":"Reisman D.","year":"2018","unstructured":"Reisman, D., Schultz, J., Crawford, K., and Whittaker, M. Algorithmic impact assessments: A practical framework for public agency accountability. AI Now (2018)."},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372879"},{"key":"e_1_2_1_84_1","volume-title":"Data and Discrimination: Converting Critical Concerns into Productive Inquiry","author":"Sandvig C.","year":"2014","unstructured":"Sandvig, C., Hamilton, K., Karahalios, K., and Langbort, C. Auditing algorithms : Research methods for detecting discrimination on internet platforms. In Data and Discrimination: Converting Critical Concerns into Productive Inquiry (2014)."},{"key":"e_1_2_1_85_1","volume-title":"July","author":"Sarah Perez","year":"2022","unstructured":"Sarah Perez. Google exec suggests Instagram and TikTok are eating into Google's core products, Search and Maps. https:\/\/techcrunch.com\/2022\/07\/12\/google-exec-suggests-instagram-and-tiktok-are-eating-into-googles-core-products-search-and-maps\/?tpcc=tcplustwitter, July 2022."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462554"},{"key":"e_1_2_1_87_1","volume-title":"News Use Across Social Media Platforms","author":"Shearer E.","year":"2017","unstructured":"Shearer, E., and Gottfried, J. News Use Across Social Media Platforms 2017. Pew Research Center (September 2017)."},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479577"},{"key":"e_1_2_1_89_1","volume-title":"Proceedings of Machine Learning Research","author":"Speicher T.","year":"2018","unstructured":"Speicher, T., Ali, M., Venkatadri, G., Ribeiro, F. N., Arvanitakis, G., Benevenuto, F., Gummadi, K. P., Loiseau, P., and Mislove, A. Potential for discrimination in online targeted advertising. In Proceedings of Machine Learning Research (2018), S. A. Friedler and C. Wilson, Eds."},{"key":"e_1_2_1_90_1","volume-title":"Discrimination in online ad delivery: Google ads, black names and white names, racial discrimination, and click advertising. Queue","author":"Sweeney L.","year":"2013","unstructured":"Sweeney, L. Discrimination in online ad delivery: Google ads, black names and white names, racial discrimination, and click advertising. Queue (2013)."},{"key":"e_1_2_1_91_1","volume-title":"The Citizen Browser Project-Auditing the Algorithms of Disinformation. https:\/\/themarkup.org\/citizen-browser","author":"The Markup","year":"2020","unstructured":"The Markup. The Citizen Browser Project-Auditing the Algorithms of Disinformation. https:\/\/themarkup.org\/citizen-browser, 2020."},{"key":"e_1_2_1_92_1","unstructured":"The US Department of Justice. Justice Department Secures Groundbreaking Settlement Agreement with Meta Platforms Formerly Known as Facebook to Resolve Allegations of Discriminatory Advertising. https:\/\/www.justice.gov\/opa\/pr\/justice-department-secures-groundbreaking-settlement-agreement-meta-platforms-formerly-known June 2022."},{"key":"e_1_2_1_93_1","volume-title":"September","author":"The Wall Street Journal","year":"2021","unstructured":"The Wall Street Journal. The Facebook Files - A Wall Street Journal Investigation. https:\/\/www.wsj.com\/articles\/the-facebook-files-11631713039, September 2021."},{"key":"e_1_2_1_94_1","volume-title":"October","author":"The White House","year":"2022","unstructured":"The White House. Blueprint for an AI Bill of Rights. https:\/\/www.whitehouse.gov\/ostp\/ai-bill-of-rights\/, October 2022."},{"key":"e_1_2_1_95_1","volume-title":"September","author":"TikTok","year":"2021","unstructured":"TikTok. Relevance is the new reach. https:\/\/www.tiktok.com\/business\/en-US\/blog\/relevance-is-the-new-reach, September 2021."},{"key":"e_1_2_1_96_1","volume-title":"September","author":"Timberg C.","year":"2021","unstructured":"Timberg, C. Facebook made big mistake in data it provided to researchers, undermining academic work. The Washington Post https:\/\/www.washingtonpost.com\/technology\/2021\/09\/10\/facebook-error-data-social-scientists\/, September 2021."},{"key":"e_1_2_1_97_1","volume-title":"October","author":"Twitter","year":"2021","unstructured":"Twitter. The Twitter ads auction. https:\/\/business.twitter.com\/en\/help\/troubleshooting\/bidding-and-auctions-faqs.html, October 2021."},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717743530"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194770.3194776"},{"key":"e_1_2_1_100_1","volume-title":"July","author":"Vermeulen M.","year":"2021","unstructured":"Vermeulen, M. The keys to the kingdom. https:\/\/knightcolumbia.org\/content\/the-keys-to-the-kingdom, July 2021."},{"key":"e_1_2_1_101_1","first-page":"195","volume-title":"RecSys '12","author":"Weinsberg U.","unstructured":"Weinsberg, U., Bhagat, S., Ioannidis, S., and Taft, N. BlurMe: Inferring and obfuscating user gender based on ratings. RecSys '12, Association for Computing Machinery, p. 195--202."},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445928"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479594"},{"key":"e_1_2_1_104_1","volume-title":"July","author":"YouTube","year":"2022","unstructured":"YouTube. YouTube researcher program. https:\/\/research.youtube\/, July 2022."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579610","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579610","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:43Z","timestamp":1750182523000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579610"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,14]]},"references-count":103,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2023,4,14]]}},"alternative-id":["10.1145\/3579610"],"URL":"https:\/\/doi.org\/10.1145\/3579610","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,14]]},"assertion":[{"value":"2023-04-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}