{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T23:48:51Z","timestamp":1776124131942,"version":"3.50.1"},"reference-count":112,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"Stanford Institute for Human-Centered Artificial Intelligence, Stanford University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"<jats:p>Mounting evidence indicates that the artificial intelligence (AI) systems that rank our social media feeds bear nontrivial responsibility for amplifying partisan animosity: negative thoughts, feelings, and behaviors toward political out-groups. Can we design these AIs to consider democratic values such as mitigating partisan animosity as part of their objective functions? We introduce a method for translating established, vetted social scientific constructs into AI objective functions, which we term societal objective functions, and demonstrate the method with application to the political science construct of anti-democratic attitudes. Traditionally, we have lacked observable outcomes to use to train such models-however, the social sciences have developed survey instruments and qualitative codebooks for these constructs, and their precision facilitates translation into detailed prompts for large language models. We apply this method to create a democratic attitude model that estimates the extent to which a social media post promotes anti-democratic attitudes, and test this democratic attitude model across three studies. In Study 1, we first test the attitudinal and behavioral effectiveness of the intervention among US partisans (N=1,380) by manually annotating (alpha=.895) social media posts with anti-democratic attitude scores and testing several feed ranking conditions based on these scores. Removal (d=.20) and downranking feeds (d=.25) reduced participants' partisan animosity without compromising their experience and engagement. In Study 2, we scale up the manual labels by creating the democratic attitude model, finding strong agreement with manual labels (rho=.75). Finally, in Study 3, we replicate Study 1 using the democratic attitude model instead of manual labels to test its attitudinal and behavioral impact (N=558), and again find that the feed downranking using the societal objective function reduced partisan animosity (d=.25). This method presents a novel strategy to draw on social science theory and methods to mitigate societal harms in social media AIs.<\/jats:p>","DOI":"10.1145\/3641002","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T10:05:31Z","timestamp":1714385131000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Embedding Democratic Values into Social Media AIs via Societal Objective Functions"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8407-9224","authenticated-orcid":false,"given":"Chenyan","family":"Jia","sequence":"first","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3448-5961","authenticated-orcid":false,"given":"Michelle S.","family":"Lam","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2273-1256","authenticated-orcid":false,"given":"Minh Chau","family":"Mai","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5367-2677","authenticated-orcid":false,"given":"Jeffrey T.","family":"Hancock","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8020-9434","authenticated-orcid":false,"given":"Michael S.","family":"Bernstein","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1086\/697253"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.20190658"},{"key":"e_1_2_1_3_1","volume-title":"How Instagram's algorithm is censoring women and vulnerable users but helping online abusers. Feminist media studies 20, 5","author":"Are Carolina","year":"2020","unstructured":"Carolina Are. 2020. How Instagram's algorithm is censoring women and vulnerable users but helping online abusers. Feminist media studies 20, 5 (2020), 741--744."},{"key":"e_1_2_1_4_1","unstructured":"Yuntao Bai Saurav Kadavath Sandipan Kundu Amanda Askell Jackson Kernion Andy Jones Anna Chen Anna Goldie Azalia Mirhoseini Cameron McKinnon Carol Chen Catherine Olsson Christopher Olah Danny Hernandez Dawn Drain Deep Ganguli Dustin Li Eli Tran-Johnson Ethan Perez Jamie Kerr Jared Mueller Jeffrey Ladish Joshua Landau Kamal Ndousse Kamile Lukosuite Liane Lovitt Michael Sellitto Nelson Elhage Nicholas Schiefer Noemi Mercado Nova DasSarma Robert Lasenby Robin Larson Sam Ringer Scott Johnston Shauna Kravec Sheer El Showk Stanislav Fort Tamera Lanham Timothy Telleen-Lawton Tom Conerly Tom Henighan Tristan Hume Samuel R. Bowman Zac Hatfield-Dodds Ben Mann Dario Amodei Nicholas Joseph Sam McCandlish Tom Brown and Jared Kaplan. 2022. Constitutional AI: Harmlessness from AI Feedback. arXiv:2212.08073 [cs.CL]"},{"key":"e_1_2_1_5_1","volume-title":"Breaking the social media prism: How to make our platforms less polarizing","author":"Bail Chris","unstructured":"Chris Bail. 2022. Breaking the social media prism: How to make our platforms less polarizing. Princeton University Press."},{"key":"e_1_2_1_6_1","volume-title":"Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239","author":"Bakshy Eytan","year":"2015","unstructured":"Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130--1132."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.7208\/chicago\/9780226748603.001.0001"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.54501\/jots.v2i1.148"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311957.3359452"},{"key":"e_1_2_1_10_1","unstructured":"Monika Bickert. 2018. Publishing Our Internal Enforcement Guidelines and Expanding Our Appeals Process. https:\/\/about.fb.com\/news\/2018\/04\/comprehensive-community-standards\/"},{"key":"e_1_2_1_11_1","volume-title":"Fairness in Machine Learning: Lessons from Political Philosophy. CoRR abs\/1712.03586","author":"Binns Reuben","year":"2017","unstructured":"Reuben Binns. 2017. Fairness in Machine Learning: Lessons from Political Philosophy. CoRR abs\/1712.03586 (2017). arXiv:1712.03586 http:\/\/arxiv.org\/abs\/1712.03586"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3386\/w26669"},{"key":"e_1_2_1_13_1","volume-title":"Overperception of moral outrage in online social networks inflates beliefs about intergroup hostility. Nature human behaviour","author":"Brady William J","year":"2023","unstructured":"William J Brady, Killian L McLoughlin, Mark P Torres, Kara F Luo, Maria Gendron, and MJ Crockett. 2023. Overperception of moral outrage in online social networks inflates beliefs about intergroup hostility. Nature human behaviour (2023), 1--11."},{"key":"e_1_2_1_14_1","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language Models are Few-Shot Learners. Advances in neural information processing systems 33 (2020) 1877--1901."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287601"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371825"},{"key":"e_1_2_1_17_1","volume-title":"How algorithmic popularity bias hinders or promotes quality. Scientific reports 8, 1","author":"Ciampaglia Giovanni Luca","year":"2018","unstructured":"Giovanni Luca Ciampaglia, Azadeh Nematzadeh, Filippo Menczer, and Alessandro Flammini. 2018. How algorithmic popularity bias hinders or promotes quality. Scientific reports 8, 1 (2018), 15951."},{"key":"e_1_2_1_18_1","volume-title":"On the nature of reactance and its role in persuasive health communication. Communication monographs 72, 2","author":"Dillard James Price","year":"2005","unstructured":"James Price Dillard and Lijiang Shen. 2005. On the nature of reactance and its role in persuasive health communication. Communication monographs 72, 2 (2005), 144--168."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/00491241221134526"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2301836120"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","unstructured":"Dean Eckles. 2022. Algorithmic transparency and assessing effects of algorithmic ranking. https:\/\/doi.org\/10.31235\/osf.io\/c8za6","DOI":"10.31235\/osf.io\/c8za6"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376232"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Eli J Finkel Christopher A Bail Mina Cikara Peter H Ditto Shanto Iyengar Samara Klar Lilliana Mason Mary C McGrath Brendan Nyhan David G Rand et al. 2020. Political sectarianism in America. Science 370 6516 (2020) 533--536.","DOI":"10.1126\/science.abe1715"},{"key":"e_1_2_1_24_1","volume-title":"Measuring the reach of\" fake news\" and online disinformation in Europe. Australasian Policing 10, 2","author":"Fletcher Richard","year":"2018","unstructured":"Richard Fletcher, Alessio Cornia, Lucas Graves, and Rasmus Kleis Nielsen. 2018. Measuring the reach of\" fake news\" and online disinformation in Europe. Australasian Policing 10, 2 (2018)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5195\/jmla.2017.88"},{"key":"e_1_2_1_26_1","volume-title":"Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press."},{"key":"e_1_2_1_27_1","volume-title":"Deen Freelon, Matthew Gentzkow, Andrew M Guess, et al.","author":"Gonz\u00e1lez-Bail\u00f3n Sandra","year":"2023","unstructured":"Sandra Gonz\u00e1lez-Bail\u00f3n, David Lazer, Pablo Barber\u00e1, Meiqing Zhang, Hunt Allcott, Taylor Brown, Adriana Crespo- Tenorio, Deen Freelon, Matthew Gentzkow, Andrew M Guess, et al. 2023. Asymmetric ideological segregation in exposure to political news on Facebook. Science 381, 6656 (2023), 392--398."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719897945"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/10584609.2018.1504840"},{"key":"e_1_2_1_30_1","volume-title":"et al","author":"Guess Andrew M","year":"2023","unstructured":"Andrew M Guess, Neil Malhotra, Jennifer Pan, Pablo Barber\u00e1, Hunt Allcott, Taylor Brown, Adriana Crespo-Tenorio, Drew Dimmery, Deen Freelon, Matthew Gentzkow, et al . 2023. How do social media feed algorithms affect attitudes and behavior in an election campaign? Science 381, 6656 (2023), 398--404."},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Andrew M Guess Neil Malhotra Jennifer Pan Pablo Barber\u00e1 Hunt Allcott Taylor Brown Adriana Crespo-Tenorio Drew Dimmery Deen Freelon Matthew Gentzkow et al. 2023. Reshares on social media amplify political news but do not detectably affect beliefs or opinions. Science 381 6656 (2023) 404--408.","DOI":"10.1126\/science.add8424"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415195"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580688"},{"key":"e_1_2_1_34_1","volume-title":"Mufan Luo, and Hannah Mieczkowski.","author":"Hancock Jeff","year":"2022","unstructured":"Jeff Hancock, Sunny Xun Liu, Mufan Luo, and Hannah Mieczkowski. 2022. Psychological well-being and social media use: a meta-analysis of associations between social media use and depression, anxiety, loneliness, eudaimonic, hedonic and social well-being. Anxiety, Loneliness, Eudaimonic, Hedonic and Social Well-Being (March 9, 2022) (2022)."},{"key":"e_1_2_1_35_1","volume-title":"Yuli Patrick Hsieh, and WH Dutton","author":"Hargittai Eszter","year":"2013","unstructured":"Eszter Hargittai, Yuli Patrick Hsieh, and WH Dutton. 2013. The Oxford handbook of Internet studies."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-022-01442-3"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2019.1573912"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-acl.507"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3543873.3587368"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2025334119"},{"key":"e_1_2_1_41_1","volume-title":"The origins and consequences of affective polarization in the United States. Annual review of political science 22","author":"Iyengar Shanto","year":"2019","unstructured":"Shanto Iyengar, Yphtach Lelkes, Matthew Levendusky, Neil Malhotra, and Sean J Westwood. 2019. The origins and consequences of affective polarization in the United States. Annual review of political science 22 (2019), 129--146."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/ajps.12152"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959186"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555096"},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Daniel Kang Xuechen Li Ion Stoica Carlos Guestrin Matei Zaharia and Tatsunori Hashimoto. 2023. Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks. arXiv:2302.05733 [cs.CR]","DOI":"10.1109\/SPW63631.2024.00018"},{"key":"e_1_2_1_46_1","unstructured":"Jon Keegan. 2016. Blue Feed Red Feed. http:\/\/graphics.wsj.com\/blue-feed-red-feed\/"},{"key":"e_1_2_1_47_1","unstructured":"Junsol Kim and Byungkyu Lee. 2023. AI-Augmented Surveys: Leveraging Large Language Models for Opinion Prediction in Nationally Representative Surveys. arXiv:2305.09620 [cs.CL]"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfab029"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfy014"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490486.3538365"},{"key":"e_1_2_1_51_1","first-page":"22199","article-title":"Large Language Models are Zero-Shot Reasoners","volume":"35","author":"Kojima Takeshi","year":"2022","unstructured":"Takeshi Kojima, Shixiang (Shane) Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. Large Language Models are Zero-Shot Reasoners. In Advances in Neural Information Processing Systems, Vol. 35. 22199--22213.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274364"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2210666120"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jadohealth.2020.07.006"},{"key":"e_1_2_1_55_1","volume-title":"com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior research methods 49, 2","author":"Litman Leib","year":"2017","unstructured":"Leib Litman, Jonathan Robinson, and Tzvi Abberbock. 2017. TurkPrime. com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior research methods 49, 2 (2017), 433--442."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719976"},{"key":"e_1_2_1_57_1","volume-title":"A systematic review of worldwide causal and correlational evidence on digital media and democracy. Nature human behaviour 7, 1","author":"Lorenz-Spreen Philipp","year":"2023","unstructured":"Philipp Lorenz-Spreen, Lisa Oswald, Stephan Lewandowsky, and Ralph Hertwig. 2023. A systematic review of worldwide causal and correlational evidence on digital media and democracy. Nature human behaviour 7, 1 (2023), 74--101."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.nuse-1.5"},{"key":"e_1_2_1_59_1","doi-asserted-by":"crossref","unstructured":"Christoph Lutz. 2022. Inequalities in Social Media Use and their Implications for Digital Methods Research. 679--690.","DOI":"10.4135\/9781529782943.n47"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531719"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445933"},{"key":"e_1_2_1_62_1","volume-title":"Twitter's Algorithm: Amplifying Anger, Animosity, and Affective Polarization. arXiv preprint arXiv:2305.16941","author":"Milli Smitha","year":"2023","unstructured":"Smitha Milli, Micah Carroll, Sashrika Pandey, Yike Wang, and Anca D Dragan. 2023. Twitter's Algorithm: Amplifying Anger, Animosity, and Affective Polarization. arXiv preprint arXiv:2305.16941 (2023)."},{"key":"e_1_2_1_63_1","volume-title":"Explaining the effects of narrative in an entertainment television program: Overcoming resistance to persuasion. Human communication research 36, 1","author":"Moyer-Gus\u00e9 Emily","year":"2010","unstructured":"Emily Moyer-Gus\u00e9 and Robin L Nabi. 2010. Explaining the effects of narrative in an entertainment television program: Overcoming resistance to persuasion. Human communication research 36, 1 (2010), 26--52."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1057\/s41599-020-00550-7"},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the international AAAI conference on web and social media","volume":"7","author":"Munson Sean","year":"2013","unstructured":"Sean Munson, Stephanie Lee, and Paul Resnick. 2013. Encouraging reading of diverse political viewpoints with a browser widget. In Proceedings of the international AAAI conference on web and social media, Vol. 7. 419--428."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753543"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.416"},{"key":"e_1_2_1_68_1","unstructured":"Arvind Narayanan. 2023. Understanding Social Media Recommendation Algorithms. https:\/\/knightcolumbia.org\/content\/understanding-social-media-recommendation-algorithms."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196764"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359243"},{"key":"e_1_2_1_71_1","volume-title":"et al","author":"Nyhan Brendan","year":"2023","unstructured":"Brendan Nyhan, Jaime Settle, Emily Thorson, Magdalena Wojcieszak, Pablo Barber\u00e1, Annie Y Chen, Hunt Allcott, Taylor Brown, Adriana Crespo-Tenorio, Drew Dimmery, et al . 2023. Like-minded sources on Facebook are prevalent but not polarizing. Nature 620, 7972 (2023), 137--144."},{"key":"e_1_2_1_72_1","unstructured":"OpenAI. 2023. GPT-4 Technical Report. arXiv:2303.08774 [cs.CL]"},{"key":"e_1_2_1_73_1","first-page":"27730","article-title":"Training Language Models to Follow Instructions with Human Feedback","volume":"35","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al . 2022. Training Language Models to Follow Instructions with Human Feedback. Advances in Neural Information Processing Systems 35 (2022), 27730--27744.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_74_1","unstructured":"Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright Pamela Mishkin Chong Zhang Sandhini Agarwal Katarina Slama Alex Ray John Schulman Jacob Hilton Fraser Kelton Luke Miller Maddie Simens Amanda Askell Peter Welinder Paul Christiano Jan Leike and Ryan Lowe. 2022. Training language models to follow instructions with human feedback. arXiv:2203.02155 [cs.CL]"},{"key":"e_1_2_1_75_1","volume-title":"Bridging Systems: Open Problems for Countering Destructive Divisiveness across Ranking, Recommenders, and Governance. arXiv preprint arXiv:2301.09976","author":"Ovadya Aviv","year":"2023","unstructured":"Aviv Ovadya and Luke Thorburn. 2023. Bridging Systems: Open Problems for Countering Destructive Divisiveness across Ranking, Recommenders, and Governance. arXiv preprint arXiv:2301.09976 (2023)."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v24i1.7518"},{"key":"e_1_2_1_77_1","unstructured":"Nitish Pahwa. 2021. Facebook Asked Users What Content Was ?Good\" or ?Bad for the World.\" Some of the Results Were Shocking. https:\/\/slate.com\/technology\/2021\/11\/facebook-good-bad-for-the-world-gftw-bftw.html"},{"key":"e_1_2_1_78_1","unstructured":"Nicholas Pangakis Samuel Wolken and Neil Fasching. 2023. Automated Annotation with Generative AI Requires Validation. arXiv:2306.00176 [cs.CL]"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","unstructured":"F\u00e1bio Perez and Ian Ribeiro. 2022. Ignore Previous Prompt: Attack Techniques For Language Models. https:\/\/doi.org\/10.48550\/ARXIV.2211.09527","DOI":"10.48550\/ARXIV.2211.09527"},{"key":"e_1_2_1_80_1","unstructured":"Jay Peters. 2022. Twitter makes it harder to choose the old reverse-chronological feed. https:\/\/www.theverge.com\/2022\/3\/10\/22971307\/twitter-home-timeline-algorithmic-reverse-chronological-feed"},{"key":"e_1_2_1_81_1","volume-title":"Partisan Antipathy: More Intense, More Personal. Technical Report. Washington, D.C. https:\/\/www.pewresearch.org\/politics\/2019\/10\/10\/the-partisan-landscape-and-views-of-the-parties\/","author":"Pew Research Center","year":"2019","unstructured":"Pew Research Center. 2019. Partisan Antipathy: More Intense, More Personal. Technical Report. Washington, D.C. https:\/\/www.pewresearch.org\/politics\/2019\/10\/10\/the-partisan-landscape-and-views-of-the-parties\/"},{"key":"e_1_2_1_82_1","unstructured":"Google Transparency Report. 2023. YouTube Community Guidelines enforcement. https:\/\/transparencyreport. google.com\/youtube-policy\/removals"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2021.1874040"},{"key":"e_1_2_1_84_1","volume-title":"Users choose to engage with more partisan news than they are exposed to on Google Search. Nature","author":"Robertson Ronald E","year":"2023","unstructured":"Ronald E Robertson, Jon Green, Damian J Ruck, Katherine Ognyanova, Christo Wilson, and David Lazer. 2023. Users choose to engage with more partisan news than they are exposed to on Google Search. Nature (2023), 1--7."},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2015.1012532"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1353\/pla.2011.0036"},{"key":"e_1_2_1_87_1","unstructured":"Shibani Santurkar Esin Durmus Faisal Ladhak Cinoo Lee Percy Liang and Tatsunori Hashimoto. 2023. Whose Opinions Do Language Models Reflect? arXiv:2303.17548 [cs.CL]"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19343"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1080\/10584609.2016.1235640"},{"key":"e_1_2_1_90_1","volume-title":"Algorithms as culture: Some tactics for the ethnography of algorithmic systems. Big data & society 4, 2","author":"Seaver Nick","year":"2017","unstructured":"Nick Seaver. 2017. Algorithms as culture: Some tactics for the ethnography of algorithmic systems. Big data & society 4, 2 (2017), 2053951717738104."},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702403"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19--1339"},{"key":"e_1_2_1_93_1","volume-title":"Two cultures. Science 130, 3373","author":"Snow Charles Percy","year":"1959","unstructured":"Charles Percy Snow. 1959. Two cultures. Science 130, 3373 (1959), 419--419."},{"key":"e_1_2_1_94_1","volume-title":"Connie Moon Sehat, et al","author":"Stray Jonathan","year":"2022","unstructured":"Jonathan Stray, Alon Halevy, Parisa Assar, Dylan Hadfield-Menell, Craig Boutilier, Amar Ashar, Lex Beattie, Michael Ekstrand, Claire Leibowicz, Connie Moon Sehat, et al. 2022. Building Human Values into Recommender Systems: An Interdisciplinary Synthesis. arXiv preprint arXiv:2207.10192 (2022)."},{"key":"e_1_2_1_95_1","unstructured":"Cass R Sunstein. 2001. http:\/\/Republic. com."},{"key":"e_1_2_1_96_1","volume-title":"1","author":"Sunstein Cass R","year":"2015","unstructured":"Cass R Sunstein. 2015. Partyism. U. Chi. Legal F. (2015), 1."},{"key":"e_1_2_1_97_1","unstructured":"Raphael Tang Yao Lu Linqing Liu Lili Mou Olga Vechtomova and Jimmy Lin. 2019. Distilling Task-Specific Knowledge from BERT into Simple Neural Networks. arXiv:1903.12136 [cs.CL]"},{"key":"e_1_2_1_98_1","unstructured":"The YouTube Team. 2019. The Four Rs of Responsibility Part 1: Removing harmful content. https:\/\/blog.youtube\/inside-youtube\/the-four-rs-of-responsibility-remove\/"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2207159119"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19355"},{"key":"e_1_2_1_101_1","unstructured":"Twitter Transparency. 2021. Rules Enforcement. https:\/\/transparency.twitter.com\/en\/reports\/rules-enforcement.html"},{"key":"e_1_2_1_102_1","volume-title":"The Stanford Encyclopedia of Philosophy (Spring 2021 ed.), Edward N","author":"van Mill David","unstructured":"David van Mill. 2021. Freedom of Speech. In The Stanford Encyclopedia of Philosophy (Spring 2021 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University."},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adolescence.2020.01.014"},{"key":"e_1_2_1_104_1","unstructured":"Jan G Voelkel Michael Stagnaro James Chu Sophia Pink Joseph Mernyk Chrystal Redekopp Isaias Ghezae Matthew Cashman Dhaval Adjodah Levi Allen et al. 2023. Megastudy identifying effective interventions to strengthen Americans' democratic attitudes. (2023)."},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.findings-emnlp.354"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1080\/10584609.2020.1760406"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3133025"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581754.3584136"},{"key":"e_1_2_1_109_1","unstructured":"Kai-Cheng Yang and Filippo Menczer. 2023. Large language models can rate news outlet credibility. arXiv:2304.00228 [cs.CL]"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376213"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"},{"key":"e_1_2_1_112_1","doi-asserted-by":"crossref","unstructured":"Caleb Ziems William Held Omar Shaikh Jiaao Chen Zhehao Zhang and Diyi Yang. 2023. Can Large Language Models Transform Computational Social Science? arXiv:2305.03514 [cs.CL]","DOI":"10.1162\/coli_a_00502"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3641002","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3641002","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:25:50Z","timestamp":1755883550000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3641002"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":112,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2024,4,17]]}},"alternative-id":["10.1145\/3641002"],"URL":"https:\/\/doi.org\/10.1145\/3641002","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,17]]},"assertion":[{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}