{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:33:33Z","timestamp":1776094413692,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":57,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,4,22]],"date-time":"2025-04-22T00:00:00Z","timestamp":1745280000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,4,28]]},"DOI":"10.1145\/3696410.3714537","type":"proceedings-article","created":{"date-parts":[[2025,4,22]],"date-time":"2025-04-22T22:57:28Z","timestamp":1745362648000},"page":"5202-5211","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Social Bots Meet Large Language Model: Political Bias and Social Learning Inspired Mitigation Strategies"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2256-4256","authenticated-orcid":false,"given":"Jinghua","family":"Piao","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, BNRist, Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9474-9174","authenticated-orcid":false,"given":"Zhihong","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, BNRist, Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7561-5646","authenticated-orcid":false,"given":"Chen","family":"Gao","sequence":"additional","affiliation":[{"name":"BNRist, Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5617-1659","authenticated-orcid":false,"given":"Yong","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, BNRist, Tsinghua University, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2025,4,22]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2313790120"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1017\/pan.2023.2"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1906420116"},{"key":"e_1_3_2_1_4_1","volume-title":"Recent trends in social learning theory","author":"Bandura Albert","unstructured":"Albert Bandura. 1972. Modeling theory: Some traditions, trends, and disputes. In Recent trends in social learning theory. Elsevier, 35--61."},{"key":"e_1_3_2_1_5_1","volume-title":"Social learning theory. Englewood Cliffs","author":"Bandura Albert","year":"1977","unstructured":"Albert Bandura. 1977. Social learning theory. Englewood Cliffs (1977)."},{"key":"e_1_3_2_1_6_1","volume-title":"Social cognitive theory of self-regulation. Organizational behavior and human decision processes","author":"Bandura Albert","year":"1991","unstructured":"Albert Bandura. 1991. Social cognitive theory of self-regulation. Organizational behavior and human decision processes, Vol. 50, 2 (1991), 248--287."},{"key":"e_1_3_2_1_7_1","volume-title":"Measuring Political Bias in Large Language Models: What Is Said and How It Is Said. arXiv preprint arXiv:2403.18932","author":"Bang Yejin","year":"2024","unstructured":"Yejin Bang, Delong Chen, Nayeon Lee, and Pascale Fung. 2024. Measuring Political Bias in Large Language Models: What Is Said and How It Is Said. arXiv preprint arXiv:2403.18932 (2024)."},{"key":"e_1_3_2_1_8_1","volume-title":"Left and right: The significance of a political distinction","author":"Bobbio Norberto","unstructured":"Norberto Bobbio. 1996. Left and right: The significance of a political distinction. University of Chicago Press."},{"key":"e_1_3_2_1_9_1","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. Advances in neural information processing systems Vol. 33 (2020) 1877--1901."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2316205120"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/147078530805000106"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-024-07421-0"},{"key":"e_1_3_2_1_13_1","volume-title":"Yuhan Liu, and Yulia Tsvetkov.","author":"Feng Shangbin","year":"2023","unstructured":"Shangbin Feng, Chan Young Park, Yuhan Liu, and Yulia Tsvetkov. 2023. From pretraining data to language models to downstream tasks: Tracking the trails of political biases leading to unfair NLP models. arXiv preprint arXiv:2305.08283 (2023)."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Lun-Wei Ku","author":"Feng Shangbin","unstructured":"Shangbin Feng, Herun Wan, Ningnan Wang, Zhaoxuan Tan, Minnan Luo, and Yulia Tsvetkov. 2024. What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Lun-Wei Ku, Andre Martins, and Vivek Srikumar (Eds.). Association for Computational Linguistics, Bangkok, Thailand, 3580--3601."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818717"},{"key":"e_1_3_2_1_16_1","first-page":"904","article-title":"Political polarization of news media and influencers on Twitter in the 2016 and 2020 US presidential elections","volume":"7","author":"Flamino James","year":"2023","unstructured":"James Flamino, Alessandro Galeazzi, Stuart Feldman, Michael W Macy, Brendan Cross, Zhenkun Zhou, Matteo Serafino, Alexandre Bovet, Hern\u00e1n A Makse, and Boleslaw K Szymanski. 2023. Political polarization of news media and influencers on Twitter in the 2016 and 2020 US presidential elections. Nature Human Behaviour, Vol. 7, 6 (2023), 904--916.","journal-title":"Nature Human Behaviour"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1515\/9783110882193.203"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1057\/s41599-024-03611-3"},{"key":"e_1_3_2_1_19_1","volume-title":"S3: Social-network Simulation System with Large Language Model-Empowered Agents. arXiv preprint arXiv:2307.14984","author":"Gao Chen","year":"2023","unstructured":"Chen Gao, Xiaochong Lan, Zhihong Lu, Jinzhu Mao, Jinghua Piao, Huandong Wang, Depeng Jin, and Yong Li. 2023. S3: Social-network Simulation System with Large Language Model-Empowered Agents. arXiv preprint arXiv:2307.14984 (2023)."},{"key":"e_1_3_2_1_20_1","volume-title":"Chatglm: A family of large language models from glm-130b to glm-4 all tools. arXiv preprint arXiv:2406.12793","author":"Aohan Zeng Team GLM","year":"2024","unstructured":"Team GLM, Aohan Zeng, Bin Xu, Bowen Wang, Chenhui Zhang, Da Yin, Dan Zhang, Diego Rojas, Guanyu Feng, Hanlin Zhao, et al. 2024. Chatglm: A family of large language models from glm-130b to glm-4 all tools. arXiv preprint arXiv:2406.12793 (2024)."},{"key":"e_1_3_2_1_21_1","volume-title":"How persuasive is AI-generated propaganda? PNAS nexus","author":"Goldstein Josh A","year":"2024","unstructured":"Josh A Goldstein, Jason Chao, Shelby Grossman, Alex Stamos, and Michael Tomz. 2024. How persuasive is AI-generated propaganda? PNAS nexus, Vol. 3, 2 (2024), pgae034."},{"key":"e_1_3_2_1_22_1","volume-title":"Logic and conversation. Syntax and semantics","author":"Grice Herbert Paul","year":"1975","unstructured":"Herbert Paul Grice. 1975. Logic and conversation. Syntax and semantics, Vol. 3 (1975), 43--58."},{"key":"e_1_3_2_1_23_1","volume-title":"Nature","volume":"587","author":"Guglielmi Giorgia","year":"2020","unstructured":"Giorgia Guglielmi. 2020. The next-generation bots interfering with the US election. Nature, Vol. 587, 7832 (2020), 21--21."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2403116121"},{"key":"e_1_3_2_1_25_1","volume-title":"Political ideologies: An introduction","author":"Heywood Andrew","unstructured":"Andrew Heywood. 2021. Political ideologies: An introduction. Bloomsbury Publishing."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.2196\/26933"},{"key":"e_1_3_2_1_27_1","unstructured":"Lennart Hofeditz Christian Ehnis Deborah Bunker Florian Brachten and Stefan Stieglitz. 2019. Meaningful Use of Social Bots? Possible Applications in Crisis Communication during Disasters.. In ECIS. 1--16."},{"key":"e_1_3_2_1_28_1","volume-title":"Towards reasoning in large language models: A survey. arXiv preprint arXiv:2212.10403","author":"Huang Jie","year":"2022","unstructured":"Jie Huang and Kevin Chen-Chuan Chang. 2022. Towards reasoning in large language models: A survey. arXiv preprint arXiv:2212.10403 (2022)."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579592"},{"key":"e_1_3_2_1_30_1","volume-title":"Advances in Neural Information Processing Systems","volume":"36","author":"Kim Siwon","year":"2024","unstructured":"Siwon Kim, Sangdoo Yun, Hwaran Lee, Martin Gubri, Sungroh Yoon, and Seong Joon Oh. 2024. Propile: Probing privacy leakage in large language models. Advances in Neural Information Processing Systems, Vol. 36 (2024)."},{"key":"e_1_3_2_1_31_1","first-page":"51991","article-title":"Camel: Communicative agents for'' mind'' exploration of large language model society","volume":"36","author":"Li Guohao","year":"2023","unstructured":"Guohao Li, Hasan Hammoud, Hani Itani, Dmitrii Khizbullin, and Bernard Ghanem. 2023a. Camel: Communicative agents for'' mind'' exploration of large language model society. Advances in Neural Information Processing Systems, Vol. 36 (2023), 51991--52008.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_2_1_33_1","volume-title":"Are you in a masquerade? exploring the behavior and impact of large language model driven social bots in online social networks. arXiv preprint arXiv:2307.10337","author":"Li Siyu","year":"2023","unstructured":"Siyu Li, Jin Yang, and Kui Zhao. 2023b. Are you in a masquerade? exploring the behavior and impact of large language model driven social bots in online social networks. arXiv preprint arXiv:2307.10337 (2023)."},{"key":"e_1_3_2_1_34_1","volume-title":"A technique for the measurement of attitudes. Archives of Psychology","author":"Likert Rensis","year":"1932","unstructured":"Rensis Likert. 1932. A technique for the measurement of attitudes. Archives of Psychology (1932)."},{"key":"e_1_3_2_1_35_1","unstructured":"Meta. 2024. Introducing Meta LLaMA 3.1. https:\/\/ai.meta.com\/blog\/meta-llama-3--1\/ Accessed: 2024--12-04."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11127-023-01097-2"},{"key":"e_1_3_2_1_37_1","unstructured":"OpenAI. 2024. OpenAI GPT Models Documentation. https:\/\/platform.openai.com\/docs\/models\/gp Accessed: 2024--12-04."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586183.3606763"},{"key":"e_1_3_2_1_39_1","volume-title":"Hinrich Sch\u00fctze, and Dirk Hovy.","author":"R\u00f6ttger Paul","year":"2024","unstructured":"Paul R\u00f6ttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Rose Kirk, Hinrich Sch\u00fctze, and Dirk Hovy. 2024. Political compass or spinning arrow? towards more meaningful evaluations for values and opinions in large language models. arXiv preprint arXiv:2402.16786 (2024)."},{"key":"e_1_3_2_1_40_1","volume-title":"International Conference on Machine Learning. PMLR, 29971--30004","author":"Santurkar Shibani","year":"2023","unstructured":"Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto. 2023. Whose opinions do language models reflect?. In International Conference on Machine Learning. PMLR, 29971--30004."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274426"},{"key":"e_1_3_2_1_42_1","volume-title":"Nature","volume":"623","author":"Shanahan Murray","year":"2023","unstructured":"Murray Shanahan, Kyle McDonell, and Laria Reynolds. 2023. Role play with large language models. Nature, Vol. 623, 7987 (2023), 493--498."},{"key":"e_1_3_2_1_43_1","volume-title":"Onur Varol, Kai-Cheng Yang, Alessandro Flammini, and Filippo Menczer.","author":"Shao Chengcheng","year":"2018","unstructured":"Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Kai-Cheng Yang, Alessandro Flammini, and Filippo Menczer. 2018. The spread of low-credibility content by social bots. Nature communications, Vol. 9, 1 (2018), 1--9."},{"key":"e_1_3_2_1_44_1","volume-title":"Science Advances","volume":"9","author":"Spitale Giovanni","year":"2023","unstructured":"Giovanni Spitale, Nikola Biller-Andorno, and Federico Germani. 2023. AI model GPT-3 (dis) informs us better than humans. Science Advances, Vol. 9, 26 (2023), eadh1850."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1803470115"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"crossref","unstructured":"James WA Strachan Dalila Albergo Giulia Borghini Oriana Pansardi Eugenio Scaliti Saurabh Gupta Krati Saxena Alessandro Rufo Stefano Panzeri Guido Manzi et al. 2024. Testing theory of mind in large language models and humans. Nature Human Behaviour (2024) 1--11.","DOI":"10.21203\/rs.3.rs-3262385\/v1"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v11i1.14871"},{"key":"e_1_3_2_1_48_1","volume-title":"Attention is all you need. Advances in neural information processing systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, Vol. 30 (2017)."},{"key":"e_1_3_2_1_49_1","volume-title":"Nature","volume":"600","author":"Waller Isaac","year":"2021","unstructured":"Isaac Waller and Ashton Anderson. 2021. Quantifying social organization and political polarization in online platforms. Nature, Vol. 600, 7888 (2021), 264--268."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-024-40231-1"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-023-01659-w"},{"key":"e_1_3_2_1_52_1","volume-title":"Denny Zhou, et al.","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, Vol. 35 (2022), 24824--24837."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3144592.3144598"},{"key":"e_1_3_2_1_54_1","volume-title":"Automating power: Social bot interference in global politics. First Monday","author":"Woolley Samuel C","year":"2016","unstructured":"Samuel C Woolley. 2016. Automating power: Social bot interference in global politics. First Monday (2016)."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-023-00765-8"},{"key":"e_1_3_2_1_56_1","volume-title":"OASIS: Open Agents Social Interaction Simulations on One Million Agents. arXiv preprint arXiv:2411.11581","author":"Yang Ziyi","year":"2024","unstructured":"Ziyi Yang, Zaibin Zhang, Zirui Zheng, Yuxian Jiang, Ziyue Gan, Zhiyu Wang, Zijian Ling, Jinsong Chen, Martz Ma, Bowen Dong, et al. 2024. OASIS: Open Agents Social Interaction Simulations on One Million Agents. arXiv preprint arXiv:2411.11581 (2024)."},{"key":"e_1_3_2_1_57_1","unstructured":"Xinnong Zhang Jiayu Lin Libo Sun Weihong Qi Yihang Yang Yue Chen Hanjia Lyu Xinyi Mou Siming Chen Jiebo Luo et al. 2024. ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agents. arXiv preprint arXiv:2410.20746 (2024)."}],"event":{"name":"WWW '25: The ACM Web Conference 2025","location":"Sydney NSW Australia","acronym":"WWW '25","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the ACM on Web Conference 2025"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3696410.3714537","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3696410.3714537","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:33Z","timestamp":1750295913000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3696410.3714537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,22]]},"references-count":57,"alternative-id":["10.1145\/3696410.3714537","10.1145\/3696410"],"URL":"https:\/\/doi.org\/10.1145\/3696410.3714537","relation":{},"subject":[],"published":{"date-parts":[[2025,4,22]]},"assertion":[{"value":"2025-04-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}