{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T19:48:26Z","timestamp":1782762506619,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":176,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T00:00:00Z","timestamp":1782345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,6,25]]},"DOI":"10.1145\/3805689.3812370","type":"proceedings-article","created":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T16:20:39Z","timestamp":1782231639000},"page":"5265-5288","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Online Communities as Collaborative Testbeds for Collective Alignment"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4555-8764","authenticated-orcid":false,"given":"Matthew","family":"Zent","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, University of Minnesota - Twin Cities, Minneapolis, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9013-5595","authenticated-orcid":false,"given":"Malik","family":"Khadar","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, University of Minnesota - Twin Cities, Minneapolis, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8389-2064","authenticated-orcid":false,"given":"Svetlana","family":"Yarosh","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, University of Minnesota - Twin Cities, Minneapolis, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0620-0903","authenticated-orcid":false,"given":"Stevie","family":"Chancellor","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, University of Minnesota - Twin Cities, Minneapolis, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8239-937X","authenticated-orcid":false,"given":"Harmanpreet","family":"Kaur","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, University of Minnesota - Twin Cities, Minneapolis, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,6,25]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2023. Data API Terms. https:\/\/redditinc.com\/policies\/data-api-terms Publication Title: Reddit Inc Homepage."},{"key":"e_1_3_2_1_2_1","unstructured":"2023. New blog post from our CEO Prashanth: Community is the future of ai. https:\/\/meta.stackexchange.com\/questions\/388401\/new-blog-post-from-our-ceo-prashanth-community-is-the-future-of-ai Publication Title: Meta Stack Exchange."},{"key":"e_1_3_2_1_3_1","unstructured":"2025. Meta: Unauthorized experiment on CMV involving ai-generated comments. https:\/\/www.reddit.com\/r\/changemyview\/comments\/1k8b2hj\/meta_unauthorized_experiment_on_cmv_involving\/"},{"key":"e_1_3_2_1_4_1","unstructured":"2025. Wikipedia:Village pump (policy)\/Good faith and AI-generated comments. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Village_pump_(policy)\/Good_faith_and_AI-generated_comments Publication Title: Wikipedia."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_3_2_1_6_1","volume-title":"A systematic review of the barriers to the implementation of artificial intelligence in healthcare. Cureus 15, 10","author":"Ahmed Molla Imaduddin","year":"2023","unstructured":"Molla Imaduddin Ahmed, Brendan Spooner, John Isherwood, Mark Lane, Emma Orrock, and Ashley Dennison. 2023. A systematic review of the barriers to the implementation of artificial intelligence in healthcare. Cureus 15, 10 (2023). Publisher: Cureus."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3715275.3732071"},{"key":"e_1_3_2_1_8_1","volume-title":"Natalia D\u00edaz-Rodr\u00edguez, and Francisco Herrera.","author":"Ali Sajid","year":"2023","unstructured":"Sajid Ali, Tamer Abuhmed, Shaker El-Sappagh, Khan Muhammad, Jose M Alonso-Moral, Roberto Confalonieri, Riccardo Guidotti, Javier Del Ser, Natalia D\u00edaz-Rodr\u00edguez, and Francisco Herrera. 2023. Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence. Information fusion 99 (2023), 101805. Publisher: Elsevier."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2024.2420041"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.12.012"},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the 2024 AAAI\/ACM Conference on AI, Ethics, and Society (AIES '24)","author":"Arzberger Anne","year":"2025","unstructured":"Anne Arzberger, Stefan Buijsman, Maria Luce Lupetti, Alessandro Bozzon, and Jie Yang. 2025. Nothing Comes without Its World - Practical Challenges of Aligning LLMs to Situated Human Values through RLHF. In Proceedings of the 2024 AAAI\/ACM Conference on AI, Ethics, and Society (AIES '24). AAAI Press, San Jose, California, USA, 61\u201373."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-018-0637-6"},{"key":"e_1_3_2_1_13_1","volume-title":"Erfan Baghaei Potraghloo, and Massoud Pedram","author":"Azizi Seyedarmin","year":"2025","unstructured":"Seyedarmin Azizi, Erfan Baghaei Potraghloo, and Massoud Pedram. 2025. Activation steering for chain-of-thought compression. arXiv preprint arXiv:2507.04742 (2025)."},{"key":"e_1_3_2_1_14_1","unstructured":"Yuntao Bai Saurav Kadavath Sandipan Kundu Amanda Askell Jackson Kernion Andy Jones Anna Chen Anna Goldie Azalia Mirhoseini Cameron McKinnon Carol Chen Catherine Olsson Christopher Olah Danny Hernandez Dawn Drain Deep Ganguli Dustin Li Eli Tran-Johnson Ethan Perez Jamie Kerr Jared Mueller Jeffrey Ladish Joshua Landau Kamal Ndousse Kamile Lukosuite Liane Lovitt Michael Sellitto Nelson Elhage Nicholas Schiefer Noemi Mercado Nova DasSarma Robert Lasenby Robin Larson Sam Ringer Scott Johnston Shauna Kravec Sheer El Showk Stanislav Fort Tamera Lanham Timothy Telleen-Lawton Tom Conerly Tom Henighan Tristan Hume Samuel R. Bowman Zac Hatfield-Dodds Ben Mann Dario Amodei Nicholas Joseph Sam McCandlish Tom Brown and Jared Kaplan. 2022. Constitutional AI: Harmlessness from AI Feedback. https:\/\/arxiv.org\/abs\/2212.08073 _eprint: 2212.08073."},{"key":"e_1_3_2_1_15_1","volume-title":"SIGCIS conference paper.","author":"Barocas Solon","year":"2017","unstructured":"Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The problem with bias: From allocative to representational harms in machine learning. In SIGCIS conference paper."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020250"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-56648-4"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551624.3555290"},{"key":"e_1_3_2_1_19_1","volume-title":"ICLR 2025 Workshop Proposals.","author":"Blaas Arno","year":"2025","unstructured":"Arno Blaas, Priya Ronald DCosta, Fan Feng, Andreas Kriegler, Zhaoying Pan, Tobias Uelwer, Jennifer Williams, Yubin Xie, and Rui Yang. 2025. I Can't Believe It's Not Better: Challenges in Applied Deep Learning. In ICLR 2025 Workshop Proposals."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046496411406137"},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society","volume":"7","author":"Boerstler Kyle","year":"2024","unstructured":"Kyle Boerstler, Vijay Keswani, Lok Chan, Jana Schaich Borg, Vincent Conitzer, Hoda Heidari, and Walter Sinnott-Armstrong. 2024. On the stability of moral preferences: A problem with computational elicitation methods. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, Vol. 7. 156\u2013167."},{"key":"e_1_3_2_1_22_1","volume-title":"Warut Khern-am nuai, and Karthik Natarajan Kannan","author":"Borwankar Sameer","year":"2024","unstructured":"Sameer Borwankar, Warut Khern-am nuai, and Karthik Natarajan Kannan. 2024. Unraveling the impact: An empirical investigation of ChatGPT's exclusion from stack overflow. Available at SSRN 4481959 (2024)."},{"key":"e_1_3_2_1_23_1","volume-title":"Mediation Challenges and Socio-Technical Gaps for Explainable Deep Learning Applications. https:\/\/arxiv.org\/abs\/1907.07178 _eprint","author":"Brand\u00e3o Rafael","year":"1907","unstructured":"Rafael Brand\u00e3o, Joel Carbonera, Clarisse de Souza, Juliana Ferreira, Bernardo Gon\u00e7alves, and Carla Leit\u00e3o. 2019. Mediation Challenges and Socio-Technical Gaps for Explainable Deep Learning Applications. https:\/\/arxiv.org\/abs\/1907.07178 _eprint: 1907.07178."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210604.3210646"},{"key":"e_1_3_2_1_25_1","unstructured":"Brocktreee. 2020. [RULE 5 UPDATE] Studies and surveys are no longer allowed. https:\/\/www.reddit.com\/r\/BipolarReddit\/comments\/f9mp0g\/rule_5_update_studies_and_surveys_are_no_longer\/"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1177\/14614448211056863"},{"key":"e_1_3_2_1_27_1","volume-title":"Conference on fairness, accountability and transparency. PMLR, 77\u201391","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77\u201391."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3640457.3687092"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.21037\/atm.2020.03.63"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2966.2009.15383.x"},{"key":"e_1_3_2_1_31_1","volume-title":"J\u00e9r\u00e9my Scheurer, Javier Rando, Rachel Freedman, Tomasz Korbak, David Lindner, Pedro Freire, and others.","author":"Casper Stephen","year":"2023","unstructured":"Stephen Casper, Xander Davies, Claudia Shi, Thomas Krendl Gilbert, J\u00e9r\u00e9my Scheurer, Javier Rando, Rachel Freedman, Tomasz Korbak, David Lindner, Pedro Freire, and others. 2023. Open problems and fundamental limitations of reinforcement learning from human feedback. arXiv preprint arXiv:2307.15217 (2023)."},{"key":"e_1_3_2_1_32_1","unstructured":"Louis Castricato Nathan Lile Rafael Rafailov Jan-Philipp Fr\u00e4nken and Chelsea Finn. 2025. PERSONA: A Reproducible Testbed for Pluralistic Alignment. In Proceedings of the 31st International Conference on Computational Linguistics Owen Rambow Leo Wanner Marianna Apidianaki Hend Al-Khalifa Barbara Di Eugenio and Steven Schockaert (Eds.). Association for Computational Linguistics Abu Dhabi UAE 11348\u201311368. https:\/\/aclanthology.org\/2025.coling-main.752\/"},{"key":"e_1_3_2_1_33_1","volume-title":"Amrit Singh Bedi, and Mengdi Wang","author":"Chakraborty Souradip","year":"2024","unstructured":"Souradip Chakraborty, Jiahao Qiu, Hui Yuan, Alec Koppel, Furong Huang, Dinesh Manocha, Amrit Singh Bedi, and Mengdi Wang. 2024. MaxMin-RLHF: Alignment with Diverse Human Preferences. https:\/\/arxiv.org\/abs\/2402.08925_eprint: 2402.08925."},{"key":"e_1_3_2_1_34_1","volume-title":"CSCW2","author":"Chancellor Stevie","year":"2023","unstructured":"Stevie Chancellor, Jessica L Feuston, and Jayhyun Chang. 2023. Contextual gaps in machine learning for mental illness prediction: The case of diagnostic disclosures. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (2023), 1\u201327. Publisher: ACM New York, NY, USA."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3743127"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.emnlp-main.925"},{"key":"e_1_3_2_1_37_1","volume-title":"Deep reinforcement learning from human preferences. Advances in neural information processing systems 30","author":"Christiano Paul F","year":"2017","unstructured":"Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017. Deep reinforcement learning from human preferences. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642775"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3617694.3623228"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/12255.001.0001"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488416"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/0306312712471581"},{"key":"e_1_3_2_1_43_1","volume-title":"Opportunities and challenges in explainable artificial intelligence (xai): A survey. arXiv preprint arXiv:2006.11371","author":"Das Arun","year":"2020","unstructured":"Arun Das and Paul Rad. 2020. Opportunities and challenges in explainable artificial intelligence (xai): A survey. arXiv preprint arXiv:2006.11371 (2020)."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3617694.3623261"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-025-01038-2"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462537"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3617694.3623223"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600211.3604661"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111774"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3361122"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3633070"},{"key":"e_1_3_2_1_52_1","unstructured":"Heather Ford and Michael Davis. [n. d.]. Implications of generative AI for knowledge integrity on Wikipedia. ([n. d.])."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444813513259"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.95"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.08.037"},{"key":"e_1_3_2_1_56_1","article-title":"Public deliberation as the organizing principle of political communication research","volume":"4","author":"Gastil John","year":"2007","unstructured":"John Gastil and Laura Black. 2007. Public deliberation as the organizing principle of political communication research. Journal of Public Deliberation 4, 1 (2007).","journal-title":"Journal of Public Deliberation"},{"key":"e_1_3_2_1_57_1","unstructured":"Matthew Groh. 2022. Identifying the Context Shift between Test Benchmarks and Production Data. https:\/\/arxiv.org\/abs\/2207.01059_eprint: 2207.01059."},{"key":"e_1_3_2_1_58_1","unstructured":"hacksoncode. 2025. Research and changemyview. https:\/\/www.reddit.com\/r\/changemyview\/wiki\/research\/"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415219"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3706599.3706683"},{"key":"e_1_3_2_1_61_1","volume-title":"The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) 5, 4","author":"Maxwell Harper F","year":"2015","unstructured":"F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) 5, 4 (2015), 1\u201319. Publisher: Acm New York, NY, USA."},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-023-09483-6"},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359318"},{"key":"e_1_3_2_1_64_1","volume-title":"Exploration versus exploitation in space, mind, and society. Trends in cognitive sciences 19, 1","author":"Hills Thomas T","year":"2015","unstructured":"Thomas T Hills, Peter M Todd, David Lazer, A David Redish, and Iain D Couzin. 2015. Exploration versus exploitation in space, mind, and society. Trends in cognitive sciences 19, 1 (2015), 46\u201354. Publisher: Elsevier."},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2019.1573912"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658979"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479606"},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274343"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jarmac.2021.10.002"},{"key":"e_1_3_2_1_70_1","volume-title":"Ai alignment: A comprehensive survey. arXiv preprint arXiv:2310.19852","author":"Ji Jiaming","year":"2023","unstructured":"Jiaming Ji, Tianyi Qiu, Boyuan Chen, Borong Zhang, Hantao Lou, Kaile Wang, Yawen Duan, Zhonghao He, Jiayi Zhou, Zhaowei Zhang, and others. 2023. Ai alignment: A comprehensive survey. arXiv preprint arXiv:2310.19852 (2023)."},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.34133\/icomputing.0064"},{"key":"e_1_3_2_1_72_1","volume-title":"Andrew Smart, and William S. Isaac","author":"Jr Donald Martin","year":"2020","unstructured":"Donald Martin Jr, Vinodkumar Prabhakaran, Jill Kuhlberg, Andrew Smart, and William S. Isaac. 2020. Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics. https:\/\/arxiv.org\/abs\/2005.07572 _eprint: 2005.07572."},{"key":"e_1_3_2_1_73_1","volume-title":"Top-level decisions through public deliberation on the internet: evidence from the evolution of Java governance. democracy 4","author":"Kaschesky Michael","year":"2009","unstructured":"Michael Kaschesky and Reinhard Riedl. 2009. Top-level decisions through public deliberation on the internet: evidence from the evolution of Java governance. democracy 4 (2009), 40."},{"key":"e_1_3_2_1_74_1","unstructured":"Timo Kaufmann Paul Weng Viktor Bengs and Eyke H\u00fcllermeier. 2024. A survey of reinforcement learning from human feedback. (2024)."},{"key":"e_1_3_2_1_75_1","volume-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society","volume":"7","author":"Keswani Vijay","year":"2024","unstructured":"Vijay Keswani, Vincent Conitzer, Hoda Heidari, Jana Schaich Borg, and Walter Sinnott-Armstrong. 2024. On the Pros and Cons of Active Learning for Moral Preference Elicitation. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, Vol. 7. 711\u2013723."},{"key":"e_1_3_2_1_76_1","volume-title":"Jana Schaich Borg, and Walter Sinnott-Armstrong","author":"Keswani Vijay","year":"2025","unstructured":"Vijay Keswani, Cyrus Cousins, Breanna Nguyen, Vincent Conitzer, Hoda Heidari, Jana Schaich Borg, and Walter Sinnott-Armstrong. 2025. Moral Change or Noise? On Problems of Aligning AI With Temporally Unstable Human Feedback. https:\/\/arxiv.org\/abs\/2511.10032_eprint: 2511.10032."},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3757707"},{"key":"e_1_3_2_1_78_1","volume-title":"The past, present and better future of feedback learning in large language models for subjective human preferences and values. arXiv preprint arXiv:2310.07629","author":"Kirk Hannah Rose","year":"2023","unstructured":"Hannah Rose Kirk, Andrew M Bean, Bertie Vidgen, Paul R\u00f6ttger, and Scott A Hale. 2023. The past, present and better future of feedback learning in large language models for subjective human preferences and values. arXiv preprint arXiv:2310.07629 (2023)."},{"key":"e_1_3_2_1_79_1","volume-title":"\u201calignment","author":"Kirk Hannah Rose","year":"2023","unstructured":"Hannah Rose Kirk, Bertie Vidgen, Paul R\u00f6ttger, and Scott A Hale. 2023. The empty signifier problem: Towards clearer paradigms for operationalising \u201calignment\u201d in large language models. arXiv preprint arXiv:2310.02457 (2023)."},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-024-00820-y"},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.52202\/079017-3342"},{"key":"e_1_3_2_1_82_1","volume-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society","volume":"8","author":"Kou Tianqi","year":"2025","unstructured":"Tianqi Kou, Dana Calacci, and Cindy Lin. 2025. Dead Zone of Accountability: Why Social Claims in Machine Learning Research Should Be Articulated and Defended. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, Vol. 8. 1501\u20131512. Issue: 2."},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v39i26.34950"},{"key":"e_1_3_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.5555\/2207798"},{"key":"e_1_3_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3319376"},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642278"},{"key":"e_1_3_2_1_87_1","unstructured":"Nathan Lambert Lewis Tunstall Nazneen Rajani and Tristan Thrush. 2023. HuggingFace H4 Stack Exchange Preference Dataset. https:\/\/huggingface.co\/datasets\/HuggingFaceH4\/stack-exchange-preferences"},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753616"},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1177\/1470594X14544284"},{"key":"e_1_3_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780199256044.001.0001"},{"key":"e_1_3_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359283"},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2025.3602520"},{"key":"e_1_3_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v19i1.35863"},{"key":"e_1_3_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272973.3274075"},{"key":"e_1_3_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3713421"},{"key":"e_1_3_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3713292"},{"key":"e_1_3_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph17041187"},{"key":"e_1_3_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702566"},{"key":"e_1_3_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1177\/20539517241255103"},{"key":"e_1_3_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173583"},{"key":"e_1_3_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2421111122"},{"key":"e_1_3_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1136\/jme-2022-108447"},{"key":"e_1_3_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i17.17817"},{"key":"e_1_3_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415186"},{"key":"e_1_3_2_1_105_1","volume-title":"On interactive machine learning and the potential of cognitive feedback. arXiv preprint arXiv:2003.10365","author":"Michael Chris J","year":"2020","unstructured":"Chris J Michael, Dina Acklin, and Jaelle Scheuerman. 2020. On interactive machine learning and the potential of cognitive feedback. arXiv preprint arXiv:2003.10365 (2020)."},{"key":"e_1_3_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-021-10088-y"},{"key":"e_1_3_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-022-10246-w"},{"key":"e_1_3_2_1_108_1","volume-title":"Participatory Design: The Third Space in HCI. Handbook of HCI (Jan.","author":"Muller Michael","year":"2002","unstructured":"Michael Muller and Allison Druin. 2002. Participatory Design: The Third Space in HCI. Handbook of HCI (Jan. 2002)."},{"key":"e_1_3_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11765.001.0001"},{"key":"e_1_3_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145266"},{"key":"e_1_3_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1108\/ITP-06-2023-0577"},{"key":"e_1_3_2_1_112_1","volume-title":"Procaccia","author":"Noothigattu Ritesh","year":"2018","unstructured":"Ritesh Noothigattu, Snehalkumar \u2018Neil\u2019 S. Gaikwad, Edmond Awad, Sohan Dsouza, Iyad Rahwan, Pradeep Ravikumar, and Ariel D. Procaccia. 2018. A Voting-Based System for Ethical Decision Making. https:\/\/arxiv.org\/abs\/1709.06692_eprint: 1709.06692."},{"key":"e_1_3_2_1_113_1","volume-title":"Agathe Balayn, Angelina Wang, Fernando Diaz, Flavio du Pin Calmon, Margaret Mitchell, Michael Ekstrand, Reuben Binns, and Solon Barocas.","author":"Olteanu Alexandra","year":"2025","unstructured":"Alexandra Olteanu, Su Lin Blodgett, Agathe Balayn, Angelina Wang, Fernando Diaz, Flavio du Pin Calmon, Margaret Mitchell, Michael Ekstrand, Reuben Binns, and Solon Barocas. 2025. Rigor in AI: Doing Rigorous AI Work Requires a Broader, Responsible AI-Informed Conception of Rigor. arXiv preprint arXiv:2506.14652 (2025)."},{"key":"e_1_3_2_1_114_1","volume-title":"Devvret Verma, Ugboaja Samuel Gregory, Monika Puttaramaiah, and Rockson Kwasi Afriyie.","author":"Onyema Edeh Michael","year":"2022","unstructured":"Edeh Michael Onyema, Khalid K Almuzaini, Fergus Uchenna Onu, Devvret Verma, Ugboaja Samuel Gregory, Monika Puttaramaiah, and Rockson Kwasi Afriyie. 2022. Prospects and challenges of using machine learning for academic forecasting. Computational Intelligence and Neuroscience 2022, 1 (2022), 5624475. Publisher: Wiley Online Library."},{"key":"e_1_3_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531674.1531682"},{"key":"e_1_3_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444804041444"},{"key":"e_1_3_2_1_117_1","volume-title":"Rule Change: No More Surveys. https:\/\/www.reddit.com\/r\/adhd_anxiety\/comments\/13vueds\/rule_change_no_more_surveys","year":"2023","unstructured":"phareous. 2023. Rule Change: No More Surveys. https:\/\/www.reddit.com\/r\/adhd_anxiety\/comments\/13vueds\/rule_change_no_more_surveys"},{"key":"e_1_3_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1145\/3335081"},{"key":"e_1_3_2_1_119_1","volume-title":"Participatory Machine Learning Using Community-Based System Dynamics. Health and human rights 22, 2 (Dec","author":"Prabhakaran Vinodkumar","year":"2020","unstructured":"Vinodkumar Prabhakaran and Donald Jr Martin. 2020. Participatory Machine Learning Using Community-Based System Dynamics. Health and human rights 22, 2 (Dec. 2020), 71\u201374. Place: United States."},{"key":"e_1_3_2_1_120_1","doi-asserted-by":"publisher","DOI":"10.1145\/3637310"},{"key":"e_1_3_2_1_121_1","unstructured":"Rafael Rafailov Archit Sharma Eric Mitchell Stefano Ermon Christopher D. Manning and Chelsea Finn. 2024. Direct Preference Optimization: Your Language Model is Secretly a Reward Model. https:\/\/arxiv.org\/abs\/2305.18290 _eprint: 2305.18290."},{"key":"e_1_3_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1080\/07370024.2020.1734931"},{"key":"e_1_3_2_1_123_1","volume-title":"What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Design. https:\/\/arxiv.org\/abs\/2007.06718 _eprint","author":"Robertson Samantha","year":"2007","unstructured":"Samantha Robertson and Niloufar Salehi. 2020. What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Design. https:\/\/arxiv.org\/abs\/2007.06718 _eprint: 2007.06718."},{"key":"e_1_3_2_1_124_1","volume-title":"What if I don't like any of the choices? The limits of preference elicitation for participatory algorithm design. arXiv preprint arXiv:2007.06718","author":"Robertson Samantha","year":"2020","unstructured":"Samantha Robertson and Niloufar Salehi. 2020. What if I don't like any of the choices? The limits of preference elicitation for participatory algorithm design. arXiv preprint arXiv:2007.06718 (2020)."},{"key":"e_1_3_2_1_125_1","volume-title":"Position: Application-Driven Innovation in Machine Learning. In Forty-first International Conference on Machine Learning. https:\/\/openreview.net\/forum?id=xEB2oF3vvb","author":"Rolnick David","year":"2024","unstructured":"David Rolnick, Alan Aspuru-Guzik, Sara Beery, Bistra Dilkina, Priya L. Donti, Marzyeh Ghassemi, Hannah Kerner, Claire Monteleoni, Esther Rolf, Milind Tambe, and Adam White. 2024. Position: Application-Driven Innovation in Machine Learning. In Forty-first International Conference on Machine Learning. https:\/\/openreview.net\/forum?id=xEB2oF3vvb"},{"key":"e_1_3_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445399"},{"key":"e_1_3_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445399"},{"key":"e_1_3_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.1609\/aies.v8i3.36710"},{"key":"e_1_3_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-023-04594-w"},{"key":"e_1_3_2_1_130_1","volume-title":"Position: The Complexity of Perfect AI Alignment - Formalizing the RLHF Trilemma. https:\/\/arxiv.org\/abs\/2511.19504 _eprint: 2511.19504.","author":"Sahoo Subramanyam","year":"2025","unstructured":"Subramanyam Sahoo, Aman Chadha, Vinija Jain, and Divya Chaudhary. 2025. Position: The Complexity of Perfect AI Alignment - Formalizing the RLHF Trilemma. https:\/\/arxiv.org\/abs\/2511.19504 _eprint: 2511.19504."},{"key":"e_1_3_2_1_131_1","volume-title":"Against deliberation. Political theory 25, 3","author":"Sanders Lynn M","year":"1997","unstructured":"Lynn M Sanders. 1997. Against deliberation. Political theory 25, 3 (1997), 347\u2013376."},{"key":"e_1_3_2_1_132_1","unstructured":"Gilbert Sarah. 2025. Guidelines for Research. https:\/\/www.reddit.com\/r\/AskHistorians\/wiki\/research\/"},{"key":"e_1_3_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274423"},{"key":"e_1_3_2_1_134_1","doi-asserted-by":"publisher","DOI":"10.1145\/175222.175225"},{"key":"e_1_3_2_1_135_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287598"},{"key":"e_1_3_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.1145\/3653697"},{"key":"e_1_3_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1145\/3654777.3676450"},{"key":"e_1_3_2_1_138_1","volume-title":"Towards understanding sycophancy in language models. arXiv preprint arXiv:2310.13548","author":"Sharma Mrinank","year":"2023","unstructured":"Mrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud, Amanda Askell, Samuel R Bowman, Newton Cheng, Esin Durmus, Zac Hatfield-Dodds, Scott R Johnston, and others. 2023. Towards understanding sycophancy in language models. arXiv preprint arXiv:2310.13548 (2023)."},{"key":"e_1_3_2_1_139_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600211.3604673"},{"key":"e_1_3_2_1_140_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v10i1.21997"},{"key":"e_1_3_2_1_141_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449787"},{"key":"e_1_3_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpos.2022.946589"},{"key":"e_1_3_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3713482"},{"key":"e_1_3_2_1_144_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551624.3555285"},{"key":"e_1_3_2_1_145_1","volume-title":"The construction of preference. American psychologist 50, 5","author":"Slovic Paul","year":"1995","unstructured":"Paul Slovic. 1995. The construction of preference. American psychologist 50, 5 (1995), 364. Publisher: American Psychological Association."},{"key":"e_1_3_2_1_146_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i17.29865"},{"key":"e_1_3_2_1_147_1","volume-title":"Andre Ye, Liwei Jiang, Ximing Lu, Nouha Dziri, and others.","author":"Sorensen Taylor","year":"2024","unstructured":"Taylor Sorensen, Jared Moore, Jillian Fisher, Mitchell Gordon, Niloofar Mireshghallah, Christopher Michael Rytting, Andre Ye, Liwei Jiang, Ximing Lu, Nouha Dziri, and others. 2024. A roadmap to pluralistic alignment. arXiv preprint arXiv:2402.05070 (2024)."},{"key":"e_1_3_2_1_148_1","unstructured":"Karolina Sta\u0144czak Nicholas Meade Mehar Bhatia Hattie Zhou Konstantin B\u00f6ttinger Jeremy Barnes Jason Stanley Jessica Montgomery Richard Zemel Nicolas Papernot Nicolas Chapados Denis Therien Timothy P. Lillicrap Ana Marasovi\u0107 Sylvie Delacroix Gillian K. Hadfield and Siva Reddy. 2025. Societal Alignment Frameworks Can Improve LLM Alignment. https:\/\/arxiv.org\/abs\/2503.00069 _eprint: 2503.00069."},{"key":"e_1_3_2_1_149_1","volume-title":"Lin (Eds.)","volume":"33","author":"Stiennon Nisan","year":"2020","unstructured":"Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. 2020. Learning to summarize with human feedback. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 3008\u20133021. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/1f89885d556929e98d3ef9b86448f951-Paper.pdf"},{"key":"e_1_3_2_1_150_1","doi-asserted-by":"publisher","DOI":"10.1145\/3465416.3483305"},{"key":"e_1_3_2_1_151_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533132"},{"key":"e_1_3_2_1_152_1","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658992"},{"key":"e_1_3_2_1_153_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384772"},{"key":"e_1_3_2_1_154_1","volume-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society","volume":"7","author":"Tahaei Mohammad","year":"2024","unstructured":"Mohammad Tahaei, Daricia Wilkinson, Alisa Frik, Michael Muller, Ruba Abu-Salma, and Lauren Wilcox. 2024. Surveys considered harmful? Reflecting on the use of surveys in AI research, development, and governance. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, Vol. 7. 1416\u20131433."},{"key":"e_1_3_2_1_155_1","doi-asserted-by":"publisher","DOI":"10.1109\/SASOW.2010.26"},{"key":"e_1_3_2_1_156_1","volume-title":"Technology & Innovation Studies 4, 1","author":"Taubert Niels Christian","year":"2008","unstructured":"Niels Christian Taubert. 2008. Balancing requirements of decision and action: Decision-making and implementation in free\/open source software projects. Science, Technology & Innovation Studies 4, 1 (2008)."},{"key":"e_1_3_2_1_157_1","volume-title":"CFP: In defense of the commons. https:\/\/wpa-announcements.tracigardner.com\/2025\/12\/04\/cfp-in-defense-of-the-commons\/ Publication Title: WPA.","year":"2025","unstructured":"Tengrrl. 2025. CFP: In defense of the commons. https:\/\/wpa-announcements.tracigardner.com\/2025\/12\/04\/cfp-in-defense-of-the-commons\/ Publication Title: WPA."},{"key":"e_1_3_2_1_158_1","unstructured":"Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux Timoth\u00e9e Lacroix Baptiste Rozi\u00e8re Naman Goyal Eric Hambro Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave and Guillaume Lample. 2023. LLaMA: Open and Efficient Foundation Language Models. https:\/\/arxiv.org\/abs\/2302.13971 _eprint: 2302.13971."},{"key":"e_1_3_2_1_159_1","first-page":"74","article-title":"Building Trust for Community-Engaged Research: Recommendations From a Qualitative Study","volume":"6","author":"Thao Tran Thi Phuong","year":"2025","unstructured":"Thi Phuong Thao Tran, Jacque-Corey Cormier, Corey Anthony Hopwood, Jordan Foster, Isabel Scheib, Fei Li, Kathleen A Dolan, Nicole A Lynch, Dawn M Aycock, Claire A Spears, and others. 2025. Building Trust for Community-Engaged Research: Recommendations From a Qualitative Study. Journal of Participatory Research Methods 6, 2 (2025), 74\u201398. Publisher: Specialty Publications.","journal-title":"Journal of Participatory Research Methods"},{"key":"e_1_3_2_1_160_1","doi-asserted-by":"publisher","DOI":"10.1145\/3750069.3750072"},{"key":"e_1_3_2_1_161_1","doi-asserted-by":"publisher","DOI":"10.1145\/3715275.3732006"},{"key":"e_1_3_2_1_162_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE61694.2024.10893121"},{"key":"e_1_3_2_1_163_1","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.98"},{"key":"e_1_3_2_1_164_1","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.98"},{"key":"e_1_3_2_1_165_1","doi-asserted-by":"publisher","DOI":"10.1080\/13698230.2017.1328093"},{"key":"e_1_3_2_1_166_1","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","volume":"18","author":"Weld Galen","year":"2024","unstructured":"Galen Weld, Amy X Zhang, and Tim Althoff. 2024. Making online communities \u2018better\u2019: a taxonomy of community values on reddit. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 18. 1611\u20131633."},{"key":"e_1_3_2_1_167_1","doi-asserted-by":"publisher","DOI":"10.1145\/3144592.3144598"},{"key":"e_1_3_2_1_168_1","unstructured":"Kate Wong. 2025. Google AI grant to inaturalist prompts community outcry. https:\/\/www.scientificamerican.com\/article\/google-ai-grant-to-inaturalist-prompts-community-outcry\/ Publication Title: Scientific American."},{"key":"e_1_3_2_1_169_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444807081230"},{"key":"e_1_3_2_1_170_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594026"},{"key":"e_1_3_2_1_171_1","unstructured":"Chloe Xiang. 2023. Startup Uses AI Chatbot to Provide Mental Health Counseling and Then Realizes It \u2018Feels Weird\u2019. https:\/\/www.vice.com\/en\/article\/startup-uses-ai-chatbot-to-provide-mental-health-counseling-and-then-realizes-it-feels-weird\/ Publication Title: Vice."},{"key":"e_1_3_2_1_172_1","doi-asserted-by":"publisher","DOI":"10.1145\/3757560"},{"key":"e_1_3_2_1_173_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392826"},{"key":"e_1_3_2_1_174_1","volume-title":"Personalization of large language models: A survey. arXiv preprint arXiv:2411.00027","author":"Zhang Zhehao","year":"2024","unstructured":"Zhehao Zhang, Ryan A Rossi, Branislav Kveton, Yijia Shao, Diyi Yang, Hamed Zamani, Franck Dernoncourt, Joe Barrow, Tong Yu, Sungchul Kim, and others. 2024. Personalization of large language models: A survey. arXiv preprint arXiv:2411.00027 (2024)."},{"key":"e_1_3_2_1_175_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.24"},{"key":"e_1_3_2_1_176_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"}],"event":{"name":"FAccT '26: The 2026 ACM Conference on Fairness, Accountability, and Transparency","location":"Montreal QC Canada","acronym":"FAccT '26","sponsor":["ACM\/SIG"]},"container-title":["Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3805689.3812370","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T19:11:32Z","timestamp":1782760292000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3805689.3812370"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,25]]},"references-count":176,"alternative-id":["10.1145\/3805689.3812370","10.1145\/3805689"],"URL":"https:\/\/doi.org\/10.1145\/3805689.3812370","relation":{},"subject":[],"published":{"date-parts":[[2026,6,25]]},"assertion":[{"value":"2026-06-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}