{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T07:11:28Z","timestamp":1782803488035,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":125,"publisher":"ACM","funder":[{"name":"Schmidt Sciences AI2050 Early Career Fellowship"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3715275.3732146","type":"proceedings-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T17:01:18Z","timestamp":1750698078000},"page":"2138-2150","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["The Value of Disagreement in AI Design, Evaluation, and Alignment"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4447-318X","authenticated-orcid":false,"given":"Sina","family":"Fazelpour","sequence":"first","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5980-3970","authenticated-orcid":false,"given":"Will","family":"Fleisher","sequence":"additional","affiliation":[{"name":"Georgetown University, Washington, DC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"e_1_3_3_2_2_2","unstructured":"Lama Ahmad Sandhini Agarwal Michael Lampe and Pamela Mishkin. 2025. OpenAI\u2019s Approach to External Red Teaming for AI Models and Systems. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2503.16431 (2025)."},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"crossref","unstructured":"Elizabeth Anderson. 2006. The epistemology of democracy. Episteme 3 1-2 (2006) 8\u201322.","DOI":"10.3366\/epi.2006.3.1-2.8"},{"key":"e_1_3_3_2_4_2","unstructured":"Anthropic. 2024. Challenges in red teaming AI systems. https:\/\/www.anthropic.com\/news\/challenges-in-red-teaming-ai-systems Accessed: 2025-01-22."},{"key":"e_1_3_3_2_5_2","unstructured":"Yuntao Bai Andy Jones Kamal Ndousse Amanda Askell Anna Chen Nova DasSarma Dawn Drain Stanislav Fort Deep Ganguli Tom Henighan et\u00a0al. 2022. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2204.05862 (2022)."},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.18574\/nyu\/9781479890491.001.0001"},{"key":"e_1_3_3_2_7_2","volume-title":"Fairness and machine learning: Limitations and opportunities","author":"Barocas Solon","year":"2023","unstructured":"Solon Barocas, Moritz Hardt, and Arvind Narayanan. 2023. Fairness and machine learning: Limitations and opportunities. MIT press."},{"key":"e_1_3_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.bppf-1.3"},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"crossref","unstructured":"Julia\u00a0B Bear and Anita\u00a0Williams Woolley. 2011. The role of gender in team collaboration and performance. Interdisciplinary science reviews 36 2 (2011) 146\u2013153.","DOI":"10.1179\/030801811X13013181961473"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Stevie Bergman Nahema Marchal John Mellor Shakir Mohamed Iason Gabriel and William Isaac. 2024. STELA: a community-centred approach to norm elicitation for AI alignment. Scientific Reports 14 1 (2024) 6616.","DOI":"10.1038\/s41598-024-56648-4"},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533204"},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"crossref","unstructured":"James Bohman. 2007. Political communication and the epistemic value of diversity: Deliberation and legitimation in media societies. Communication Theory 17 4 (2007) 348\u2013355.","DOI":"10.1111\/j.1468-2885.2007.00301.x"},{"key":"e_1_3_3_2_13_2","unstructured":"Rishi Bommasani Kathleen\u00a0A Creel Ananya Kumar Dan Jurafsky and Percy\u00a0S Liang. 2022. Picking on the same person: Does algorithmic monoculture lead to outcome homogenization? Advances in Neural Information Processing Systems 35 (2022) 3663\u20133678."},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"crossref","unstructured":"Daniel Braun. 2024. I beg to differ: how disagreement is handled in the annotation of legal machine learning data sets. Artificial intelligence and law 32 3 (2024) 839\u2013862.","DOI":"10.1007\/s10506-023-09369-4"},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Liam\u00a0Kofi Bright. 2024. Duboisian leadership through standpoint epistemology. The Monist 107 1 (2024) 82\u201397.","DOI":"10.1093\/monist\/onad032"},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v37i6.25840"},{"key":"e_1_3_3_2_17_2","unstructured":"Stephen Casper Xander Davies Claudia Shi Thomas\u00a0Krendl Gilbert J\u00e9r\u00e9my Scheurer Javier Rando Rachel Freedman Tomasz Korbak David Lindner Pedro Freire et\u00a0al. 2023. Open problems and fundamental limitations of reinforcement learning from human feedback. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2307.15217 (2023)."},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Stephanie Castelin and Grace White. 2022. \u201cI\u2019ma strong independent Black woman\u201d: The strong Black woman schema and mental health in college-aged Black women. Psychology of Women Quarterly 46 2 (2022) 196\u2013208.","DOI":"10.1177\/03616843211067501"},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"publisher","unstructured":"David Christensen. 2009. Disagreement as Evidence: The Epistemology of Controversy. Philosophy Compass 4 5 (2009) 756\u2013767. 10.1111\/j.1747-9991.2009.00237.x","DOI":"10.1111\/j.1747-9991.2009.00237.x"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Robert\u00a0B Cialdini and Noah\u00a0J Goldstein. 2004. Social influence: Compliance and conformity. Annu. Rev. Psychol. 55 1 (2004) 591\u2013621.","DOI":"10.1146\/annurev.psych.55.090902.142015"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"crossref","unstructured":"Patricia\u00a0Hill Collins. 1986. Learning from the outsider within: The sociological significance of Black feminist thought. Social problems 33 6 (1986) s14\u2013s32.","DOI":"10.2307\/800672"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"crossref","unstructured":"Matteo Colombo and Stephan Hartmann. 2017. Bayesian cognitive science unification and explanation. The British Journal for the Philosophy of Science (2017).","DOI":"10.1093\/bjps\/axv036"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"crossref","unstructured":"Nancy\u00a0J Cooke Jamie\u00a0C Gorman Christopher\u00a0W Myers and Jasmine\u00a0L Duran. 2013. Interactive team cognition. Cognitive science 37 2 (2013) 255\u2013285.","DOI":"10.1111\/cogs.12009"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/SaTML54575.2023.00050"},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"publisher","unstructured":"Helen\u00a0De Cruz and Johan\u00a0De Smedt. 2013. The Value of Epistemic Disagreement in Scientific Practice. The Case of Homo Floresiensis. Studies in History and Philosophy of Science Part A 44 2 (2013) 169\u2013177. 10.1016\/j.shpsa.2013.02.002","DOI":"10.1016\/j.shpsa.2013.02.002"},{"key":"e_1_3_3_2_26_2","doi-asserted-by":"crossref","unstructured":"Aida\u00a0Mostafazadeh Davani Mark D\u00edaz and Vinodkumar Prabhakaran. 2022. Dealing with disagreements: Looking beyond the majority vote in subjective annotations. Transactions of the Association for Computational Linguistics 10 (2022) 92\u2013110.","DOI":"10.1162\/tacl_a_00449"},{"key":"e_1_3_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3617694.3623261"},{"key":"e_1_3_3_2_28_2","doi-asserted-by":"crossref","unstructured":"Morton Deutsch and Harold\u00a0B Gerard. 1955. A study of normative and informational social influences upon individual judgment. The journal of abnormal and social psychology 51 3 (1955) 629.","DOI":"10.1037\/h0046408"},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3534647"},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278729"},{"key":"e_1_3_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v8i1.7474"},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Joann\u00a0G Elmore Gary\u00a0M Longton Patricia\u00a0A Carney Berta\u00a0M Geller Tracy Onega Anna\u00a0NA Tosteson Heidi\u00a0D Nelson Margaret\u00a0S Pepe Kimberly\u00a0H Allison Stuart\u00a0J Schnitt et\u00a0al. 2015. Diagnostic concordance among pathologists interpreting breast biopsy specimens. Jama 313 11 (2015) 1122\u20131132.","DOI":"10.1001\/jama.2015.1405"},{"key":"e_1_3_3_2_33_2","unstructured":"Tyna Eloundou and Teddy Lee. 2024. Democratic inputs to AI grant program: lessons learned and implementation plans. Available at: https:\/\/openai.com\/blog\/democraticinputs-to-ai-grant-program-update (accessed 11 February 2025)."},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Sina Fazelpour and David Danks. 2021. Algorithmic bias: Senses sources solutions. Philosophy Compass 16 8 (2021) e12760.","DOI":"10.1111\/phc3.12760"},{"key":"e_1_3_3_2_35_2","doi-asserted-by":"crossref","unstructured":"Sina Fazelpour and Maria De-Arteaga. 2022. Diversity in sociotechnical machine learning systems. Big Data & Society 9 1 (2022) 20539517221082027.","DOI":"10.1177\/20539517221082027"},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"crossref","unstructured":"Sina Fazelpour Zachary\u00a0C Lipton and David Danks. 2022. Algorithmic fairness and the situated dynamics of justice. Canadian Journal of Philosophy 52 1 (2022) 44\u201360.","DOI":"10.1017\/can.2021.24"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"crossref","unstructured":"Sina Fazelpour and Daniel Steel. 2022. Diversity trust and conformity: A simulation study. Philosophy of Science 89 2 (2022) 209\u2013231.","DOI":"10.1017\/psa.2021.25"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","unstructured":"Will Fleisher. 2018. Rational Endorsement. Philosophical Studies 175 10 (2018) 2649\u20132675. 10.1007\/s11098-017-0976-4","DOI":"10.1007\/s11098-017-0976-4"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"publisher","unstructured":"Will Fleisher. 2019. Endorsement and Assertion. No\u00fbs 55 2 (2019) 363\u2013384. 10.1111\/nous.12315","DOI":"10.1111\/nous.12315"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"publisher","unstructured":"Will Fleisher. 2020. How to Endorse Conciliationism. Synthese 198 10 (2020) 9913\u20139939. 10.1007\/s11229-020-02695-z","DOI":"10.1007\/s11229-020-02695-z"},{"key":"e_1_3_3_2_41_2","doi-asserted-by":"crossref","unstructured":"Will Fleisher. 2022. Understanding idealization and explainable AI. Episteme 19 4 (2022) 534\u2013560.","DOI":"10.1017\/epi.2022.39"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.415"},{"key":"e_1_3_3_2_43_2","doi-asserted-by":"crossref","unstructured":"Eve Fleisig Su\u00a0Lin Blodgett Dan Klein and Zeerak Talat. 2024. The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labels. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2405.05860 (2024).","DOI":"10.18653\/v1\/2024.naacl-long.126"},{"key":"e_1_3_3_2_44_2","volume-title":"The Stanford Encyclopedia of Philosophy (Winter 2024 ed.)","author":"Frances Bryan","year":"2024","unstructured":"Bryan Frances and Jonathan Matheson. 2024. Disagreement. In The Stanford Encyclopedia of Philosophy (Winter 2024 ed.), Edward\u00a0N. Zalta and Uri Nodelman (Eds.). Metaphysics Research Lab, Stanford University."},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"crossref","unstructured":"Phoebe Friesen and Jordan Goldstein. 2022. Standpoint theory and the psy sciences: Can marginalization and critical engagement lead to an epistemic advantage? Hypatia 37 4 (2022) 659\u2013687.","DOI":"10.1017\/hyp.2022.58"},{"key":"e_1_3_3_2_46_2","unstructured":"Deep Ganguli Liane Lovitt Jackson Kernion Amanda Askell Yuntao Bai Saurav Kadavath Ben Mann Ethan Perez Nicholas Schiefer Kamal Ndousse et\u00a0al. 2022. Red teaming language models to reduce harms: Methods scaling behaviors and lessons learned. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2209.07858 (2022)."},{"key":"e_1_3_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502004"},{"key":"e_1_3_3_2_48_2","doi-asserted-by":"publisher","unstructured":"Sandra Harding. 2004. A Socially Relevant Philosophy of Science? Resources From Standpoint Theory\u2019s Controversiality. Hypatia 19 1 (2004) 25\u201347. 10.1111\/j.1527-2001.2004.tb01267.x","DOI":"10.1111\/j.1527-2001.2004.tb01267.x"},{"key":"e_1_3_3_2_49_2","doi-asserted-by":"crossref","unstructured":"Sandra Harding. 2009. Standpoint theories: Productively controversial. Hypatia 24 4 (2009) 192\u2013200.","DOI":"10.1111\/j.1527-2001.2009.01067.x"},{"key":"e_1_3_3_2_50_2","volume-title":"Objectivity and diversity: Another logic of scientific research","author":"Harding Sandra","year":"2019","unstructured":"Sandra Harding. 2019. Objectivity and diversity: Another logic of scientific research. University of Chicago Press."},{"key":"e_1_3_3_2_51_2","volume-title":"The feminist standpoint theory reader: Intellectual and political controversies","author":"Harding Sandra\u00a0G","year":"2004","unstructured":"Sandra\u00a0G Harding. 2004. The feminist standpoint theory reader: Intellectual and political controversies. Psychology Press."},{"key":"e_1_3_3_2_52_2","doi-asserted-by":"crossref","unstructured":"Remco Heesen Liam\u00a0Kofi Bright and Andrew Zucker. 2019. Vindicating methodological triangulation. Synthese 196 (2019) 3067\u20133081.","DOI":"10.1007\/s11229-016-1294-7"},{"key":"e_1_3_3_2_53_2","doi-asserted-by":"crossref","unstructured":"Babak Heydari Pedram Heydari and Mohsen Mosleh. 2020. Not all bridges connect: integration in multi-community networks. The Journal of Mathematical Sociology 44 4 (2020) 199\u2013220.","DOI":"10.1080\/0022250X.2019.1694519"},{"key":"e_1_3_3_2_54_2","doi-asserted-by":"crossref","unstructured":"Babak Heydari Mohsen Mosleh and Kia Dalili. 2015. Efficient network structures with separable heterogeneous connection costs. Economics Letters 134 (2015) 82\u201385.","DOI":"10.1016\/j.econlet.2015.06.014"},{"key":"e_1_3_3_2_55_2","doi-asserted-by":"crossref","unstructured":"Lu Hong and Scott\u00a0E Page. 2004. Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proceedings of the National Academy of Sciences 101 46 (2004) 16385\u201316389.","DOI":"10.1073\/pnas.0403723101"},{"key":"e_1_3_3_2_56_2","unstructured":"Chris\u00a0Jay Hoofnagle Ashkan Soltani Nathaniel Good and Dietrich\u00a0J Wambach. 2012. Behavioral advertising: The offer you can\u2019t refuse. Harv. L. & Pol\u2019y Rev. 6 (2012) 273."},{"key":"e_1_3_3_2_57_2","volume-title":"The Stanford Encyclopedia of Philosophy (Spring 2025 ed.)","author":"Horowitz Sophie","year":"2025","unstructured":"Sophie Horowitz. 2025. Higher-Order Evidence. In The Stanford Encyclopedia of Philosophy (Spring 2025 ed.), Edward\u00a0N. Zalta and Uri Nodelman (Eds.). Metaphysics Research Lab, Stanford University."},{"key":"e_1_3_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658979"},{"key":"e_1_3_3_2_59_2","doi-asserted-by":"crossref","unstructured":"Kristen Intemann. 2010. 25 years of feminist empiricism and standpoint theory: Where are we now? Hypatia 25 4 (2010) 778\u2013796.","DOI":"10.1111\/j.1527-2001.2010.01138.x"},{"key":"e_1_3_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445901"},{"key":"e_1_3_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658899"},{"key":"e_1_3_3_2_62_2","unstructured":"Akshita Jha Aida Davani Chandan\u00a0K Reddy Shachi Dave Vinodkumar Prabhakaran and Sunipa Dev. 2023. SeeGULL: A stereotype benchmark with broad geo-cultural coverage leveraging generative models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2305.11840 (2023)."},{"key":"e_1_3_3_2_63_2","doi-asserted-by":"crossref","unstructured":"Anna Jobin Marcello Ienca and Effy Vayena. 2019. The global landscape of AI ethics guidelines. Nature Machine Intelligence 1 9 (2019) 389\u2013399.","DOI":"10.1038\/s42256-019-0088-2"},{"key":"e_1_3_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580645"},{"key":"e_1_3_3_2_65_2","doi-asserted-by":"crossref","unstructured":"S\u00a0Vittal Katikireddi and Sean\u00a0A Valles. 2015. Coupled ethical\u2013epistemic analysis of public health research and practice: Categorizing variables to improve population health and equity. American journal of public health 105 1 (2015) e36\u2013e42.","DOI":"10.2105\/AJPH.2014.302279"},{"key":"e_1_3_3_2_66_2","unstructured":"Hannah\u00a0Rose Kirk Alexander Whitefield Paul R\u00f6ttger Andrew Bean Katerina Margatina Juan Ciro Rafael Mosquera Max Bartolo Adina Williams He He et\u00a0al. 2024. The PRISM Alignment Project: What Participatory Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2404.16019 (2024)."},{"key":"e_1_3_3_2_67_2","doi-asserted-by":"publisher","unstructured":"Philip Kitcher. 1990. The Division of Cognitive Labor. Journal of Philosophy 87 1 (1990) 5\u201322. 10.2307\/2026796","DOI":"10.2307\/2026796"},{"key":"e_1_3_3_2_68_2","doi-asserted-by":"crossref","unstructured":"Jon Kleinberg Jens Ludwig Sendhil Mullainathan and Cass\u00a0R Sunstein. 2018. Discrimination in the Age of Algorithms. Journal of Legal Analysis 10 (2018) 113\u2013174.","DOI":"10.1093\/jla\/laz001"},{"key":"e_1_3_3_2_69_2","doi-asserted-by":"crossref","unstructured":"Jon Kleinberg and Manish Raghavan. 2021. Algorithmic monoculture and social welfare. Proceedings of the National Academy of Sciences 118 22 (2021) e2018340118.","DOI":"10.1073\/pnas.2018340118"},{"key":"e_1_3_3_2_70_2","unstructured":"Tzu-Sheng Kuo Quan\u00a0Ze Chen Amy\u00a0X Zhang Jane Hsieh Haiyi Zhu and Kenneth Holstein. 2024. PolicyCraft: Supporting Collaborative and Participatory Policy Design through Case-Grounded Deliberation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2409.15644 (2024)."},{"key":"e_1_3_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642278"},{"key":"e_1_3_3_2_72_2","doi-asserted-by":"crossref","unstructured":"Jaakko Kuorikoski and Caterina Marchionni. 2016. Evidential diversity and the triangulation of phenomena. Philosophy of Science 83 2 (2016) 227\u2013247.","DOI":"10.1086\/684960"},{"key":"e_1_3_3_2_73_2","doi-asserted-by":"crossref","unstructured":"H\u00e9l\u00e8ne Landemore. 2017. Beyond the fact of disagreement? The epistemic turn in deliberative democracy. Social Epistemology 31 3 (2017) 277\u2013295.","DOI":"10.1080\/02691728.2017.1317868"},{"key":"e_1_3_3_2_74_2","doi-asserted-by":"crossref","unstructured":"J\u00fcrgen Landes. 2021. The variety of evidence thesis and its independence of degrees of independence. Synthese 198 11 (2021) 10611\u201310641.","DOI":"10.1007\/s11229-020-02738-5"},{"key":"e_1_3_3_2_75_2","doi-asserted-by":"crossref","unstructured":"Seth Lazar. 2024. Legitimacy Authority and Democratic. Oxford Studies in Political Philosophy Volume 10 (2024) 28.","DOI":"10.1093\/oso\/9780198909460.003.0002"},{"key":"e_1_3_3_2_76_2","doi-asserted-by":"crossref","unstructured":"Min\u00a0Kyung Lee Daniel Kusbit Anson Kahng Ji\u00a0Tae Kim Xinran Yuan Allissa Chan Daniel See Ritesh Noothigattu Siheon Lee Alexandros Psomas et\u00a0al. 2019. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction 3 CSCW (2019) 1\u201335.","DOI":"10.1145\/3359283"},{"key":"e_1_3_3_2_77_2","unstructured":"Adam\u00a0Dahlgren Lindstr\u00f6m Leila Methnani Lea Krause Petter Ericson \u00cd\u00f1igo Mart\u00ednez de\u00a0Rituerto de Troya Dimitri\u00a0Coelho Mollo and Roel Dobbe. 2024. AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitations. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2406.18346 (2024)."},{"key":"e_1_3_3_2_78_2","unstructured":"Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML\u2019s impact disparity require treatment disparity? Advances in neural information processing systems 31 (2018)."},{"key":"e_1_3_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1515\/9780691209753"},{"key":"e_1_3_3_2_80_2","volume-title":"The Epistemology of Disagreement","author":"Matheson Jonathan","year":"2015","unstructured":"Jonathan Matheson. 2015. The Epistemology of Disagreement. Palgrave, New York."},{"key":"e_1_3_3_2_81_2","doi-asserted-by":"publisher","unstructured":"Hugo Mercier and Dan Sperber. 2011. Argumentation: Its Adaptiveness and Efficacy. Behavioral and Brain Sciences 34 2 (2011) 94\u2013111. 10.1017\/s0140525x10003031","DOI":"10.1017\/s0140525x10003031"},{"key":"e_1_3_3_2_82_2","series-title":"Reihe Politikwissenschaft \/ Institut f\u00fcr H\u00f6here Studien, Abt. Politikwissenschaft","volume-title":"Deliberative democracy or agonistic pluralism","author":"Mouffe Chantal","year":"2000","unstructured":"Chantal Mouffe. 2000. Deliberative democracy or agonistic pluralism. Reihe Politikwissenschaft \/ Institut f\u00fcr H\u00f6here Studien, Abt. Politikwissenschaft, Vol.\u00a072. Institut f\u00fcr H\u00f6here Studien (IHS), Wien, Wien. 17 pages."},{"key":"e_1_3_3_2_83_2","doi-asserted-by":"crossref","unstructured":"Ryan Muldoon. 2013. Diversity and the division of cognitive labor. Philosophy Compass 8 2 (2013) 117\u2013125.","DOI":"10.1111\/phc3.12000"},{"key":"e_1_3_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511617201"},{"key":"e_1_3_3_2_85_2","doi-asserted-by":"crossref","unstructured":"Hasti Narimanzadeh Arash Badie-Modiri Iuliia\u00a0G Smirnova and Ted Hsuan\u00a0Yun Chen. 2023. Crowdsourcing subjective annotations using pairwise comparisons reduces bias and error compared to the majority-vote method. Proceedings of the ACM on Human-Computer Interaction 7 CSCW2 (2023) 1\u201329.","DOI":"10.1145\/3610183"},{"key":"e_1_3_3_2_86_2","doi-asserted-by":"crossref","unstructured":"Helen Nissenbaum. 2019. Contextual integrity up and down the data food chain. Theoretical inquiries in law 20 1 (2019) 221\u2013256.","DOI":"10.1515\/til-2019-0008"},{"key":"e_1_3_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.5555\/3158240"},{"key":"e_1_3_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287567"},{"key":"e_1_3_3_2_89_2","unstructured":"Ethan Perez Sam Ringer Kamil\u0117 Luko\u0161i\u016bt\u0117 Karina Nguyen Edwin Chen Scott Heiner Craig Pettit Catherine Olsson Sandipan Kundu Saurav Kadavath et\u00a0al. 2022. Discovering language model behaviors with model-written evaluations. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2212.09251 (2022)."},{"key":"e_1_3_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00971"},{"key":"e_1_3_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvc77c0h.12"},{"key":"e_1_3_3_2_92_2","doi-asserted-by":"crossref","unstructured":"Katherine\u00a0W Phillips Katie\u00a0A Liljenquist and Margaret\u00a0A Neale. 2009. Is the pain worth the gain? The advantages and liabilities of agreeing with socially distinct newcomers. Personality and Social Psychology Bulletin 35 3 (2009) 336\u2013350.","DOI":"10.1177\/0146167208328062"},{"key":"e_1_3_3_2_93_2","doi-asserted-by":"crossref","unstructured":"Katherine\u00a0W Phillips and Denise\u00a0Lewin Loyd. 2006. When surface and deep-level diversity collide: The effects on dissenting group members. Organizational behavior and human decision processes 99 2 (2006) 143\u2013160.","DOI":"10.1016\/j.obhdp.2005.12.001"},{"key":"e_1_3_3_2_94_2","doi-asserted-by":"crossref","unstructured":"Gaile Pohlhaus. 2002. Knowing communities: An investigation of Harding\u2019s standpoint epistemology. Social epistemology 16 3 (2002) 283\u2013293.","DOI":"10.1080\/0269172022000025633"},{"key":"e_1_3_3_2_95_2","doi-asserted-by":"crossref","unstructured":"Vinodkumar Prabhakaran Aida\u00a0Mostafazadeh Davani and Mark D\u00edaz. 2021. On releasing Annotator-Level labels and information in datasets. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2110.05699 (2021).","DOI":"10.18653\/v1\/2021.law-1.14"},{"key":"e_1_3_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372873"},{"key":"e_1_3_3_2_97_2","doi-asserted-by":"crossref","unstructured":"Quinetta\u00a0M Roberson. 2019. Diversity in the workplace: A review synthesis and future research agenda. Annual Review of Organizational Psychology and Organizational Behavior 6 (2019) 69\u201388.","DOI":"10.1146\/annurev-orgpsych-012218-015243"},{"key":"e_1_3_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533216"},{"key":"e_1_3_3_2_99_2","doi-asserted-by":"publisher","unstructured":"Catharine Saint-Croix. 2020. Privilege and Position: Formal Tools for Standpoint Epistemology. Res Philosophica 97 4 (2020) 489\u2013524. 10.11612\/resphil.1953","DOI":"10.11612\/resphil.1953"},{"key":"e_1_3_3_2_100_2","first-page":"29971","volume-title":"International Conference on Machine Learning","author":"Santurkar Shibani","year":"2023","unstructured":"Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto. 2023. Whose opinions do language models reflect?. In International Conference on Machine Learning. PMLR, 29971\u201330004."},{"key":"e_1_3_3_2_101_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1163"},{"key":"e_1_3_3_2_102_2","doi-asserted-by":"crossref","unstructured":"Mike Schaekermann Graeme Beaton Minahz Habib Andrew Lim Kate Larson and Edith Law. 2019. Understanding expert disagreement in medical data analysis through structured adjudication. Proceedings of the ACM on Human-Computer Interaction 3 CSCW (2019) 1\u201323.","DOI":"10.1145\/3359178"},{"key":"e_1_3_3_2_103_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781410605795"},{"key":"e_1_3_3_2_104_2","unstructured":"Christopher Small Michael Bjorkegren Timo Erkkil\u00e4 Lynette Shaw and Colin Megill. 2021. Polis: Scaling deliberation by mapping high dimensional opinion spaces. Recerca: revista de pensament i an\u00e0lisi 26 2 (2021)."},{"key":"e_1_3_3_2_105_2","volume-title":"Social empiricism","author":"Solomon Miriam","year":"2007","unstructured":"Miriam Solomon. 2007. Social empiricism. MIT press."},{"key":"e_1_3_3_2_106_2","unstructured":"Taylor Sorensen Jared Moore Jillian Fisher Mitchell Gordon Niloofar Mireshghallah Christopher\u00a0Michael Rytting Andre Ye Liwei Jiang Ximing Lu Nouha Dziri et\u00a0al. 2024. A roadmap to pluralistic alignment. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2402.05070 (2024)."},{"key":"e_1_3_3_2_107_2","doi-asserted-by":"crossref","unstructured":"Dominik Stammbach Philine Widmer Eunjung Cho Caglar Gulcehre and Elliott Ash. 2024. Aligning Large Language Models with Diverse Political Viewpoints. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2406.14155 (2024).","DOI":"10.18653\/v1\/2024.emnlp-main.412"},{"key":"e_1_3_3_2_108_2","unstructured":"Daniel Steel Sina Fazelpour Bianca Crewe and Kinley Gillette. 2019. Information elaboration and epistemic effects of diversity. Synthese (2019) 1\u201321."},{"key":"e_1_3_3_2_109_2","doi-asserted-by":"crossref","unstructured":"Daniel Steel Sina Fazelpour Kinley Gillette Bianca Crewe and Michael Burgess. 2018. Multiple diversity concepts and their ethical-epistemic implications. European Journal for Philosophy of Science 8 3 (2018) 761\u2013780.","DOI":"10.1007\/s13194-018-0209-5"},{"key":"e_1_3_3_2_110_2","doi-asserted-by":"publisher","unstructured":"Michael Strevens. 2003. The Role of the Priority Rule in Science. Journal of Philosophy 100 2 (2003) 55\u201379. 10.5840\/jphil2003100224","DOI":"10.5840\/jphil2003100224"},{"key":"e_1_3_3_2_111_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658992"},{"key":"e_1_3_3_2_112_2","doi-asserted-by":"crossref","unstructured":"Elham Tabassi. 2023. Artificial Intelligence Risk Management Framework (AI RMF 1.0). (2023).","DOI":"10.6028\/NIST.AI.100-1"},{"key":"e_1_3_3_2_113_2","doi-asserted-by":"publisher","unstructured":"Johanna Thoma. 2015. The Epistemic Division of Labor Revisited. Philosophy of Science 82 3 (2015) 454\u2013472. 10.1086\/681768","DOI":"10.1086\/681768"},{"key":"e_1_3_3_2_114_2","doi-asserted-by":"publisher","unstructured":"Briana Toole. 2021. Recent Work in Standpoint Epistemology. Analysis 81 2 (2021) 338\u2013350. 10.1093\/analys\/anab026","DOI":"10.1093\/analys\/anab026"},{"key":"e_1_3_3_2_115_2","doi-asserted-by":"crossref","unstructured":"Nancy Tuana. 2010. Leading with ethics aiming for policy: New opportunities for philosophy of science. Synthese 177 (2010) 471\u2013492.","DOI":"10.1007\/s11229-010-9793-4"},{"key":"e_1_3_3_2_116_2","doi-asserted-by":"crossref","unstructured":"Nancy Tuana. 2013. Embedding philosophers in the practices of science: bringing humanities to the sciences. Synthese 190 11 (2013) 1955\u20131973.","DOI":"10.1007\/s11229-012-0171-2"},{"key":"e_1_3_3_2_117_2","doi-asserted-by":"crossref","unstructured":"Nancy Tuana. 2017. Understanding coupled ethical-epistemic issues relevant to climate modeling and decision support science. Scientific integrity and ethics in the geosciences (2017) 155\u2013173.","DOI":"10.1002\/9781119067825.ch10"},{"key":"e_1_3_3_2_118_2","doi-asserted-by":"crossref","unstructured":"Alexandra\u00a0N Uma Tommaso Fornaciari Dirk Hovy Silviu Paun Barbara Plank and Massimo Poesio. 2021. Learning from disagreement: A survey. Journal of Artificial Intelligence Research 72 (2021) 1385\u20131470.","DOI":"10.1613\/jair.1.12752"},{"key":"e_1_3_3_2_119_2","first-page":"921","volume-title":"AMIA annual symposium proceedings","author":"Valizadegan Hamed","year":"2012","unstructured":"Hamed Valizadegan, Quang Nguyen, and Milos Hauskrecht. 2012. Learning medical diagnosis models from multiple experts. In AMIA annual symposium proceedings, Vol.\u00a02012. 921."},{"key":"e_1_3_3_2_120_2","doi-asserted-by":"crossref","unstructured":"Kate Vredenburgh. 2022. The right to explanation. Journal of Political Philosophy 30 2 (2022) 209\u2013229.","DOI":"10.1111\/jopp.12262"},{"key":"e_1_3_3_2_121_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-5618"},{"key":"e_1_3_3_2_122_2","unstructured":"Amy\u00a0A Winecoff and Miranda Bogen. 2024. Improving governance outcomes through AI documentation: Bridging theory and practice. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2409.08960 (2024)."},{"key":"e_1_3_3_2_123_2","first-page":"26","volume-title":"Science and other cultures: issues in philosophies of science and technology","author":"Wylie Alison","year":"2003","unstructured":"Alison Wylie. 2003. Why Standpoint Matters. In Science and other cultures: issues in philosophies of science and technology, Robert Figueroa and Sandra\u00a0G. Harding (Eds.). Routledge, 26\u201348."},{"key":"e_1_3_3_2_124_2","doi-asserted-by":"crossref","unstructured":"Alison Wylie. 2017. What knowers know well: standpoint theory and gender archeology. Scientiae Studia 15 1 (2017) 13\u201338.","DOI":"10.11606\/51678-31662017000100002"},{"key":"e_1_3_3_2_125_2","first-page":"260","volume-title":"Human language technologies 2007: The conference of the North American chapter of the association for computational linguistics; proceedings of the main conference","author":"Zaidan Omar","year":"2007","unstructured":"Omar Zaidan, Jason Eisner, and Christine Piatko. 2007. Using \u201cannotator rationales\u201d to improve machine learning for text categorization. In Human language technologies 2007: The conference of the North American chapter of the association for computational linguistics; proceedings of the main conference. 260\u2013267."},{"key":"e_1_3_3_2_126_2","doi-asserted-by":"crossref","unstructured":"Weiyu Zhang. 2015. Perceived procedural fairness in deliberation: Predictors and effects. Communication Research 42 3 (2015) 345\u2013364.","DOI":"10.1177\/0093650212469544"}],"event":{"name":"FAccT '25: The 2025 ACM Conference on Fairness, Accountability, and Transparency","location":"Athens Greece","acronym":"FAccT '25"},"container-title":["Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715275.3732146","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T11:15:33Z","timestamp":1750763733000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715275.3732146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":125,"alternative-id":["10.1145\/3715275.3732146","10.1145\/3715275"],"URL":"https:\/\/doi.org\/10.1145\/3715275.3732146","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-06-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}