{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T21:27:07Z","timestamp":1789507627125,"version":"build-2803163510"},"publisher-location":"New York, NY, USA","reference-count":48,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3715275.3732138","type":"proceedings-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T17:01:18Z","timestamp":1750698078000},"page":"2040-2055","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Allocation Multiplicity: Evaluating the Promises of the Rashomon Set"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5232-3264","authenticated-orcid":false,"given":"Shomik","family":"Jain","sequence":"first","affiliation":[{"name":"Institute for Data, Systems, and Society, MIT, Cambridge, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-7356-7141","authenticated-orcid":false,"given":"Margaret","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering & Computer Science, MIT, Cambridge, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7371-2680","authenticated-orcid":false,"given":"Kathleen","family":"Creel","sequence":"additional","affiliation":[{"name":"Department of Philosophy & Religion and Khoury College of Computer Sciences, Northeastern University, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7072-2912","authenticated-orcid":false,"given":"Ashia","family":"Wilson","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering & Computer Science, MIT, Cambridge, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"e_1_3_3_2_2_2","unstructured":"Werner Antweiler. 2018. A sigmoid-logit probability function for the (0 1) domain. https:\/\/wernerantweiler.ca\/blog.php?item=2018-11-03"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1017\/9781108582865"},{"key":"e_1_3_3_2_4_2","unstructured":"Eric Auerbach Annie Liang Max Tabord-Meehan and Kyohei Okumura. 2024. Testing the Fairness-Improvability of Algorithms. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2405.04816 (2024)."},{"key":"e_1_3_3_2_5_2","volume-title":"Fairness and machine learning: Limitations and opportunities","author":"Barocas Solon","year":"2023","unstructured":"Solon Barocas, Moritz Hardt, and Arvind Narayanan. 2023. Fairness and machine learning: Limitations and opportunities. MIT press."},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658928"},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"crossref","unstructured":"Emily Black John\u00a0Logan Koepke Pauline Kim Solon Barocas and Mingwei Hsu. 2024. Less discriminatory algorithms. Georgetown Law Journal (2024). https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=4590481","DOI":"10.2139\/ssrn.4590481"},{"key":"e_1_3_3_2_8_2","volume-title":"Ninth International Conference on Learning Representations","author":"Black Emily","year":"2021","unstructured":"Emily Black and Klas Leino. 2021. Selective Ensembles for Consistent Predictions. In Ninth International Conference on Learning Representations."},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3617694.3623259"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533149"},{"key":"e_1_3_3_2_11_2","unstructured":"Rishi Bommasani Kathleen\u00a0A Creel Ananya Kumar Dan Jurafsky and Percy\u00a0S Liang. 2022. Picking on the same person: Does algorithmic monoculture lead to outcome homogenization? Advances in Neural Information Processing Systems 35 (2022) 3663\u20133678."},{"key":"e_1_3_3_2_12_2","doi-asserted-by":"crossref","unstructured":"Leo Breiman. 2001. Statistical modeling: The two cultures. Statistical science 16 3 (2001) 199\u2013231.","DOI":"10.1214\/ss\/1009213726"},{"key":"e_1_3_3_2_13_2","first-page":"87","volume-title":"Proceedings of the Aristotelian Society","volume":"91","author":"Broome John","year":"1990","unstructured":"John Broome. 1990. Fairness. In Proceedings of the Aristotelian Society, Vol.\u00a091. 87\u2013101."},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i20.30203"},{"key":"e_1_3_3_2_15_2","first-page":"2144","volume-title":"International Conference on Machine Learning","author":"Coston Amanda","year":"2021","unstructured":"Amanda Coston, Ashesh Rambachan, and Alexandra Chouldechova. 2021. Characterizing fairness over the set of good models under selective labels. In International Conference on Machine Learning. PMLR, 2144\u20132155."},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"publisher","unstructured":"Kathleen Creel and Deborah Hellman. 2022. The Algorithmic Leviathan: Arbitrariness Fairness and Opportunity in Algorithmic Decision-Making Systems. Canadian Journal of Philosophy 52 1 (2022) 26\u201343. 10.1017\/can.2022.3","DOI":"10.1017\/can.2022.3"},{"key":"e_1_3_3_2_17_2","unstructured":"Alexander D\u2019Amour Katherine Heller Dan Moldovan Ben Adlam Babak Alipanahi Alex Beutel Christina Chen Jonathan Deaton Jacob Eisenstein Matthew\u00a0D Hoffman et\u00a0al. 2022. Underspecification presents challenges for credibility in modern machine learning. Journal of Machine Learning Research 23 226 (2022) 1\u201361."},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Philip Dawid. 2017. On individual risk. Synthese 194 9 (2017) 3445\u20133474.","DOI":"10.1007\/s11229-015-0953-4"},{"key":"e_1_3_3_2_19_2","unstructured":"Ally\u00a0Yalei Du Dung\u00a0Daniel Ngo and Zhiwei\u00a0Steven Wu. 2024. Reconciling Model Multiplicity for Downstream Decision Making. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2405.19667 (2024)."},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3406325.3451064"},{"key":"e_1_3_3_2_21_2","unstructured":"Aaron Fisher Cynthia Rudin and Francesca Dominici. 2019. All models are wrong but many are useful: Learning a variable\u2019s importance by studying an entire class of prediction models simultaneously. Journal of Machine Learning Research 20 177 (2019) 1\u201381."},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV57701.2024.00443"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594116"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658912"},{"key":"e_1_3_3_2_25_2","first-page":"1939","volume-title":"International Conference on Machine Learning","author":"H\u00e9bert-Johnson Ursula","year":"2018","unstructured":"Ursula H\u00e9bert-Johnson, Michael Kim, Omer Reingold, and Guy Rothblum. 2018. Multicalibration: Calibration for the (computationally-identifiable) masses. In International Conference on Machine Learning. PMLR, 1939\u20131948."},{"key":"e_1_3_3_2_26_2","unstructured":"Hsiang Hsu and Flavio Calmon. 2022. Rashomon capacity: A metric for predictive multiplicity in classification. Advances in Neural Information Processing Systems 35 (2022) 28988\u201329000. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/ba4caa85ecdcafbf9102ab8ec384182d-Paper-Conference.pdf"},{"key":"e_1_3_3_2_27_2","unstructured":"Hsiang Hsu Guihong Li Shaohan Hu et\u00a0al. 2024. Dropout-Based Rashomon Set Exploration for Efficient Predictive Multiplicity Estimation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2402.00728 (2024)."},{"key":"e_1_3_3_2_28_2","volume-title":"Forty-first International Conference on Machine Learning","author":"Jain Shomik","year":"2024","unstructured":"Shomik Jain, Kathleen Creel, and Ashia Wilson. 2024. Position: Scarce Resource Allocations That Rely On Machine Learning Should Be Randomized. In Forty-first International Conference on Machine Learning."},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658899"},{"key":"e_1_3_3_2_30_2","unstructured":"Junqi Jiang Antonio Rago Francesco Leofante and Francesca Toni. 2023. Recourse under model multiplicity via argumentative ensembling. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2312.15097 (2023)."},{"key":"e_1_3_3_2_31_2","doi-asserted-by":"crossref","unstructured":"Jon Kleinberg and Manish Raghavan. 2021. Algorithmic monoculture and social welfare. Proceedings of the National Academy of Sciences 118 22 (2021) e2018340118.","DOI":"10.1073\/pnas.2018340118"},{"key":"e_1_3_3_2_32_2","unstructured":"Benjamin Laufer Manish Raghavan and Solon Barocas. 2024. Fundamental Limits in the Search for Less Discriminatory Algorithms\u2013and How to Avoid Them. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2412.18138 (2024)."},{"key":"e_1_3_3_2_33_2","unstructured":"Sichao Li Amanda\u00a0S Barnard and Quanling Deng. 2024. Practical attribution guidance for rashomon sets. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2407.18482 (2024)."},{"key":"e_1_3_3_2_34_2","volume-title":"Advances in Neural Information Processing Systems","author":"Liu Jiachang","year":"2022","unstructured":"Jiachang Liu, Chudi Zhong, Boxuan Li, Margo Seltzer, and Cynthia Rudin. 2022. FasterRisk: Fast and Accurate Interpretable Risk Scores. In Advances in Neural Information Processing Systems, Alice\u00a0H. Oh, Alekh Agarwal, Danielle Belgrave, and Kyunghyun Cho (Eds.). https:\/\/openreview.net\/forum?id=xTYL1J6Xt-z"},{"key":"e_1_3_3_2_35_2","unstructured":"Carol Long Hsiang Hsu Wael Alghamdi and Flavio Calmon. 2024. Individual arbitrariness and group fairness. Advances in Neural Information Processing Systems 36 (2024)."},{"key":"e_1_3_3_2_36_2","series-title":"Proceedings of Machine Learning Research","first-page":"6765","volume-title":"Proceedings of the 37th International Conference on Machine Learning","volume":"119","author":"Marx Charles","year":"2020","unstructured":"Charles Marx, Flavio Calmon, and Berk Ustun. 2020. Predictive Multiplicity in Classification. In Proceedings of the 37th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol.\u00a0119), Hal\u00a0Daum\u00e9 III and Aarti Singh (Eds.). PMLR, 6765\u20136774. https:\/\/proceedings.mlr.press\/v119\/marx20a.html"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3593988"},{"key":"e_1_3_3_2_38_2","unstructured":"Arvind Narayanan Angelina Wang Sayash Kapoor and Solon Barocas. 2024. Does the UK\u2019s liver transplant matching algorithm systematically exclude younger patients? https:\/\/www.aisnakeoil.com\/p\/does-the-uks-liver-transplant-matching."},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"crossref","unstructured":"Ziad Obermeyer Brian Powers Christine Vogeli and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366 6464 (2019) 447\u2013453.","DOI":"10.1126\/science.aax2342"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3593980"},{"key":"e_1_3_3_2_41_2","volume-title":"Forty-first International Conference on Machine Learning","author":"Rudin Cynthia","year":"2024","unstructured":"Cynthia Rudin, Chudi Zhong, Lesia Semenova, Margo Seltzer, Ronald Parr, Jiachang Liu, Srikar Katta, Jon Donnelly, Harry Chen, and Zachery Boner. 2024. Position: Amazing Things Come From Having Many Good Models. In Forty-first International Conference on Machine Learning. https:\/\/openreview.net\/forum?id=oFDFGd9Age"},{"key":"e_1_3_3_2_42_2","unstructured":"Lesia Semenova Harry Chen Ronald Parr and Cynthia Rudin. 2023. A path to simpler models starts with noise. Advances in neural information processing systems 36 (2023). https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2023\/file\/0a49935d2b3d3342ca08d6db0adcfa34-Paper-Conference.pdf"},{"key":"e_1_3_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533232"},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658974"},{"key":"e_1_3_3_2_45_2","unstructured":"Connor Toups Rishi Bommasani Kathleen Creel Sarah Bana Dan Jurafsky and Percy\u00a0S Liang. 2023. Ecosystem-level analysis of deployed machine learning reveals homogeneous outcomes. Advances in Neural Information Processing Systems 36 (2023)."},{"key":"e_1_3_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3593998"},{"key":"e_1_3_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v37i9.26227"},{"key":"e_1_3_3_2_48_2","volume-title":"Advances in Neural Information Processing Systems","author":"Xin Rui","year":"2022","unstructured":"Rui Xin, Chudi Zhong, Zhi Chen, Takuya Takagi, Margo Seltzer, and Cynthia Rudin. 2022. Exploring the Whole Rashomon Set of Sparse Decision Trees. In Advances in Neural Information Processing Systems, Alice\u00a0H. Oh, Alekh Agarwal, Danielle Belgrave, and Kyunghyun Cho (Eds.). https:\/\/openreview.net\/forum?id=WHqVVk3UHr"},{"key":"e_1_3_3_2_49_2","volume-title":"Thirty-seventh Conference on Neural Information Processing Systems","author":"Zhong Chudi","year":"2023","unstructured":"Chudi Zhong, Zhi Chen, Jiachang Liu, Margo Seltzer, and Cynthia Rudin. 2023. Exploring and Interacting with the Set of Good Sparse Generalized Additive Models. In Thirty-seventh Conference on Neural Information Processing Systems. https:\/\/openreview.net\/forum?id=CzAAbKOHQW"}],"event":{"name":"FAccT '25: The 2025 ACM Conference on Fairness, Accountability, and Transparency","location":"Athens Greece","acronym":"FAccT '25"},"container-title":["Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715275.3732138","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T11:19:50Z","timestamp":1750763990000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715275.3732138"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":48,"alternative-id":["10.1145\/3715275.3732138","10.1145\/3715275"],"URL":"https:\/\/doi.org\/10.1145\/3715275.3732138","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-06-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}