{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T05:55:29Z","timestamp":1782280529468,"version":"3.54.5"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,5,2]]},"abstract":"<jats:p>The issue of fairness in decision-making is a critical one, especially given the variety of stakeholder demands for differing and mutually incompatible versions of fairness. Adopting a strategic interaction of perspectives provides an alternative to enforcing a singular standard of fairness. We present a web-based software application, FairPlay, that enables multiple stakeholders to debias datasets collaboratively. With FairPlay, users can negotiate and arrive at a mutually acceptable outcome without a universally agreed-upon theory of fairness. In the absence of such a tool, reaching a consensus would be highly challenging due to the lack of a systematic negotiation process and the inability to modify and observe changes. We have conducted user studies that demonstrate the success of FairPlay, as users could reach a consensus within about five rounds of gameplay, illustrating the application's potential for enhancing fairness in AI systems.<\/jats:p>","DOI":"10.1145\/3710982","type":"journal-article","created":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T01:35:05Z","timestamp":1746236105000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["<scp>FairPlay:<\/scp>\n            A Collaborative Approach to Mitigate Bias in Datasets for Improved AI Fairness"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1157-9082","authenticated-orcid":false,"given":"Tina","family":"Behzad","sequence":"first","affiliation":[{"name":"Department of Computer Science, Stony Brook University, Stony Brook, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6477-1495","authenticated-orcid":false,"given":"Mithilesh Kumar","family":"Singh","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Stony Brook University, Stony Brook, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1412-4384","authenticated-orcid":false,"given":"Anthony J.","family":"Ripa","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Stony Brook University, Stony Brook, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0996-8590","authenticated-orcid":false,"given":"Klaus","family":"Mueller","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Stony Brook University, Stony Brook, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,5,2]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"International conference on machine learning. PMLR, 60--69","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\u00edk, John Langford, and Hanna Wallach. 2018. A reductions approach to fair classification. In International conference on machine learning. PMLR, 60--69."},{"key":"e_1_2_1_2_1","volume-title":"Fairsight: Visual analytics for fairness in decision making","author":"Ahn Yongsu","year":"2019","unstructured":"Yongsu Ahn and Yu-Ru Lin. 2019. Fairsight: Visual analytics for fairness in decision making. IEEE transactions on visualization and computer graphics 26, 1 (2019), 1086--1095."},{"key":"e_1_2_1_3_1","unstructured":"Larry Alexander and Michael Moore. 2007. Deontological ethics. (2007)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/0165-0114(78)90017--9"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","unstructured":"Rashmi Bhardwaj and Debabrata Datta. 2020. Consensus Algorithm. Springer International Publishing Cham 91--107. doi:10.1007\/978--3-030--38677--1_5","DOI":"10.1007\/978--3-030--38677--1_5"},{"key":"e_1_2_1_7_1","volume-title":"Conference on fairness, accountability and transparency. PMLR, 149--159","author":"Binns Reuben","year":"2018","unstructured":"Reuben Binns. 2018. Fairness in machine learning: Lessons from political philosophy. In Conference on fairness, accountability and transparency. PMLR, 149--159."},{"key":"e_1_2_1_8_1","volume-title":"Usability Evaluation in Industry","author":"Brooke John","unstructured":"John Brooke. 1996. SUS: a \"quick and dirty\" usability scale. In Usability Evaluation in Industry, P.W. Jordan, B. Thomas, B. A. Weerdmeester, and A. L. McClelland (Eds.). Taylor and Francis, London."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST47406.2019.8986948"},{"key":"e_1_2_1_10_1","volume-title":"Karthikeyan Natesan Ramamurthy, and Kush R Varshney","author":"Calmon Flavio","year":"2017","unstructured":"Flavio Calmon, Dennis Wei, Bhanukiran Vinzamuri, Karthikeyan Natesan Ramamurthy, and Kush R Varshney. 2017. Optimized pre-processing for discrimination prevention. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3616865"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2012.09.014"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research","volume":"2220","author":"Chierichetti Flavio","year":"2019","unstructured":"Flavio Chierichetti, Ravi Kumar, Silvio Lattanzi, and Sergei Vassilvtiskii. 2019. Matroids, Matchings, and Fairness. In Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research, Vol. 89), Kamalika Chaudhuri and Masashi Sugiyama (Eds.). PMLR, 2212--2220. https: \/\/proceedings.mlr.press\/v89\/chierichetti19a.html"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2750365"},{"key":"e_1_2_1_16_1","volume-title":"Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management science 64, 3","author":"Dietvorst Berkeley J","year":"2018","unstructured":"Berkeley J Dietvorst, Joseph P Simmons, and Cade Massey. 2018. Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management science 64, 3 (2018), 1155--1170."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_2_1_18_1","first-page":"683","article-title":"Facilitating Knowledge Communication through Joint Interactive Visualization","volume":"10","author":"Eppler Martin J","year":"2004","unstructured":"Martin J Eppler. 2004. Facilitating Knowledge Communication through Joint Interactive Visualization. J. Univers. Comput. Sci. 10, 6 (2004), 683--690.","journal-title":"J. Univers. Comput. Sci."},{"key":"e_1_2_1_19_1","first-page":"17","article-title":"Consensus-building in a multi-participant spatial decision support system","volume":"11","author":"Feick Robert D","year":"1999","unstructured":"Robert D Feick and G Brent Hall. 1999. Consensus-building in a multi-participant spatial decision support system. URISA journal 11, 2 (1999), 17--23.","journal-title":"URISA journal"},{"key":"e_1_2_1_20_1","unstructured":"Sorelle A. Friedler Carlos Scheidegger and Suresh Venkatasubramanian. 2016. On the (im)possibility of fairness. arXiv:1609.07236"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3433949"},{"key":"e_1_2_1_22_1","volume-title":"On formalizing fairness in prediction with machine learning. arXiv preprint arXiv:1710.03184","author":"Gajane Pratik","year":"2017","unstructured":"Pratik Gajane and Mykola Pechenizkiy. 2017. On formalizing fairness in prediction with machine learning. arXiv preprint arXiv:1710.03184 (2017)."},{"key":"e_1_2_1_23_1","first-page":"473","article-title":"D-BIAS: a causality-based human-in-the-loop system for tackling algorithmic bias","volume":"29","author":"Ghai Bhavya","year":"2022","unstructured":"Bhavya Ghai and Klaus Mueller. 2022. D-BIAS: a causality-based human-in-the-loop system for tackling algorithmic bias. IEEE Transactions on Visualization and Computer Graphics 29, 1 (2022), 473--482.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_2_1_24_1","volume-title":"Equality of opportunity in supervised learning. Advances in neural information processing systems 29","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems 29 (2016)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1391107.1391112"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_2_1_27_1","volume-title":"Consensus building: Clarifications for the critics. Planning theory 3, 1","author":"Innes Judith E","year":"2004","unstructured":"Judith E Innes. 2004. Consensus building: Clarifications for the critics. Planning theory 3, 1 (2004), 5--20."},{"key":"e_1_2_1_28_1","volume-title":"Data preprocessing techniques for classification without discrimination. Knowledge and information systems 33, 1","author":"Kamiran Faisal","year":"2012","unstructured":"Faisal Kamiran and Toon Calders. 2012. Data preprocessing techniques for classification without discrimination. Knowledge and information systems 33, 1 (2012), 1--33."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314287"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1257\/pandp.20181018"},{"key":"e_1_2_1_31_1","unstructured":"Jon Kleinberg Sendhil Mullainathan and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv:1609.05807"},{"key":"e_1_2_1_32_1","volume-title":"Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807","author":"Kleinberg Jon","year":"2016","unstructured":"Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807 (2016)."},{"key":"e_1_2_1_33_1","volume-title":"Hawthorne Revisited: Management and the Worker, Its Critics, and Developments in Human Relations in Industry","author":"Landsberger Henry A.","year":"1958","unstructured":"Henry A. Landsberger. 1958. Hawthorne Revisited: Management and the Worker, Its Critics, and Developments in Human Relations in Industry. Cornell University, Ithaca, NY."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1080\/21642583.2019.1695689"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2015.09.024"},{"key":"e_1_2_1_36_1","first-page":"280","article-title":"Budgeted social choice: From consensus to personalized decision making","volume":"11","author":"Lu Tyler","year":"2011","unstructured":"Tyler Lu and Craig Boutilier. 2011. Budgeted social choice: From consensus to personalized decision making. In IJCAI, Vol. 11. 280--286.","journal-title":"IJCAI"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3503568"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research","volume":"118","author":"Menon Aditya Krishna","unstructured":"Aditya Krishna Menon and Robert C. Williamson. 2018. The cost of fairness in binary classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 107--118. https:\/\/proceedings.mlr.press\/v81\/menon18a.html"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168931.2168945"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3494672"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121341.1121514"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445604"},{"key":"e_1_2_1_43_1","volume-title":"Aequitas: A bias and fairness audit toolkit. arXiv preprint arXiv:1811.05577","author":"Saleiro Pedro","year":"2018","unstructured":"Pedro Saleiro, Benedict Kuester, Loren Hinkson, Jesse London, Abby Stevens, Ari Anisfeld, Kit T Rodolfa, and Rayid Ghani. 2018. Aequitas: A bias and fairness audit toolkit. arXiv preprint arXiv:1811.05577 (2018)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.2307\/2091716"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287598"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Ben Shneiderman. 2022. Human-centered AI. Oxford University Press.","DOI":"10.1093\/oso\/9780192845290.001.0001"},{"key":"e_1_2_1_47_1","volume-title":"prediction, and search","author":"Spirtes Peter","unstructured":"Peter Spirtes, Clark N Glymour, and Richard Scheines. 2000. Causation, prediction, and search. MIT press."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2020.12.028"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11077-006-9024-5"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717743530"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551390"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3030471"},{"key":"e_1_2_1_53_1","volume-title":"The what-if tool: Interactive probing of machine learning models","author":"Wexler James","year":"2019","unstructured":"James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics 26, 1 (2019), 56--65."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114850"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376447"},{"key":"e_1_2_1_56_1","unstructured":"Eliezer Yudkowsky. 2004. Coherent extrapolated volition."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2018.11.052"},{"key":"e_1_2_1_58_1","volume-title":"Garnett (Eds.)","volume":"32","author":"Zhao Han","year":"2019","unstructured":"Han Zhao and Geoff Gordon. 2019. Inherent Tradeoffs in Learning Fair Representations. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2019\/file\/b4189d9de0fb2b9cce090bd1a15e3420-Paper.pdf"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23774-4_23"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3710982","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3710982","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T00:51:20Z","timestamp":1755737480000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3710982"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,2]]},"references-count":59,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,2]]}},"alternative-id":["10.1145\/3710982"],"URL":"https:\/\/doi.org\/10.1145\/3710982","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,2]]},"assertion":[{"value":"2025-05-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}