{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T01:07:41Z","timestamp":1783040861033,"version":"3.54.6"},"reference-count":112,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T00:00:00Z","timestamp":1681430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1952085, 1939606, 2125858"],"award-info":[{"award-number":["1952085, 1939606, 2125858"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,4,14]]},"abstract":"<jats:p>Research exploring how to support decision-making has often used machine learning to automate or assist human decisions. We take an alternative approach for improving decision-making, using machine learning to help stakeholders surface ways to improve and make fairer decision-making processes. We created \"Deliberating with AI\", a web tool that enables people to create and evaluate ML models in order to examine strengths and shortcomings of past decision-making and deliberate on how to improve future decisions. We apply this tool to a context of people selection, having stakeholders---decision makers (faculty) and decision subjects (students)---use the tool to improve graduate school admission decisions. Through our case study, we demonstrate how the stakeholders used the web tool to create ML models that they used as boundary objects to deliberate over organization decision-making practices. We share insights from our study to inform future research on stakeholder-centered participatory AI design and technology for organizational decision-making.<\/jats:p>","DOI":"10.1145\/3579601","type":"journal-article","created":{"date-parts":[[2023,4,16]],"date-time":"2023-04-16T17:23:07Z","timestamp":1681665787000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":65,"title":["Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9850-2783","authenticated-orcid":false,"given":"Angie","family":"Zhang","sequence":"first","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8742-3257","authenticated-orcid":false,"given":"Olympia","family":"Walker","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5306-8373","authenticated-orcid":false,"given":"Kaci","family":"Nguyen","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3533-2959","authenticated-orcid":false,"given":"Jiajun","family":"Dai","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2593-7452","authenticated-orcid":false,"given":"Anqing","family":"Chen","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2696-6546","authenticated-orcid":false,"given":"Min Kyung","family":"Lee","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,4,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCIDS.2019.8862140"},{"key":"e_1_2_1_2_1","first-page":"77","article-title":"Machine bias: There's software used across the country to predict future criminals. And it's biased against blacks","volume":"23","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias: There's software used across the country to predict future criminals. And it's biased against blacks. ProPublica, Vol. 23 (2016), 77--91.","journal-title":"ProPublica"},{"key":"e_1_2_1_3_1","volume-title":"Human-Centered Data Science: An Introduction","author":"Aragon Cecilia","unstructured":"Cecilia Aragon, Shion Guha, Marina Kogan, Michael Muller, and Gina Neff. 2022. Human-Centered Data Science: An Introduction. MIT Press."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjy012"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-73246-2"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/00221546.2018.1442633"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979275"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287"},{"key":"e_1_2_1_9_1","volume-title":"Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American economic review","author":"Bertrand Marianne","year":"2004","unstructured":"Marianne Bertrand and Sendhil Mullainathan. 2004. Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American economic review, Vol. 94, 4 (2004), 991--1013."},{"key":"e_1_2_1_10_1","volume-title":"Fairlearn: A toolkit for assessing and improving fairness in AI. Microsoft, Tech. Rep. MSR-TR-2020--32","author":"Bird Sarah","year":"2020","unstructured":"Sarah Bird, Miro Dud'ik, Richard Edgar, Brandon Horn, Roman Lutz, Vanessa Milan, Mehrnoosh Sameki, Hanna Wallach, and Kathleen Walker. 2020. Fairlearn: A toolkit for assessing and improving fairness in AI. Microsoft, Tech. Rep. MSR-TR-2020--32 (2020)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300271"},{"key":"e_1_2_1_12_1","volume-title":"Conference on fairness, accountability and transparency. PMLR, 77--91","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77--91."},{"key":"e_1_2_1_13_1","volume-title":"A conceptual definition and theoretical model of public deliberation in small face-to-face groups. Communication theory","author":"Burkhalter Stephanie","year":"2002","unstructured":"Stephanie Burkhalter, John Gastil, and Todd Kelshaw. 2002. A conceptual definition and theoretical model of public deliberation in small face-to-face groups. Communication theory, Vol. 12, 4 (2002), 398--422."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3443435"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2021.102607"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2022.102285"},{"key":"e_1_2_1_17_1","unstructured":"Dennis Carey and Matt Smith. 2016. How companies are using simulations competitions and analytics to hire. https:\/\/hbr.org\/2016\/04\/how-companies-are-using-simulations-competitions-and-analytics-to-hire"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300761"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445308"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300789"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3154862.3154881"},{"key":"e_1_2_1_22_1","volume-title":"Algorithmic bias: A counterfactual perspective. NSF Trustworthy Algorithms","author":"Cowgill Bo","year":"2017","unstructured":"Bo Cowgill and Catherine Tucker. 2017. Algorithmic bias: A counterfactual perspective. NSF Trustworthy Algorithms (2017)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.childyouth.2017.06.027"},{"key":"e_1_2_1_24_1","volume-title":"Science","volume":"243","author":"Dawes Robyn M","year":"1989","unstructured":"Robyn M Dawes, David Faust, and Paul E Meehl. 1989. Clinical versus actuarial judgment. Science, Vol. 243, 4899 (1989), 1668--1674."},{"key":"e_1_2_1_25_1","volume-title":"Doubting AI Predictions: Influence-Driven Second Opinion Recommendation. arXiv preprint arXiv:2205.00072","author":"De-Arteaga Maria","year":"2022","unstructured":"Maria De-Arteaga, Alexandra Chouldechova, and Artur Dubrawski. 2022. Doubting AI Predictions: Influence-Driven Second Opinion Recommendation. arXiv preprint arXiv:2205.00072 (2022)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376638"},{"key":"e_1_2_1_27_1","volume-title":"Stakeholder Participation in AI: Beyond\" Add Diverse Stakeholders and Stir\". arXiv preprint arXiv:2111.01122","author":"Delgado Fernando","year":"2021","unstructured":"Fernando Delgado, Stephen Yang, Michael Madaio, and Qian Yang. 2021. Stakeholder Participation in AI: Beyond\" Add Diverse Stakeholders and Stir\". arXiv preprint arXiv:2111.01122 (2021)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1075\/idj.23.1.03dig"},{"key":"e_1_2_1_29_1","volume-title":"Data feminism","author":"D'ignazio Catherine","unstructured":"Catherine D'ignazio and Lauren F Klein. 2020. Data feminism. MIT press."},{"key":"e_1_2_1_30_1","unstructured":"Carol B Diminnie. 1992. An Essential Guide to Graduate Admissions. A Policy Statement. (1992)."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v4i1.13270"},{"key":"e_1_2_1_32_1","volume-title":"Public deliberation in an era of communicative plenty. Policy & politics","author":"Ercan Selen A","year":"2019","unstructured":"Selen A Ercan, Carolyn M Hendriks, and John S Dryzek. 2019. Public deliberation in an era of communicative plenty. Policy & politics, Vol. 47, 1 (2019), 19--36."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376293"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.359001"},{"key":"e_1_2_1_35_1","volume-title":"Deliberative democracy","author":"Fishkin James S","year":"2002","unstructured":"James S Fishkin. 2002. Deliberative democracy. The Blackwell guide to social and political philosophy (2002), 221--238."},{"key":"e_1_2_1_36_1","volume-title":"Minipublics: Deliberative designs and their consequences. In Deliberation, participation and democracy","author":"Fung Archon","year":"2007","unstructured":"Archon Fung. 2007. Minipublics: Deliberative designs and their consequences. In Deliberation, participation and democracy. Springer, 159--183."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458723"},{"key":"e_1_2_1_38_1","volume-title":"Orchestrating impartiality: The impact of\" blind\" auditions on female musicians. American economic review","author":"Goldin Claudia","year":"2000","unstructured":"Claudia Goldin and Cecilia Rouse. 2000. Orchestrating impartiality: The impact of\" blind\" auditions on female musicians. American economic review, Vol. 90, 4 (2000), 715--741."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0032-3217.2003.00450.x"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"32","author":"Nina","year":"2018","unstructured":"Nina Grgi?-Hlavc a, Muhammad Bilal Zafar, Krishna P Gummadi, and Adrian Weller. 2018. Beyond distributive fairness in algorithmic decision making: Feature selection for procedurally fair learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32."},{"key":"e_1_2_1_41_1","volume-title":"Clinical versus mechanical prediction: a meta-analysis. Psychological assessment","author":"Grove William M","year":"2000","unstructured":"William M Grove, David H Zald, Boyd S Lebow, Beth E Snitz, and Chad Nelson. 2000. Clinical versus mechanical prediction: a meta-analysis. Psychological assessment, Vol. 12, 1 (2000), 19."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359318"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2019.62.3"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300291"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445918"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bushor.2018.03.007"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986201"},{"key":"e_1_2_1_49_1","unstructured":"Jerome Karabel. 2005. The chosen: The hidden history of admission and exclusion at Harvard Yale and Princeton. Houghton Mifflin Harcourt."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372874"},{"key":"e_1_2_1_51_1","unstructured":"Rebecca Kelliher. 2021. Ai in admissions can reduce or reinforce biases. https:\/\/www.diverseeducation.com\/students\/article\/15114427\/ai-in-admissions-can-reduce-or-reinforce-biases#: :text=Admissions%20offices%20have%20been%20rolling these%20emerging%20tools%20are%20used."},{"key":"e_1_2_1_52_1","volume-title":"Holistic review in graduate admissions","author":"Kent Julia D","year":"2016","unstructured":"Julia D Kent and Maureen Terese McCarthy. 2016. Holistic review in graduate admissions. Council of Graduate Schools (2016)."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462516"},{"key":"e_1_2_1_54_1","volume-title":"Human decisions and machine predictions. The quarterly journal of economics","author":"Kleinberg Jon","year":"2018","unstructured":"Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2018. Human decisions and machine predictions. The quarterly journal of economics, Vol. 133, 1 (2018), 237--293."},{"key":"e_1_2_1_55_1","volume-title":"New York Times","volume":"30","author":"Kramer Margaret","year":"2019","unstructured":"Margaret Kramer. 2019. A timeline of key Supreme Court cases on affirmative action. New York Times, Vol. 30 (2019)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145249"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675147"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-007-9044-5"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998230"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359284"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807552"},{"key":"e_1_2_1_62_1","volume-title":"Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al.","author":"Lee Min Kyung","year":"2019","unstructured":"Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al. 2019b. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--35."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445261"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376609"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030166"},{"key":"e_1_2_1_66_1","unstructured":"Nira Liberman Yaacov Trope and Elena Stephan. 2007. Psychological distance. (2007)."},{"key":"e_1_2_1_67_1","volume-title":"Designing for the Bittersweet: Improving Sensitive Experiences with Recommender Systems. In CHI Conference on Human Factors in Computing Systems. 1--18","author":"Lustig Caitlin","year":"2022","unstructured":"Caitlin Lustig, Artie Konrad, and Jed R Brubaker. 2022. Designing for the Bittersweet: Improving Sensitive Experiences with Recommender Systems. In CHI Conference on Human Factors in Computing Systems. 1--18."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10755-014-9313-4"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512899"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376445"},{"key":"e_1_2_1_71_1","volume-title":"Predict responsibly: improving fairness and accuracy by learning to defer. arXiv preprint arXiv:1711.06664","author":"Madras David","year":"2017","unstructured":"David Madras, Toniann Pitassi, and Richard Zemel. 2017. Predict responsibly: improving fairness and accuracy by learning to defer. arXiv preprint arXiv:1711.06664 (2017)."},{"key":"e_1_2_1_72_1","unstructured":"Emmanuel Martinez and Lauren Kirchner. 2021. The Secret Bias Hidden in Mortgage-Approval Algorithms."},{"key":"e_1_2_1_73_1","volume-title":"Science Advances","volume":"7","author":"Matrajt Laura","year":"2021","unstructured":"Laura Matrajt, Julia Eaton, Tiffany Leung, and Elizabeth R Brown. 2021. Vaccine optimization for COVID-19: Who to vaccinate first? Science Advances, Vol. 7, 6 (2021), eabf1374."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3457607"},{"key":"e_1_2_1_75_1","volume-title":"Supporting Storytelling With Evidence in Holistic Review Processes: A Participatory Design Approach. Proceedings of the ACM on Human-Computer Interaction","volume":"4","author":"Metoyer Ronald A","year":"2020","unstructured":"Ronald A Metoyer, Tya S Chuanromanee, Gina M Girgis, Qiyu Zhi, and Eleanor C Kinyon. 2020. Supporting Storytelling With Evidence in Holistic Review Processes: A Participatory Design Approach. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW1 (2020), 1--24."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450658"},{"key":"e_1_2_1_77_1","volume-title":"A toolkit for centering racial equity throughout data integration. Actionable Intelligence for Social Policy","author":"Nelson Amy Hawn","unstructured":"Amy Hawn Nelson, Della Jenkins, Sharon Zanti, Matthew F Katz, Emily Berkowitz, TC Burnett, and Dennis P Culhane. 2020. A toolkit for centering racial equity throughout data integration. Actionable Intelligence for Social Policy, University of Pennsylvania."},{"key":"e_1_2_1_78_1","unstructured":"Derek Newton. 2021. Artificial intelligence grading your 'neuroticism'? welcome to colleges' new frontier. https:\/\/www.usatoday.com\/story\/news\/education\/2021\/04\/26\/ai-infiltrating-college-admissions-teaching-grading\/7348128002\/"},{"key":"e_1_2_1_79_1","unstructured":"DJ Pangburn. 2019. Schools are using software to help pick who gets in. what could go wrong? https:\/\/www.fastcompany.com\/90342596\/schools-are-quietly-turning-to-ai-to-help-pick-who-gets-in-what-could-go-wrong"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287567"},{"key":"e_1_2_1_81_1","volume-title":"Qualitative evaluation and research methods","author":"Patton Michael Quinn","unstructured":"Michael Quinn Patton. 1990. Qualitative evaluation and research methods. SAGE Publications, inc."},{"key":"e_1_2_1_82_1","volume-title":"Inside graduate admissions: Merit, diversity, and faculty gatekeeping","author":"Posselt Julie R","unstructured":"Julie R Posselt. 2016. Inside graduate admissions: Merit, diversity, and faculty gatekeeping. Harvard University Press."},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1093\/sf\/soaa026"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372873"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476089"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359178"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274423"},{"key":"e_1_2_1_88_1","volume-title":"The reflective practitioner: How professionals think in action","author":"Sch\u00f6n Donald A","unstructured":"Donald A Sch\u00f6n. 2017. The reflective practitioner: How professionals think in action. Routledge."},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445971"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415224"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533110"},{"key":"e_1_2_1_92_1","unstructured":"Rachel Emma Silverman and Nikki Waller. 2015. The algorithm that tells the boss who might quit. https:\/\/www.wsj.com\/articles\/the-algorithm-that-tells-the-boss-who-might-quit-1426287935"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376783"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330664"},{"key":"e_1_2_1_95_1","volume-title":"Distributed artificial intelligence","author":"Star Susan Leigh","unstructured":"Susan Leigh Star. 1989. The structure of ill-structured solutions: Boundary objects and heterogeneous distributed problem solving. In Distributed artificial intelligence. Elsevier, 37--54."},{"key":"e_1_2_1_96_1","volume-title":"Cognitive Biases in Visualizations","author":"Sukumar Poorna Talkad","unstructured":"Poorna Talkad Sukumar and Ronald Metoyer. 2018. A visualization approach to addressing reviewer bias in holistic college admissions. In Cognitive Biases in Visualizations. Springer, 161--175."},{"key":"e_1_2_1_97_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"2","author":"Sukumar Poorna Talkad","year":"2018","unstructured":"Poorna Talkad Sukumar, Ronald Metoyer, and Shuai He. 2018. Making a pecan pie: Understanding and supporting the holistic review process in admissions. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 1--22."},{"key":"e_1_2_1_98_1","first-page":"117","article-title":"Prioritizing homeless assistance using predictive algorithms: an evidence-based approach","volume":"20","author":"Toros Halil","year":"2018","unstructured":"Halil Toros and Daniel Flaming. 2018. Prioritizing homeless assistance using predictive algorithms: an evidence-based approach. Cityscape, Vol. 20, 1 (2018), 117--146.","journal-title":"Cityscape"},{"key":"e_1_2_1_99_1","volume-title":"Legal Information Institute","author":"Bollinger Grutter","year":"2003","unstructured":"Grutter v Bollinger. 2014. 539 US 306 (2003). Legal Information Institute, Cornell University Law School. https:\/\/www. law. cornell. edu\/supct\/html\/02--241. ZO. html (2014)."},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359130"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2021\/16559"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i1.2504"},{"key":"e_1_2_1_103_1","volume-title":"The what-if tool: Interactive probing of machine learning models","author":"Wexler James","year":"2019","unstructured":"James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics, Vol. 26, 1 (2019), 56--65."},{"key":"e_1_2_1_104_1","volume-title":"City Digits: Local Lotto: Developing youth data literacy by investigating the lottery. Journal of Digital Media Literacy","author":"Williams Sarah","year":"2014","unstructured":"Sarah Williams, Erica Deahl, Laurie Rubel, and Vivian Lim. 2014. City Digits: Local Lotto: Developing youth data literacy by investigating the lottery. Journal of Digital Media Literacy (2014)."},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445928"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174230"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376807"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196729"},{"key":"e_1_2_1_109_1","volume-title":"Wikipedia ORES Explorer: Visualizing Trade-offs For Designing Applications With Machine Learning API. In Designing Interactive Systems Conference","author":"Ye Zining","year":"2021","unstructured":"Zining Ye, Xinran Yuan, Shaurya Gaur, Aaron Halfaker, Jodi Forlizzi, and Haiyi Zhu. 2021. Wikipedia ORES Explorer: Visualizing Trade-offs For Designing Applications With Machine Learning API. In Designing Interactive Systems Conference 2021. 1554--1565."},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395528"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501866"},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579601","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579601","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579601","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:43Z","timestamp":1750182523000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579601"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,14]]},"references-count":112,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2023,4,14]]}},"alternative-id":["10.1145\/3579601"],"URL":"https:\/\/doi.org\/10.1145\/3579601","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,14]]},"assertion":[{"value":"2023-04-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}