{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:30:20Z","timestamp":1760711420957,"version":"3.44.0"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T00:00:00Z","timestamp":1730937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSF","award":["2107298"],"award-info":[{"award-number":["2107298"]}]},{"DOI":"10.13039\/501100006374","name":"Alfred P. Sloan Foundation","doi-asserted-by":"publisher","award":["G202014036"],"award-info":[{"award-number":["G202014036"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,11,7]]},"abstract":"<jats:p>Past work has sought to design AI ethics interventions--such as checklists or toolkits--to help practitioners design more ethical AI systems. However, other work demonstrates how these interventions may instead serve to limit critique to that addressed within the intervention, while rendering broader concerns illegitimate. In this paper, drawing on work examining how standards enact discursive closure and how power relations affect whether and how people raise critique, we recruit three corporate teams, and one activist team, each with prior context working with one another, to play a game designed to trigger broad discussion around AI ethics. We use this as a point of contrast to trigger reflection on their teams' past discussions, examining factors which may affect their ''license to critique'' in AI ethics discussions. We then report on how particular affordances of this game may influence discussion, and find that the hypothetical context created in the game is unlikely to be a viable mechanism for real world change. We discuss how power dynamics within a group and notions of ''scope'' affect whether people may be willing to raise critique in AI ethics discussions, and discuss our finding that games are unlikely to enable direct changes to products or practice, but may be more likely to allow members to find critically-aligned allies for future collective action.<\/jats:p>","DOI":"10.1145\/3686938","type":"journal-article","created":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T15:52:40Z","timestamp":1731081160000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Power and Play: Investigating \"License to Critique\" in Teams' AI Ethics Discussions"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6912-8067","authenticated-orcid":false,"given":"David Gray","family":"Widder","sequence":"first","affiliation":[{"name":"Digital Life Initiative, Cornell Tech, New York City, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9489-4188","authenticated-orcid":false,"given":"Laura","family":"Dabbish","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7159-7524","authenticated-orcid":false,"given":"James D.","family":"Herbsleb","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1824-0243","authenticated-orcid":false,"given":"Nikolas","family":"Martelaro","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,11,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Sara Ahmed. 2021. Complaint!Duke University Press."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.2304\/pfie.2006.4.2.96"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3323697"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445922"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467--6486.00151"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503508"},{"key":"e_1_2_1_7_1","volume-title":"Fairlearn: A toolkit for assessing and improving fairness in AI. Microsoft, Tech. Rep. MSR-TR-2020--32","author":"Bird Sarah","year":"2020","unstructured":"Sarah Bird, Miro Dud\u00edk, Richard Edgar, Brandon Horn, Roman Lutz, Vanessa Milan, Mehrnoosh Sameki, Hanna Wallach, and Kathleen Walker. 2020. Fairlearn: A toolkit for assessing and improving fairness in AI. Microsoft, Tech. Rep. MSR-TR-2020--32 (2020)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533157"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479582"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-022-04643-y"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1017\/beq.2016.66"},{"key":"e_1_2_1_12_1","volume-title":"Thematic analysis: a practical guide. Thematic Analysis","author":"Clarke Victoria","year":"2021","unstructured":"Victoria Clarke and Virginia Braun. 2021. Thematic analysis: a practical guide. Thematic Analysis (2021), 1--100."},{"key":"e_1_2_1_13_1","volume-title":"Google Employees Say They Faced Retaliation After Organizing Walkout. https:\/\/www.nytimes.com\/2019\/04\/22\/technology\/google-walkout-employees-retaliation.html. The New York Times (22","author":"Conger Kate","year":"2019","unstructured":"Kate Conger and Daisuke Wakabayashi. 2019. Google Employees Say They Faced Retaliation After Organizing Walkout. https:\/\/www.nytimes.com\/2019\/04\/22\/technology\/google-walkout-employees-retaliation.html. The New York Times (22 April 2019). Accessed: 2023-06--27."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.21606\/drs.2016.15"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3557890"},{"volume-title":"Democracy in an age of corporate colonization: Developments in communication and the politics of everyday life","author":"Deetz Stanley","key":"e_1_2_1_16_1","unstructured":"Stanley Deetz. 1992. Democracy in an age of corporate colonization: Developments in communication and the politics of everyday life. SUNY press."},{"key":"e_1_2_1_17_1","volume-title":"Speculative Everything: Design, Fiction, and Social Dreaming","author":"Dunne Anthony","year":"2013","unstructured":"Anthony Dunne and Fiona Raby. 2013. Speculative Everything: Design, Fiction, and Social Dreaming. MIT Press. Google-Books-ID: 9gQyAgAAQBAJ."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","unstructured":"Mary Flanagan and Helen Nissenbaum. 2014. Values at Play in Digital Games. https:\/\/doi.org\/10.7551\/mitpress\/9016.001.0001","DOI":"10.7551\/mitpress\/9016.001.0001"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533241"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2019.258"},{"key":"e_1_2_1_21_1","volume-title":"David Gray Widder, and Emma Strubell","author":"Gururaja Sireesh","year":"2023","unstructured":"Sireesh Gururaja, Amanda Bertsch, Clara Na, David Gray Widder, and Emma Strubell. 2023. To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processing. arXiv preprint arXiv:2310.07715 (2023)."},{"key":"e_1_2_1_22_1","volume-title":"Nuclear Rites: A Weapons Laboratory at the End of the Cold War","author":"Gusterson Hugh","year":"1996","unstructured":"Hugh Gusterson. 1996. Nuclear Rites: A Weapons Laboratory at the End of the Cold War. University of California Press."},{"key":"e_1_2_1_23_1","volume-title":"Situated knowledges: The science question in feminism and the privilege of partial perspective. Simians, cyborgs, and women: The reinvention of nature","author":"Haraway Donna J","year":"1991","unstructured":"Donna J Haraway. 1991. Situated knowledges: The science question in feminism and the privilege of partial perspective. Simians, cyborgs, and women: The reinvention of nature (1991), 183--201."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.35.1.zok6"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/02691720500145449"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.2019.1324"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0088-2"},{"key":"e_1_2_1_29_1","volume-title":"Venture Beat","volume":"1","author":"Johnson Khari","year":"2019","unstructured":"Khari Johnson. 2019. AI ethics is all about power. Venture Beat, Vol. 1 (2019)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1086\/603535"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3310433"},{"key":"e_1_2_1_32_1","unstructured":"Hao-Ping Hank Lee Lan Gao Stephanie Yang Jodi Forlizzi and Sauvik Das. [n. d.]. 'I Don't Know If We're Doing Good. I Don't Know If We're Doing Bad?: Investigating How Practitioners Scope Motivate and Conduct Privacy Work When Developing AI Products. ( [n. d.])."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442420"},{"key":"e_1_2_1_34_1","volume-title":"Paradigmatic controversies, contradictions, and emerging confluences, revisited","author":"Lincoln Yvonna S","year":"2011","unstructured":"Yvonna S Lincoln, Susan A Lynham, and Egon G Guba. 2011. Paradigmatic controversies, contradictions, and emerging confluences, revisited. The Sage handbook of qualitative research, Vol. 4 (2011), 97--128."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512899"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376445"},{"key":"e_1_2_1_37_1","volume-title":"Jennifer Wortman Vaughan, and Hanna Wallach","author":"Madaio Michael A","year":"2020","unstructured":"Michael A Madaio, Luke Stark, Jennifer Wortman Vaughan, and Hanna Wallach. 2020. Microsoft AI Fairness Checklist. https:\/\/query.prod.cms.rt.microsoft.com\/cms\/api\/am\/binary\/RE4t6dA."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415168"},{"key":"e_1_2_1_39_1","volume-title":"Looking past yesterday's tomorrow: using futures studies methods to extend the research horizon. (April","author":"Mankoff Jennifer","year":"2013","unstructured":"Jennifer Mankoff, Jennifer A Rode, and Haakon Faste. 2013. Looking past yesterday's tomorrow: using futures studies methods to extend the research horizon. (April 2013), 10."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3409251.3411734"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0013773"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1353\/sor.2019.0022"},{"key":"e_1_2_1_43_1","volume-title":"Google Researcher Says She Was Fired Over Paper Highlighting Bias in A. I. The New York Times (Dec","author":"Metz Cade","year":"2020","unstructured":"Cade Metz and Daisuke Wakabayashi. 2020. Google Researcher Says She Was Fired Over Paper Highlighting Bias in A. I. The New York Times (Dec. 2020)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0114-4"},{"key":"e_1_2_1_45_1","volume-title":"24th ACM Conference on Computer-Supported Cooperative Work and Social Computing","author":"Rakova Bogdana","year":"2020","unstructured":"Bogdana Rakova, Jingying Yang, Henriette Cramer, and Rumman Chowdhury. 2020. Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practices. In 24th ACM Conference on Computer-Supported Cooperative Work and Social Computing (2020)."},{"volume-title":"Domination and the arts of resistance: Hidden transcripts","author":"Scott James C","key":"e_1_2_1_46_1","unstructured":"James C Scott. 1990. Domination and the arts of resistance: Hidden transcripts. Yale university press."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512325"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319-05834--4_2"},{"volume-title":"Basics of qualitative research","author":"Strauss Anselm","key":"e_1_2_1_49_1","unstructured":"Anselm Strauss and Juliet Corbin. 1990. Basics of qualitative research. Sage publications."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449253"},{"key":"e_1_2_1_51_1","volume-title":"Located accountabilities in technology production. Scandinavian journal of information systems","author":"Suchman Lucy","year":"2002","unstructured":"Lucy Suchman. 2002. Located accountabilities in technology production. Scandinavian journal of information systems, Vol. 14, 2 (2002), 7."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/1050651920910219"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580903"},{"volume-title":"The Challenger launch decision: Risky technology, culture, and deviance at NASA","author":"Vaughan Diane","key":"e_1_2_1_54_1","unstructured":"Diane Vaughan. 1996. The Challenger launch decision: Risky technology, culture, and deviance at NASA. University of Chicago press."},{"key":"e_1_2_1_55_1","volume-title":"Max Van Kleek, and Reuben Binns","author":"Veale Michael","year":"2018","unstructured":"Michael Veale, Max Van Kleek, and Reuben Binns. 2018. Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In 2018 chi conference on human factors in computing systems. 1--14."},{"volume-title":"Learning from strangers: The art and method of qualitative interview studies","author":"Weiss Robert S","key":"e_1_2_1_56_1","unstructured":"Robert S Weiss. 1995. Learning from strangers: The art and method of qualitative interview studies. Simon and Schuster."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445650"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1177\/20539517231177620"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533779"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594012"},{"key":"e_1_2_1_61_1","volume-title":"Entertainment Computing and Serious Games: International GI-Dagstuhl Seminar 15283","author":"Wilkinson Phil","year":"2015","unstructured":"Phil Wilkinson. 2016. A brief history of serious games. In Entertainment Computing and Serious Games: International GI-Dagstuhl Seminar 15283, Dagstuhl Castle, Germany, July 5--10, 2015, Revised Selected Papers. Springer, 17--41."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479499"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3579621"},{"key":"e_1_2_1_64_1","unstructured":"Carole-Jean Wu Ramya Raghavendra Udit Gupta Bilge Acun Newsha Ardalani Kiwan Maeng Gloria Chang Fiona Aga Behram James Huang Charles Bai Michael Gschwind Anurag Gupta Myle Ott Anastasia Melnikov Salvatore Candido David Brooks Geeta Chauhan Benjamin Lee Hsien-Hsin S. Lee Bugra Akyildiz Maximilian Balandat Joe Spisak Ravi Jain Mike Rabbat and Kim Hazelwood. 2022. Sustainable AI: Environmental Implications Challenges and Opportunities. arxiv: 2111.00364 [cs]"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-804206-9.00027-1"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686938","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686938","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:21:20Z","timestamp":1755768080000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686938"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,7]]},"references-count":65,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2024,11,7]]}},"alternative-id":["10.1145\/3686938"],"URL":"https:\/\/doi.org\/10.1145\/3686938","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2024,11,7]]},"assertion":[{"value":"2024-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}