{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:00:22Z","timestamp":1776114022781,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":81,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,6,12]],"date-time":"2023-06-12T00:00:00Z","timestamp":1686528000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,12]]},"DOI":"10.1145\/3593013.3594071","type":"proceedings-article","created":{"date-parts":[[2023,6,12]],"date-time":"2023-06-12T14:40:46Z","timestamp":1686580846000},"page":"1162-1173","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Going public: the role of public participation approaches in commercial AI labs"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-9687-3353","authenticated-orcid":false,"given":"Lara","family":"Groves","sequence":"first","affiliation":[{"name":"Ada Lovelace Institute, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1239-0478","authenticated-orcid":false,"given":"Aidan","family":"Peppin","sequence":"additional","affiliation":[{"name":"Ada Lovelace Institute, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3683-2293","authenticated-orcid":false,"given":"Andrew","family":"Strait","sequence":"additional","affiliation":[{"name":"Ada Lovelace Institute, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6989-9812","authenticated-orcid":false,"given":"Jenny","family":"Brennan","sequence":"additional","affiliation":[{"name":"Ada Lovelace Institute, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2023,6,12]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2940299.2940317"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/01944366908977225"},{"key":"e_1_3_2_1_3_1","volume-title":"Retrieved","author":"Atkinson Robert","year":"2019","unstructured":"[3] Robert Atkinson, Doug Brake, Daniel Castro, Colin Cunliff, Joe Kennedy, Michael McLaughlin, and Joshua New. 2019. Apolicymaker\u2019s guide to the \u201ctechlash\u201d\u2013what it is and why it\u2019s a threat to growth and progress | ITIF. Retrieved May 10, 2023 from https:\/\/itif.org\/publications\/2019\/10\/28\/policymakers-guide-techlash\/."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","unstructured":"[4] Imon Banerjee et al. 2022. Reading race: AI recognises patient\u2019s racial identity in medical images. The Lancet Digital Health 4 6 (June 2022) e406\u2013e414. arXiv: 2107.10356[cs eess]. doi: 10.1016\/S2589-7500(22)00063-2.","DOI":"10.1016\/S2589-7500(22)00063-2"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534145"},{"key":"e_1_3_2_1_6_1","volume-title":"Participatory AI for humanitarian innovation: a briefing paper. Nesta","author":"Berditchevskaia Aleks","year":"2023","unstructured":"[6] Aleks Berditchevskaia, Eirini Malliaraki, and Kathy Peach. 2021. Participatory AI for humanitarian innovation: a briefing paper. Nesta, London. Retrieved Jan. 17, 2023 from https:\/\/www.nesta.org.uk\/report\/participatory-ai-humanitarian-innovation-briefing-paper\/."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372860"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551624.3555290"},{"key":"e_1_3_2_1_9_1","volume-title":"The values encoded in machine learning research. (June 21","author":"Birhane Abeba","year":"2022","unstructured":"[9] Abeba Birhane, Pratyusha Kalluri, Dallas Card, William Agnew, Ravit Dotan, and Michelle Bao. 2022. The values encoded in machine learning research. (June 21, 2022). Retrieved Jan. 7, 2023 from http:\/\/arxiv.org\/abs\/2106.15590 arXiv: 2106.15590[cs]."},{"key":"e_1_3_2_1_10_1","volume-title":"Retrieved","author":"BIT.","year":"2022","unstructured":"[10] BIT. 2022. Deliberative democracy in action. Retrieved Jan. 13, 2023 from https:\/\/www.bi.team\/blogs\/deliberative-democracy-in-action\/."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1068\/c6s"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533111"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462612"},{"key":"e_1_3_2_1_14_1","unstructured":"[14] Mark Bovens. 2007. Analysing and assessing public accountability. a conceptual framework. European Law Journal 37. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1111\/j.1468-0386.2007.00378.x."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10606-016-9259-4"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_2_1_17_1","unstructured":"[17] Ellie Brodie Eddie Cowling and Nina Nissen. 2009. Understanding participation: An introduction 50."},{"key":"e_1_3_2_1_18_1","unstructured":"[18] Joy Buolamwini and Timnit Gebru. 2018. Gender shades: intersectional accuracy disparities in commercial gender classification 15."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203133026"},{"key":"e_1_3_2_1_20_1","volume-title":"Retrieved","author":"Chan Alan","year":"2021","unstructured":"[20] Alan Chan, Chinasa T. Okolo, Zachary Terner, and AngelinaWang. 2021. The limits of global inclusion in AI development. (Feb. 1, 2021). Retrieved Jan. 11, 2023 from http:\/\/arxiv.org\/abs\/2102.01265 arXiv: 2102.01265[cs]."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1706.03741"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1328(199906)11:4<597::AID-JID610>3.0.CO;2-Q"},{"key":"e_1_3_2_1_23_1","volume-title":"NY, (Apr. 7, 2023","author":"Cobbe Jennifer","year":"2023","unstructured":"[23] Jennifer Cobbe, Michael Veale, and Jatinder Singh. 2023. Understanding accountability in algorithmic supply chains. Rochester, NY, (Apr. 7, 2023). Retrieved May 4, 2023 from https:\/\/papers.ssrn.com\/abstract=4430778."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533150"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1093\/cdj"},{"key":"e_1_3_2_1_26_1","volume-title":"Design justice: community-led practices to build the worlds we need. Information policy","author":"Costanza-Chock Sasha","unstructured":"[26] Sasha Costanza-Chock. 2020. Design justice: community-led practices to build the worlds we need. Information policy. The MIT Press, Cambridge, MA. isbn: 978-0-262-04345-8."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2021.1986102"},{"key":"e_1_3_2_1_28_1","volume-title":"Retrieved","author":"Delgado Fernando","year":"2021","unstructured":"[28] Fernando Delgado, Stephen Yang, Michael Madaio, and Qian Yang. 2021. Stakeholder participation in AI: beyond \u201cadd diverse stakeholders and stir\u201d, (Nov. 1, 2021). Retrieved Apr. 28, 2022 from http:\/\/arxiv.org\/abs\/2111.01122."},{"key":"e_1_3_2_1_29_1","volume-title":"Access for all: the democratisation of AI. (Nov. 10","author":"Dempsey Paul","year":"2021","unstructured":"[29] Paul Dempsey. 2021. Access for all: the democratisation of AI. (Nov. 10, 2021). Retrieved Feb. 1, 2023 from https:\/\/eandt.theiet.org\/content\/articles\/2021\/11\/access-for-all-the-democratisation-of-ai\/."},{"key":"e_1_3_2_1_30_1","volume-title":"Retrieved","author":"Denton Emily","year":"2020","unstructured":"[30] Emily Denton, Alex Hanna, Razvan Amironesei, AndrewSmart, Hilary Nicole, and Morgan Klaus Scheuerman. 2020. Bringing the people back in: contesting benchmark machine learning datasets. (July 14, 2020). Retrieved Jan. 17, 2023 from http:\/\/arxiv.org\/abs\/2007.07399 arXiv: 2007.07399[cs]."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3534647"},{"key":"e_1_3_2_1_32_1","volume-title":"Retrieved","author":"Dilhac Marc-Antoine","year":"2021","unstructured":"[32] Marc-Antoine Dilhac. 2021. Responsible artificial intelligence: a guide for deliberation | international observatory on the societal impacts of AI and digital technology. Retrieved May 10, 2023 from https:\/\/observatoire-ia.ulaval.ca\/en\/responsible-artificial-intelligence-a-guide-for-deliberation\/."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.2307\/2095101"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025739"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaw2694"},{"key":"e_1_3_2_1_36_1","volume-title":"Automating Inequality: How High-Tech Tools Profile, Police and Punish the Poor.","author":"Eubanks Virginia","year":"2018","unstructured":"[36] Virginia Eubanks. 2018. Automating Inequality: How High-Tech Tools Profile, Police and Punish the Poor."},{"key":"e_1_3_2_1_37_1","unstructured":"[37] Chad W Flanders. 2013. What is the value of participation? OKLAHOMA LAW REVIEW 66."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359134"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1177\/0894439318788314"},{"key":"e_1_3_2_1_40_1","unstructured":"[40] Deep Ganguli et al. 2022. Red teaming language models to reduce harms: methods scaling behaviors and lessons learned."},{"key":"e_1_3_2_1_41_1","volume-title":"Beyond window dressing: public participation for marginalized communities in the datafied society","author":"Gilman Michele E.","year":"2022","unstructured":"[41] Michele E. Gilman. 2022. Beyond window dressing: public participation for marginalized communities in the datafied society. Rochester, NY, (Nov. 2, 2022). Retrieved Nov. 17, 2022 from https:\/\/papers.ssrn.com\/abstract=4266250."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1177\/00953997211034137"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eiar.2013.06.003"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1564.001.0001"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386381"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-021-01357-z"},{"key":"e_1_3_2_1_47_1","volume-title":"State of AI report","author":"Ian Hogarth Nathan Benaich","year":"2022","unstructured":"[47] Nathan Benaich {and} Ian Hogarth. 2022. State of AI report 2022. Retrieved Feb. 2, 2023 from https:\/\/www.stateof.ai\/."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2019.62.3"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2104.04072"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/wcc.645"},{"key":"e_1_3_2_1_51_1","volume-title":"d.] Core values, ethics, spectrum \u2013 the 3 pillars of public participation - international association for public participation. Retrieved","year":"2022","unstructured":"[51] IAP2. [n. d.] Core values, ethics, spectrum \u2013 the 3 pillars of public participation - international association for public participation. Retrieved May 4, 2022 from https:\/\/www.iap2.org\/page\/pillars."},{"key":"e_1_3_2_1_52_1","volume-title":"AI Now Institute, and Open Government Partnership","author":"Ada Lovelace Institute","year":"2021","unstructured":"[52] Ada Lovelace Institute, AI Now Institute, and Open Government Partnership. 2021. Algorithmic accountability for the public sector. Ada Lovelace Institute, AI Now Institute, Open Government Partnership, 70. https:\/\/www.opengovpartnership.org\/documents\/algorithmic-accountability-public-sector."},{"key":"e_1_3_2_1_53_1","first-page":"978","volume-title":"Jacko and Andrew Sears, (Eds.) The human-computer interaction handbook: fundamentals, evolving technologies, and emerging applications. Human factors and ergonomics","author":"Julie","unstructured":"[53] Julie A. Jacko and Andrew Sears, (Eds.) The human-computer interaction handbook: fundamentals, evolving technologies, and emerging applications. Human factors and ergonomics. Lawrence Erlbaum Associates, Mahwah, N.J. 1277 pp. isbn: 978-0-429-16397-5."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-020-02003-2"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372874"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","unstructured":"[56] Donald J. Kochan. 2017. The commenting power: agency accountability through public participation. SSRN Electronic Journal. doi: 10.2139\/ssrn.3006157.","DOI":"10.2139\/ssrn.3006157"},{"key":"e_1_3_2_1_57_1","volume-title":"Medium. (Dec. 21","author":"Lloyd Alexis","year":"2020","unstructured":"[57] Alexis Lloyd. 2020. Camera obscura: beyond the lens of user-centered design. Medium. (Dec. 21, 2020). Retrieved Jan. 11, 2023 from https:\/\/alexis.medium.com\/camera-obscura-beyond-the-lens-of-user-centered-design-631bb4f37594."},{"key":"e_1_3_2_1_58_1","volume-title":"Retrieved","author":"Jr Donald Martin","year":"2022","unstructured":"[58] Donald Martin Jr., Vinodkumar Prabhakaran, Jill Kuhlberg, Andrew Smart, and William S. Isaac. 2020. Participatory problem formulation for fairer machine learning through community based system dynamics. arXiv:2005.07572 [cs, stat], (May 22, 2020). Retrieved Apr. 13, 2022 from http:\/\/arxiv.org\/abs\/2005.07572 arXiv: 2005.07572."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-020-00405-8"},{"key":"e_1_3_2_1_60_1","unstructured":"[60] Emanuel Moss and Jacob Metcalf. 2020. Ethics owners: a new model of organizational responsibility in data-driven technology companies 74. https:\/\/datasociety.net\/library\/ethics-owners\/."},{"key":"e_1_3_2_1_61_1","volume-title":"Ranjit Singh, Madeleine Clare Elish, and Jacob Metcalf.","author":"Moss Emanuel","year":"2021","unstructured":"[61] Emanuel Moss, Elizabeth Anne Watkins, Ranjit Singh, Madeleine Clare Elish, and Jacob Metcalf. 2021. Assembling Accountability: Algorithmic Impact Assessment for the Public Interest. Data & Society. https:\/\/datasociety.net\/library\/assembling-accountability-algorithmic-impact-assessment-for-the-public-interest\/."},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2017-018426"},{"key":"e_1_3_2_1_63_1","volume-title":"Retrieved","author":"AI.","year":"2023","unstructured":"[63] OpenAI. 2023. Announcing OpenAI\u2019s bug bounty program. Retrieved May 10, 2023 from https:\/\/openai.com\/blog\/bug-bounty-program."},{"key":"e_1_3_2_1_64_1","volume-title":"Retrieved","author":"AI.","year":"2023","unstructured":"[64] OpenAI. 2023. Howshould AI systems behave, and who should decide? (Feb. 17, 2023). Retrieved Apr. 20, 2023 from https:\/\/openai.com\/blog\/how-should-ai-systems-behave."},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5282"},{"key":"e_1_3_2_1_66_1","volume-title":"Participatory data stewardship","author":"Patel Reema","year":"2022","unstructured":"[66] Reema Patel, Aidan Peppin, Valentina Pavel, Jenny Brennan, Imogen Parker, and Jansu Safak. 2021. Participatory data stewardship. Ada Lovelace Institute. Retrieved Jan. 10, 2022 from https:\/\/www.adalovelaceinstitute.org\/report\/participatory-data-stewardship\/."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445103"},{"key":"e_1_3_2_1_68_1","volume-title":"Retrieved","author":"Probiner Scott","year":"2018","unstructured":"[68] Scott Probiner and Timothy Murphy. 2018. From smart products to smart systems. Retrieved Jan. 31, 2023 from https:\/\/www2.deloitte.com\/content\/www\/us\/en\/insights\/focus\/cognitive-technologies\/participatory-design-artificialintelligence.html."},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449081"},{"key":"e_1_3_2_1_70_1","volume-title":"Retrieved","author":"Robertson Samantha","year":"2020","unstructured":"[70] Samantha Robertson and Niloufar Salehi. 2020. What if i don\u2019t like any of the choices? the limits of preference elicitation for participatory algorithm design. arXiv:2007.06718 [cs], (July 13, 2020). Retrieved Apr. 29, 2022 from http:\/\/arxiv.org\/abs\/2007.06718 arXiv: 2007.06718."},{"key":"e_1_3_2_1_71_1","volume-title":"Democratising decisions about technology: a toolkit. (Oct. 24","author":"The RSA.","year":"2019","unstructured":"[71] The RSA. 2019. Democratising decisions about technology: a toolkit. (Oct. 24, 2019). Retrieved Feb. 3, 2023 from https:\/\/www.thersa.org\/reports\/democratising-decisions-technology-toolkit."},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40900-020-00239-w"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-022-00537-w"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3534631"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2303.12642"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-022-01202-3"},{"key":"e_1_3_2_1_77_1","volume-title":"Retrieved","author":"Sloane Mona","year":"2020","unstructured":"[77] Mona Sloane, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2020. Participation is not a design fix for machine learning. (Aug. 11, 2020). Retrieved May 11, 2023 from http:\/\/arxiv.org\/abs\/2007.02423 arXiv: 2007.02423[cs]."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1002\/hast.27"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.respol.2013.05.008"},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533132"},{"key":"e_1_3_2_1_81_1","unstructured":"[81] Jennifer Wortman Vaughan. 2017. Making better use of the crowd: how crowdsourcing can advance machine learning research 46. https:\/\/jmlr.org\/papers\/v18\/17-234.html."}],"event":{"name":"FAccT '23: the 2023 ACM Conference on Fairness, Accountability, and Transparency","location":"Chicago IL USA","acronym":"FAccT '23"},"container-title":["2023 ACM Conference on Fairness Accountability and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3593013.3594071","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3593013.3594071","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:18Z","timestamp":1750178238000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3593013.3594071"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,12]]},"references-count":81,"alternative-id":["10.1145\/3593013.3594071","10.1145\/3593013"],"URL":"https:\/\/doi.org\/10.1145\/3593013.3594071","relation":{},"subject":[],"published":{"date-parts":[[2023,6,12]]},"assertion":[{"value":"2023-06-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}