{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:23:58Z","timestamp":1776093838182,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":89,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,30]]},"DOI":"10.1145\/3617694.3623239","type":"proceedings-article","created":{"date-parts":[[2023,10,29]],"date-time":"2023-10-29T15:52:11Z","timestamp":1698594731000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["FeedbackLogs: Recording and Incorporating Stakeholder Feedback into Machine Learning Pipelines"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4910-1825","authenticated-orcid":false,"given":"Matthew","family":"Barker","sequence":"first","affiliation":[{"name":"University of Cambridge, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4912-7216","authenticated-orcid":false,"given":"Emma","family":"Kallina","sequence":"additional","affiliation":[{"name":"University of Cambridge, United Kingdom and Responsible AI Institute, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7500-3730","authenticated-orcid":false,"given":"Dhananjay","family":"Ashok","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7032-716X","authenticated-orcid":false,"given":"Katherine","family":"Collins","sequence":"additional","affiliation":[{"name":"University of Cambridge, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4090-3461","authenticated-orcid":false,"given":"Ashley","family":"Casovan","sequence":"additional","affiliation":[{"name":"Responsible AI Institute, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1915-7158","authenticated-orcid":false,"given":"Adrian","family":"Weller","sequence":"additional","affiliation":[{"name":"University of Cambridge, United Kingdom and The Alan Turing Institute, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6650-1893","authenticated-orcid":false,"given":"Ameet","family":"Talwalkar","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2783-0265","authenticated-orcid":false,"given":"Valerie","family":"Chen","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4611-1668","authenticated-orcid":false,"given":"Umang","family":"Bhatt","sequence":"additional","affiliation":[{"name":"University of Cambridge, United Kingdom and The Alan Turing Institute, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,30]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Machine Learning. 50\u201359","author":"Adel Tameem","year":"2018","unstructured":"Tameem Adel , Zoubin Ghahramani , and Adrian Weller . 2018 . Discovering interpretable representations for both deep generative and discriminative models . In International Conference on Machine Learning. 50\u201359 . Tameem Adel, Zoubin Ghahramani, and Adrian Weller. 2018. Discovering interpretable representations for both deep generative and discriminative models. In International Conference on Machine Learning. 50\u201359."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942288"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942288"},{"key":"e_1_3_2_1_5_1","volume-title":"What is information governance and how does it differ from data governance?Governance Directions 69, 8","author":"Bennett Susan","year":"2017","unstructured":"Susan Bennett . 2017. What is information governance and how does it differ from data governance?Governance Directions 69, 8 ( 2017 ), 462\u2013467. Susan Bennett. 2017. What is information governance and how does it differ from data governance?Governance Directions 69, 8 (2017), 462\u2013467."},{"key":"e_1_3_2_1_6_1","volume-title":"ICML Workshop on Human Interpretability","author":"Bhatt Umang","year":"2020","unstructured":"Umang Bhatt , McKane Andrus , Adrian Weller , and Alice Xiang . 2020 . Machine learning explainability for external stakeholders . ICML Workshop on Human Interpretability (2020). Umang Bhatt, McKane Andrus, Adrian Weller, and Alice Xiang. 2020. Machine learning explainability for external stakeholders. ICML Workshop on Human Interpretability (2020)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462571"},{"key":"e_1_3_2_1_8_1","volume-title":"Power to the People? Opportunities and Challenges for Participatory AI. Equity and Access in Algorithms, Mechanisms, and Optimization","author":"Birhane Abeba","year":"2022","unstructured":"Abeba Birhane , William Isaac , Vinodkumar Prabhakaran , Mark D\u00edaz , Madeleine\u00a0Clare Elish , Iason Gabriel , and Shakir Mohamed . 2022. Power to the People? Opportunities and Challenges for Participatory AI. Equity and Access in Algorithms, Mechanisms, and Optimization ( 2022 ), 1\u20138. Abeba Birhane, William Isaac, Vinodkumar Prabhakaran, Mark D\u00edaz, Madeleine\u00a0Clare Elish, Iason Gabriel, and Shakir Mohamed. 2022. Power to the People? Opportunities and Challenges for Participatory AI. Equity and Access in Algorithms, Mechanisms, and Optimization (2022), 1\u20138."},{"key":"e_1_3_2_1_9_1","volume-title":"On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258","author":"Bommasani Rishi","year":"2021","unstructured":"Rishi Bommasani , Drew\u00a0 A Hudson , Ehsan Adeli , Russ Altman , Simran Arora , Sydney von Arx , Michael\u00a0 S Bernstein , Jeannette Bohg , Antoine Bosselut , Emma Brunskill , 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 ( 2021 ). Rishi Bommasani, Drew\u00a0A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael\u00a0S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021)."},{"key":"e_1_3_2_1_10_1","volume-title":"Thematic analysis","author":"Braun Virginia","unstructured":"Virginia Braun and Victoria Clarke . 2012. Thematic analysis . American Psychological Association . Virginia Braun and Victoria Clarke. 2012. Thematic analysis.American Psychological Association."},{"key":"e_1_3_2_1_11_1","volume-title":"Language models are few-shot learners. Advances in neural information processing systems 33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared\u00a0 D Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , Amanda Askell , 2020. Language models are few-shot learners. Advances in neural information processing systems 33 ( 2020 ), 1877\u20131901. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared\u00a0D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877\u20131901."},{"key":"e_1_3_2_1_12_1","volume-title":"The malicious use of artificial intelligence: Forecasting, prevention, and mitigation. arXiv preprint arXiv:1802.07228","author":"Brundage Miles","year":"2018","unstructured":"Miles Brundage , Shahar Avin , Jack Clark , Helen Toner , Peter Eckersley , Ben Garfinkel , Allan Dafoe , Paul Scharre , Thomas Zeitzoff , Bobby Filar , 2018. The malicious use of artificial intelligence: Forecasting, prevention, and mitigation. arXiv preprint arXiv:1802.07228 ( 2018 ). Miles Brundage, Shahar Avin, Jack Clark, Helen Toner, Peter Eckersley, Ben Garfinkel, Allan Dafoe, Paul Scharre, Thomas Zeitzoff, Bobby Filar, 2018. The malicious use of artificial intelligence: Forecasting, prevention, and mitigation. arXiv preprint arXiv:1802.07228 (2018)."},{"key":"e_1_3_2_1_13_1","volume-title":"Perspectives on incorporating expert feedback into model updates. Patterns 4, 7","author":"Chen Valerie","year":"2023","unstructured":"Valerie Chen , Umang Bhatt , Hoda Heidari , Adrian Weller , and Ameet Talwalkar . 2023. Perspectives on incorporating expert feedback into model updates. Patterns 4, 7 ( 2023 ). Valerie Chen, Umang Bhatt, Hoda Heidari, Adrian Weller, and Ameet Talwalkar. 2023. Perspectives on incorporating expert feedback into model updates. Patterns 4, 7 (2023)."},{"key":"e_1_3_2_1_14_1","first-page":"6","article-title":"Interpretable Machine Learning: Moving from Mythos to Diagnostics","volume":"19","author":"Chen Valerie","year":"2022","unstructured":"Valerie Chen , Jeffrey Li , Joon\u00a0Sik Kim , Gregory Plumb , and Ameet Talwalkar . 2022 . Interpretable Machine Learning: Moving from Mythos to Diagnostics . Queue 19 , 6 (jan 2022), 28\u201356. https:\/\/doi.org\/10.1145\/3511299 10.1145\/3511299 Valerie Chen, Jeffrey Li, Joon\u00a0Sik Kim, Gregory Plumb, and Ameet Talwalkar. 2022. Interpretable Machine Learning: Moving from Mythos to Diagnostics. Queue 19, 6 (jan 2022), 28\u201356. https:\/\/doi.org\/10.1145\/3511299","journal-title":"Queue"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445308"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TTS.2021.3077595"},{"key":"e_1_3_2_1_17_1","volume-title":"White paper on artificial intelligence: A European approach to excellence and trust. Com (2020) 65 Final","author":"European Commission","year":"2020","unstructured":"European Commission . 2020. White paper on artificial intelligence: A European approach to excellence and trust. Com (2020) 65 Final ( 2020 ). European Commission. 2020. White paper on artificial intelligence: A European approach to excellence and trust. Com (2020) 65 Final (2020)."},{"key":"e_1_3_2_1_18_1","unstructured":"European Commission. 2021. EU AI Act - Draft. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/HTML\/?uri=CELEX:52021PC0206&from=EN. (Accessed on 02\/07\/2023).  European Commission. 2021. EU AI Act - Draft. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/HTML\/?uri=CELEX:52021PC0206&from=EN. (Accessed on 02\/07\/2023)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33012438"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533213"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/599"},{"key":"e_1_3_2_1_22_1","volume-title":"International Conference on Machine Learning. PMLR, 1528\u20131537","author":"Dao Tri","year":"2019","unstructured":"Tri Dao , Albert Gu , Alexander Ratner , Virginia Smith , Chris De\u00a0Sa , and Christopher R\u00e9 . 2019 . A kernel theory of modern data augmentation . In International Conference on Machine Learning. PMLR, 1528\u20131537 . Tri Dao, Albert Gu, Alexander Ratner, Virginia Smith, Chris De\u00a0Sa, and Christopher R\u00e9. 2019. A kernel theory of modern data augmentation. In International Conference on Machine Learning. PMLR, 1528\u20131537."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534187"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302310"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/604045.604056"},{"key":"e_1_3_2_1_26_1","volume-title":"Trainable Neural Networks. In International Conference on Learning Representations.","author":"Frankle Jonathan","year":"2018","unstructured":"Jonathan Frankle and Michael Carbin . 2018 . The Lottery Ticket Hypothesis: Finding Sparse , Trainable Neural Networks. In International Conference on Learning Representations. Jonathan Frankle and Michael Carbin. 2018. The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3557997"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458723"},{"key":"e_1_3_2_1_29_1","volume-title":"Reward reports for reinforcement learning. arXiv preprint arXiv:2204.10817","author":"Gilbert Thomas\u00a0Krendl","year":"2022","unstructured":"Thomas\u00a0Krendl Gilbert , Sarah Dean , Nathan Lambert , Tom Zick , and Aaron Snoswell . 2022. Reward reports for reinforcement learning. arXiv preprint arXiv:2204.10817 ( 2022 ). Thomas\u00a0Krendl Gilbert, Sarah Dean, Nathan Lambert, Tom Zick, and Aaron Snoswell. 2022. Reward reports for reinforcement learning. arXiv preprint arXiv:2204.10817 (2022)."},{"key":"e_1_3_2_1_30_1","volume-title":"Approximation to Bayes risk in repeated play. Contributions to the Theory of Games 3, 2","author":"Hannan James","year":"1957","unstructured":"James Hannan . 1957. Approximation to Bayes risk in repeated play. Contributions to the Theory of Games 3, 2 ( 1957 ), 97\u2013139. James Hannan. 1957. Approximation to Bayes risk in repeated play. Contributions to the Theory of Games 3, 2 (1957), 97\u2013139."},{"key":"#cr-split#-e_1_3_2_1_31_1.1","unstructured":"Peter Hase Mohit Bansal Been Kim and Asma Ghandeharioun. 2023. Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models. https:\/\/doi.org\/10.48550\/ARXIV.2301.04213 10.48550\/ARXIV.2301.04213"},{"key":"#cr-split#-e_1_3_2_1_31_1.2","unstructured":"Peter Hase Mohit Bansal Been Kim and Asma Ghandeharioun. 2023. Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models. https:\/\/doi.org\/10.48550\/ARXIV.2301.04213"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462564"},{"key":"e_1_3_2_1_33_1","volume-title":"The description\u2013experience gap in risky choice. Trends in cognitive sciences 13, 12","author":"Hertwig Ralph","year":"2009","unstructured":"Ralph Hertwig and Ido Erev . 2009. The description\u2013experience gap in risky choice. Trends in cognitive sciences 13, 12 ( 2009 ), 517\u2013523. Ralph Hertwig and Ido Erev. 2009. The description\u2013experience gap in risky choice. Trends in cognitive sciences 13, 12 (2009), 517\u2013523."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.2308\/acch.2010.24.2.297"},{"key":"e_1_3_2_1_35_1","volume-title":"How to be responsible in AI publication. Nature Machine Intelligence 3","author":"Intelligence Nature\u00a0Machine","year":"2021","unstructured":"Nature\u00a0Machine Intelligence . 2021. How to be responsible in AI publication. Nature Machine Intelligence 3 ( 2021 ). Nature\u00a0Machine Intelligence. 2021. How to be responsible in AI publication. Nature Machine Intelligence 3 (2021)."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.3301590"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858558"},{"key":"e_1_3_2_1_38_1","volume-title":"International Conference on Machine Learning. PMLR, 5338\u20135348","author":"Koh Pang\u00a0Wei","year":"2020","unstructured":"Pang\u00a0Wei Koh , Thao Nguyen , Yew\u00a0Siang Tang , Stephen Mussmann , Emma Pierson , Been Kim , and Percy Liang . 2020 . Concept bottleneck models . In International Conference on Machine Learning. PMLR, 5338\u20135348 . Pang\u00a0Wei Koh, Thao Nguyen, Yew\u00a0Siang Tang, Stephen Mussmann, Emma Pierson, Been Kim, and Percy Liang. 2020. Concept bottleneck models. In International Conference on Machine Learning. PMLR, 5338\u20135348."},{"key":"e_1_3_2_1_39_1","volume-title":"International Conference on Machine Learning Workshop.","author":"Kulynych Bogdan","year":"2020","unstructured":"Bogdan Kulynych , David Madras , Smitha Milli , Inioluwa\u00a0Deborah Raji , Angela Zhou , and Richard Zemel . 2020 . Participatory Approaches to Machine Learning . International Conference on Machine Learning Workshop. Bogdan Kulynych, David Madras, Smitha Milli, Inioluwa\u00a0Deborah Raji, Angela Zhou, and Richard Zemel. 2020. Participatory Approaches to Machine Learning. International Conference on Machine Learning Workshop."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939874"},{"key":"e_1_3_2_1_41_1","volume-title":"Evaluating Human-Language Model Interaction. arXiv preprint arXiv:2212.09746","author":"Lee Mina","year":"2022","unstructured":"Mina Lee , Megha Srivastava , Amelia Hardy , John Thickstun , Esin Durmus , Ashwin Paranjape , Ines Gerard-Ursin , Xiang\u00a0Lisa Li , Faisal Ladhak , Frieda Rong , 2022. Evaluating Human-Language Model Interaction. arXiv preprint arXiv:2212.09746 ( 2022 ). Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ashwin Paranjape, Ines Gerard-Ursin, Xiang\u00a0Lisa Li, Faisal Ladhak, Frieda Rong, 2022. Evaluating Human-Language Model Interaction. arXiv preprint arXiv:2212.09746 (2022)."},{"key":"e_1_3_2_1_42_1","volume-title":"Holistic evaluation of language models. arXiv preprint arXiv:2211.09110","author":"Liang Percy","year":"2022","unstructured":"Percy Liang , Rishi Bommasani , Tony Lee , Dimitris Tsipras , Dilara Soylu , Michihiro Yasunaga , Yian Zhang , Deepak Narayanan , Yuhuai Wu , Ananya Kumar , 2022. Holistic evaluation of language models. arXiv preprint arXiv:2211.09110 ( 2022 ). Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, 2022. Holistic evaluation of language models. arXiv preprint arXiv:2211.09110 (2022)."},{"key":"e_1_3_2_1_43_1","volume-title":"The weighted majority algorithm. Information and computation 108, 2","author":"Littlestone Nick","year":"1994","unstructured":"Nick Littlestone and Manfred\u00a0 K Warmuth . 1994. The weighted majority algorithm. Information and computation 108, 2 ( 1994 ), 212\u2013261. Nick Littlestone and Manfred\u00a0K Warmuth. 1994. The weighted majority algorithm. Information and computation 108, 2 (1994), 212\u2013261."},{"key":"e_1_3_2_1_44_1","unstructured":"Todor Markov. 2022. New and improved content moderation tooling. https:\/\/openai.com\/blog\/new-and-improved-content-moderation-tooling\/  Todor Markov. 2022. New and improved content moderation tooling. https:\/\/openai.com\/blog\/new-and-improved-content-moderation-tooling\/"},{"key":"e_1_3_2_1_45_1","volume-title":"Locating and Editing Factual Associations in GPT. Advances in Neural Information Processing Systems 36","author":"Meng Kevin","year":"2022","unstructured":"Kevin Meng , David Bau , Alex Andonian , and Yonatan Belinkov . 2022. Locating and Editing Factual Associations in GPT. Advances in Neural Information Processing Systems 36 ( 2022 ). Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. 2022. Locating and Editing Factual Associations in GPT. Advances in Neural Information Processing Systems 36 (2022)."},{"key":"#cr-split#-e_1_3_2_1_46_1.1","unstructured":"Kevin Meng Arnab\u00a0Sen Sharma Alex Andonian Yonatan Belinkov and David Bau. 2022. Mass-Editing Memory in a Transformer. https:\/\/doi.org\/10.48550\/ARXIV.2210.07229 10.48550\/ARXIV.2210.07229"},{"key":"#cr-split#-e_1_3_2_1_46_1.2","unstructured":"Kevin Meng Arnab\u00a0Sen Sharma Alex Andonian Yonatan Belinkov and David Bau. 2022. Mass-Editing Memory in a Transformer. https:\/\/doi.org\/10.48550\/ARXIV.2210.07229"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-021-09557-8"},{"key":"e_1_3_2_1_49_1","volume-title":"AI watch: AI Standardisation Landscape: state of play and link to the European Commission proposal for an AI regulatory framework. AI watch","author":"Nativi Stephano","year":"2021","unstructured":"Stephano Nativi and Sarah De\u00a0Nigris . 2021. AI watch: AI Standardisation Landscape: state of play and link to the European Commission proposal for an AI regulatory framework. AI watch , Publications Office of the European Union , Luxembourg ( 2021 ), 1\u201323. https:\/\/doi.org\/doi:10.2760\/376602 10.2760\/376602 Stephano Nativi and Sarah De\u00a0Nigris. 2021. AI watch: AI Standardisation Landscape: state of play and link to the European Commission proposal for an AI regulatory framework. AI watch, Publications Office of the European Union, Luxembourg (2021), 1\u201323. https:\/\/doi.org\/doi:10.2760\/376602"},{"key":"e_1_3_2_1_50_1","unstructured":"House of\u00a0Commons\u00a0of Canada. 2022. Government Bill C-27 (44-1) - First Reading - Digital Charter Implementation Act. https:\/\/www.parl.ca\/DocumentViewer\/en\/44-1\/bill\/C-27\/first-reading. (Accessed on 02\/07\/2023).  House of\u00a0Commons\u00a0of Canada. 2022. Government Bill C-27 (44-1) - First Reading - Digital Charter Implementation Act. https:\/\/www.parl.ca\/DocumentViewer\/en\/44-1\/bill\/C-27\/first-reading. (Accessed on 02\/07\/2023)."},{"key":"e_1_3_2_1_51_1","first-page":"27730","article-title":"Training language models to follow instructions with human feedback","volume":"35","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang , Jeffrey Wu , Xu Jiang , Diogo Almeida , Carroll Wainwright , Pamela Mishkin , Chong Zhang , Sandhini Agarwal , Katarina Slama , Alex Ray , 2022 . Training language models to follow instructions with human feedback . Advances in Neural Information Processing Systems 35 (2022), 27730 \u2013 27744 . Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730\u201327744.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3533378"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.12994"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314244"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372873"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449081"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.14778\/3157794.3157797"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0231300"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533239"},{"key":"e_1_3_2_1_60_1","volume-title":"Principles to practices for responsible AI: closing the gap. arXiv preprint arXiv:2006.04707","author":"Schiff Daniel","year":"2020","unstructured":"Daniel Schiff , Bogdana Rakova , Aladdin Ayesh , Anat Fanti , and Michael Lennon . 2020. Principles to practices for responsible AI: closing the gap. arXiv preprint arXiv:2006.04707 ( 2020 ). Daniel Schiff, Bogdana Rakova, Aladdin Ayesh, Anat Fanti, and Michael Lennon. 2020. Principles to practices for responsible AI: closing the gap. arXiv preprint arXiv:2006.04707 (2020)."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401117"},{"key":"e_1_3_2_1_62_1","volume-title":"Improving recommender systems beyond the algorithm. arXiv preprint arXiv:1802.07578","author":"Schnabel Tobias","year":"2018","unstructured":"Tobias Schnabel , Paul\u00a0 N Bennett , and Thorsten Joachims . 2018. Improving recommender systems beyond the algorithm. arXiv preprint arXiv:1802.07578 ( 2018 ). Tobias Schnabel, Paul\u00a0N Bennett, and Thorsten Joachims. 2018. Improving recommender systems beyond the algorithm. arXiv preprint arXiv:1802.07578 (2018)."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1080\/0267257X.2019.1596970"},{"key":"e_1_3_2_1_64_1","volume-title":"A Human-Centric Take on Model Monitoring. arXiv preprint arXiv:2206.02868","author":"Shergadwala N","year":"2022","unstructured":"Murtuza\u00a0 N Shergadwala , Himabindu Lakkaraju , and Krishnaram Kenthapadi . 2022. A Human-Centric Take on Model Monitoring. arXiv preprint arXiv:2206.02868 ( 2022 ). Murtuza\u00a0N Shergadwala, Himabindu Lakkaraju, and Krishnaram Kenthapadi. 2022. A Human-Centric Take on Model Monitoring. arXiv preprint arXiv:2206.02868 (2022)."},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"crossref","unstructured":"Mona Sloane Emanuel Moss Olaitan Awomolo and Laura Forlano. 2022. Participation is not a design fix for machine learning. In Equity and Access in Algorithms Mechanisms and Optimization. 1\u20136.  Mona Sloane Emanuel Moss Olaitan Awomolo and Laura Forlano. 2022. Participation is not a design fix for machine learning. In Equity and Access in Algorithms Mechanisms and Optimization. 1\u20136.","DOI":"10.1145\/3551624.3555285"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372870"},{"key":"e_1_3_2_1_67_1","volume-title":"Release strategies and the social impacts of language models. arXiv preprint arXiv:1908.09203","author":"Solaiman Irene","year":"2019","unstructured":"Irene Solaiman , Miles Brundage , Jack Clark , Amanda Askell , Ariel Herbert-Voss , Jeff Wu , Alec Radford , Gretchen Krueger , Jong\u00a0Wook Kim , Sarah Kreps , 2019. Release strategies and the social impacts of language models. arXiv preprint arXiv:1908.09203 ( 2019 ). Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong\u00a0Wook Kim, Sarah Kreps, 2019. Release strategies and the social impacts of language models. arXiv preprint arXiv:1908.09203 (2019)."},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1108\/MAJ-07-2017-1596"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/1216295.1216316"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445088"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(99)00062-X"},{"key":"e_1_3_2_1_72_1","unstructured":"Guido Van\u00a0Rossum and Fred\u00a0L Drake\u00a0Jr. 1995. Python reference manual. Centrum voor Wiskunde en Informatica Amsterdam.  Guido Van\u00a0Rossum and Fred\u00a0L Drake\u00a0Jr. 1995. Python reference manual. Centrum voor Wiskunde en Informatica Amsterdam."},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.5555\/3152676"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3011559"},{"key":"e_1_3_2_1_75_1","volume-title":"GAM Changer: Editing Generalized Additive Models with Interactive Visualization. arXiv preprint arXiv:2112.03245","author":"Wang J","year":"2021","unstructured":"Zijie\u00a0 J Wang , Alex Kale , Harsha Nori , Peter Stella , Mark Nunnally , Duen\u00a0Horng Chau , Mihaela Vorvoreanu , Jennifer\u00a0Wortman Vaughan , and Rich Caruana . 2021. GAM Changer: Editing Generalized Additive Models with Interactive Visualization. arXiv preprint arXiv:2112.03245 ( 2021 ). Zijie\u00a0J Wang, Alex Kale, Harsha Nori, Peter Stella, Mark Nunnally, Duen\u00a0Horng Chau, Mihaela Vorvoreanu, Jennifer\u00a0Wortman Vaughan, and Rich Caruana. 2021. GAM Changer: Editing Generalized Additive Models with Interactive Visualization. arXiv preprint arXiv:2112.03245 (2021)."},{"key":"e_1_3_2_1_76_1","first-page":"24824","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei Jason","year":"2022","unstructured":"Jason Wei , Xuezhi Wang , Dale Schuurmans , Maarten Bosma , Fei Xia , Ed Chi , Quoc\u00a0 V Le , Denny Zhou , 2022 . Chain-of-thought prompting elicits reasoning in large language models . Advances in Neural Information Processing Systems 35 (2022), 24824 \u2013 24837 . Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc\u00a0V Le, Denny Zhou, 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022), 24824\u201324837.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_77_1","first-page":"14034","article-title":"Learning deep attribution priors based on prior knowledge","volume":"33","author":"Weinberger Ethan","year":"2020","unstructured":"Ethan Weinberger , Joseph Janizek , and Su-In Lee . 2020 . Learning deep attribution priors based on prior knowledge . Advances in Neural Information Processing Systems 33 (2020), 14034 \u2013 14045 . Ethan Weinberger, Joseph Janizek, and Su-In Lee. 2020. Learning deep attribution priors based on prior knowledge. Advances in Neural Information Processing Systems 33 (2020), 14034\u201314045.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308532.3329441"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00780"},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8622525"},{"key":"e_1_3_2_1_81_1","volume-title":"Toward human-centered AI: a perspective from human-computer interaction. interactions 26, 4","author":"Wei Xu.","year":"2019","unstructured":"Wei Xu. 2019. Toward human-centered AI: a perspective from human-computer interaction. interactions 26, 4 ( 2019 ), 42\u201346. Wei Xu. 2019. Toward human-centered AI: a perspective from human-computer interaction. interactions 26, 4 (2019), 42\u201346."},{"key":"e_1_3_2_1_82_1","volume-title":"IUI Workshops.","author":"Yang Yiwei","year":"2019","unstructured":"Yiwei Yang , Eser Kandogan , Yunyao Li , Prithviraj Sen , and Walter\u00a0 S Lasecki . 2019 . A study on interaction in human-in-the-loop machine learning for text analytics . In IUI Workshops. Yiwei Yang, Eser Kandogan, Yunyao Li, Prithviraj Sen, and Walter\u00a0S Lasecki. 2019. A study on interaction in human-in-the-loop machine learning for text analytics. In IUI Workshops."},{"key":"e_1_3_2_1_83_1","unstructured":"Muhammad\u00a0Bilal Zafar Isabel Valera Manuel\u00a0Gomez Rogriguez and Krishna\u00a0P Gummadi. 2017. Fairness constraints: Mechanisms for fair classification. In Artificial Intelligence and Statistics. PMLR 962\u2013970.  Muhammad\u00a0Bilal Zafar Isabel Valera Manuel\u00a0Gomez Rogriguez and Krishna\u00a0P Gummadi. 2017. Fairness constraints: Mechanisms for fair classification. In Artificial Intelligence and Statistics. PMLR 962\u2013970."},{"key":"e_1_3_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.destud.2007.04.001"},{"key":"e_1_3_2_1_85_1","volume-title":"Frontiers in Psychology","author":"Zhang Shiying","year":"2021","unstructured":"Shiying Zhang , Zixuan Meng , Beibei Chen , Xiu Yang , and Xinran Zhao . 2021. Motivation, Social Emotion , and the Acceptance of Artificial Intelligence Virtual Assistants\u2014 Trust-Based Mediating Effects . Frontiers in Psychology ( 2021 ), 3441. Shiying Zhang, Zixuan Meng, Beibei Chen, Xiu Yang, and Xinran Zhao. 2021. Motivation, Social Emotion, and the Acceptance of Artificial Intelligence Virtual Assistants\u2014Trust-Based Mediating Effects. Frontiers in Psychology (2021), 3441."},{"key":"e_1_3_2_1_86_1","volume-title":"Chi","author":"Zhou Denny","year":"2022","unstructured":"Denny Zhou , Nathanael Sch\u00e4rli , Le Hou , Jason Wei , Nathan Scales , Xuezhi Wang , Dale Schuurmans , Olivier Bousquet , Quoc Le , and Ed Chi . 2022 . Least-to-Most Prompting Enables Complex Reasoning in Large Language Models . arXiv e-prints (2022), arXiv\u20132205. Denny Zhou, Nathanael Sch\u00e4rli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Olivier Bousquet, Quoc Le, and Ed Chi. 2022. Least-to-Most Prompting Enables Complex Reasoning in Large Language Models. arXiv e-prints (2022), arXiv\u20132205."},{"key":"e_1_3_2_1_87_1","volume-title":"Large language models are human-level prompt engineers. arXiv preprint arXiv:2211.01910","author":"Zhou Yongchao","year":"2022","unstructured":"Yongchao Zhou , Andrei\u00a0Ioan Muresanu , Ziwen Han , Keiran Paster , Silviu Pitis , Harris Chan , and Jimmy Ba. 2022. Large language models are human-level prompt engineers. arXiv preprint arXiv:2211.01910 ( 2022 ). Yongchao Zhou, Andrei\u00a0Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba. 2022. Large language models are human-level prompt engineers. arXiv preprint arXiv:2211.01910 (2022)."}],"event":{"name":"EAAMO '23: Equity and Access in Algorithms, Mechanisms, and Optimization","location":"Boston MA USA","acronym":"EAAMO '23","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGecom Special Interest Group on Economics and Computation"]},"container-title":["Equity and Access in Algorithms, Mechanisms, and Optimization"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617694.3623239","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617694.3623239","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:32Z","timestamp":1750178192000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617694.3623239"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,30]]},"references-count":89,"alternative-id":["10.1145\/3617694.3623239","10.1145\/3617694"],"URL":"https:\/\/doi.org\/10.1145\/3617694.3623239","relation":{},"subject":[],"published":{"date-parts":[[2023,10,30]]},"assertion":[{"value":"2023-10-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}