{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,24]],"date-time":"2025-08-24T01:15:04Z","timestamp":1755998104668,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T00:00:00Z","timestamp":1626825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,21]]},"DOI":"10.1145\/3461702.3462608","type":"proceedings-article","created":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T01:21:38Z","timestamp":1627694498000},"page":"795-806","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Unpacking the Expressed Consequences of AI Research in Broader Impact Statements"],"prefix":"10.1145","author":[{"given":"Priyanka","family":"Nanayakkara","sequence":"first","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}]},{"given":"Jessica","family":"Hullman","sequence":"additional","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}]},{"given":"Nicholas","family":"Diakopoulos","sequence":"additional","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,7,30]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Navigating the Broader Impacts of AI Research Workshop at the 34th Conference on Neural Information Processing Systems","author":"Abuhamad Grace","year":"2020","unstructured":"Grace Abuhamad and Claudel Rheault . 2020 . Like a Researcher Stating Broader Impact For the Very First Time . Navigating the Broader Impacts of AI Research Workshop at the 34th Conference on Neural Information Processing Systems (2020). Grace Abuhamad and Claudel Rheault. 2020. Like a Researcher Stating Broader Impact For the Very First Time. Navigating the Broader Impacts of AI Research Workshop at the 34th Conference on Neural Information Processing Systems (2020)."},{"unstructured":"Eytan Adar. 2018. Negative Potential in CS. https:\/\/medium.com\/@eytanadar\/negative-potential-in-cs-b26964b4f502 .  Eytan Adar. 2018. Negative Potential in CS. https:\/\/medium.com\/@eytanadar\/negative-potential-in-cs-b26964b4f502 .","key":"e_1_3_2_1_2_1"},{"unstructured":"Carolyn Ashurst Markus Anderljung Carina Prunkl Jan Leike Yarin Gal Toby Shevlane and Allan Dafoe. 2020. A Guide to Writing the NeurIPS Impact Statement. https:\/\/medium.com\/@GovAI\/a-guide-to-writing-the-neurips-impact-statement-4293b723f832  Carolyn Ashurst Markus Anderljung Carina Prunkl Jan Leike Yarin Gal Toby Shevlane and Allan Dafoe. 2020. A Guide to Writing the NeurIPS Impact Statement. https:\/\/medium.com\/@GovAI\/a-guide-to-writing-the-neurips-impact-statement-4293b723f832","key":"e_1_3_2_1_3_1"},{"key":"e_1_3_2_1_4_1","volume-title":"The Californian Ideology. Science as Culture","author":"Barbrook Richard","year":"1996","unstructured":"Richard Barbrook and Andy Cameron . 1996. The Californian Ideology. Science as Culture , Vol. 6 , 1 ( 1996 ), 44--72. Richard Barbrook and Andy Cameron. 1996. The Californian Ideology. Science as Culture , Vol. 6, 1 (1996), 44--72."},{"volume-title":"Principles of Biomedical Ethics","author":"Beauchamp Tom L","unstructured":"Tom L Beauchamp and James F Childress . 2001. Principles of Biomedical Ethics . Oxford University Press , USA. Tom L Beauchamp and James F Childress. 2001. Principles of Biomedical Ethics .Oxford University Press, USA.","key":"e_1_3_2_1_5_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_6_1","DOI":"10.1145\/3442188.3445922"},{"key":"e_1_3_2_1_7_1","volume-title":"Race After Technology: Abolitionist Tools for the New Jim Code. Social Forces","author":"Benjamin Ruha","year":"2019","unstructured":"Ruha Benjamin . 2019. Race After Technology: Abolitionist Tools for the New Jim Code. Social Forces ( 2019 ). Ruha Benjamin. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. Social Forces (2019)."},{"key":"e_1_3_2_1_8_1","volume-title":"ACM Conference on Fairness, Accountability, and Transparency (FAccT) . 210--219","author":"Bietti Elettra","year":"2020","unstructured":"Elettra Bietti . 2020 . From Ethics Washing to Ethics Bashing: A View on Tech Ethics from Within Moral Philosophy . In ACM Conference on Fairness, Accountability, and Transparency (FAccT) . 210--219 . Elettra Bietti. 2020. From Ethics Washing to Ethics Bashing: A View on Tech Ethics from Within Moral Philosophy. In ACM Conference on Fairness, Accountability, and Transparency (FAccT) . 210--219."},{"key":"e_1_3_2_1_9_1","volume-title":"The Underlying Values of Machine Learning Research. Resistance AI Workshop at NeurIPS 2020","author":"Birhane Abeba","year":"2020","unstructured":"Abeba Birhane , Pratyusha Kalluri , Dallas Card , William Agnew , Ravit Dotan , and Michelle Bao . 2020 . The Underlying Values of Machine Learning Research. Resistance AI Workshop at NeurIPS 2020 (2020). Abeba Birhane, Pratyusha Kalluri, Dallas Card, William Agnew, Ravit Dotan, and Michelle Bao. 2020. The Underlying Values of Machine Learning Research. Resistance AI Workshop at NeurIPS 2020 (2020)."},{"unstructured":"Margarita Boyarskaya Alexandra Olteanu and Kate Crawford. 2020. Overcoming Failures of Imagination in AI Infused System Development and Deployment. Navigating the Broader Impacts of AI Research Workshop at the 34th Conference on Neural Information Processing Systems (2020).  Margarita Boyarskaya Alexandra Olteanu and Kate Crawford. 2020. Overcoming Failures of Imagination in AI Infused System Development and Deployment. Navigating the Broader Impacts of AI Research Workshop at the 34th Conference on Neural Information Processing Systems (2020).","key":"e_1_3_2_1_10_1"},{"key":"e_1_3_2_1_11_1","first-page":"2","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun Virginia","year":"2008","unstructured":"Virginia Braun and Victoria Clarke . 2008 . Using thematic analysis in psychology . Qualitative Research in Psychology , Vol. 3 , 2 (July 2008), 77--101. Virginia Braun and Victoria Clarke. 2008. Using thematic analysis in psychology . Qualitative Research in Psychology , Vol. 3, 2 (July 2008), 77--101.","journal-title":"Qualitative Research in Psychology"},{"unstructured":"Philip Brey. 2017. Ethics of Emerging Technology .Rowman and Littlefield International. https:\/\/ethicsandtechnology.eu\/wp-content\/uploads\/downloadable-content\/Brey-2017-Ethics-Emerging-Tech.pdf  Philip Brey. 2017. Ethics of Emerging Technology .Rowman and Littlefield International. https:\/\/ethicsandtechnology.eu\/wp-content\/uploads\/downloadable-content\/Brey-2017-Ethics-Emerging-Tech.pdf","key":"e_1_3_2_1_12_1"},{"volume-title":"Science and Moral Imagination: A New Ideal for Values in Science","author":"Brown Matthew","unstructured":"Matthew Brown . 2020. Science and Moral Imagination: A New Ideal for Values in Science . University of Pittsburgh Press. Matthew Brown. 2020. Science and Moral Imagination: A New Ideal for Values in Science. University of Pittsburgh Press.","key":"e_1_3_2_1_13_1"},{"key":"e_1_3_2_1_14_1","volume-title":"Zhiwei Steven Wu, and Mingyi Hong","author":"Chen Xiangyi","year":"2020","unstructured":"Xiangyi Chen , Tiancong Chen , Haoran Sun , Zhiwei Steven Wu, and Mingyi Hong . 2020 . Distributed Training with Heterogeneous Data : Bridging Median- and Mean-based Algorithms. Advances in Neural Information Processing Systems , Vol. 33 (2020). Xiangyi Chen, Tiancong Chen, Haoran Sun, Zhiwei Steven Wu, and Mingyi Hong. 2020. Distributed Training with Heterogeneous Data: Bridging Median- and Mean-based Algorithms. Advances in Neural Information Processing Systems , Vol. 33 (2020)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_15_1","DOI":"10.1145\/2844110"},{"volume-title":"Science, Policy, and the Value-Free Ideal","author":"Douglas Heather","unstructured":"Heather Douglas . 2009. Science, Policy, and the Value-Free Ideal . University of Pittsburgh Press . Heather Douglas. 2009. Science, Policy, and the Value-Free Ideal .University of Pittsburgh Press.","key":"e_1_3_2_1_16_1"},{"key":"e_1_3_2_1_17_1","volume-title":"Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor","author":"Eubanks Virginia","year":"2018","unstructured":"Virginia Eubanks . 2018 . Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor . St. Martin's Press . Virginia Eubanks. 2018. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor .St. Martin's Press."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_18_1","DOI":"10.1145\/242485.242493"},{"volume-title":"Analyzing qualitative data","author":"Gibbs Graham R","unstructured":"Graham R Gibbs . 2007. Analyzing qualitative data . Sage London , England . Graham R Gibbs. 2007. Analyzing qualitative data .Sage London, England.","key":"e_1_3_2_1_19_1"},{"key":"e_1_3_2_1_20_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Gillick Jon","year":"2019","unstructured":"Jon Gillick and David Bamman . 2019 . Breaking Speech Recognizers to Imagine Lyrics . Advances in Neural Information Processing Systems , Vol. 32 (2019). Jon Gillick and David Bamman. 2019. Breaking Speech Recognizers to Imagine Lyrics. Advances in Neural Information Processing Systems , Vol. 32 (2019)."},{"volume-title":"Discovery of Grounded Theory: Strategies for Qualitative Research","author":"Glaser Barney G","unstructured":"Barney G Glaser and Anselm L Strauss . 2017. Discovery of Grounded Theory: Strategies for Qualitative Research . Routledge . Barney G Glaser and Anselm L Strauss. 2017. Discovery of Grounded Theory: Strategies for Qualitative Research .Routledge.","key":"e_1_3_2_1_21_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_22_1","DOI":"10.1080\/23299460.2014.882077"},{"key":"e_1_3_2_1_23_1","volume-title":"Social studies of science","author":"Guston David H","year":"2014","unstructured":"David H Guston . 2014. Understanding ?anticipatory governance'. Social studies of science , Vol. 44 , 2 ( 2014 ), 218--242. David H Guston. 2014. Understanding ?anticipatory governance'. Social studies of science , Vol. 44, 2 (2014), 218--242."},{"key":"e_1_3_2_1_24_1","volume-title":"Resistance AI Workshop at NeurIPS 2020","author":"Hanna Alex","year":"2020","unstructured":"Alex Hanna and Tina M. Park . 2020. Against Scale: Provocations and Resistances to Scale Thinking . Resistance AI Workshop at NeurIPS 2020 ( 2020 ). Alex Hanna and Tina M. Park. 2020. Against Scale: Provocations and Resistances to Scale Thinking. Resistance AI Workshop at NeurIPS 2020 (2020)."},{"unstructured":"Brent Hecht. 2020. Suggestions for Writing NeurIPS 2020 Broader Impacts Statements. https:\/\/brenthecht.medium.com\/suggestions-for-writing-neurips-2020-broader-impacts-statements-121da1b765bf  Brent Hecht. 2020. Suggestions for Writing NeurIPS 2020 Broader Impacts Statements. https:\/\/brenthecht.medium.com\/suggestions-for-writing-neurips-2020-broader-impacts-statements-121da1b765bf","key":"e_1_3_2_1_25_1"},{"key":"e_1_3_2_1_26_1","volume-title":"Lana Yarosh, Bushra Anjum, Danish Contractor, and Cathy Wu.","author":"Hecht Brent","year":"2018","unstructured":"Brent Hecht , Lauren Wilcox , Jeffrey P Bigham , Johannes Sch\u00f6ning , Ehsan Hoque , Jason Ernst , Yonatan Bisk , Luigi De Russis , Lana Yarosh, Bushra Anjum, Danish Contractor, and Cathy Wu. 2018 . It's Time to Do Something : Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process. ACM Future of Computing Blog ( 2018). Brent Hecht, Lauren Wilcox, Jeffrey P Bigham, Johannes Sch\u00f6ning, Ehsan Hoque, Jason Ernst, Yonatan Bisk, Luigi De Russis, Lana Yarosh, Bushra Anjum, Danish Contractor, and Cathy Wu. 2018. It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process. ACM Future of Computing Blog (2018)."},{"unstructured":"Jessica Hullman. 2020. The NeurIPS 2020 broader impacts experiment. https:\/\/statmodeling.stat.columbia.edu\/2020\/12\/21\/the-neurips-2020-broader-impacts-experiment\/.  Jessica Hullman. 2020. The NeurIPS 2020 broader impacts experiment. https:\/\/statmodeling.stat.columbia.edu\/2020\/12\/21\/the-neurips-2020-broader-impacts-experiment\/.","key":"e_1_3_2_1_27_1"},{"unstructured":"Hsuan-Tien Lin Maria-Florina Balcan Raia Hadsell and Marc'Aurelio Ranzato. 2020. What we learned from NeurIPS 2020 reviewing process. https:\/\/neuripsconf.medium.com\/what-we-learned-from-neurips-2020-reviewing-process-e24549eea38f  Hsuan-Tien Lin Maria-Florina Balcan Raia Hadsell and Marc'Aurelio Ranzato. 2020. What we learned from NeurIPS 2020 reviewing process. https:\/\/neuripsconf.medium.com\/what-we-learned-from-neurips-2020-reviewing-process-e24549eea38f","key":"e_1_3_2_1_28_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_29_1","DOI":"10.1145\/3442188.3445935"},{"key":"e_1_3_2_1_30_1","volume-title":"Jacob Metcalf, and Madeleine Clare Elish.","author":"Moss Emanuel","year":"2020","unstructured":"Emanuel Moss , Elizabeth Anne Watkins , Jacob Metcalf, and Madeleine Clare Elish. 2020 . Governing with Algorithmic Impact Assessments: Six Observations . Available at SSRN (2020). Emanuel Moss, Elizabeth Anne Watkins, Jacob Metcalf, and Madeleine Clare Elish. 2020. Governing with Algorithmic Impact Assessments: Six Observations. Available at SSRN (2020)."},{"unstructured":"Payam Moula and Per Sandin. 2017. Ethical Tools. In The Ethics of Technology: Methods and Approaches Sven Ove Hansson (Ed.). Rowman & Littlefield Chapter 8.  Payam Moula and Per Sandin. 2017. Ethical Tools. In The Ethics of Technology: Methods and Approaches Sven Ove Hansson (Ed.). Rowman & Littlefield Chapter 8.","key":"e_1_3_2_1_31_1"},{"volume-title":"Algorithms of Oppression: How Search Engines Reinforce Racism","author":"Noble Safiya Umoja","unstructured":"Safiya Umoja Noble . 2018. Algorithms of Oppression: How Search Engines Reinforce Racism . NYU Press . Safiya Umoja Noble. 2018. Algorithms of Oppression: How Search Engines Reinforce Racism .NYU Press.","key":"e_1_3_2_1_32_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_33_1","DOI":"10.1093\/scipol\/scs093"},{"volume-title":"Qualitative Research & Evaluation Methods: Integrating Theory and Practice 4 ed.)","author":"Patton Michael Quinn","unstructured":"Michael Quinn Patton . 2014. Qualitative Research & Evaluation Methods: Integrating Theory and Practice 4 ed.) . Sage Publications . Michael Quinn Patton. 2014. Qualitative Research & Evaluation Methods: Integrating Theory and Practice 4 ed.). Sage Publications.","key":"e_1_3_2_1_34_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_35_1","DOI":"10.1038\/s42256-021-00298-y"},{"key":"e_1_3_2_1_36_1","first-page":"1162","article-title":"The Moral Character of Cryptographic Work","volume":"2015","author":"Rogaway Phillip","year":"2015","unstructured":"Phillip Rogaway . 2015 . The Moral Character of Cryptographic Work . IACR Cryptol. ePrint Arch. , Vol. 2015 (2015), 1162 . Phillip Rogaway. 2015. The Moral Character of Cryptographic Work. IACR Cryptol. ePrint Arch. , Vol. 2015 (2015), 1162.","journal-title":"IACR Cryptol. ePrint Arch."},{"key":"e_1_3_2_1_37_1","volume-title":"Human Compatible: Artificial Intelligence and the Problem of Control","author":"Russell Stuart","year":"2019","unstructured":"Stuart Russell . 2019 . Human Compatible: Artificial Intelligence and the Problem of Control . Viking . Stuart Russell. 2019. Human Compatible: Artificial Intelligence and the Problem of Control. Viking."},{"key":"e_1_3_2_1_38_1","volume-title":"Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society .","author":"von Schomberg Ren\u00e9","year":"2013","unstructured":"Ren\u00e9 von Schomberg . 2013 . Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society . (2013), 51--74. https:\/\/doi.org\/10.1002\/9781118551424.ch3 Ren\u00e9 von Schomberg. 2013. Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society . (2013), 51--74. https:\/\/doi.org\/10.1002\/9781118551424.ch3"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_39_1","DOI":"10.1145\/3381831"},{"key":"e_1_3_2_1_40_1","volume-title":"Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation. arXiv preprint arXiv:2010.11411","author":"Shen Hong","year":"2020","unstructured":"Hong Shen , Wesley Deng , Aditi Chattopadhyay , Steven Wu , Xu Wang , and Haiyi Zhu . 2020 . Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation. arXiv preprint arXiv:2010.11411 (2020). Hong Shen, Wesley Deng, Aditi Chattopadhyay, Steven Wu, Xu Wang, and Haiyi Zhu. 2020. Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation. arXiv preprint arXiv:2010.11411 (2020)."},{"key":"e_1_3_2_1_41_1","volume-title":"Energy and Policy Considerations for Deep Learning in NLP. arXiv preprint arXiv:1906.02243","author":"Strubell Emma","year":"2019","unstructured":"Emma Strubell , Ananya Ganesh , and Andrew McCallum . 2019. Energy and Policy Considerations for Deep Learning in NLP. arXiv preprint arXiv:1906.02243 ( 2019 ). Emma Strubell, Ananya Ganesh, and Andrew McCallum. 2019. Energy and Policy Considerations for Deep Learning in NLP. arXiv preprint arXiv:1906.02243 (2019)."},{"key":"e_1_3_2_1_42_1","volume-title":"A Framework for Understanding Unintended Consequences of Machine Learning. arXiv preprint arXiv:1901.10002","author":"Suresh Harini","year":"2019","unstructured":"Harini Suresh and John V Guttag . 2019. A Framework for Understanding Unintended Consequences of Machine Learning. arXiv preprint arXiv:1901.10002 ( 2019 ). Harini Suresh and John V Guttag. 2019. A Framework for Understanding Unintended Consequences of Machine Learning. arXiv preprint arXiv:1901.10002 (2019)."},{"key":"e_1_3_2_1_43_1","volume-title":"Do Artifacts Have Politics? Daedalus","author":"Winner Langdon","year":"1980","unstructured":"Langdon Winner . 1980. Do Artifacts Have Politics? Daedalus ( 1980 ), 121--136. Langdon Winner. 1980. Do Artifacts Have Politics? Daedalus (1980), 121--136."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_44_1","DOI":"10.1007\/s10676-010-9242-6"}],"event":{"sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"],"acronym":"AIES '21","name":"AIES '21: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Virtual Event USA"},"container-title":["Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462608","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461702.3462608","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:06Z","timestamp":1750191426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462608"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,21]]},"references-count":44,"alternative-id":["10.1145\/3461702.3462608","10.1145\/3461702"],"URL":"https:\/\/doi.org\/10.1145\/3461702.3462608","relation":{},"subject":[],"published":{"date-parts":[[2021,7,21]]},"assertion":[{"value":"2021-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}