{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T10:24:42Z","timestamp":1775471082372,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":79,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T00:00:00Z","timestamp":1626825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/"}],"funder":[{"name":"Wenner Gren Foundation"},{"name":"Luminate"},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1704369 and 1633400"],"award-info":[{"award-number":["1704369 and 1633400"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,21]]},"DOI":"10.1145\/3461702.3462580","type":"proceedings-article","created":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T01:21:32Z","timestamp":1627694492000},"page":"1010-1022","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Governing Algorithmic Systems with Impact Assessments: Six Observations"],"prefix":"10.1145","author":[{"given":"Elizabeth Anne","family":"Watkins","sequence":"first","affiliation":[{"name":"Data & Society Research Institute and Princeton Center for Information Technology Policy, Princeton, NJ, USA"}]},{"given":"Emanuel","family":"Moss","sequence":"additional","affiliation":[{"name":"Data & Society Research Institute, New York City, NY, USA"}]},{"given":"Jacob","family":"Metcalf","sequence":"additional","affiliation":[{"name":"Data & Society Research Institute, New York City, NY, USA"}]},{"given":"Ranjit","family":"Singh","sequence":"additional","affiliation":[{"name":"Data & Society Research Institute, New York City, NY, USA"}]},{"given":"Madeleine Clare","family":"Elish","sequence":"additional","affiliation":[{"name":"Google Research, Mountain View, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,7,30]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Ada Lovelace Institute and DataKind UK 2020. Examining the Blackbox: Tools for assessing algorithmic systems. https:\/\/www.adalovelaceinstitute.org\/wp-content\/uploads\/2020\/04\/Ada-Lovelace-Institute-DataKind-UK-Examining-the-Black-Box-Report-2020.pdf  Ada Lovelace Institute and DataKind UK 2020. Examining the Blackbox: Tools for assessing algorithmic systems. https:\/\/www.adalovelaceinstitute.org\/wp-content\/uploads\/2020\/04\/Ada-Lovelace-Institute-DataKind-UK-Examining-the-Black-Box-Report-2020.pdf"},{"key":"e_1_3_2_1_2_1","volume-title":"116th Congress. (2019--2020)","author":"Algorithmic Accountability Act","year":"2019","unstructured":"Algorithmic Accountability Act . 2019 . H.R. 2231 , 116th Congress. (2019--2020) . Algorithmic Accountability Act. 2019. H.R. 2231, 116th Congress. (2019--2020)."},{"key":"e_1_3_2_1_3_1","unstructured":"Allison-Hope D. Darnton H. and Lee M. 2019. \"Google's Human Rights by Design.\" Business for Social Responsibility blog: https:\/\/www.bsr.org\/en\/our-insights\/blog-view\/google-human-rights-impact-assessment-celebrity-recognition.  Allison-Hope D. Darnton H. and Lee M. 2019. \"Google's Human Rights by Design.\" Business for Social Responsibility blog: https:\/\/www.bsr.org\/en\/our-insights\/blog-view\/google-human-rights-impact-assessment-celebrity-recognition."},{"key":"e_1_3_2_1_4_1","unstructured":"Angwin J. Larson J. Mattu S. and Kirchner L. 2016. Machine Bias. ProPublica.  Angwin J. Larson J. Mattu S. and Kirchner L. 2016. Machine Bias. ProPublica."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/eet.303"},{"key":"e_1_3_2_1_6_1","unstructured":"Beierle T.C. and Cayford J 2010. Democracy in practice: Public participation in environmental decisions. Routledge.  Beierle T.C. and Cayford J 2010. Democracy in practice: Public participation in environmental decisions. Routledge."},{"key":"e_1_3_2_1_7_1","volume-title":"Of bicycles, bakelites, and bulbs: toward a theory of sociotechnical change","author":"Bijker W.","unstructured":"Bijker . W. 1995. Of bicycles, bakelites, and bulbs: toward a theory of sociotechnical change . MIT Press , Cambridge, MA . Bijker. W. 1995. Of bicycles, bakelites, and bulbs: toward a theory of sociotechnical change. MIT Press, Cambridge, MA."},{"key":"e_1_3_2_1_8_1","volume-title":"(Eds.)","author":"Bijker W.","year":"1987","unstructured":"Bijker , W. Hughes , T. , and Pinch , T . (Eds.) . 1987 . The Social Construction of Technological Systems: New Directions in the Sociology and History of Technology. MIT Press , Cambridge, Mass. Bijker, W. Hughes, T., and Pinch, T. (Eds.). 1987. The Social Construction of Technological Systems: New Directions in the Sociology and History of Technology. MIT Press, Cambridge, Mass."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0386.2007.00378.x"},{"key":"e_1_3_2_1_10_1","volume-title":"Voices From the Grassroots, edited by Robert D. Bullard","author":"Bullard D.","unstructured":"Bullard , Robert D. 1999. \" Anatomy of Environmental Racism and the Environmental Justice Movement.\" In Confronting Environmental Racism : Voices From the Grassroots, edited by Robert D. Bullard . South End Press . Bullard, Robert D. 1999. \"Anatomy of Environmental Racism and the Environmental Justice Movement.\" In Confronting Environmental Racism: Voices From the Grassroots, edited by Robert D. Bullard. South End Press."},{"key":"e_1_3_2_1_11_1","unstructured":"Buolamwini J. and Gebru T. 2018 January. Gender shades: Intersectional accuracy disparities in commercial gender classification. In\u00a0Conference on fairness accountability and transparency\u00a0(pp. 77--91).  Buolamwini J. and Gebru T. 2018 January. Gender shades: Intersectional accuracy disparities in commercial gender classification. In\u00a0Conference on fairness accountability and transparency\u00a0(pp. 77--91)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2018.0080"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/0263276411424420"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.2307\/1289740"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/12255.001.0001"},{"key":"e_1_3_2_1_16_1","volume-title":"Online Advertising: A Multidisciplinary Inquiry.\" In Conference on Fairness, Accountability and Transparency, 20--34. PMLR","author":"Datta A.","year":"2018","unstructured":"Datta , A. , Anupam D. , Makagon , J. , Mulligan , D. , and Tschantz , M.C . 2018 . \"Discrimination in Online Advertising: A Multidisciplinary Inquiry.\" In Conference on Fairness, Accountability and Transparency, 20--34. PMLR . http:\/\/proceedings.mlr.press\/v81\/datta18a.html Datta, A., Anupam D., Makagon, J., Mulligan, D., and Tschantz, M.C. 2018. \"Discrimination in Online Advertising: A Multidisciplinary Inquiry.\" In Conference on Fairness, Accountability and Transparency, 20--34. PMLR. http:\/\/proceedings.mlr.press\/v81\/datta18a.html"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2307\/1072530"},{"key":"e_1_3_2_1_18_1","volume-title":"The Public and Its Problems","author":"Dewey J.","unstructured":"Dewey , J. 1927. The Public and Its Problems . New York : H. Holt and Company . Dewey, J. 1927. The Public and Its Problems. New York: H. Holt and Company."},{"key":"e_1_3_2_1_19_1","unstructured":"Eckersley P. 2019. \"Impossibility and Uncertainty Theorems in AI Value Alignment (or Why Your AGI Should Not Have a Utility Function).\" ArXiv:1901.00064 [Cs] March. http:\/\/arxiv.org\/abs\/1901.00064.  Eckersley P. 2019. \"Impossibility and Uncertainty Theorems in AI Value Alignment (or Why Your AGI Should Not Have a Utility Function).\" ArXiv:1901.00064 [Cs] March. http:\/\/arxiv.org\/abs\/1901.00064."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.17351\/ests2019.260"},{"key":"e_1_3_2_1_21_1","volume-title":"Innovation: A Study of Integrating AI in Clinical Care.\" Data & Society Research Institute.","author":"Elish M.C.","year":"2020","unstructured":"Elish , M.C. and Watkins , E.A . 2020 . \"Repairing Innovation: A Study of Integrating AI in Clinical Care.\" Data & Society Research Institute. Elish, M.C. and Watkins, E.A. 2020. \"Repairing Innovation: A Study of Integrating AI in Clinical Care.\" Data & Society Research Institute."},{"key":"e_1_3_2_1_22_1","volume-title":"Automating inequality: How high-tech tools profile, police, and punish the poor","author":"Eubanks V.","unstructured":"Eubanks , V. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor . St. Martin's Press . Eubanks, V. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin's Press."},{"issue":"4","key":"e_1_3_2_1_23_1","first-page":"683","article-title":"The uncertain relationship between transparency and accountability","volume":"17","author":"Fox","year":"2007","unstructured":"Fox , Jonathan. 2007 . \" The uncertain relationship between transparency and accountability .\" Development in Practice , 17 4 , 683 -- 671 . Fox, Jonathan. 2007. \"The uncertain relationship between transparency and accountability.\" Development in Practice, 17:4, 683--671.","journal-title":"Development in Practice"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/puar.12361"},{"key":"e_1_3_2_1_25_1","unstructured":"Gebru T. Morgenstern J. Vecchione B. Vaughan J.W. Wallach H. Daum\u00e9 III H. and Crawford K. 2018. Datasheets for datasets.\u00a0arXiv preprint arXiv:1803.09010.  Gebru T. Morgenstern J. Vecchione B. Vaughan J.W. Wallach H. Daum\u00e9 III H. and Crawford K. 2018. Datasheets for datasets.\u00a0arXiv preprint arXiv:1803.09010."},{"key":"e_1_3_2_1_26_1","unstructured":"Government of Canada. 2019. Directive on Automated Decision-Making. https:\/\/www.tbs-sct.gc.ca\/pol\/doc-eng.aspx?id=32592  Government of Canada. 2019. Directive on Automated Decision-Making. https:\/\/www.tbs-sct.gc.ca\/pol\/doc-eng.aspx?id=32592"},{"key":"e_1_3_2_1_27_1","article-title":"New York Attorney General's Probe Into Fake FCC Comments Deepens","author":"Grimaldo J.","year":"2018","unstructured":"Grimaldo , J. 2018 . \" New York Attorney General's Probe Into Fake FCC Comments Deepens .\" Wall Street Journal. Grimaldo, J. 2018. \"New York Attorney General's Probe Into Fake FCC Comments Deepens.\" Wall Street Journal.","journal-title":"Wall Street Journal."},{"key":"e_1_3_2_1_28_1","volume-title":"Scale: Provocations and Resistances to Scale Thinking.\" ArXiv:2010.08850 [Cs], October","author":"Hanna A.","year":"2020","unstructured":"Hanna , A. , and Park , T.M . 2020 . \"Against Scale: Provocations and Resistances to Scale Thinking.\" ArXiv:2010.08850 [Cs], October . http:\/\/arxiv.org\/abs\/2010.08850. Hanna, A., and Park, T.M. 2020. \"Against Scale: Provocations and Resistances to Scale Thinking.\" ArXiv:2010.08850 [Cs], October. http:\/\/arxiv.org\/abs\/2010.08850."},{"key":"e_1_3_2_1_29_1","volume-title":"Discourse, Violence.\"","author":"Hoffmann A.L.","year":"2095","unstructured":"Hoffmann , A.L. 2020. \" Terms of Inclusion : Data , Discourse, Violence.\" New Media & Society , September, 14614448 2095 8725. Hoffmann, A.L. 2020. \"Terms of Inclusion: Data, Discourse, Violence.\" New Media & Society, September, 1461444820958725."},{"key":"e_1_3_2_1_30_1","unstructured":"Holland S. Hosny A. Newman S. Joseph J. Chmielinski K. 2018. The dataset nutrition label: A framework to drive higher quality data standards. arXiv:1805.03677  Holland S. Hosny A. Newman S. Joseph J. Chmielinski K. 2018. The dataset nutrition label: A framework to drive higher quality data standards. arXiv:1805.03677"},{"key":"e_1_3_2_1_31_1","volume-title":"A., Hanna, A., Denton, E., Greer, C., Kjartansson, O., Barnes, P.","author":"Hutchinson B.","year":"2020","unstructured":"Hutchinson , B. , Smart , A., Hanna, A., Denton, E., Greer, C., Kjartansson, O., Barnes, P. , and Mitchell, M. 2020 . \"Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructure.\" ArXiv :2010.13561 [Cs], October. http:\/\/arxiv.org\/abs\/2010.13561. Hutchinson, B., Smart, A., Hanna, A., Denton, E., Greer, C., Kjartansson, O., Barnes, P., and Mitchell, M. 2020. \"Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructure.\" ArXiv:2010.13561 [Cs], October. http:\/\/arxiv.org\/abs\/2010.13561."},{"key":"e_1_3_2_1_32_1","volume-title":"How to put citizens at the heart of decision-making","author":"Involve","unstructured":"Involve . 2005. People & Participation : How to put citizens at the heart of decision-making . Beacon Press : London . Available online: https:\/\/www.involve.org.uk\/sites\/default\/files\/uploads\/People-and-Participation.pdf Involve. 2005. People & Participation: How to put citizens at the heart of decision-making. Beacon Press: London. Available online: https:\/\/www.involve.org.uk\/sites\/default\/files\/uploads\/People-and-Participation.pdf"},{"key":"e_1_3_2_1_33_1","volume-title":"States of knowledge: the co-production of science and the social order","author":"Jasanoff S.","unstructured":"Jasanoff , S. 2004. States of knowledge: the co-production of science and the social order . Routledge . Jasanoff, S. 2004. States of knowledge: the co-production of science and the social order. Routledge."},{"key":"e_1_3_2_1_34_1","unstructured":"Johnson K. 2020. Amsterdam and Helsinki launch algorithm registriesto bring transparency to public deployments of AI. VentureBeat (Sept.2020).\u00a0https:\/\/venturebeat.com\/2020\/09\/28\/amsterdam-and-helsinki-launchalgorithm-registries-to-bring-transparency-to-public-deployments-of-ai\/  Johnson K. 2020. Amsterdam and Helsinki launch algorithm registriesto bring transparency to public deployments of AI. VentureBeat (Sept.2020).\u00a0https:\/\/venturebeat.com\/2020\/09\/28\/amsterdam-and-helsinki-launchalgorithm-registries-to-bring-transparency-to-public-deployments-of-ai\/"},{"key":"e_1_3_2_1_35_1","volume-title":"GDPR: Producing Multi-layered Explanations.\" U of Colorado Law Legal Studies Research Paper No. 19--28. Available at SSRN: https:\/\/doi.org\/10.2139\/ssrn.3456224","author":"Kaminski M.","year":"2019","unstructured":"Kaminski , M. and Malgieri , G . 2019 . \"Algorithmic Impact Assessments under the GDPR: Producing Multi-layered Explanations.\" U of Colorado Law Legal Studies Research Paper No. 19--28. Available at SSRN: https:\/\/doi.org\/10.2139\/ssrn.3456224 10.2139\/ssrn.3456224 Kaminski, M. and Malgieri, G. 2019. \"Algorithmic Impact Assessments under the GDPR: Producing Multi-layered Explanations.\" U of Colorado Law Legal Studies Research Paper No. 19--28. Available at SSRN: https:\/\/doi.org\/10.2139\/ssrn.3456224"},{"key":"e_1_3_2_1_36_1","unstructured":"Karlin M. and Corriveau N. 2018. \"The Government of Canada's Algorithmic Impact Assessment: Take Two.\" https:\/\/medium.com\/@supergovernance\/the-government-of-canadas-algorithmic-impact-assessment-take-two-8a22a87acf6f.\u00a0  Karlin M. and Corriveau N. 2018. \"The Government of Canada's Algorithmic Impact Assessment: Take Two.\" https:\/\/medium.com\/@supergovernance\/the-government-of-canadas-algorithmic-impact-assessment-take-two-8a22a87acf6f.\u00a0"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3390\/socsci8100281"},{"key":"e_1_3_2_1_38_1","first-page":"1","article-title":"The Misgendering Machines: Trans\/HCI Implications of Automatic Gender Recognition","volume":"88","author":"Keyes O.","year":"2018","unstructured":"Keyes , O. 2018 . \" The Misgendering Machines: Trans\/HCI Implications of Automatic Gender Recognition .\" Proceedings of the ACM on Human-Computer Interaction 2 (CSCW) : 88 : 1 -- 88 :22. https:\/\/doi.org\/10.1145\/3274357. 10.1145\/3274357 Keyes, O. 2018. \"The Misgendering Machines: Trans\/HCI Implications of Automatic Gender Recognition.\" Proceedings of the ACM on Human-Computer Interaction 2 (CSCW): 88:1--88:22. https:\/\/doi.org\/10.1145\/3274357.","journal-title":"Proceedings of the ACM on Human-Computer Interaction 2 (CSCW)"},{"key":"e_1_3_2_1_39_1","first-page":"601","article-title":"The commenting power: Agency accountability through public participation. Okla","volume":"70","author":"Kochan D.J.","year":"2017","unstructured":"Kochan , D.J. , 2017 . The commenting power: Agency accountability through public participation. Okla . L. Rev. , 70 , p. 601 . Kochan, D.J., 2017. The commenting power: Agency accountability through public participation. Okla. L. Rev., 70, p.601.","journal-title":"L. Rev."},{"key":"e_1_3_2_1_40_1","unstructured":"Koene Ansgar Chris Clifton Yohko Hatada Helena Webb and Rashida Richardson. 2019. \"A governance framework for algorithmic accountability and transparency.\" Brussels: European Parliamentary Research Service.  Koene Ansgar Chris Clifton Yohko Hatada Helena Webb and Rashida Richardson. 2019. \"A governance framework for algorithmic accountability and transparency.\" Brussels: European Parliamentary Research Service."},{"key":"e_1_3_2_1_41_1","volume-title":"Reassembling the social: an introduction to actor-network theory","author":"Latour B.","unstructured":"Latour , B. 2005. Reassembling the social: an introduction to actor-network theory . Oxford University Press , Oxford Latour, B. 2005. Reassembling the social: an introduction to actor-network theory. Oxford University Press, Oxford"},{"key":"e_1_3_2_1_42_1","volume-title":"The epistemology of epistopics: Science and technology studies as an emergent (non)discipline","author":"Lynch M.","year":"2015","unstructured":"Lynch , M. 2001. The epistemology of epistopics: Science and technology studies as an emergent (non)discipline . American Sociological Association, Science , Knowledge & Technology Section (ASA-SKAT) Newsletter (Fall): 2--3. https:\/\/asaskat.files.wordpress.com\/ 2015 \/11\/skat-331.pdf Lynch, M. 2001. The epistemology of epistopics: Science and technology studies as an emergent (non)discipline. American Sociological Association, Science, Knowledge & Technology Section (ASA-SKAT) Newsletter (Fall): 2--3. https:\/\/asaskat.files.wordpress.com\/2015\/11\/skat-331.pdf"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10746-016-9385-5"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/0306312706077367"},{"key":"e_1_3_2_1_45_1","volume-title":"Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics. Fair & Responsible AI Workshop. CHI","author":"Martin","year":"2020","unstructured":"Martin Jr ., D., Prabhakaran , V. , Kuhlberg , J. , Smart , A. , & Issac , W. S. 2020 . Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics. Fair & Responsible AI Workshop. CHI 2020. Martin Jr., D., Prabhakaran, V., Kuhlberg, J., Smart, A., & Issac, W. S. 2020. Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics. Fair & Responsible AI Workshop. CHI 2020."},{"key":"e_1_3_2_1_46_1","first-page":"28","article-title":"Racial Impact Statements as a Means of Reducing Unwarranted Sentencing Disparities","volume":"5","author":"Mauer M.","year":"2007","unstructured":"Mauer , M. 2007 . \" Racial Impact Statements as a Means of Reducing Unwarranted Sentencing Disparities .\" Ohio State Journal of Criminal Law 5 : 28 . Mauer, M. 2007. \"Racial Impact Statements as a Means of Reducing Unwarranted Sentencing Disparities.\" Ohio State Journal of Criminal Law 5: 28.","journal-title":"Ohio State Journal of Criminal Law"},{"key":"e_1_3_2_1_47_1","volume-title":"Accountability and Transparency (FAccT '21)","author":"Metcalf J.","year":"2021","unstructured":"Metcalf , J. , Moss , E. , Watkins , E.A. , Singh , R. , and Elish , M.C . 2021. \"Algorithmic Impact Assessments and Accountability: The Co-Construction of Impacts.\" In Proceedings of the ACM Conference on Fairness , Accountability and Transparency (FAccT '21) , March 3 --10 , 2021 , Virtual Event, Canada. ACM, New York, NY, USA, 12 pages. https:\/\/doi.org\/10.1145\/3442188.3445935 10.1145\/3442188.3445935 Metcalf, J., Moss, E., Watkins, E.A., Singh, R., and Elish, M.C. 2021. \"Algorithmic Impact Assessments and Accountability: The Co-Construction of Impacts.\" In Proceedings of the ACM Conference on Fairness, Accountability and Transparency (FAccT '21), March 3--10, 2021, Virtual Event, Canada. ACM, New York, NY, USA, 12 pages. https:\/\/doi.org\/10.1145\/3442188.3445935"},{"key":"e_1_3_2_1_48_1","volume-title":"In\u00a0Proceedings of the conference on fairness, accountability, and transparency\u00a0(pp. 220--229)","author":"Mitchell M.","unstructured":"Mitchell , M. , Wu , S. , Zaldivar , A. , Barnes , P. , Vasserman , L. , Hutchinson , B. , Spitzer , E. , Raji , I.D. and Gebru , T ., 2019, January. Model cards for model reporting . In\u00a0Proceedings of the conference on fairness, accountability, and transparency\u00a0(pp. 220--229) . Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D. and Gebru, T., 2019, January. Model cards for model reporting. In\u00a0Proceedings of the conference on fairness, accountability, and transparency\u00a0(pp. 220--229)."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.1997.9711022105"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-020-00405-8"},{"key":"e_1_3_2_1_51_1","unstructured":"Moss E. Watkins E.A. Singh R. Elish M.C. and Metcalf J. (forthcoming). \"Assembling Accountability Through Algorithmic Impact Assessment.\" Data & Society Research Institute. http:\/\/datasociety.net\/library\/assembling-accountability\/  Moss E. Watkins E.A. Singh R. Elish M.C. and Metcalf J. (forthcoming). \"Assembling Accountability Through Algorithmic Impact Assessment.\" Data & Society Research Institute. http:\/\/datasociety.net\/library\/assembling-accountability\/"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1086\/708034"},{"key":"e_1_3_2_1_53_1","first-page":"2019","article-title":"Procurement as Policy: Administrative Process for Machine Learning","volume":"34","author":"Mulligan D. K.","year":"2019","unstructured":"Mulligan , D. K. and Kenneth A. B. 2019 . \" Procurement as Policy: Administrative Process for Machine Learning \". Berkeley Technology Law Journal , Vol. 34 , 2019 . Available at SSRN: https:\/\/ssrn.com\/abstract=3464203. Mulligan, D. K. and Kenneth A. B. 2019. \"Procurement as Policy: Administrative Process for Machine Learning\". Berkeley Technology Law Journal, Vol. 34, 2019. Available at SSRN: https:\/\/ssrn.com\/abstract=3464203.","journal-title":"Berkeley Technology Law Journal"},{"key":"e_1_3_2_1_54_1","volume-title":"In\u00a0Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency\u00a0(pp. 33--44)","author":"Raji I.D.","unstructured":"Raji , I.D. , Smart , A. , White , R.N. , Mitchell , M. , Gebru , T. , Hutchinson , B. , Smith-Loud , J. , Theron , D. and Barnes , P ., 2020, January. Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing . In\u00a0Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency\u00a0(pp. 33--44) . Raji, I.D., Smart, A., White, R.N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D. and Barnes, P., 2020, January. Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing. In\u00a0Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency\u00a0(pp. 33--44)."},{"key":"e_1_3_2_1_55_1","unstructured":"Reisman D. Schultz J. Crawford K. and Whittaker M. 2018. \"Algorithmic impact assessments: A practical framework for public agency accountability.\" AI Now Institute. 1--22. https:\/\/ainowinstitute.org\/aiareport2018.pdf.  Reisman D. Schultz J. Crawford K. and Whittaker M. 2018. \"Algorithmic impact assessments: A practical framework for public agency accountability.\" AI Now Institute. 1--22. https:\/\/ainowinstitute.org\/aiareport2018.pdf."},{"key":"e_1_3_2_1_56_1","unstructured":"Rona-Tas A. 2017. The Off-Label Use of Consumer Credit Ratings. Historical Social Research 42(1 (159)) 52--76.  Rona-Tas A. 2017. The Off-Label Use of Consumer Credit Ratings. Historical Social Research 42(1 (159)) 52--76."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.2307\/975505"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"crossref","unstructured":"Rowe G. and Frewer L.J. 2000. Public participation methods: A framework for evaluation. Science technology & human values 25(1) pp.3--29.  Rowe G. and Frewer L.J. 2000. Public participation methods: A framework for evaluation. Science technology & human values 25(1) pp.3--29.","DOI":"10.1177\/016224390002500101"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"crossref","unstructured":"Selbst A. 2017. \"Disparate Impact in Big Data Policing \" 52 Georgia L. Rev. https:\/\/ssrn.com\/ abstract=2819182  Selbst A. 2017. \"Disparate Impact in Big Data Policing \" 52 Georgia L. Rev. https:\/\/ssrn.com\/ abstract=2819182","DOI":"10.2139\/ssrn.2819182"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"crossref","unstructured":"Selbst A. and Barocas S. 2018. ?The Intuitive Appeal of Explainable Machines.\" 87 Fordham Law Review 1085 (2018).  Selbst A. and Barocas S. 2018. ?The Intuitive Appeal of Explainable Machines.\" 87 Fordham Law Review 1085 (2018).","DOI":"10.2139\/ssrn.3126971"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.2307\/1338988"},{"key":"e_1_3_2_1_62_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning","author":"Sloane M.","unstructured":"Sloane , M. , Moss , E. , Awomolo , O. and Forlano , L ., 2020. Participation is not a design fix for machine learning . Proceedings of the 37th International Conference on Machine Learning , Vienna, Austria. Sloane, M., Moss, E., Awomolo, O. and Forlano, L., 2020. Participation is not a design fix for machine learning. Proceedings of the 37th International Conference on Machine Learning, Vienna, Austria."},{"issue":"705","key":"e_1_3_2_1_63_1","first-page":"05","article-title":"Institutional Life of Algorithmic Risk Assessments","volume":"34","author":"Solow-Niederman A.","year":"2019","unstructured":"Solow-Niederman , A. , Choi , Y. , and Van den Broeck , G. 2019 . \" Institutional Life of Algorithmic Risk Assessments .\" Berkeley Technology Law Journal 34 ( 705 ): 05 -- 744 . Solow-Niederman, A., Choi, Y., and Van den Broeck, G. 2019. \"Institutional Life of Algorithmic Risk Assessments.\" Berkeley Technology Law Journal 34 (705): 05--744.","journal-title":"Berkeley Technology Law Journal"},{"key":"e_1_3_2_1_64_1","unstructured":"Taylor S. 1984. Making bureaucracies think: The environmental impact statement strategy of administrative reform.\u00a0Making bureaucracies think: the environmental impact statement strategy of administrative reform.CA: Stanford University Press  Taylor S. 1984. Making bureaucracies think: The environmental impact statement strategy of administrative reform.\u00a0Making bureaucracies think: the environmental impact statement strategy of administrative reform.CA: Stanford University Press"},{"key":"e_1_3_2_1_65_1","first-page":"203","volume-title":"Algorithmic harms beyond Facebook and Google: Emergent challenges of computational agency.\u00a0Colo. Tech. LJ,\u00a013","author":"Tufekci Z.","unstructured":"Tufekci , Z. , 2015. Algorithmic harms beyond Facebook and Google: Emergent challenges of computational agency.\u00a0Colo. Tech. LJ,\u00a013 , p. 203 . Tufekci, Z., 2015. Algorithmic harms beyond Facebook and Google: Emergent challenges of computational agency.\u00a0Colo. Tech. LJ,\u00a013, p.203."},{"key":"#cr-split#-e_1_3_2_1_66_1.1","doi-asserted-by":"crossref","unstructured":"Ulnicane I Knight W. Leach T. Stahl B.C. and Wanjiku W. 2020. \"Framing Governance for a Contested Emerging Technology: Insights from AI Policy.\" Policy and Society December 1--20. https:\/\/doi.org\/10.1080\/14494035.2020.1855800. 10.1080\/14494035.2020.1855800","DOI":"10.1080\/14494035.2020.1855800"},{"key":"#cr-split#-e_1_3_2_1_66_1.2","doi-asserted-by":"crossref","unstructured":"Ulnicane I Knight W. Leach T. Stahl B.C. and Wanjiku W. 2020. \"Framing Governance for a Contested Emerging Technology: Insights from AI Policy.\" Policy and Society December 1--20. https:\/\/doi.org\/10.1080\/14494035.2020.1855800.","DOI":"10.1080\/14494035.2020.1855800"},{"key":"e_1_3_2_1_67_1","volume-title":"2019 \"Administration by Algorithm? Public Management Meets Public Sector Machine Learning.\" In: Algorithmic Regulation","author":"Veale M.","year":"2019","unstructured":"Veale , M. and Brass , I . 2019 \"Administration by Algorithm? Public Management Meets Public Sector Machine Learning.\" In: Algorithmic Regulation (Karen Yeung and Martin Lodge eds., Oxford University Press , 2019 ). Available at SSRN: https:\/\/ssrn.com\/abstract=3375391. Veale, M. and Brass, I. 2019 \"Administration by Algorithm? Public Management Meets Public Sector Machine Learning.\" In: Algorithmic Regulation (Karen Yeung and Martin Lodge eds., Oxford University Press, 2019). Available at SSRN: https:\/\/ssrn.com\/abstract=3375391."},{"key":"e_1_3_2_1_68_1","first-page":"161","volume-title":"Innovation: The European Journal of Social Science Research, 26(1--2)","author":"Wadhwa K.","year":"2013","unstructured":"Wadhwa , K. and Rodrigues , R. , 2013 . Evaluating privacy impact assessments. Innovation: The European Journal of Social Science Research, 26(1--2) , pp. 161 -- 180 . Wadhwa, K. and Rodrigues, R., 2013. Evaluating privacy impact assessments. Innovation: The European Journal of Social Science Research, 26(1--2), pp.161--180."},{"issue":"2","key":"e_1_3_2_1_69_1","first-page":"2020","article-title":"Privacy Law's False Promise","volume":"97","author":"Waldman A.E.","year":"2019","unstructured":"Waldman , A.E. 2019 . \" Privacy Law's False Promise \". Washington University Law Review , Vol. 97 , No. 2 , 2020 . Available at SSRN: https:\/\/ssrn.com\/abstract=3499913. Waldman, A.E. 2019. \"Privacy Law's False Promise\". Washington University Law Review, Vol. 97, No. 2, 2020. Available at SSRN: https:\/\/ssrn.com\/abstract=3499913.","journal-title":"Washington University Law Review"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.copsyc.2019.08.025"},{"key":"e_1_3_2_1_71_1","unstructured":"Warofka A. 2018. \"An Independent Assessment of the Human Rights Impact of Facebook in Myanmar.\" Facebook press release Nov 5: https:\/\/about.fb.com\/news\/2018\/11\/myanmar-hria\/  Warofka A. 2018. \"An Independent Assessment of the Human Rights Impact of Facebook in Myanmar.\" Facebook press release Nov 5: https:\/\/about.fb.com\/news\/2018\/11\/myanmar-hria\/"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-6210.2005.00495.x"},{"key":"e_1_3_2_1_73_1","unstructured":"\"What is Impact Assessment?\" 2014. Based on OECD Directorate for Science Technology and Innovation \"Assessing the Impact of State Interventions in Research -- Techniques Issues and Solutions\" unpublished manuscript.  \"What is Impact Assessment?\" 2014. Based on OECD Directorate for Science Technology and Innovation \"Assessing the Impact of State Interventions in Research -- Techniques Issues and Solutions\" unpublished manuscript."},{"key":"e_1_3_2_1_74_1","first-page":"3372833","article-title":"What to Account for When Accounting for Algorithms: A Systematic Literature Review on Algorithmic Accountability","volume":"1145","author":"Wieringa M.","year":"2020","unstructured":"Wieringa , M. 2020 . \" What to Account for When Accounting for Algorithms: A Systematic Literature Review on Algorithmic Accountability .\" In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 1--18. Barcelona Spain: ACM. https:\/\/doi.org\/10. 1145\/3351095 . 3372833 . 10.1145\/3351095.3372833 Wieringa, M. 2020. \"What to Account for When Accounting for Algorithms: A Systematic Literature Review on Algorithmic Accountability.\" In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 1--18. Barcelona Spain: ACM. https:\/\/doi.org\/10.1145\/3351095.3372833.","journal-title":"ACM. https:\/\/doi.org\/10."},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978542.1978568"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1093\/scipol\/sct083"},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-019-09497-z"},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1177\/0306312719865607"}],"event":{"name":"AIES '21: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Virtual Event USA","acronym":"AIES '21","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"]},"container-title":["Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462580","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461702.3462580","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461702.3462580","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:05Z","timestamp":1750191425000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462580"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,21]]},"references-count":79,"alternative-id":["10.1145\/3461702.3462580","10.1145\/3461702"],"URL":"https:\/\/doi.org\/10.1145\/3461702.3462580","relation":{},"subject":[],"published":{"date-parts":[[2021,7,21]]},"assertion":[{"value":"2021-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}