{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T01:24:22Z","timestamp":1776993862800,"version":"3.51.4"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,2,7]],"date-time":"2021-02-07T00:00:00Z","timestamp":1612656000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,7]],"date-time":"2021-02-07T00:00:00Z","timestamp":1612656000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI Ethics"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>As the use of data and artificial intelligence systems becomes crucial to core services and business, it increasingly demands a multi-stakeholder and complex governance approach. The Information Commissioner's Office\u2019s \u2018Guidance on the AI auditing framework: Draft guidance for consultation\u2019 is a move forward in AI governance. The aim of this initiative is toward producing guidance that encompasses both technical (e.g. system impact assessments) and non-engineering (e.g. human oversight) components to governance and represents a significant milestone in the movement towards standardising AI governance. This paper will summarise and critically evaluate the ICO effort and try to anticipate future debates and present some general recommendations.<\/jats:p>","DOI":"10.1007\/s43681-021-00039-2","type":"journal-article","created":{"date-parts":[[2021,2,9]],"date-time":"2021-02-09T03:04:50Z","timestamp":1612839890000},"page":"301-310","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["AI auditing and impact assessment: according to the UK information commissioner\u2019s office"],"prefix":"10.1007","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8484-7492","authenticated-orcid":false,"given":"Emre","family":"Kazim","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danielle Mendes Thame","family":"Denny","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adriano","family":"Koshiyama","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,2,7]]},"reference":[{"key":"39_CR1","unstructured":"Jeff Orlowski.: The Social Dilemma (Exposure Labs, Argent Pictures, The Space Program 2020)."},{"key":"39_CR2","doi-asserted-by":"crossref","unstructured":"Serge Abiteboul., Gilles Dowek.: The age of algorithms (K Rae Nelson tr, 1a Edi\u00e7\u00e3o, Cambridge University Press 2020).","DOI":"10.1017\/9781108614139"},{"key":"39_CR3","unstructured":"Cathy O\u2019Neil.: Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy (1 edition, Crown 2016)."},{"key":"39_CR4","unstructured":"Ada Lovelace Institute and DataKind UK, \u2018Examining the Black Box: Tools for Assessing Algorithmic Systems.\u2019 (Ada Lovelace Institute and DataKind UK 2020) https:\/\/www.adalovelaceinstitute.org\/examining-the-black-box-tools-for-assessing-algorithmic-systems\/ accessed 8 June 2020."},{"key":"39_CR5","doi-asserted-by":"publisher","unstructured":"Stefan Schiffner., and others (eds).: Privacy Technologies and Policy: 4th Annual Privacy Forum, APF 2016, Frankfurt\/Main, Germany, September 7\u20138, 2016, Proceedings, 9857 (Springer International Publishing 2016) https:\/\/doi.org\/10.1007\/978-3-319-44760-5 accessed 8 June 2020.","DOI":"10.1007\/978-3-319-44760-5"},{"key":"39_CR6","unstructured":"Information Commissioner\u2019s Office ICO, \u2018Guidance on the AI Auditing Framework. ICO Draft Guidance for Consultation\u2019 (ICO Information Commissioner\u2019s Office 2020) https:\/\/ico.org.uk\/media\/about-the-ico\/consultations\/2617219\/guidance-on-the-ai-auditing-framework-draft-for-consultation.pdf"},{"key":"39_CR7","unstructured":"European Commission, \u2018Ethics Guidelines for Trustworthy AI\u2019 (Shaping Europe\u2019s digital future - European Commission, 8 April 2019) https:\/\/ec.europa.eu\/digital-single-market\/en\/news\/ethics-guidelines-trustworthy-ai accessed 9 June 2020."},{"key":"39_CR8","doi-asserted-by":"crossref","unstructured":"Luciano Floridi., Josh Cowls.: \u2018A Unified Framework of Five Principles for AI in Society\u2019 (2019) 1 Harvard Data Science Review https:\/\/hdsr.mitpress.mit.edu\/pub\/l0jsh9d1\/release\/6 accessed 9 June 2020.","DOI":"10.1162\/99608f92.8cd550d1"},{"key":"39_CR9","doi-asserted-by":"crossref","unstructured":"Lilian Edwards., Michael Veale.: \u2018Slave to the Algorithm? Why a \u201cRight to an Explanation\u201d Is Probably Not the Remedy You Are Looking For\u2019 (2017) 16 Duke Law & Technology Review 18.","DOI":"10.31228\/osf.io\/97upg"},{"key":"39_CR10","unstructured":"Jess Whittlestone., and others.: \u2018Ethical and Societal Implications of Algorithms, Data, and Artificial Intelligence: A Roadmap for Research\u2019 59."},{"key":"39_CR11","unstructured":"Royal Statistical Society, \u2018Accreditation Scheme\u2019 (2020) https:\/\/rss.org.uk\/membership\/professional-development\/accreditation-scheme\/ accessed 12 June 2020."},{"key":"39_CR12","unstructured":"Adriano Koshiyama., Emre Kazim.: \u2018Lack of Vision: A Comment on the EU\u2019s White Paper on Artificial Intelligence\u2019 (ResearchGate, 2019) https:\/\/www.researchgate.net\/publication\/340714178_Lack_of_Vision_A_Comment_on_the_EU's_White_Paper_on_Artificial_Intelligence accessed 12 June 2020; European Commission, \u2018White Paper on Artificial Intelligence: A European Approach to Excellence and Trust\u2019 (European Commission - European Commission, 2020) https:\/\/ec.europa.eu\/info\/publications\/white-paper-artificial-intelligence-european-approach-excellence-and-trust_en accessed 12 June 2020."},{"key":"39_CR13","unstructured":"Stuart Russell., Peter Norvig.: Artificial Intelligence: A Modern Approach (Pearson 2020) http:\/\/aima.cs.berkeley.edu\/index.html."},{"key":"39_CR14","unstructured":"Sam Corbett-Davies., Sharad Goel.: \u2018The measure and mismeasure of fairness: a critical review of fair machine learning\u2019."},{"key":"39_CR15","unstructured":"Ninareh Mehrabi., others.: \u2018A Survey on Bias and Fairness in Machine Learning\u2019 [2019]] http:\/\/arxiv.org\/abs\/1908.09635 accessed 12 June 2020."},{"key":"39_CR16","unstructured":"Geoff Pleiss., others.: \u2018On Fairness and Calibration\u2019 (2017) http:\/\/arxiv.org\/abs\/1709.02012 accessed 12 June 2020."},{"key":"39_CR17","doi-asserted-by":"publisher","unstructured":"Luca Oneto., Silvia Chiappa.: \u2018Fairness in Machine Learning\u2019 in Luca Oneto and others (eds), Recent Trends in Learning From Data: Tutorials from the INNS Big Data and Deep Learning Conference (INNSBDDL2019) (Springer International Publishing 2020) https:\/\/doi.org\/10.1007\/978-3-030-43883-8_7 accessed 12 June 2020.","DOI":"10.1007\/978-3-030-43883-8_7"},{"key":"39_CR18","unstructured":"Robert H Sloan., Richard Warner.: \u2018The Proxy Problem: Fairness and Artificial Intelligence\u2019 (Social Science Research Network 2019) SSRN Scholarly Paper ID 3441888 https:\/\/papers.ssrn.com\/abstract=3441888 accessed 12 June 2020."},{"key":"39_CR19","unstructured":"\u2018U.S. Equal Employment Opportunity Commission\u2019 (1978) https:\/\/www.eeoc.gov\/ accessed 12 June 2020;"},{"key":"39_CR20","doi-asserted-by":"crossref","unstructured":"Barbara Lerner, \u2018Employment Discrimination: Adverse Impact, Validity, and Equality\u2019 (1979) 1979 The Supreme Court Review 17.","DOI":"10.1086\/scr.1979.3109565"},{"key":"39_CR21","unstructured":"Richard S Barrett.: Challenging the Myths of Fair Employment Practices (Quorum 1998); Biddle, \u2018Uniform Employee Selection Guidelines on Employee Selection Procedures\u2019 (2018) http:\/\/www.uniformguidelines.com\/ accessed 12 June 2020."},{"key":"39_CR22","unstructured":"Timnit Gebru., and others.: \u2018Datasheets for Datasets\u2019 https:\/\/arxiv.org\/abs\/1803.09010v7 accessed 12 June 2020; Miles Brundage and others, \u2018Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims\u2019 https:\/\/arxiv.org\/abs\/2004.07213v2 accessed 12 June 2020."},{"key":"39_CR23","doi-asserted-by":"crossref","unstructured":"Alexandra Chouldechova.: \u2018Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments\u2019 (2017) 5 Big Data 153.","DOI":"10.1089\/big.2016.0047"},{"key":"39_CR24","doi-asserted-by":"crossref","unstructured":"Patrick Van Esch., and others.: AI-enabled biometrics in recruiting: Insights from marketers for managers, Australasian Marketing Journal (2020).","DOI":"10.1016\/j.ausmj.2020.04.003"},{"key":"39_CR25","doi-asserted-by":"crossref","unstructured":"Cynthia Dwork., Aaron Roth.: \u2018The algorithmic foundations of differential privacy\u2019 (2014) https:\/\/www.cis.upenn.edu\/~aaroth\/privacybook.html accessed 12 June 2020","DOI":"10.1561\/9781601988195"},{"key":"39_CR26","unstructured":"Information Commissioner\u2019s Office ICO, \u2018Data Minimisation and Privacy-Preserving Techniques in AI Systems\u2019 (1 November 2019) https:\/\/ico.org.uk\/about-the-ico\/news-and-events\/ai-blog-data-minimisation-and-privacy-preserving-techniques-in-ai-systems\/ accessed 12 June 2020."},{"key":"39_CR27","unstructured":"Trevor Hastie., Robert Tibshirani., Jerome Friedman.: The elements of statistical learning: data mining, inference, and prediction, second edition (2nd edition, Springer 2016);"},{"key":"39_CR28","unstructured":"Trevor Hastie Bradley Efron.: Computer Age Statistical Inference (Cambridge University Press 2016)."},{"key":"39_CR29","doi-asserted-by":"crossref","unstructured":"Nick Bostrom.: \u2018Existential Risk Prevention as Global Priority\u2019 (2013) 4 Global Policy 15.","DOI":"10.1111\/1758-5899.12002"},{"key":"39_CR30","doi-asserted-by":"crossref","unstructured":"Stuart Russell., John Bohannon.: \u2018Artificial Intelligence. Fears of an AI Pioneer\u2019 (2015) 349 Science (New York, N.Y.) 252.","DOI":"10.1126\/science.349.6245.252"},{"key":"39_CR31","doi-asserted-by":"crossref","unstructured":"Paul Lukowicz.: \u2018The Challenge of Human Centric AI\u2019 (2019) 3 Digitale Welt 9.","DOI":"10.1007\/s42354-019-0200-0"},{"key":"39_CR32","unstructured":"Information Commissioner\u2019s Office ICO and The Alan Turing Institute, \u2018Explaining Decisions Made with AI\u2019 (ICO 2020) https:\/\/ico.org.uk\/for-organisations\/guide-to-data-protection\/key-data-protection-themes\/explaining-decisions-made-with-artificial-intelligence\/ accessed 2 October 2020."},{"key":"39_CR33","unstructured":"Lorrie Faith Cranor.: \u2018A Framework for Reasoning about the Human in the Loop\u2019, Proceedings of the 1st Conference on Usability, Psychology, and Security (USENIX Association 2008)."},{"issue":"3","key":"39_CR34","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1016\/j.clsr.2017.03.004","volume":"33","author":"Patrick Van Esch and others","year":"2017","unstructured":"Patrick Van Esch and others: Autonomous weapon systems: is a space warfare manual required? Computer Law & Security Review 33(3), 382\u2013389 (2017)","journal-title":"Computer Law & Security Review"},{"key":"39_CR35","doi-asserted-by":"crossref","unstructured":"Patrick Van Esch., and others.: Job candidates' reactions to AI-enabled job application processes. AI and Ethics (2020)","DOI":"10.1007\/s43681-020-00025-0"},{"key":"39_CR36","unstructured":"Richard S Sutton., Andrew G Barto., Francis Bach.: Reinforcement Learning: An Introduction (second edition edition, MIT Press 2018)."},{"key":"39_CR37","doi-asserted-by":"publisher","unstructured":"Zoubin Ghahramani.:\u2018Unsupervised Learning\u2019 in Olivier Bousquet, Ulrike von Luxburg and Gunnar R\u00e4tsch (eds), Advanced Lectures on Machine Learning: ML Summer Schools 2003, Canberra, Australia, February 2 - 14, 2003, T\u00fcbingen, Germany, August 4 - 16, 2003, Revised Lectures (Springer 2004) https:\/\/doi.org\/10.1007\/978-3-540-28650-9_5 accessed 12 June 2020.","DOI":"10.1007\/978-3-540-28650-9_5"},{"key":"39_CR38","doi-asserted-by":"crossref","unstructured":"Philip Treleaven., Jeremy Barnett., Adriano Koshiyama.: \u2018Algorithms: Law and Regulation\u2019 (2019) 52 Computer 32.","DOI":"10.1109\/MC.2018.2888774"},{"key":"39_CR39","doi-asserted-by":"crossref","unstructured":"Emre Kazim., Adriano Koshiyama.: \"The interrelation between data and AI ethics in the context of impact assessments.\" AI and Ethics 1\u20137 (2020).","DOI":"10.1007\/s43681-020-00029-w"},{"key":"39_CR40","doi-asserted-by":"crossref","unstructured":"Anna Jobin., and others.: The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389-399 (2019)","DOI":"10.1038\/s42256-019-0088-2"},{"key":"39_CR41","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.3240529","author":"D Leslie","year":"2019","unstructured":"Leslie, D.: Understanding artificial intelligence ethics and safety: A guide for the responsible design and implementation of AI systems in the public sector. The Alan Turing Institute (2019). https:\/\/doi.org\/10.5281\/zenodo.3240529","journal-title":"The Alan Turing Institute"},{"key":"39_CR42","unstructured":"AI Governance Database, Nesta https:\/\/www.nesta.org.uk\/data-visualisation-and-interactive\/ai-governance-database\/ (2020)"},{"key":"39_CR43","unstructured":"Yves Genest.: Artificial Intelligence and Auditing: Overview of Potential Impact on Public Sector Auditors (October 18, 2019), https:\/\/caaf-fcar.ca\/en\/performance-audit\/research-and-methodology\/research-highlights\/3455-research-highlights-3 accessed 5 January 2021"},{"key":"39_CR44","unstructured":"Government of Canada, Algorithmic Impact Assessment, https:\/\/canada-ca.github.io\/aia-eia-js\/ accessed 5 January 2021"},{"key":"39_CR45","unstructured":"H.R.2231 - Algorithmic Accountability Act of 2019, 116th Congress (2019\u20132020) Sponsor: Rep. Clarke, Yvette D. [D-NY-9] (Introduced 04\/10\/2019). Committees: House - Energy and Commerce"},{"key":"39_CR46","unstructured":"Dave Dawson., and others.: Artificial Intelligence: Australia\u2019s Ethics Framework. Data61 CSIRO, Australia (2019)."},{"key":"39_CR47","unstructured":"Review into bias in algorithmic Decision-making, CDEI (2020). https:\/\/assets.publishing.service.gov.uk\/government\/uploads\/system\/uploads\/attachment_data\/file\/939109\/CDEI_review_into_bias_in_algorithmic_decision-making.pdf."},{"key":"39_CR48","unstructured":"Opinion of the Data Ethics Commission, Daten Ethik Kommission (Germany) (2020). https:\/\/www.bmjv.de\/SharedDocs\/Downloads\/DE\/Themen\/Fokusthemen\/Gutachten_DEK_EN_lang.html"},{"key":"39_CR49","unstructured":"AI transparency in financial services \u2013 why, what, who and when?, FCA (2020) https:\/\/www.fca.org.uk\/insight\/ai-transparency-financial-services-why-what-who-and-when"},{"key":"39_CR50","unstructured":"Laurent Dupont., Olivier Fliche., Su Yang.: Gouvernance des algorithms d\u2019intelligence artificielle dans le secteur financier: Document de r\u00e9flexion (June 2020), P\u00f4le Fintech-Innovation, ACPR."}],"updated-by":[{"DOI":"10.1007\/s43681-021-00046-3","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2021,3,10]],"date-time":"2021-03-10T00:00:00Z","timestamp":1615334400000}}],"container-title":["AI and Ethics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-021-00039-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43681-021-00039-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-021-00039-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T19:27:45Z","timestamp":1671132465000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43681-021-00039-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,7]]},"references-count":50,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,8]]}},"alternative-id":["39"],"URL":"https:\/\/doi.org\/10.1007\/s43681-021-00039-2","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s43681-021-00046-3","asserted-by":"object"}]},"ISSN":["2730-5953","2730-5961"],"issn-type":[{"value":"2730-5953","type":"print"},{"value":"2730-5961","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,7]]},"assertion":[{"value":"15 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 January 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 March 2021","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s43681-021-00046-3","URL":"https:\/\/doi.org\/10.1007\/s43681-021-00046-3","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}}]}}