{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T03:09:45Z","timestamp":1773198585084,"version":"3.50.1"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,7,2]],"date-time":"2022-07-02T00:00:00Z","timestamp":1656720000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,2]],"date-time":"2022-07-02T00:00:00Z","timestamp":1656720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100009244","name":"Stockholm University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100009244","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Machine learning algorithms (ML) are increasingly used to support decision-making in the exercise of public authority. Here, we argue that an important consideration has been overlooked in previous discussions: whether the use of ML undermines the democratic legitimacy of public institutions. From the perspective of democratic legitimacy, it is not enough that ML contributes to efficiency and accuracy in the exercise of public authority, which has so far been the focus in the scholarly literature engaging with these developments. According to one influential theory, exercises of administrative and judicial authority are democratically legitimate if and only if administrative and judicial decisions serve the ends\u00a0of the democratic law maker, are based on reasons\u00a0that align with these ends and are\u00a0accessible\u00a0to the public. These requirements are not satisfied by decisions determined through ML since such decisions are determined by statistical operations that are opaque in several respects. However, not all ML-based decision support systems pose the same risk, and we argue that a considered judgment on the democratic legitimacy of ML in exercises of public authority need take the complexity of the issue into account. This paper outlines considerations that help guide the assessment of whether a ML undermines democratic legitimacy when used to support public decisions. We argue that two main considerations are pertinent to such normative assessment. The first is the extent to which ML is practiced as intended and the extent to which it replaces decisions that were previously accessible and based on reasons. The second is that uses of ML in exercises of public authority should be embedded in an institutional infrastructure that secures reason giving and accessibility.<\/jats:p>","DOI":"10.1007\/s00146-022-01493-0","type":"journal-article","created":{"date-parts":[[2022,7,2]],"date-time":"2022-07-02T04:02:41Z","timestamp":1656734561000},"page":"975-984","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Artificial intelligence and democratic legitimacy. The problem of publicity in public authority"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2983-4522","authenticated-orcid":false,"given":"Ludvig","family":"Beckman","sequence":"first","affiliation":[]},{"given":"Jonas","family":"Hultin Rosenberg","sequence":"additional","affiliation":[]},{"given":"Karim","family":"Jebari","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,7,2]]},"reference":[{"key":"1493_CR1","volume-title":"Prediction machines: the simple economics of artificial intelligence","author":"A Agrawal","year":"2018","unstructured":"Agrawal A, Gans J, Goldfarb A (2018) Prediction machines: the simple economics of artificial intelligence. Harvard Business Press, London"},{"issue":"3","key":"1493_CR2","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1016\/j.jcrimjus.2004.02.008","volume":"32","author":"S Becker","year":"2004","unstructured":"Becker S (2004) Assessing the use of profiling in searches by law enforcement personnel. J Crim Just 32(3):183\u2013193","journal-title":"J Crim Just"},{"key":"1493_CR3","first-page":"7","volume":"2021","author":"H Bennmarker","year":"2021","unstructured":"Bennmarker H, Lundin M, M\u00f6rtlund T, Sibbmark K, S\u00f6derstr\u00f6m M, Vikstr\u00f6m J (2021) \u201cKrom \u2013 erfarenheter fr\u00e5n en ny matchningstj\u00e4nst med frist\u00e5ende leverant\u00f6rer inom arbetsmarknadspolitiken.\u201d IFAU Rapport 2021:7","journal-title":"IFAU Rapport"},{"issue":"3","key":"1493_CR4","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1086\/292040","volume":"87","author":"H Beran","year":"1977","unstructured":"Beran H (1977) In defense of the consent theory of political obligation and authority. Ethics 87(3):260\u2013271","journal-title":"Ethics"},{"key":"1493_CR6","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006","unstructured":"Bishop CM (2006) Pattern recognition and machine learning. Springer, Berlin"},{"key":"1493_CR7","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715622512","author":"J Burrell","year":"2016","unstructured":"Burrell J (2016) How the machine \u201cthinks\u201d: understanding opacity in machine learning. Big Data Soc. https:\/\/doi.org\/10.1177\/2053951715622512","journal-title":"Big Data Soc"},{"key":"1493_CR8","doi-asserted-by":"crossref","unstructured":"Chesterman S (2019) Artificial Intelligence and the Problem of Autonomy. Notre Dame Journal on Emerging Technologies. NUS Law Working Paper No. 2019\/016","DOI":"10.2139\/ssrn.3450540"},{"issue":"3","key":"1493_CR9","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1111\/j.1467-9760.2004.00200.x","volume":"12","author":"T Christiano","year":"2004","unstructured":"Christiano T (2004) The authority of democracy. J Polit Philos 12(3):266\u2013290","journal-title":"J Polit Philos"},{"key":"1493_CR10","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198297475.001.0001","volume-title":"The constitution of equality: democratic authority and its limits","author":"T Christiano","year":"2008","unstructured":"Christiano T (2008) The constitution of equality: democratic authority and its limits. Oxford UP, Oxford"},{"key":"1493_CR11","unstructured":"Council of Europe (2019) Ad Hoc committee on artificial intelligence\u2013CAHAI. https:\/\/www.coe.int\/en\/web\/artificial-intelligence\/cahai. Accessed 1 Jan 2022"},{"key":"1493_CR12","doi-asserted-by":"crossref","unstructured":"Covington P, Adams J, Sargin E (2016) Deep neural networks for YouTube recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems, pp 191\u2013198","DOI":"10.1145\/2959100.2959190"},{"key":"1493_CR13","unstructured":"D\u2019Amour A et al (2020) Underspecification presents challenges for credibility in modern machine learning. ArXiv: 2011.03395"},{"issue":"1\u201310","key":"1493_CR14","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1007\/s00146-020-00960-w","volume":"35","author":"LK de Fine","year":"2020","unstructured":"de Fine LK, de Fine LJ (2020) Artificial intelligence, transparency, and public decision-making. AI Soc 35(1\u201310):917\u2013926. https:\/\/doi.org\/10.1007\/s00146-020-00960-w","journal-title":"AI Soc"},{"key":"1493_CR15","volume-title":"Regulating artificial intelligence","author":"C Djeffal","year":"2020","unstructured":"Djeffal C (2020) Artificial intelligence and public governance. In: Wischmeyer T, Rademacher T (eds) Regulating artificial intelligence. Springer, Berlin"},{"issue":"10","key":"1493_CR16","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/2347736.2347755","volume":"55","author":"P Domingos","year":"2012","unstructured":"Domingos P (2012) A few useful things to know about machine learning. Commun ACM 55(10):78\u201387","journal-title":"Commun ACM"},{"key":"1493_CR17","doi-asserted-by":"publisher","DOI":"10.1177\/2053951716665128","author":"P Dourish","year":"2016","unstructured":"Dourish P (2016) Algorithms and their others: algorithmic culture in context. Big Data Soc. https:\/\/doi.org\/10.1177\/2053951716665128","journal-title":"Big Data Soc"},{"key":"1493_CR18","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aao5580","author":"J Dressel","year":"2018","unstructured":"Dressel J, Farid H (2018) The accuracy, fairness, and limits of predicting recidivism. Sci Adv. https:\/\/doi.org\/10.1126\/sciadv.aao5580","journal-title":"Sci Adv"},{"key":"1493_CR19","volume-title":"Oxford studies in political philosophy: volume 1","author":"D Enoch","year":"2015","unstructured":"Enoch D (2015) Against public reason. In: Sobel D, Vallentyne P, Wall S (eds) Oxford studies in political philosophy: volume 1. Oxford University Press, Oxford"},{"key":"1493_CR20","volume-title":"Democratic authority: a philosophical framework","author":"DM Estlund","year":"2008","unstructured":"Estlund DM (2008) Democratic authority: a philosophical framework. Princeton, Princeton UP"},{"key":"1493_CR21","unstructured":"EU Ethics Guidelines for Trustworthy AI (2019). https:\/\/ec.europa.eu\/digital-single-market\/en\/news\/ethics-guidelines-trustworthy-ai. Accessed 1 Jan 2022."},{"key":"1493_CR22","unstructured":"European Commission (2018a) High-level expert group on artificial intelligence: draft ethics guidelines for trustworthy AI. Brussels"},{"key":"1493_CR23","unstructured":"European Commission for the Efficiency of Justice (CEPEJ) European Ethical Charter on the Use of Artificial Intelligence (2018b) Adopted at the 31st plenary meeting of the CEPEJ (Strasbourg, December 3\u20134, 2018b)"},{"issue":"1","key":"1493_CR24","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1353\/jod.2019.0003","volume":"30","author":"S Feldstein","year":"2019","unstructured":"Feldstein S (2019) The road to unfreedom: How artificial intelligence is reshaping repression. J Democr 30(1):40\u201352","journal-title":"J Democr"},{"key":"1493_CR25","doi-asserted-by":"publisher","DOI":"10.7312\/flor14158","volume-title":"The right to know: transparency for an open world","author":"A Florini","year":"2007","unstructured":"Florini A (2007) The right to know: transparency for an open world. Columbia UP, New York"},{"key":"1493_CR26","volume-title":"Authority, reasons and discretion","author":"CJ Friedrich","year":"1968","unstructured":"Friedrich CJ (1968) Authority, reasons and discretion. Harvard UP, Cambridge"},{"key":"1493_CR27","volume-title":"Transparency: the key to better governance?","year":"2006","unstructured":"Hood C, Heald D (eds) (2006) Transparency: the key to better governance? Oxford UP, Oxford"},{"issue":"6388","key":"1493_CR28","doi-asserted-by":"publisher","first-page":"478","DOI":"10.1126\/science.360.6388.478","volume":"360","author":"M Hutson","year":"2018","unstructured":"Hutson M (2018) Has artificial intelligence become alchemy? Science 360(6388):478","journal-title":"Science"},{"key":"1493_CR29","volume-title":"Born free and equal? A philosophical inquiry into the nature of discrimination","author":"K Lippert-Rasmussen","year":"2014","unstructured":"Lippert-Rasmussen K (2014) Born free and equal? A philosophical inquiry into the nature of discrimination. Oxford University Press, Oxford"},{"key":"1493_CR30","doi-asserted-by":"publisher","DOI":"10.1177\/2053951719895805","author":"M Mann","year":"2019","unstructured":"Mann M, Matzner T (2019) Challenging algorithmic profiling: The limits of data protection and anti-discrimination in responding to emergent discrimination. Big Data Soc. https:\/\/doi.org\/10.1177\/2053951719895805","journal-title":"Big Data Soc"},{"key":"1493_CR31","volume-title":"Rebooting AI","author":"G Marcus","year":"2019","unstructured":"Marcus G, Davis E (2019) Rebooting AI. Ballantine Books Inc, New York"},{"key":"1493_CR32","doi-asserted-by":"publisher","first-page":"20180089","DOI":"10.1098\/rsta.2018.0089","volume":"376","author":"P Nemitz","year":"2018","unstructured":"Nemitz P (2018) Constitutional democracy and technology in the age of artificial intelligence. Philos Trans R Soc A 376:20180089","journal-title":"Philos Trans R Soc A"},{"key":"1493_CR33","volume-title":"Weapons of math destruction: how big data increases inequality and threatens democracy","author":"C O\u2019Neil","year":"2016","unstructured":"O\u2019Neil C (2016) Weapons of math destruction: how big data increases inequality and threatens democracy. Crown Publishers, New York"},{"key":"1493_CR34","doi-asserted-by":"publisher","DOI":"10.1177\/1362480620972703","author":"P O'Malley","year":"2020","unstructured":"O\u2019Malley P, Smith GJD (2020) \u201cSmart\u201d crime prevention? Digitization and racialized crime control in a Smart City. Theor Criminol. https:\/\/doi.org\/10.1177\/1362480620972703","journal-title":"Theor Criminol"},{"key":"1493_CR35","first-page":"452","volume":"634","author":"E Parliament","year":"2020","unstructured":"Parliament E (2020) The ethics of artificial intelligence: Issues and initiatives. Eur Parliam Res Serv PE 634:452","journal-title":"Eur Parliam Res Serv PE"},{"key":"1493_CR36","doi-asserted-by":"publisher","DOI":"10.1525\/9780520913035","volume-title":"The prince and the law 1200\u20131600: sovereignty and rights in the Western legal tradition","author":"K Pennington","year":"1993","unstructured":"Pennington K (1993) The prince and the law 1200\u20131600: sovereignty and rights in the Western legal tradition. California University Press, California"},{"key":"1493_CR37","unstructured":"Peter F (2017) Political legitimacy. In: Zalta EN (eds) The Stanford encyclopedia of philosophy, summer 2017 edition."},{"key":"1493_CR39","volume-title":"Political liberalism","author":"J Rawls","year":"1993","unstructured":"Rawls J (1993) Political liberalism. Columbia University Press, New York"},{"key":"1493_CR40","volume-title":"The authority of law","author":"J Raz","year":"2009","unstructured":"Raz J (2009) The authority of law. Oxford University Press, Oxford"},{"key":"1493_CR41","unstructured":"Rudovsky D (2001) Law enforcement by stereotypes and serendipity: racial profiling and stops and searches without. University of Pennsylvania Journal of Constitutional Law Cause 3(1):296\u2013366"},{"key":"1493_CR42","volume-title":"Artificial intelligence : a modern approach","author":"S Russel","year":"2020","unstructured":"Russel S, Norvig N (2020) Artificial intelligence\u202f: a modern approach, 4th edn. Pearson, London","edition":"4"},{"key":"1493_CR43","doi-asserted-by":"publisher","first-page":"E16","DOI":"10.1017\/dap.2020.19","volume":"2","author":"C Starke","year":"2020","unstructured":"Starke C, L\u00fcnich M (2020) Artificial intelligence for political decision-making in the European Union: effects on citizens\u2019 perceptions of input, throughput, and output legitimacy. Data Policy 2:E16. https:\/\/doi.org\/10.1017\/dap.2020.19","journal-title":"Data Policy"},{"key":"1493_CR44","doi-asserted-by":"crossref","unstructured":"Sumpter D (2018) Outnumbered. From Facebook and Google to fake news and filter-bubbles\u2014The algorithms that control our lives. Bloomsbury Sigma, London","DOI":"10.5040\/9781472947451"},{"key":"1493_CR45","unstructured":"The Montr\u00e9al Declaration of Responsible AI (2018) Montr\u00e9al declaration of responsible artificial intelligence 2018. https:\/\/recherche.umontreal.ca\/english\/strategic-initiatives\/montreal-declaration-for-a-responsible-ai\/. Accessed 20 Dec 2021"},{"issue":"4","key":"1493_CR46","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1111\/papa.12036","volume":"42","author":"D Viehoff","year":"2014","unstructured":"Viehoff D (2014) Democratic equality and political authority. Philos Public Aff 42(4):337\u2013375. https:\/\/doi.org\/10.1111\/papa.12036","journal-title":"Philos Public Aff"},{"issue":"147","key":"1493_CR47","doi-asserted-by":"publisher","first-page":"127","DOI":"10.2307\/2220334","volume":"37","author":"J Waldron","year":"1987","unstructured":"Waldron J (1987) Theoretical foundations of liberalism. Philos Q 37(147):127","journal-title":"Philos Q"},{"issue":"228","key":"1493_CR48","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1111\/j.1467-9213.2007.495.x","volume":"57","author":"S Wall","year":"2007","unstructured":"Wall S (2007) Democracy and equality. Philos Q 57(228):416\u2013438","journal-title":"Philos Q"},{"key":"1493_CR49","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1111\/1468-2230.12412","volume":"82","author":"M Zalnieriute","year":"2019","unstructured":"Zalnieriute M, Moses LB, Williams G (2019) The rule of law and automation of government decision-making. Mod Law Rev 82:425\u2013455","journal-title":"Mod Law Rev"},{"key":"1493_CR50","unstructured":"Zuboff S (2019) The age of surveillance capitalism: the fight for a human future at the new frontier of power. Profile Books, London"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01493-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-022-01493-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01493-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T15:03:17Z","timestamp":1719586997000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-022-01493-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,2]]},"references-count":48,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["1493"],"URL":"https:\/\/doi.org\/10.1007\/s00146-022-01493-0","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,2]]},"assertion":[{"value":"21 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}