{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T13:01:21Z","timestamp":1776085281161,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,7,21]],"date-time":"2023-07-21T00:00:00Z","timestamp":1689897600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,21]],"date-time":"2023-07-21T00:00:00Z","timestamp":1689897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100011033","name":"Agencia Estatal de Investigaci\u00f3n","doi-asserted-by":"publisher","award":["PID2019-104943RB-I00"],"award-info":[{"award-number":["PID2019-104943RB-I00"]}],"id":[{"id":"10.13039\/501100011033","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["B-HUM-64-UGR20"],"award-info":[{"award-number":["B-HUM-64-UGR20"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006393","name":"Universidad de Granada","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006393","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recommender Systems (RecSys) have been around since the early days of the Internet, helping users navigate the vast ocean of information and the increasingly available options that have been available for us ever since. The range of tasks for which one could use a RecSys is expanding as the technical capabilities grow, with the disruption of Machine Learning representing a tipping point in this domain, as in many others. However, the increase of the technical capabilities of AI-powered RecSys did not come with a thorough consideration of their ethical implications and, despite being a well-established technical domain, the potential impacts of RecSys on their users are still under-assessed. This paper aims at filling this gap in regards to one of the main impacts of RecSys: personal autonomy. We first describe how technology can affect human values and a suitable methodology to identify these effects and mitigate potential harms: Value Sensitive Design (VSD). We use VSD to carry out a conceptual investigation of personal autonomy in the context of a generic RecSys and draw on a nuanced account of procedural autonomy to focus on two components: competence and authenticity. We provide the results of our inquiry as a value hierarchy and apply it to the design of a speculative RecSys as an example.<\/jats:p>","DOI":"10.1007\/s00146-023-01720-2","type":"journal-article","created":{"date-parts":[[2023,7,21]],"date-time":"2023-07-21T07:03:11Z","timestamp":1689922991000},"page":"2479-2491","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["AI-powered recommender systems and the preservation of personal autonomy"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3253-806X","authenticated-orcid":false,"given":"Juan Ignacio","family":"del Valle","sequence":"first","affiliation":[]},{"given":"Francisco","family":"Lara","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,7,21]]},"reference":[{"issue":"4","key":"1720_CR1","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1007\/s11023-018-9479-0","volume":"28","author":"C Burr","year":"2018","unstructured":"Burr C, Cristianini N, Ladyman J (2018) An analysis of the interaction between intelligent software agents and human users. Minds Mach 28(4):735\u2013774. https:\/\/doi.org\/10.1007\/s11023-018-9479-0","journal-title":"Minds Mach"},{"issue":"1\u20132","key":"1720_CR2","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1023\/b:phil.0000014532.56866.5c","volume":"117","author":"J Christman","year":"2004","unstructured":"Christman J (2004) Relational autonomy, liberal individualism, and the social constitution of selves. Philos Studies 117(1\u20132):143\u2013164. https:\/\/doi.org\/10.1023\/b:phil.0000014532.56866.5c","journal-title":"Philos Studies"},{"key":"1720_CR3","unstructured":"Christman J (2020) Autonomy in Moral and Political Philosophy. The Stanford Encyclopedia of Philosophy. https:\/\/plato.stanford.edu\/archives\/fall2020\/entries\/autonomy-moral\/. Accessed 29 Oct 2022"},{"key":"1720_CR4","volume-title":"Introduction to philosophy of technology","author":"M Coeckelbergh","year":"2020","unstructured":"Coeckelbergh M (2020a) Introduction to philosophy of technology. Oxford University Press, Oxford"},{"key":"1720_CR5","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/12549.001.0001","volume-title":"AI Ethics","author":"M Coeckelbergh","year":"2020","unstructured":"Coeckelbergh M (2020b) AI Ethics. MIT Press, Cambridge"},{"key":"1720_CR6","volume-title":"The political philosophy of AI: an introduction","author":"M Coeckelbergh","year":"2022","unstructured":"Coeckelbergh M (2022a) The political philosophy of AI: an introduction. John Wiley & Sons, Hoboken"},{"key":"1720_CR7","doi-asserted-by":"publisher","first-page":"152","DOI":"10.7312\/coec20654","volume-title":"Self-improvement: technologies of the soul in the age of artificial intelligence","author":"M Coeckelbergh","year":"2022","unstructured":"Coeckelbergh M (2022b) Self-improvement: technologies of the soul in the age of artificial intelligence. Columbia University Press, Columbia, p 152"},{"issue":"4","key":"1720_CR8","doi-asserted-by":"publisher","first-page":"629","DOI":"10.1007\/s13347-018-0317-3","volume":"31","author":"J Danaher","year":"2018","unstructured":"Danaher J (2018) Toward an ethics of AI assistants: an initial framework. Philos Technol 31(4):629\u2013653. https:\/\/doi.org\/10.1007\/s13347-018-0317-3","journal-title":"Philos Technol"},{"issue":"1","key":"1720_CR9","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/s10676-009-9215-9","volume":"12","author":"K de Vries","year":"2010","unstructured":"de Vries K (2010) Identity, profiling algorithms and a world of ambient intelligence. Ethics Inf Technol 12(1):71\u201385. https:\/\/doi.org\/10.1007\/s10676-009-9215-9","journal-title":"Ethics Inf Technol"},{"key":"1720_CR10","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511614484","volume-title":"Human identity and bioethics","author":"D DeGrazia","year":"2005","unstructured":"DeGrazia D (2005) Human identity and bioethics. Cambridge University Press, Cambridge. https:\/\/doi.org\/10.1017\/CBO9780511614484"},{"issue":"2","key":"1720_CR11","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s13347-011-0057-0","volume":"25","author":"S Dorrestijn","year":"2012","unstructured":"Dorrestijn S (2012) Technical mediation and subjectivation: tracing and extending foucault\u2019s philosophy of technology. Philos Technol 25(2):221\u2013241. https:\/\/doi.org\/10.1007\/s13347-011-0057-0","journal-title":"Philos Technol"},{"key":"1720_CR12","doi-asserted-by":"crossref","unstructured":"Friedman B, Hendry DG (2019) Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Cambridge","DOI":"10.7551\/mitpress\/7585.001.0001"},{"key":"1720_CR35","unstructured":"Friedman B, Kahn PH,  Borning A (2002) Value Sensitive Design: Theory and Methods"},{"key":"1720_CR36","unstructured":"Friedman B, Kahn PH,  Borning A (2006) Value sensitive design and information systems. In: Zhang P, Galletta D (eds) Human-computer interaction and management information systems: Foundations. M. E. Sharpe, New York"},{"issue":"2","key":"1720_CR13","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1007\/s13347-017-0285-z","volume":"31","author":"A Giubilini","year":"2018","unstructured":"Giubilini A, Savulescu J (2018) The artificial moral advisor. The \u201cideal observer\u201d meets artificial intelligence. Philos Technol 31(2):169\u2013188. https:\/\/doi.org\/10.1007\/s13347-017-0285-z","journal-title":"Philos Technol"},{"key":"1720_CR14","unstructured":"Harari YN (2018, September 14) Yuval Noah Harari: The myth of freedom. The Guardian. https:\/\/www.theguardian.com\/books\/2018\/sep\/14\/yuval-noah-harari-the-new-threat-to-liberal-democracy. Accessed 29 Oct 2022"},{"key":"1720_CR15","volume-title":"John Dewey?s pragmatic technology","author":"LA Hickman","year":"1990","unstructured":"Hickman LA (1990) John Dewey?s pragmatic technology. Indiana University Press, Bloomington"},{"key":"1720_CR16","doi-asserted-by":"publisher","DOI":"10.1515\/9781438426402","volume-title":"Postphenomenology and technoscience: the peking university lectures","author":"D Ihde","year":"2009","unstructured":"Ihde D (2009) Postphenomenology and technoscience: the peking university lectures. State University of New York Press, Albany"},{"issue":"9","key":"1720_CR17","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","volume":"1","author":"A Jobin","year":"2019","unstructured":"Jobin A, Ienca M, Vayena E (2019) Artificial Intelligence: the global landscape of ethics guidelines. Nat Mach Intell 1(9):389\u2013399. https:\/\/doi.org\/10.1038\/s42256-019-0088-2","journal-title":"Nat Mach Intell"},{"key":"1720_CR18","volume-title":"The philosophy of online manipulation","year":"2022","unstructured":"Jongepier F, Klenk M (eds) (2022) The philosophy of online manipulation. Routledge, New York"},{"issue":"1","key":"1720_CR19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0162243903259188","volume":"29","author":"J Keulartz","year":"2004","unstructured":"Keulartz J, Schermer M, Korthals M, Swierstra T (2004) Ethics in technological culture: a programmatic proposal for a pragmatist approach. Sci Technol Human Values 29(1):3\u201329. https:\/\/doi.org\/10.1177\/0162243903259188","journal-title":"Sci Technol Human Values"},{"key":"1720_CR20","unstructured":"Klenk M (2019) Autonomy and online manipulation. Internet Policy Review. https:\/\/policyreview.info\/articles\/news\/autonomy-and-online-manipulation\/1431. Accessed 26 May 2023"},{"key":"1720_CR21","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1007\/978-3-030-50585-1_4","volume-title":"Ethics of digital well-being. A multidisciplinary approach","author":"M Klenk","year":"2020","unstructured":"Klenk M (2020) Digital well-being and manipulation online. Ethics of digital well-being. A multidisciplinary approach. Springer, New York, pp 81\u2013100"},{"issue":"1","key":"1720_CR22","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1080\/00346764.2021.1894350","volume":"80","author":"M Klenk","year":"2022","unstructured":"Klenk M (2022) (Online) manipulation: sometimes hidden, always careless. Rev Soc Econ 80(1):85\u2013105. https:\/\/doi.org\/10.1080\/00346764.2021.1894350","journal-title":"Rev Soc Econ"},{"key":"1720_CR23","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511554476","volume-title":"The sources of normativity","author":"CM Korsgaard","year":"1996","unstructured":"Korsgaard CM (1996) The sources of normativity. Cambridge University Press, Cambridge"},{"issue":"4","key":"1720_CR24","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1111\/j.1467-9833.2008.00440.x","volume":"39","author":"C MacKenzie","year":"2008","unstructured":"MacKenzie C (2008) Relational autonomy, normative authority and perfectionism. J Social Philos 39(4):512\u2013533. https:\/\/doi.org\/10.1111\/j.1467-9833.2008.00440.x","journal-title":"J Social Philos"},{"key":"1720_CR25","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1007\/978-94-007-4707-4_10","volume-title":"Handbook of Neuroethics","author":"C Mackenzie","year":"2015","unstructured":"Mackenzie C, Walker M (2015) Neurotechnologies, personal identity, and the ethics of authenticity. Handbook of Neuroethics. Springer Netherlands, Dordrecht, pp 373\u2013392"},{"issue":"4","key":"1720_CR26","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1007\/s00146-020-00950-y","volume":"35","author":"S Milano","year":"2020","unstructured":"Milano S, Taddeo M, Floridi L (2020) Recommender systems and their ethical challenges. AI Soc 35(4):957\u2013967. https:\/\/doi.org\/10.1007\/s00146-020-00950-y","journal-title":"AI Soc"},{"key":"1720_CR37","doi-asserted-by":"publisher","unstructured":"Manders-Huits N (2011) What Values in Design? The Challenge of Incorporating Moral Values into Design. Sci Eng Ethics 17:271\u2013287. https:\/\/doi.org\/10.1007\/s11948-010-9198-2","DOI":"10.1007\/s11948-010-9198-2"},{"key":"1720_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-1-4899-7637-6","volume-title":"Recommender systems handbook","author":"F Ricci","year":"2015","unstructured":"Ricci F, Rokach L, Shapira B (2015) Recommender systems: introduction and challenges. In: Ricci F, Rokach L, Shapira B (eds) Recommender systems handbook. Springer US, Boston, pp 1\u201334"},{"key":"1720_CR28","doi-asserted-by":"crossref","unstructured":"Susser D, Roessler B, Nissenbaum H (2019) Technology, autonomy, and manipulation. Internet Policy Review. 8(2). https:\/\/policyreview.info\/articles\/analysis\/technology-autonomy-and-manipulation","DOI":"10.14763\/2019.2.1410"},{"issue":"1","key":"1720_CR29","doi-asserted-by":"publisher","first-page":"5","DOI":"10.5324\/eip.v9i1.1838","volume":"9","author":"T Swierstra","year":"2015","unstructured":"Swierstra T (2015) Identifying the normative challenges posed by technology\u2019s \u2018soft\u2019 impacts1. Etikk i Praksis 9(1):5\u201320","journal-title":"Etikk i Praksis"},{"key":"1720_CR30","unstructured":"Taylor C (1991) The Ethics of Authenticity. Harvard University Press, Cambridge"},{"key":"1720_CR31","unstructured":"Thaler RH, Sunstein CR (2008) Nudge. Penguin, UK"},{"key":"1720_CR32","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1007\/978-94-007-7762-0_20","volume":"15","author":"I van de Poel","year":"2013","unstructured":"van de Poel I (2013) Translating values into design requirements. Philos Eng Technol 15:253\u2013266. https:\/\/doi.org\/10.1007\/978-94-007-7762-0_20","journal-title":"Philos Eng Technol"},{"key":"1720_CR33","doi-asserted-by":"crossref","unstructured":"Verbeek PP (2011) Moralizing Technology: Understanding and Designing the Morality of Things. University of Chicago Press, Chicago","DOI":"10.7208\/chicago\/9780226852904.001.0001"},{"key":"1720_CR34","unstructured":"Wylie C (2019) Mindf*ck. Profile Books, London"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-023-01720-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-023-01720-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-023-01720-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T04:11:36Z","timestamp":1726805496000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-023-01720-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,21]]},"references-count":37,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["1720"],"URL":"https:\/\/doi.org\/10.1007\/s00146-023-01720-2","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,21]]},"assertion":[{"value":"27 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}