{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T18:34:05Z","timestamp":1781807645322,"version":"3.54.5"},"reference-count":72,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T00:00:00Z","timestamp":1647388800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T00:00:00Z","timestamp":1647388800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we outline a new method for evaluating the human impact of machine-learning (ML) applications. In partnership with Underwriters Laboratories Inc., we have developed a framework to evaluate the impacts of a particular use of machine learning that is based on the goals and values of the domain in which that application is deployed. By examining the use of artificial intelligence (AI) in particular domains, such as journalism, criminal justice, or law, we can develop more nuanced and practically relevant understandings of key ethical guidelines for artificial intelligence. By decoupling the extraction of the facts of the matter from the evaluation of the impact of the resulting systems, we create a framework for the process of assessing impact that has two distinctly different phases.<\/jats:p>","DOI":"10.1007\/s00146-022-01417-y","type":"journal-article","created":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T18:05:30Z","timestamp":1647453930000},"page":"1415-1428","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Separating facts and evaluation: motivation, account, and learnings from a novel approach to evaluating the human impacts of machine learning"],"prefix":"10.1007","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9935-2994","authenticated-orcid":false,"given":"Ryan","family":"Jenkins","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4579-6685","authenticated-orcid":false,"given":"Kristian","family":"Hammond","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Spurlock","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9741-2014","authenticated-orcid":false,"given":"Leilani","family":"Gilpin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,3,16]]},"reference":[{"issue":"4","key":"1417_CR1","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1177\/0730888491018004001","volume":"18","author":"A Abbott","year":"1991","unstructured":"Abbott A (1991) The order of professionalization: an empirical analysis. Work Occup 18(4):355\u2013384","journal-title":"Work Occup"},{"key":"1417_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10506-021-09286-4","volume":"30","author":"K Alikhademi","year":"2021","unstructured":"Alikhademi K et al (2021) A review of predictive policing from the perspective of fairness. Artif Intell Law 30:1\u201317","journal-title":"Artif Intell Law"},{"issue":"3","key":"1417_CR3","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1007\/s10676-006-0004-4","volume":"7","author":"C Allen","year":"2005","unstructured":"Allen C, Smit I, Wallach W (2005) Artificial morality: top-down, bottom-up, and hybrid approaches. Ethics Inf Technol 7(3):149\u2013155","journal-title":"Ethics Inf Technol"},{"key":"1417_CR4","volume-title":"Value in ethics and economics","author":"E Anderson","year":"1993","unstructured":"Anderson E (1993) Value in ethics and economics. Harvard University Press, Cambridge"},{"key":"1417_CR5","doi-asserted-by":"crossref","unstructured":"Angwin J, Larson J, Mattu S, Kirchner L (2016) Machine Bias. ProPublica, https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing. Accessed 28 May 2021","DOI":"10.1201\/9781003278290-37"},{"key":"1417_CR6","first-page":"671","volume":"104","author":"S Barocas","year":"2016","unstructured":"Barocas S, Selbst AD (2016) Big data\u2019s disparate impact. Calif L Rev 104:671","journal-title":"Calif L Rev"},{"key":"1417_CR7","unstructured":"BBC News (2018) Amazon Scrapped \u2018sexist AI\u2019 Tool. BBC News. https:\/\/www.bbc.com\/news\/technology-45809919. Accessed 12 Nov 2021"},{"key":"1417_CR8","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199572458.001.0001","volume-title":"The idea of human rights","author":"CR Beitz","year":"2009","unstructured":"Beitz CR (2009) The idea of human rights. Oxford University Press, Oxford"},{"key":"1417_CR9","unstructured":"Bidar M (2021) Liberals to \u2018Moscow Mitch,\u2019 Conservatives to QAnon: Facebook Researchers Saw How Its Algorithms Led to Misinformation.\u201d CBS News. https:\/\/www.cbsnews.com\/news\/facebook-algorithm-news-feed-conservatives-liberals-india\/"},{"key":"1417_CR10","doi-asserted-by":"publisher","unstructured":"Brey P (2004) Ethical aspects of facial recognition systems in public places. J Inf Commun Ethics Soc. https:\/\/doi.org\/10.1108\/14779960480000246","DOI":"10.1108\/14779960480000246"},{"issue":"12","key":"1417_CR11","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1145\/3430368","volume":"63","author":"C Canca","year":"2020","unstructured":"Canca C (2020) Operationalizing AI ethics principles. Commun ACM 63(12):18\u201321. https:\/\/doi.org\/10.1145\/3430368","journal-title":"Commun ACM"},{"key":"1417_CR12","unstructured":"Corbett-Davies S et al (2019) A Computer Program Used for Bail and Sentencing Decisions Was Labeled Biased against Blacks. It\u2019s Actually Not That Clear. Washington Post. https:\/\/www.washingtonpost.com\/news\/monkey-cage\/wp\/2016\/10\/17\/can-an-algorithm-be-racist-our-analysis-is-more-cautious-than-propublicas\/. Accessed 28 May 2021"},{"issue":"4","key":"1417_CR13","first-page":"867","volume":"12","author":"R Crespo","year":"2016","unstructured":"Crespo R (2016) Aristotle on agency, habits and institutions. J Inst Econ 12(4):867\u2013884","journal-title":"J Inst Econ"},{"key":"1417_CR14","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/1-4020-3846-1_5","volume-title":"Recent work on intrinsic value","author":"J Dancy","year":"2005","unstructured":"Dancy J (2005) Should we pass the buck? In: R\u00f8nnow-Rasmussen T, Zimmerman MJ (eds) Recent work on intrinsic value. Springer, Dordrecht, pp 33\u201344"},{"issue":"4","key":"1417_CR16","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1177\/1464884905056815","volume":"6","author":"M Deuze","year":"2005","unstructured":"Deuze M (2005) What is journalism?: Professional identity and ideology of journalists reconsidered. Journalism 6(4):442\u2013464","journal-title":"Journalism"},{"key":"1417_CR17","volume-title":"Law\u2019s empire","author":"R Dworkin","year":"1986","unstructured":"Dworkin R (1986) Law\u2019s empire. Belknap Press of Harvard Univ. Press, Cambridge"},{"issue":"8","key":"1417_CR18","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1111\/phc3.12245","volume":"10","author":"E Erman","year":"2015","unstructured":"Erman E, M\u00f6ller N (2015) Practices and principles: on the methodological turn in political theory. Philos Compass 10(8):533\u2013546","journal-title":"Philos Compass"},{"issue":"1","key":"1417_CR19","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0191453715580475","volume":"42","author":"E Erman","year":"2016","unstructured":"Erman E, M\u00f6ller N (2016) What distinguishes the practice-dependent approach to justice? Philos Soc Crit 42(1):3\u201323","journal-title":"Philos Soc Crit"},{"key":"1417_CR21","doi-asserted-by":"publisher","unstructured":"Fjeld J, Nele A, Hannah H, Adam N, Madhulika S (2020) Principled Artificial Intelligence: Mapping Consensus in Ethical and Rights-Based Approaches to Principles for AI. Berkman Klein Center Research Publication No. 2020-1, Available at SSRN: https:\/\/ssrn.com\/abstract=3518482 or https:\/\/doi.org\/10.2139\/ssrn.3518482","DOI":"10.2139\/ssrn.3518482"},{"issue":"1","key":"1417_CR22","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1177\/0730888485012001004","volume":"12","author":"PB Forsyth","year":"1985","unstructured":"Forsyth PB, Danisiewicz TJ (1985) Toward a theory of professionalization. Work Occup 12(1):59\u201376","journal-title":"Work Occup"},{"issue":"6","key":"1417_CR23","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1145\/242485.242493","volume":"3","author":"B Friedman","year":"1996","unstructured":"Friedman B (1996) Value-sensitive design. Interactions 3(6):16\u201323","journal-title":"Interactions"},{"key":"1417_CR24","unstructured":"Friedman B, Kahn P, Borning A (2002) Value sensitive design: theory and methods. University of Washington technical report"},{"issue":"3","key":"1417_CR26","first-page":"50","volume":"38","author":"B Goodman","year":"2017","unstructured":"Goodman B, Flaxman S (2017) European Union regulations on algorithmic decision-making and a \u201cright to explanation.\u201d AI Mag 38(3):50\u201357","journal-title":"AI Mag"},{"issue":"1","key":"1417_CR27","doi-asserted-by":"publisher","first-page":"92","DOI":"10.2307\/2092242","volume":"33","author":"RH Hall","year":"1968","unstructured":"Hall RH (1968) Professionalization and bureaucratization. Am Sociol Rev 33(1):92\u2013104. https:\/\/doi.org\/10.2307\/2092242","journal-title":"Am Sociol Rev"},{"issue":"3","key":"1417_CR28","first-page":"459","volume":"11","author":"F Hindriks","year":"2015","unstructured":"Hindriks F, Guala F (2015) Institutions, rules, and equilibria: a unified theory. J Inst Econ 11(3):459\u2013480","journal-title":"J Inst Econ"},{"issue":"1","key":"1417_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/00213624.2006.11506879","volume":"40","author":"GM Hodgson","year":"2006","unstructured":"Hodgson GM (2006) What are institutions? J Econ Issues 40(1):1\u201325","journal-title":"J Econ Issues"},{"issue":"3","key":"1417_CR30","first-page":"497","volume":"11","author":"GM Hodgson","year":"2015","unstructured":"Hodgson GM (2015) On defining institutions: rules versus equilibria. J Inst Econ 11(3):497\u2013505","journal-title":"J Inst Econ"},{"key":"1417_CR31","unstructured":"IEEE (2018) Ethically Aligned Design.\u201d Version 2: For public comment. The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. Available at https:\/\/standards.ieee.org\/content\/dam\/ieee-standards\/standards\/web\/documents\/other\/ead_v2.pdf. Accessed 27 May 2021"},{"issue":"3","key":"1417_CR32","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1111\/j.1088-4963.2005.00034.x","volume":"33","author":"A James","year":"2005","unstructured":"James A (2005) Constructing justice for existing practice: Rawls and the status quo. Philos Public Aff 33(3):281\u2013316","journal-title":"Philos Public Aff"},{"issue":"1","key":"1417_CR33","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1163\/17455243-4681059","volume":"13","author":"R Jubb","year":"2016","unstructured":"Jubb R (2016) \u2018Recover it from the facts as we know them\u2019: practice-dependence\u2019s predecessors. J Moral Philos 13(1):77\u201399","journal-title":"J Moral Philos"},{"key":"1417_CR34","first-page":"189","volume":"34","author":"ME Kaminski","year":"2019","unstructured":"Kaminski ME (2019) The right to explanation, explained. Berkeley Tech LJ 34:189","journal-title":"Berkeley Tech LJ"},{"issue":"1","key":"1417_CR35","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/23299460.2014.992769","volume":"2","author":"AH Kiran","year":"2015","unstructured":"Kiran AH, Oudshoorn N, Verbeek P-P (2015) Beyond checklists: toward an ethical-constructive technology assessment. J Responsible Innov 2(1):5\u201319","journal-title":"J Responsible Innov"},{"key":"1417_CR36","doi-asserted-by":"crossref","unstructured":"Kirkpatrick J, Hahn EN, Haufler AJ (2017) Trust and Human-Robot Interactions. In: Lin P, Jenkins R, Abney K (eds) Robot Ethics 2.0: from Autonomous Cars to Artificial Intelligence","DOI":"10.1093\/oso\/9780190652951.003.0010"},{"issue":"6","key":"1417_CR38","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1002\/sres.703","volume":"23","author":"P Kroes","year":"2006","unstructured":"Kroes P et al (2006) Treating socio-technical systems as engineering systems: some conceptual problems. Syst Res Behav Sci 23(6):803\u2013814","journal-title":"Syst Res Behav Sci"},{"issue":"4","key":"1417_CR39","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1093\/aesthj\/ayq040","volume":"50","author":"P Lamarque","year":"2010","unstructured":"Lamarque P (2010) Wittgenstein, literature, and the idea of a practice. Br J Aesthet 50(4):375\u2013388","journal-title":"Br J Aesthet"},{"issue":"1","key":"1417_CR40","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1177\/14624740022227854","volume":"2","author":"M Lynch","year":"2000","unstructured":"Lynch M (2000) Rehabilitation as rhetoric: the ideal of reformation in contemporary parole discourse and practices. Punishment Soc 2(1):40\u201365","journal-title":"Punishment Soc"},{"key":"1417_CR41","volume-title":"After virtue: a study in moral theory","author":"A MacIntyre","year":"1981","unstructured":"MacIntyre A (1981) After virtue: a study in moral theory. University of Notre Dame Press, Notre Dame"},{"key":"1417_CR42","volume-title":"Whose justice? Which rationality?","author":"AC MacIntyre","year":"1988","unstructured":"MacIntyre AC (1988) Whose justice? Which rationality? University of Notre Dame Press, Notre Dame"},{"key":"1417_CR43","doi-asserted-by":"publisher","unstructured":"Madaio MA, Stark L, Vaughan JW, Wallach H (2020) Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1\u201314. Honolulu HI USA: ACM https:\/\/doi.org\/10.1145\/3313831.3376445","DOI":"10.1145\/3313831.3376445"},{"key":"1417_CR44","doi-asserted-by":"crossref","unstructured":"Max R, Kriebitz A, Von Websky C (2020) Ethical considerations about the implications of artificial intelligence in finance. In: Handbook on Ethics in Finance. pp 1\u201316","DOI":"10.1007\/978-3-030-00001-1_21-1"},{"key":"1417_CR46","unstructured":"Mesthene EG (1997) The role of technology in society. In: Schrder-Frechette K (ed) Technology and values. pp 71\u201385"},{"key":"1417_CR47","doi-asserted-by":"crossref","unstructured":"Mittelstadt B (2019) AI Ethics\u2013Too Principled to Fail? CoRR arXiv:1906.06668 (2019)","DOI":"10.2139\/ssrn.3391293"},{"key":"1417_CR48","first-page":"119","volume":"79","author":"H Nissenbaum","year":"2004","unstructured":"Nissenbaum H (2004) Privacy as contextual integrity. Wash Law Rev 79:119","journal-title":"Wash Law Rev"},{"issue":"4","key":"1417_CR49","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1162\/DAED_a_00113","volume":"140","author":"H Nissenbaum","year":"2011","unstructured":"Nissenbaum H (2011) A contextual approach to privacy online. Daedalus 140(4):32\u201348","journal-title":"Daedalus"},{"key":"1417_CR50","unstructured":"Owen LH (2015) Mark Zuckerberg Has Thoughts on the Future of News on Facebook. Nieman Lab. https:\/\/www.niemanlab.org\/2015\/06\/mark-zuckerberg-has-thoughts-on-the-future-of-news-on-facebook\/. Accessed 13 Nov 2021"},{"key":"1417_CR51","doi-asserted-by":"crossref","unstructured":"Owen R et al (2013) A framework for responsible innovation. In: Responsible innovation: managing the responsible emergence of science and innovation in society, vol 31, pp 27\u201350","DOI":"10.1002\/9781118551424.ch2"},{"issue":"5","key":"1417_CR52","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1016\/j.techfore.2005.06.002","volume":"73","author":"E Palm","year":"2006","unstructured":"Palm E, Hansson SO (2006) The case for ethical technology assessment (eTA). Technol Forecast Soc Chang 73(5):543\u2013558","journal-title":"Technol Forecast Soc Chang"},{"key":"1417_CR53","unstructured":"Pew Research Center (2021) News Consumption Across Social Media in 2021.https:\/\/www.pewresearch.org\/journalism\/2021\/09\/20\/news-consumption-across-social-media-in-2021\/. Accessed 13 Nov 2021"},{"key":"1417_CR55","unstructured":"Plato, Reeve CDC (2004) Republic. Indianapolis: Hackett Pub. Co"},{"issue":"1","key":"1417_CR54","doi-asserted-by":"publisher","first-page":"3","DOI":"10.2307\/2182230","volume":"64","author":"J Rawls","year":"1955","unstructured":"Rawls J (1955) Two concepts of rules. Philos Rev 64(1):3\u201332","journal-title":"Philos Rev"},{"key":"1417_CR56","volume-title":"The oxford handbook of political institutions","year":"2006","unstructured":"Rhodes RAW et al (eds) (2006) The oxford handbook of political institutions. Oxford University Press, Oxford"},{"key":"1417_CR57","volume-title":"Practical reasoning about final ends","author":"HS Richardson","year":"1997","unstructured":"Richardson HS (1997) Practical reasoning about final ends. Cambridge University Press, Cambridge"},{"key":"1417_CR58","doi-asserted-by":"publisher","unstructured":"Rodgers S (2021) Themed issue introduction: promises and perils of artificial intelligence and advertising. J Advert 50(1):1\u201310. https:\/\/doi.org\/10.1080\/00913367.2020.1868233","DOI":"10.1080\/00913367.2020.1868233"},{"issue":"1","key":"1417_CR60","first-page":"1","volume":"1","author":"J Searle","year":"2005","unstructured":"Searle J (2005) What is an Institution? J Inst Econ 1(1):1\u201322","journal-title":"J Inst Econ"},{"key":"1417_CR61","unstructured":"Selbst A, Powles J (2018) Meaningful Information and the Right to Explanation. In: Conference on fairness, accountability and transparency. PMLR"},{"key":"1417_CR62","doi-asserted-by":"crossref","unstructured":"Selinger E, Leong B (2021) The ethics of facial recognition technology. In: V\u00e9liz C (ed) Forthcoming in The Oxford Handbook of Digital Ethics","DOI":"10.2139\/ssrn.3762185"},{"key":"1417_CR63","doi-asserted-by":"publisher","first-page":"2393","DOI":"10.1016\/j.procs.2020.03.292","volume":"167","author":"RA Shaikh","year":"2020","unstructured":"Shaikh RA, Sahu TP, Anand V (2020) Predicting outcomes of legal cases based on legal factors using classifiers. Proc Comput Sci 167:2393\u20132402. https:\/\/doi.org\/10.1016\/j.procs.2020.03.292","journal-title":"Proc Comput Sci"},{"key":"1417_CR64","volume-title":"Poor discipline","author":"J Simon","year":"1993","unstructured":"Simon J (1993) Poor discipline. University of Chicago Press, Chicago"},{"key":"1417_CR65","unstructured":"Tatum JS (1997) the political construction of technology: a call for constructive technology assessment. In: Shrader-Frechette K (ed) Technology and values. pp 115"},{"key":"1417_CR66","doi-asserted-by":"crossref","unstructured":"Van de Poel I (2013) Translating values into design requirements. In: Philosophy and engineering: reflections on practice, principles and process. Springer, Dordrecht, pp 253\u2013266","DOI":"10.1007\/978-94-007-7762-0_20"},{"key":"1417_CR67","doi-asserted-by":"crossref","unstructured":"Van de Poel I (2015) Conflicting values in design for values. In: Handbook of ethics, values, and technological design: sources, theory, values and application domains, pp 89\u2013116","DOI":"10.1007\/978-94-007-6970-0_5"},{"issue":"3","key":"1417_CR68","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/s11023-020-09537-4","volume":"30","author":"I Van de Poel","year":"2020","unstructured":"Van de Poel I (2020) Embedding values in artificial intelligence (AI) systems. Minds Mach 30(3):385\u2013409","journal-title":"Minds Mach"},{"key":"1417_CR69","volume-title":"Ethics, technology, and engineering: an introduction","author":"I Van de Poel","year":"2011","unstructured":"Van de Poel I, Royakkers L (2011) Ethics, technology, and engineering: an introduction. Wiley, Hoboken"},{"key":"1417_CR70","doi-asserted-by":"crossref","unstructured":"Van den Hoven J et al (2014) Responsible innovation. In: Third international conference on responsible innovation, vol 22","DOI":"10.1007\/978-94-017-8956-1"},{"issue":"1","key":"1417_CR71","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1007\/s11948-019-00105-3","volume":"26","author":"G Van de Kaa","year":"2020","unstructured":"Van de Kaa G et al (2020) How to weigh values in value sensitive design: A best worst method approach for the case of smart metering. Sci Eng Ethics 26(1):475\u2013494","journal-title":"Sci Eng Ethics"},{"key":"1417_CR72","doi-asserted-by":"publisher","DOI":"10.1515\/9780271033228","volume-title":"What things do: philosophical reflections on technology, agency, and design","author":"P-P Verbeek","year":"2005","unstructured":"Verbeek P-P (2005) What things do: philosophical reflections on technology, agency, and design. Pennsylvania State Univ. Press, University Park"},{"key":"1417_CR73","unstructured":"Walzer M (2008) Spheres of justice: a defense of pluralism and equality. Basic books"},{"key":"1417_CR74","volume-title":"The global journalist: news people around the world","year":"1998","unstructured":"Weaver DH (ed) (1998) The global journalist: news people around the world. Hampton Press, New Jersey"},{"key":"1417_CR75","doi-asserted-by":"crossref","unstructured":"Wieringa M (2020) What to account for when accounting for algorithms: A systematic literature review on algorithmic accountability. In: Proceedings of the 2020 conference on fairness, accountability, and transparency","DOI":"10.1145\/3351095.3372833"},{"key":"1417_CR76","doi-asserted-by":"publisher","first-page":"345","DOI":"10.2307\/1134532","volume":"20","author":"C Wilcox","year":"1929","unstructured":"Wilcox C (1929) Parole: principles and practice. Am Inst Crim L Criminol 20:345","journal-title":"Am Inst Crim L Criminol"},{"issue":"2","key":"1417_CR77","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1086\/223790","volume":"70","author":"HL Wilensky","year":"1964","unstructured":"Wilensky HL (1964) The Professionalization of Everyone? Am J Sociol 70(2):137\u2013158","journal-title":"Am J Sociol"},{"key":"1417_CR78","unstructured":"Zhang D, Mishra S, Brynjolfsson E, Etchemendy J, Ganguli D, Grosz B, Lyons T, Manyika J, Niebles JC, Sellitto M, Shoham Y, Clark J, Perrault R (2021) The AI Index 2021 Annual Report. AI Index Steering Committee, Human-Centered AI Institute, Stanford University, Stanford"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01417-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-022-01417-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-022-01417-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,13]],"date-time":"2023-07-13T18:12:40Z","timestamp":1689271960000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-022-01417-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,16]]},"references-count":72,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["1417"],"URL":"https:\/\/doi.org\/10.1007\/s00146-022-01417-y","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,16]]},"assertion":[{"value":"30 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 February 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 March 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}