{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T20:02:12Z","timestamp":1775160132391,"version":"3.50.1"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T00:00:00Z","timestamp":1674432000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T00:00:00Z","timestamp":1674432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007601","name":"Horizon2020","doi-asserted-by":"publisher","award":["871042"],"award-info":[{"award-number":["871042"]}],"id":[{"id":"10.13039\/501100007601","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2023,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Artificial intelligence-based (AI) technologies such as machine learning (ML) systems are playing an increasingly relevant role in medicine and healthcare, bringing about novel ethical and epistemological issues that need to be timely addressed. Even though ethical questions connected to epistemic concerns have been at the center of the debate, it is going unnoticed how epistemic forms of injustice can be ML-induced, specifically in healthcare. I analyze the shortcomings of an ML system currently deployed in the USA to predict patients\u2019 likelihood of opioid addiction and misuse (PDMP algorithmic platforms). Drawing on this analysis, I aim to show that the wrong inflicted on epistemic agents involved in and affected by these systems\u2019 decision-making processes can be captured through the lenses of Miranda Fricker\u2019s account of <jats:italic>hermeneutical injustice<\/jats:italic>. I further argue that ML-induced hermeneutical injustice is particularly harmful due to what I define as an <jats:italic>automated hermeneutical appropriation<\/jats:italic> from the side of the ML system. The latter occurs if the ML system establishes meanings and shared hermeneutical resources without allowing for human oversight, impairing understanding and communication practices among stakeholders involved in medical decision-making. Furthermore and very much crucially, an automated hermeneutical appropriation can be recognized if physicians are strongly limited in their possibilities to safeguard patients from ML-induced hermeneutical injustice. Overall, my paper should expand the analysis of ethical issues raised by ML systems that are to be considered epistemic in nature, thus contributing to bridging the gap between these two dimensions in the ongoing debate.<\/jats:p>","DOI":"10.1007\/s10676-023-09676-z","type":"journal-article","created":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T09:08:40Z","timestamp":1674464920000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Automated opioid risk scores: a case for machine learning-induced epistemic injustice in healthcare"],"prefix":"10.1007","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8928-5513","authenticated-orcid":false,"given":"Giorgia","family":"Pozzi","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,1,23]]},"reference":[{"key":"9676_CR1","volume-title":"Introduction to Machine Learning","author":"E Alpaydin","year":"2014","unstructured":"Alpaydin, E. (2014). Introduction to Machine Learning. Massachusetts Institute of Technology."},{"key":"9676_CR2","unstructured":"Bamboo Health. NarxCare and patients. Retrieved December 9, 2022, from https:\/\/bamboohealth.com\/narxcare-and-patients\/"},{"issue":"22","key":"9676_CR3","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1001\/jama.2017.14585","volume":"318","author":"BE Bejnordi","year":"2017","unstructured":"Bejnordi, B. E., et al. (2017). Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. Journal of the American Medical Association, 318(22), 2199\u20132210. https:\/\/doi.org\/10.1001\/jama.2017.14585","journal-title":"JAMA: Journal of the American Medical Association"},{"issue":"1","key":"9676_CR4","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/s11673-016-9761-x","volume":"14","author":"DZ Buchman","year":"2017","unstructured":"Buchman, D. Z., Ho, A., & Goldberg, D. S. (2017). Investigating trust, expertise, and epistemic injustice in chronic pain. Journal of Bioethical Inquiry, 14(1), 31\u201342. https:\/\/doi.org\/10.1007\/s11673-016-9761-x","journal-title":"Journal of Bioethical Inquiry"},{"issue":"1","key":"9676_CR5","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1111\/josp.12348","volume":"52","author":"MF Byskov","year":"2021","unstructured":"Byskov, M. F. (2021). What makes epistemic in justice an \u201cinjustice\u201d? Journal of Social Philosophy, 52(1), 114\u2013131. https:\/\/doi.org\/10.1111\/josp.12348","journal-title":"Journal of Social Philosophy"},{"key":"9676_CR6","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1136\/medethics-2016-103691","volume":"43","author":"H Carel","year":"2017","unstructured":"Carel, H., Blease, C., & Geraghty, K. (2017). Epistemic injustice in healthcare encounters: Evidence from chronic fatigue syndrome. Journal of Medical Ethics, 43, 549\u2013557.","journal-title":"Journal of Medical Ethics"},{"issue":"4","key":"9676_CR7","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1007\/s11019-014-9560-2","volume":"17","author":"H Carel","year":"2014","unstructured":"Carel, H., & Kidd, I. J. (2014). Epistemic injustice in healthcare: A philosophical analysis. Medicine, Health Care and Philosophy, 17(4), 529\u2013540. https:\/\/doi.org\/10.1007\/s11019-014-9560-2","journal-title":"Medicine, Health Care and Philosophy"},{"issue":"2","key":"9676_CR8","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1111\/josp.12393","volume":"52","author":"R Chung","year":"2021","unstructured":"Chung, R. (2021). Structural health vulnerability: Health inequalities, structural and epistemic injustice. Journal of Social Philosophy, 52(2), 201\u2013216. https:\/\/doi.org\/10.1111\/josp.12393","journal-title":"Journal of Social Philosophy"},{"issue":"4","key":"9676_CR9","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1007\/s11023-018-9481-6","volume":"28","author":"JM Dur\u00e1n","year":"2018","unstructured":"Dur\u00e1n, J. M., & Formanek, N. (2018). Grounds for trust: Essential epistemic opacity and computational reliabilism. Minds and Machines, 28(4), 645\u2013666. https:\/\/doi.org\/10.1007\/s11023-018-9481-6","journal-title":"Minds and Machines"},{"issue":"16","key":"9676_CR10","doi-asserted-by":"publisher","first-page":"2221","DOI":"10.1001\/jama.1992.03480160079038","volume":"267","author":"EJ Emanuel","year":"1992","unstructured":"Emanuel, E. J., & Emanuel, L. L. (1992). Four models of the physician-patient relationship. Journal of the American Medical Association, 267(16), 2221\u20132226.","journal-title":"JAMA"},{"issue":"1","key":"9676_CR11","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","volume":"25","author":"A Esteva","year":"2019","unstructured":"Esteva, A., et al. (2019). A guide to deep learning in healthcare. Nature Medicine, 25(1), 24\u201329. https:\/\/doi.org\/10.1038\/s41591-018-0316-z","journal-title":"Nature Medicine"},{"key":"9676_CR12","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198237907.001.0001","volume-title":"Epistemic injustice","author":"M Fricker","year":"2007","unstructured":"Fricker, M. (2007). Epistemic injustice. Oxford University Press."},{"issue":"22","key":"9676_CR13","doi-asserted-by":"publisher","first-page":"2184","DOI":"10.1001\/jama.2017.14580","volume":"318","author":"JA Golden","year":"2017","unstructured":"Golden, J. A. (2017). Deep learning algorithms for detection of lymph node metastases from breast cancer. Helping artificial intelligence be seen.\u00a0Journal of the American Medical Association, 318(22), 2184\u20132186. https:\/\/doi.org\/10.1001\/jama.2017.14580","journal-title":"JAMA: Journal of the American Medical Association"},{"issue":"3","key":"9676_CR14","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1136\/medethics-2019-105586","volume":"46","author":"T Grote","year":"2020","unstructured":"Grote, T., & Berens, P. (2020). On the ethics of algorithmic decision-making in healthcare. Journal of Medical Ethics, 46(3), 205\u2013211. https:\/\/doi.org\/10.1136\/medethics-2019-105586","journal-title":"Journal of Medical Ethics"},{"key":"9676_CR15","doi-asserted-by":"publisher","first-page":"103549","DOI":"10.1016\/j.drugpo.2021.103549","volume":"101","author":"S Haines","year":"2022","unstructured":"Haines, S., et al. (2022). Key considerations for the implementation of clinically focused Prescription Drug Monitoring Programs to avoid unintended consequences. International Journal of Drug Policy, 101, 103549. https:\/\/doi.org\/10.1016\/j.drugpo.2021.103549","journal-title":"International Journal of Drug Policy"},{"key":"9676_CR16","unstructured":"Hao, K (2020). Doctors are using AI to triage covid-19 patients. The tools may be here to stay. In MIT Technology Review. Retrieved July 27, 2021."},{"issue":"7","key":"9676_CR17","doi-asserted-by":"publisher","first-page":"1179","DOI":"10.1111\/pme.12469","volume":"15","author":"C Hildebran","year":"2014","unstructured":"Hildebran, C., et al. (2014). How clinicians use prescription drug monitoring programs: A qualitative inquiry. Pain Medicine., 15(7), 1179\u20131186.","journal-title":"Pain Medicine."},{"issue":"11","key":"9676_CR18","doi-asserted-by":"publisher","first-page":"2061","DOI":"10.1093\/pm\/pnw019","volume":"17","author":"C Hildebran","year":"2016","unstructured":"Hildebran, C., et al. (2016). Clinical styles and practice policies: Influence on communication with patients regarding worrisome prescription drug monitoring program data. Pain Medicine, 17(11), 2061\u20132066. https:\/\/doi.org\/10.1093\/pm\/pnw019","journal-title":"Pain Medicine"},{"key":"9676_CR19","doi-asserted-by":"publisher","DOI":"10.1093\/0195158709.001.0001","volume-title":"Extending ourselves. Computational science, empiricism, and scientific method","author":"P Humphreys","year":"2004","unstructured":"Humphreys, P. (2004). Extending ourselves. Computational science, empiricism, and scientific method. Oxford University Press."},{"issue":"3","key":"9676_CR20","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1007\/s11229-008-9435-2","volume":"169","author":"P Humphreys","year":"2009","unstructured":"Humphreys, P. (2009). The philosophical novelty of computer simulation methods. Synthese, 169(3), 615\u2013626. https:\/\/doi.org\/10.1007\/s11229-008-9435-2","journal-title":"Synthese"},{"issue":"2","key":"9676_CR21","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1111\/japp.12172","volume":"34","author":"IJ Kidd","year":"2017","unstructured":"Kidd, I. J., & Carel, H. (2017). Epistemic injustice and illness. Journal of Applied Philosophy, 34(2), 172\u2013190. https:\/\/doi.org\/10.1111\/japp.12172","journal-title":"Journal of Applied Philosophy"},{"key":"9676_CR22","doi-asserted-by":"publisher","DOI":"10.4324\/9781315212043","volume-title":"The Routledge handbook of epistemic injustice","author":"IJ Kidd","year":"2017","unstructured":"Kidd, I. J., Medina, J., & Pohlhaus, G. (2017). Introduction to the Routledge handbook of epistemic injustice. In I. J. Kidd, J. Medina, & G. Pohlhaus (Eds.), The Routledge handbook of epistemic injustice. Routledge."},{"key":"9676_CR23","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/S1556-3499(13)60161-8","volume":"14","author":"DJ Lawrence","year":"2007","unstructured":"Lawrence, D. J. (2007). The four principles of biomedical ethics: A foundation for current bioethical debate. Journal of Chiropractic Humanities, 14, 34\u201340. https:\/\/doi.org\/10.1016\/S1556-3499(13)60161-8","journal-title":"Journal of Chiropractic Humanities"},{"key":"9676_CR24","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-83620-7","volume-title":"Handbook of artificial intelligence in healthcare: Practicalities and prospects","author":"C-P Lim","year":"2022","unstructured":"Lim, C.-P., et al. (2022). Handbook of artificial intelligence in healthcare: Practicalities and prospects (Vol. 2). Springer."},{"issue":"3","key":"9676_CR25","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3236386.3241340","volume":"16","author":"ZC Lipton","year":"2018","unstructured":"Lipton, Z. C. (2018). The mythos of model interpretability. Queue, 16(3), 31\u201357.","journal-title":"Queue"},{"issue":"2","key":"9676_CR26","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1177\/2372732220942894","volume":"7","author":"EP Lloyd","year":"2020","unstructured":"Lloyd, E. P., Paganini, G. A., & ten Brinke, L. (2020). Gender stereotypes explain disparities in pain care and inform equitable policies. Policy Insights from the Behavioral and Brain Sciences, 7(2), 198\u2013204. https:\/\/doi.org\/10.1177\/2372732220942894","journal-title":"Policy Insights from the Behavioral and Brain Sciences"},{"issue":"1","key":"9676_CR27","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1002\/hast.973","volume":"49","author":"AJ London","year":"2019","unstructured":"London, A. J. (2019). Artificial intelligence and black-box medical decisions: Accuracy versus explainability. Hastings Center Report, 49(1), 15\u201321. https:\/\/doi.org\/10.1002\/hast.973","journal-title":"Hastings Center Report"},{"key":"9676_CR28","doi-asserted-by":"crossref","unstructured":"Mason, R. (2021). Hermeneutical Injustice. In The Routledge handbook of social and political philosophy of language (pp. 247\u2013258). Routledge.","DOI":"10.4324\/9781003164869-19"},{"issue":"3","key":"9676_CR29","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1136\/medethics-2018-105118","volume":"45","author":"RJ McDougall","year":"2019","unstructured":"McDougall, R. J. (2019). Computer knows best? The need for value-flexibility in medical AI. Journal of Medical Ethics, 45(3), 156\u2013160. https:\/\/doi.org\/10.1136\/medethics-2018-105118","journal-title":"Journal of Medical Ethics"},{"issue":"2","key":"9676_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2053951716679679","volume":"3","author":"BD Mittelstadt","year":"2016","unstructured":"Mittelstadt, B. D., et al. (2016). The ethics of algorithms: Mapping the debate. Big Data and Society, 3(2), 1\u201321. https:\/\/doi.org\/10.1177\/2053951716679679","journal-title":"Big Data and Society"},{"key":"9676_CR31","doi-asserted-by":"publisher","first-page":"112674","DOI":"10.1016\/j.socscimed.2019.112674","volume":"245","author":"F Moes","year":"2020","unstructured":"Moes, F., et al. (2020). Questions regarding \u2018epistemic injustice\u2019 in knowledge intensive policy making: Two examples from Dutch health insurance policy. Social Science and Medicine, 245, 112674.","journal-title":"Social Science and Medicine"},{"issue":"7","key":"9676_CR32","doi-asserted-by":"publisher","first-page":"1859","DOI":"10.1007\/s11999-011-1770-9","volume":"469","author":"JM Mossey","year":"2011","unstructured":"Mossey, J. M. (2011). Defining racial and ethnic disparities in pain management. Clinical Orthopaedics and Related Research, 469(7), 1859\u20131870. https:\/\/doi.org\/10.1007\/s11999-011-1770-9","journal-title":"Clinical Orthopaedics and Related Research"},{"key":"9676_CR33","doi-asserted-by":"publisher","unstructured":"Oliva, J. (2022). Dosing Discrimination: Regulating PDMP risk scores (January 18, 2021). 110 California Law Review 47, Available at SSRN:\u00a0https:\/\/ssrn.com\/abstract=3768774\u00a0or\u00a0https:\/\/doi.org\/10.2139\/ssrn.3768774","DOI":"10.2139\/ssrn.3768774"},{"issue":"3","key":"9676_CR34","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1007\/s11023-019-09502-w","volume":"29","author":"A P\u00e1ez","year":"2019","unstructured":"P\u00e1ez, A. (2019). The pragmatic turn in explainable Artificial Intelligence (XAI). Minds and Machines, 29(3), 441\u2013459. https:\/\/doi.org\/10.1007\/s11023-019-09502-w","journal-title":"Minds and Machines"},{"key":"9676_CR35","doi-asserted-by":"publisher","first-page":"109090","DOI":"10.1016\/j.drugalcdep.2021.109090","volume":"228","author":"L Picco","year":"2021","unstructured":"Picco, L., et al. (2021). How prescription drug monitoring programs influence clinical decision-making: A mixed methods systematic review and meta-analysis. Drug and Alcohol Dependence, 228, 109090. https:\/\/doi.org\/10.1016\/j.drugalcdep.2021.109090","journal-title":"Drug and Alcohol Dependence"},{"key":"9676_CR45","doi-asserted-by":"publisher","unstructured":"Pozzi, G. (2023). Testimonial injustice in medical machine learning. Journal of Medical Ethics. https:\/\/doi.org\/10.1136\/jme-2022-108630","DOI":"10.1136\/jme-2022-108630"},{"key":"9676_CR46","unstructured":"Pozzi, G. & Dur\u00e1n, J. M. (under review).\u00a0Informativeness and epistemic injustice in explanatory medical machine learning."},{"issue":"5","key":"9676_CR36","doi-asserted-by":"publisher","first-page":"893","DOI":"10.1016\/j.cell.2018.02.013","volume":"172","author":"L Rampasek","year":"2018","unstructured":"Rampasek, L., & Goldenberg, A. (2018). Learning from everyday images enables expert-like diagnosis of retinal diseases. Cell, 172(5), 893\u2013895. https:\/\/doi.org\/10.1016\/j.cell.2018.02.013","journal-title":"Cell"},{"issue":"10","key":"9676_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0204155","volume":"13","author":"R Singh","year":"2018","unstructured":"Singh, R., et al. (2018). Deep learning in chest radiography: Detection of findings and presence of change. PLoS ONE, 13(10), 1\u201312. https:\/\/doi.org\/10.1371\/journal.pone.0204155","journal-title":"PLoS ONE"},{"issue":"2","key":"9676_CR38","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1007\/s11229-022-03631-z","volume":"200","author":"J Symons","year":"2022","unstructured":"Symons, J., & Alvarado, R. (2022). Epistemic injustice and data science technologies. Synthese, 200(2), 87. https:\/\/doi.org\/10.1007\/s11229-022-03631-z","journal-title":"Synthese"},{"key":"9676_CR39","unstructured":"Szalavitz, M. (2021). The pain was unbearable. So why did doctors turn her away? In Wired. Retrieved March 2022, from https:\/\/www.wired.com\/story\/opioid-drug-addiction-algorithm-chronic-pain\/"},{"issue":"1","key":"9676_CR40","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"EJ Topol","year":"2019","unstructured":"Topol, E. J. (2019). High-performance medicine: The convergence of human and artificial intelligence. Nature Medicine, 25(1), 44\u201356. https:\/\/doi.org\/10.1038\/s41591-018-0300-7","journal-title":"NatureMedicine"},{"issue":"3","key":"9676_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11916-018-0670-z","volume":"22","author":"N Vadivelu","year":"2018","unstructured":"Vadivelu, N., et al. (2018). The opioid crisis: A comprehensive overview. Current Pain and Headache Reports, 22(3), 1\u20136.","journal-title":"Current Pain and Headache Reports"},{"issue":"3","key":"9676_CR42","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/s11023-020-09537-4","volume":"30","author":"I Van de Poel","year":"2020","unstructured":"Van de Poel, I. (2020). Embedding values in Artificial Intelligence (AI) systems. Minds and Machines, 30(3), 385\u2013409. https:\/\/doi.org\/10.1007\/s11023-020-09537-4","journal-title":"Minds and Machines"},{"key":"9676_CR43","unstructured":"Van den Hoven, J. (1998). Moral responsibility, public office and information technology. In: Public administration in an information age: a handbook (pp. 97\u2013112)."},{"issue":"3","key":"9676_CR44","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1007\/s11019-014-9608-3","volume":"18","author":"A Wardrope","year":"2015","unstructured":"Wardrope, A. (2015). Medicalization and epistemic injustice. Medicine, Health Care and Philosophy, 18(3), 341\u2013352. https:\/\/doi.org\/10.1007\/s11019-014-9608-3","journal-title":"Medicine, Health Care and Philosophy"}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09676-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10676-023-09676-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09676-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T06:18:39Z","timestamp":1679984319000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10676-023-09676-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,23]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["9676"],"URL":"https:\/\/doi.org\/10.1007\/s10676-023-09676-z","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,23]]},"assertion":[{"value":"12 January 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 January 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"3"}}