{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T10:58:58Z","timestamp":1775473138463,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,4,5]],"date-time":"2022-04-05T00:00:00Z","timestamp":1649116800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,4,5]],"date-time":"2022-04-05T00:00:00Z","timestamp":1649116800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002347","name":"bundesministerium f\u00fcr bildung und forschung","doi-asserted-by":"publisher","award":["01GP1910A"],"award-info":[{"award-number":["01GP1910A"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003107","name":"bundesministerium f\u00fcr gesundheit","doi-asserted-by":"publisher","award":["2520DAT10G"],"award-info":[{"award-number":["2520DAT10G"]}],"id":[{"id":"10.13039\/501100003107","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2022,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The increased presence of medical AI in clinical use raises the ethical question which standard of explainability is required for an acceptable and responsible implementation of AI-based applications in medical contexts. In this paper, we elaborate on the emerging debate surrounding the standards of explainability for medical AI. For this, we first distinguish several goods explainability is usually considered to contribute to the use of AI in general, and medical AI in specific. Second, we propose to understand the value of explainability relative to other available norms of explainable decision-making. Third, in pointing out that we usually accept heuristics and uses of bounded rationality for medical decision-making by physicians, we argue that the explainability of medical decisions should not be measured against an idealized diagnostic process, but according to practical considerations. We conclude, fourth, to resolve the issue of explainability-standards by relocating the issue to the AI\u2019s certifiability and interpretability.<\/jats:p>","DOI":"10.1007\/s10676-022-09646-x","type":"journal-article","created":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T18:03:51Z","timestamp":1649354631000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Relative explainability and double standards in medical decision-making"],"prefix":"10.1007","volume":"24","author":[{"given":"Hendrik","family":"Kempt","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan-Christoph","family":"Heilinger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saskia K.","family":"Nagel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,4,5]]},"reference":[{"key":"9646_CR1","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-019-00391-6","author":"JC Bjerring","year":"2020","unstructured":"Bjerring, J. C., & Busch, J. (2020). Artificial intelligence and patient-centered decision-making. Philosophy & Technology. https:\/\/doi.org\/10.1007\/s13347-019-00391-6","journal-title":"Philosophy & Technology"},{"key":"9646_CR2","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-020-00960-w","author":"K de Fine Licht","year":"2020","unstructured":"de Fine Licht, K., & de Fine Licht, J. (2020). Artificial intelligence, transparency, and public decision-making: Why explanations are key when trying to produce perceived legitimacy. AI & Society. https:\/\/doi.org\/10.1007\/s00146-020-00960-w","journal-title":"AI & Society"},{"issue":"4","key":"9646_CR3","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1086\/648111","volume":"76","author":"HE Douglas","year":"2009","unstructured":"Douglas, H. E. (2009). Reintroducing prediction to explanation. Philosophy of Science, 76(4), 444\u2013463.","journal-title":"Philosophy of Science"},{"key":"9646_CR4","doi-asserted-by":"crossref","unstructured":"Dur\u00e1n, J. (2021). Dissecting scientific explanation in AI (sXAI): a case for medicine and healthcare. Artificial Intelligence. https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/S0004370221000497v?via%3Dihub","DOI":"10.1016\/j.artint.2021.103498"},{"key":"9646_CR5","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1093\/jncimonographs\/lgq038","volume":"41","author":"JG Elmore","year":"2010","unstructured":"Elmore, J. G., Ganschow, P. S., & Geller, B. M. (2010). Communication between patients and providers and informed decision making. Journal of the National Cancer Institute. Monographs, 41, 204\u2013209. https:\/\/doi.org\/10.1093\/jncimonographs\/lgq038","journal-title":"Journal of the National Cancer Institute. Monographs"},{"issue":"1","key":"9646_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2053951719860542","volume":"6","author":"H Felzmann","year":"2019","unstructured":"Felzmann, H., Fosch Villaronga, E., Lutz, C., & Tam\u00f2-Larrieux, A. (2019). Transparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns. Big Data & Society, 6(1), 1\u201314. https:\/\/doi.org\/10.1177\/2053951719860542","journal-title":"Big Data & Society"},{"key":"9646_CR7","doi-asserted-by":"publisher","first-page":"3333","DOI":"10.1007\/s11948-020-00276-4","volume":"26","author":"H Felzmann","year":"2020","unstructured":"Felzmann, H., Fosch-Villaronga, E., Lutz, C., & Tam\u00f2-Larrieux, A. (2020). Towards transparency by design for artificial intelligence. Science and Engineering Ethics, 26, 3333\u20133361. https:\/\/doi.org\/10.1007\/s11948-020-00276-4","journal-title":"Science and Engineering Ethics"},{"key":"9646_CR8","doi-asserted-by":"publisher","DOI":"10.1111\/japp.12496","author":"M Ferreira","year":"2021","unstructured":"Ferreira, M. (2021). Inscrutable processes: Algorithms, agency, and divisions of deliberative labour. Journal of Applied Philosophy. https:\/\/doi.org\/10.1111\/japp.12496","journal-title":"Journal of Applied Philosophy"},{"issue":"4","key":"9646_CR9","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1007\/s11023-018-9482-5","volume":"28","author":"L Floridi","year":"2018","unstructured":"Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., & Vayena, E. (2018). AI4People\u2014an ethical framework for a good AI society: Opportunities, risks, principles, and recommendations. Minds and Machines, 28(4), 689\u2013707. https:\/\/doi.org\/10.1007\/s11023-018-9482-5","journal-title":"Minds and Machines"},{"issue":"3","key":"9646_CR10","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1136\/medethics-2019-105586","volume":"46","author":"T Grote","year":"2020","unstructured":"Grote, T., & Berens, P. (2020). On the ethics of algorithmic decision-making in healthcare. Journal of Medical Ethics, 46(3), 205\u2013211. https:\/\/doi.org\/10.1136\/medethics-2019-105586","journal-title":"Journal of Medical Ethics"},{"key":"9646_CR11","doi-asserted-by":"publisher","unstructured":"Grote T. & Di Nucci E. (2020). Algorithmic Decision-Making and the Problem of Control. In: Beck B., K\u00fchler M. (eds) Technology, Anthropology, and Dimensions of Responsibility. Techno:Phil\u2014Aktuelle Herausforderungen der Technikphilosophie, vol 1. J.B. Metzler, Stuttgart. https:\/\/doi.org\/10.1007\/978-3-476-04896-7_8","DOI":"10.1007\/978-3-476-04896-7_8"},{"key":"9646_CR12","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-021-01200-5","author":"M G\u00fcnther","year":"2021","unstructured":"G\u00fcnther, M., & Kasirzadeh, A. (2021). Algorithmic and human decision making: For a double standard of transparency. AI & Society. https:\/\/doi.org\/10.1007\/s00146-021-01200-5","journal-title":"AI & Society"},{"issue":"4","key":"9646_CR13","doi-asserted-by":"publisher","first-page":"251","DOI":"10.2471\/BLT.19.237487","volume":"98","author":"I Habli","year":"2020","unstructured":"Habli, I., Lawton, T., & Porter, Z. (2020). Artificial intelligence in health care: Accountability and safety. Bulletin of the World Health Organization, 98(4), 251\u2013256. https:\/\/doi.org\/10.2471\/BLT.19.237487","journal-title":"Bulletin of the World Health Organization"},{"key":"9646_CR14","unstructured":"Heaven, W. D. (2020). Google\u2019s medical AI was super accurate in a lab. Real life was a different story. MIT Technology Review. Retrieved 2021 from https:\/\/www.technologyreview.com\/2020\/04\/27\/1000658\/google-medical-ai-accurate-lab-real-life-clinic-covid-diabetes-retina-disease\/"},{"key":"9646_CR15","unstructured":"High Level Expert Group on AI of the European Union. (2019). Ethics guidelines for trustworthy AI. https:\/\/www.aepd.es\/sites\/default\/files\/2019-12\/ai-ethics-guidelines.pdf"},{"issue":"3","key":"9646_CR16","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1093\/jmp\/21.3.303","volume":"21","author":"KM Hunter","year":"1996","unstructured":"Hunter, K. M. (1996). Narrative, literature, and the clinical exercise of practical reason. The Journal of Medicine and Philosophy, 21(3), 303\u2013320. https:\/\/doi.org\/10.1093\/jmp\/21.3.303","journal-title":"The Journal of Medicine and Philosophy"},{"issue":"22","key":"9646_CR17","doi-asserted-by":"publisher","first-page":"2353","DOI":"10.1001\/jama.2016.17438","volume":"316","author":"S Jha","year":"2016","unstructured":"Jha, S., & Topol, E. J. (2016). Adapting to artificial intelligence: Radiologists and pathologists as information specialists. JAMA, 316(22), 2353\u20132354. https:\/\/doi.org\/10.1001\/jama.2016.17438","journal-title":"JAMA"},{"key":"9646_CR18","doi-asserted-by":"publisher","unstructured":"Lipton, Z. C. (2016). The Mythos of Model Interpretability. Communications of the ACM 61(10).https:\/\/doi.org\/10.1145\/3233231","DOI":"10.1145\/3233231"},{"issue":"8","key":"9646_CR19","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1111\/j.1747-9991.2011.00413.x","volume":"6","author":"T Lombrozo","year":"2011","unstructured":"Lombrozo, T. (2011). The instrumental value of explanations. Philosophy Compass, 6(8), 539\u2013551. https:\/\/doi.org\/10.1111\/j.1747-9991.2011.00413.x","journal-title":"Philosophy Compass"},{"issue":"1","key":"9646_CR20","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1002\/hast.973","volume":"49","author":"AJ London","year":"2019","unstructured":"London, A. J. (2019). Artificial intelligence and black-box medical decisions: Accuracy versus explainability. Hastings Center Report, 49(1), 15\u201321. https:\/\/doi.org\/10.1002\/hast.973","journal-title":"Hastings Center Report"},{"issue":"1","key":"9646_CR21","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s11017-016-9377-5","volume":"38","author":"HH Maung","year":"2017","unstructured":"Maung, H. H. (2017). The causal explanatory functions of medical diagnoses. Theoretical Medicine and Bioethics, 38(1), 41\u201359. https:\/\/doi.org\/10.1007\/s11017-016-9377-5","journal-title":"Theoretical Medicine and Bioethics"},{"key":"9646_CR100","doi-asserted-by":"crossref","unstructured":"McDougall, R. J. (2019). Computer knows best? The need for value-flexibility in medical AI. J Med Ethics 45, 156\u2013160.","DOI":"10.1136\/medethics-2018-105118"},{"key":"9646_CR22","doi-asserted-by":"publisher","unstructured":"McLafferty, R., Williams, R. G., Lambert, A. D., & Dunnington, G. L. (2006). Surgeon communication behaviors that lead patients to not recommend the surgeon to family members or friends: Analysis and impact. Surgery. https:\/\/doi.org\/10.1016\/j.surg.2006.06.021","DOI":"10.1016\/j.surg.2006.06.021"},{"key":"9646_CR23","doi-asserted-by":"publisher","unstructured":"Mittelstadt, B., Russell, C., & Wachter, S. (2019). Explaining explanations in AI. In Proceedings of the conference on fairness, accountability, and transparency (pp. 279\u2013288). https:\/\/doi.org\/10.1145\/3287560.3287574","DOI":"10.1145\/3287560.3287574"},{"key":"9646_CR24","doi-asserted-by":"publisher","unstructured":"Montague, E. N. H., Winchester, W. W., & Klein, B. M. (2010). Trust in medical technology by patients and health care providers in obstetric work systems. Behaviour & Information Technology, 29(5): 541\u2013554. https:\/\/doi.org\/10.1080\/01449291003752914","DOI":"10.1080\/01449291003752914"},{"issue":"2","key":"9646_CR25","doi-asserted-by":"publisher","DOI":"10.7189\/jogh.09.020318","volume":"9","author":"T Panch","year":"2019","unstructured":"Panch, T., Mattie, H., & Atun, R. (2019). Artificial intelligence and algorithmic bias: Implications for health systems. Journal of Global Health, 9(2), 010318. https:\/\/doi.org\/10.7189\/jogh.09.020318","journal-title":"Journal of Global Health"},{"key":"9646_CR26","doi-asserted-by":"publisher","unstructured":"Reyes M., Meier R., Pereira S., et al. (2020). On the interpretability of artificial intelligence in radiology: Challenges and opportunities. Radiology: Artificial Intelligence. 2020;2(3):e190043. https:\/\/doi.org\/10.1148\/ryai.2020190043","DOI":"10.1148\/ryai.2020190043"},{"key":"9646_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.techsoc.2020.101421","author":"SC Robinson","year":"2020","unstructured":"Robinson, S. C. (2020). Trust, transparency, and openness: How inclusion of cultural values shapes Nordic national public policy strategies for artificial intelligence (AI). Technology in Society. https:\/\/doi.org\/10.1016\/j.techsoc.2020.101421","journal-title":"Technology in Society"},{"issue":"5","key":"9646_CR28","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206\u2013215. https:\/\/doi.org\/10.1038\/s42256-019-0048-x","journal-title":"Nature Machine Intelligence"},{"key":"9646_CR29","doi-asserted-by":"publisher","DOI":"10.1111\/bioe.12887","author":"M Sand","year":"2021","unstructured":"Sand, M., Dur\u00e1n, J. M., & Jongsma, K. R. (2021). Responsibility beyond design: Physicians\u2019 requirements for ethical medical AI. Bioethics. https:\/\/doi.org\/10.1111\/bioe.12887","journal-title":"Bioethics"},{"issue":"1","key":"9646_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-016-0377-1","volume":"16","author":"G Saposnik","year":"2016","unstructured":"Saposnik, G., Redelmeier, D., Ruff, C. C., & Tobler, P. N. (2016). Cognitive biases associated with medical decisions: A systematic review. BMC Medical Informatics and Decision Making, 16(1), 1\u201314. https:\/\/doi.org\/10.1186\/s12911-016-0377-1","journal-title":"BMC Medical Informatics and Decision Making"},{"key":"9646_CR31","doi-asserted-by":"crossref","unstructured":"Sharp, R., Surdeanu, M., Jansen, P., Valenzuela-Esc\u00e1rcega, M. A., Clark, P., & Hammond, M. (2017, August). Tell me why: Using question answering as distant supervision for answer justification. In Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) (pp. 69\u201379).","DOI":"10.18653\/v1\/K17-1009"},{"key":"9646_CR32","volume-title":"Models of man; social and rational","author":"HA Simon","year":"1957","unstructured":"Simon, H. A. (1957). Models of man; social and rational. Wiley."},{"key":"9646_CR33","doi-asserted-by":"publisher","unstructured":"Smart, A., James, L., Hutchinson, B., Wu, S., & Vallor, S. (2020). Why reliabilism is not enough: Epistemic and moral justification in machine learning. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society (pp. 372\u2013377). https:\/\/doi.org\/10.1145\/3375627.3375866","DOI":"10.1145\/3375627.3375866"},{"key":"9646_CR34","doi-asserted-by":"publisher","unstructured":"Tutt, A. (2017). An FDA for algorithms. 69 Administrative Law Review. https:\/\/doi.org\/10.2139\/ssrn.2747994","DOI":"10.2139\/ssrn.2747994"},{"key":"9646_CR35","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1126\/science.185.4157.1124","volume":"185","author":"A Tversky","year":"1974","unstructured":"Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124\u20131131.","journal-title":"Science"},{"issue":"4","key":"9646_CR36","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1007\/s13347-018-0330-6s","volume":"32","author":"J Zerilli","year":"2019","unstructured":"Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019). Transparency in algorithmic and human decision-making: Is there a double standard? Philosophy & Technology, 32(4), 661\u2013683. https:\/\/doi.org\/10.1007\/s13347-018-0330-6s","journal-title":"Philosophy & Technology"}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-022-09646-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10676-022-09646-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-022-09646-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T04:29:09Z","timestamp":1656476949000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10676-022-09646-x"}},"subtitle":["Should medical AI be subjected to higher standards in medical decision-making than doctors?"],"short-title":[],"issued":{"date-parts":[[2022,4,5]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,6]]}},"alternative-id":["9646"],"URL":"https:\/\/doi.org\/10.1007\/s10676-022-09646-x","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,5]]},"assertion":[{"value":"10 March 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 April 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We have no conflicting or competing interests to declare.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"20"}}