{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T15:21:22Z","timestamp":1785338482273,"version":"3.55.0"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T00:00:00Z","timestamp":1692921600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T00:00:00Z","timestamp":1692921600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>While the literature on putting a \u201chuman in the loop\u201d in artificial intelligence (AI) and machine learning (ML) has grown significantly, limited attention has been paid to how human expertise ought to be combined with AI\/ML judgments. This design question arises because of the ubiquity and quantity of algorithmic decisions being made today in the face of widespread public reluctance to forgo human expert judgment. To resolve this conflict, we propose that human expert judges be included via appeals processes for review of algorithmic decisions. Thus, the human intervenes only in a limited number of cases and only after an initial AI\/ML judgment has been made. Based on an analogy with appellate processes in judiciary decision-making, we argue that this is, in many respects, a more efficient way to divide the labor between a human and a machine. Human reviewers can add more nuanced clinical, moral, or legal reasoning, and they can consider case-specific information that is not easily quantified and, as such, not available to the AI\/ML at an initial stage. In doing so, the human can serve as a crucial error correction check on the AI\/ML, while retaining much of the efficiency of AI\/ML\u2019s use in the decision-making process. In this paper, we develop these widely applicable arguments while focusing primarily on examples from the use of AI\/ML in medicine, including organ allocation, fertility care, and hospital readmission.<\/jats:p>","DOI":"10.1038\/s41746-023-00906-8","type":"journal-article","created":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T10:02:30Z","timestamp":1692957750000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["How AI can learn from the law: putting humans in the loop only on appeal"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0223-3305","authenticated-orcid":false,"given":"I. Glenn","family":"Cohen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boris","family":"Babic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5718-3982","authenticated-orcid":false,"given":"Sara","family":"Gerke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiong","family":"Xia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9525-6110","authenticated-orcid":false,"given":"Theodoros","family":"Evgeniou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1730-568X","authenticated-orcid":false,"given":"Klaus","family":"Wertenbroch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,25]]},"reference":[{"key":"906_CR1","unstructured":"Barocas, S., Hardt, M. & Narayanan, A. Fairness and machine learning: limitations and opportunities. https:\/\/fairmlbook.org\/index.html (2022)."},{"key":"906_CR2","doi-asserted-by":"publisher","first-page":"387","DOI":"10.2307\/1925895","volume":"36","author":"PA Samuelson","year":"1954","unstructured":"Samuelson, P. A. The pure theory of public expenditure. Rev. Econ. Stat. 36, 387\u2013389 (1954).","journal-title":"Rev. Econ. Stat."},{"key":"906_CR3","doi-asserted-by":"publisher","first-page":"2819","DOI":"10.1257\/aer.20191330","volume":"110","author":"I Charles","year":"2020","unstructured":"Charles, I. & Tonetti, C. Nonrivalry and the economics of data. AER 110, 2819\u20132858 (2020).","journal-title":"AER"},{"key":"906_CR4","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1037\/xge0000033","volume":"144","author":"BJ Dietvorst","year":"2015","unstructured":"Dietvorst, B. J., Simmons, J. P. & Massey, C. Algorithm aversion: people erroneously avoid algorithms after seeing them err. J. Exp. Psychol: Gen. 144, 114\u2013126 (2015).","journal-title":"J. Exp. Psychol: Gen."},{"key":"906_CR5","doi-asserted-by":"publisher","first-page":"629","DOI":"10.1093\/jcr\/ucz013","volume":"46","author":"C Longoni","year":"2019","unstructured":"Longoni, C., Bonezzi, A. & Morewedge, C. K. Resistance to medical artificial intelligence. J. Consum. Res. 46, 629\u2013650 (2019).","journal-title":"J. Consum. Res."},{"key":"906_CR6","doi-asserted-by":"publisher","first-page":"1636","DOI":"10.1038\/s41562-021-01146-0","volume":"5","author":"R Cadario","year":"2021","unstructured":"Cadario, R., Longoni, C. & Morewedge, C. K. Understanding, explaining, and utilizing medical artificial intelligence. Nat. Hum. Behav. 5, 1636\u20131642 (2021).","journal-title":"Nat. Hum. Behav."},{"key":"906_CR7","doi-asserted-by":"publisher","first-page":"887","DOI":"10.1287\/mnsc.36.8.887","volume":"36","author":"RC Blattberg","year":"1990","unstructured":"Blattberg, R. C. & Hoch, S. J. Database models and managerial intuition: 50% model + 50% manager. Manag. Sci. 36, 887\u2013899 (1990).","journal-title":"Manag. Sci."},{"key":"906_CR8","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1287\/mnsc.42.1.51","volume":"42","author":"SJ Hoch","year":"1996","unstructured":"Hoch, S. J. & Schkade, D. A. A psychological approach to decision support systems. Manag. Sci. 42, 51\u201364 (1996).","journal-title":"Manag. Sci."},{"key":"906_CR9","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-00864-9","volume":"11","author":"EM Heffernan","year":"2021","unstructured":"Heffernan, E. M., Schlichting, M. L. & Mack, M. L. Learning exceptions to the rule in human and model via hippocampal encoding. Sci. Rep. 11, 21429 (2021).","journal-title":"Sci. Rep."},{"key":"906_CR10","first-page":"669","volume":"2","author":"H Dejean","year":"2002","unstructured":"Dejean, H. Learning rules and their exceptions. JMLR 2, 669\u2013693 (2002).","journal-title":"JMLR"},{"key":"906_CR11","doi-asserted-by":"publisher","first-page":"1155","DOI":"10.1287\/mnsc.2016.2643","volume":"64","author":"BJ Dietvorst","year":"2018","unstructured":"Dietvorst, B. J., Simmons, J. P. & Massey, C. Overcoming algorithm aversion: people will use imperfect algorithms if they can (even slightly) modify them. Manag. Sci. 64, 1155\u20131170 (2018).","journal-title":"Manag. Sci."},{"key":"906_CR12","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1177\/0022243719851788","volume":"56","author":"N Castelo","year":"2019","unstructured":"Castelo, N., Bos, W. M. & Lehmann, D. R. Task-dependent algorithm aversion. J. Mark. Res. 56, 809\u2013825 (2019).","journal-title":"J. Mark. Res."},{"key":"906_CR13","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1177\/0022242920957347","volume":"86","author":"C Longoni","year":"2022","unstructured":"Longoni, C. & Cian, L. Artificial intelligence in utilitarian vs. hedonic contexts: the \u201cword-of-machine\u201d effect. J. Mark. 86, 91\u2013108 (2022).","journal-title":"J. Mark."},{"key":"906_CR14","doi-asserted-by":"publisher","first-page":"1302","DOI":"10.1177\/0956797620948841","volume":"31","author":"BJ Dietvorst","year":"2020","unstructured":"Dietvorst, B. J. & Bharti, S. People reject algorithms in uncertain decision domains because they have diminishing sensitivity to forecasting error. Psychol. Sci. 31, 1302\u20131314 (2020).","journal-title":"Psychol. Sci."},{"key":"906_CR15","doi-asserted-by":"publisher","first-page":"1675","DOI":"10.1007\/s10815-021-02254-6","volume":"38","author":"MF Kragh","year":"2021","unstructured":"Kragh, M. F. & Karstoft, H. Embryo selection with artificial intelligence: how to evaluate and compare methods? J. Assist. Reprod. Genet. 38, 1675\u20131689 (2021).","journal-title":"J. Assist. Reprod. Genet."},{"key":"906_CR16","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1126\/science.185.4157.1124","volume":"185","author":"A Tversky","year":"1974","unstructured":"Tversky, A. & Kahneman, D. Judgment under uncertainty: heuristics and biases: biases in judgments reveal some heuristics of thinking under uncertainty. Science 185, 1124\u20131131 (1974).","journal-title":"Science"},{"key":"906_CR17","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1287\/mnsc.38.2.212","volume":"38","author":"R Glazer","year":"1992","unstructured":"Glazer, R., Steckel, J. H. & Winer, R. S. Locally rational decision making: the distracting effect of information on managerial performance. Manag. Sci. 38, 212\u2013226 (1992).","journal-title":"Manag. Sci."},{"key":"906_CR18","doi-asserted-by":"publisher","first-page":"1668","DOI":"10.1126\/science.2648573","volume":"243","author":"RM Dawes","year":"1989","unstructured":"Dawes, R. M., Faust, D. & Meehl, P. E. Clinical versus actuarial judgment. Science 243, 1668\u20131674 (1989).","journal-title":"Science"},{"key":"906_CR19","doi-asserted-by":"crossref","unstructured":"Meehl, P. E. Clinical Versus Statistical Prediction: a Theoretical Analysis and a Review of the Evidence (University of Minnesota Press,1954).","DOI":"10.1037\/11281-000"},{"key":"906_CR20","doi-asserted-by":"publisher","first-page":"153","DOI":"10.2307\/1519845","volume":"66","author":"J Sunshine","year":"2003","unstructured":"Sunshine, J. & Tyler, T. R. Moral solidarity, identification with the community, and the importance of procedural justice: the police as prototypical representatives of a group\u2019s moral values. Soc. Psychol. Q. 66, 153\u2013165 (2003).","journal-title":"Soc. Psychol. Q."},{"key":"906_CR21","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1007\/s11211-008-0083-y","volume":"21","author":"JL Napier","year":"2008","unstructured":"Napier, J. L. & Tyler, T. R. Does moral conviction really override concerns about procedural justice? A reexamination of the value protection model. Soc. Justice Res. 21, 509\u2013528 (2008).","journal-title":"Soc. Justice Res."},{"key":"906_CR22","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1037\/0022-3514.49.4.953","volume":"49","author":"BH Sheppard","year":"1985","unstructured":"Sheppard, B. H. Justice is no simple matter: case for elaborating our model of procedural fairness. J. Pers. Soc. Psychol. 49, 953\u2013962 (1985).","journal-title":"J. Pers. Soc. Psychol."},{"key":"906_CR23","doi-asserted-by":"publisher","first-page":"653","DOI":"10.1007\/s10551-021-05032-7","volume":"183","author":"K Martin","year":"2023","unstructured":"Martin, K. & Waldman, A. Are algorithmic decisions legitimate? The effect of process and outcomes on perceptions of legitimacy of AI decisions. J. Bus. Ethics 183, 653\u2013670 (2023).","journal-title":"J. Bus. Ethics"},{"key":"906_CR24","unstructured":"Regulation (EU) 2022\/2065 of the European Parliament and of the Council of 19 October 2022 on a Single Market for Digital Services and amending Directive 2000\/31\/EC (Digital Services Act), OJ L277\/1 (2022)."},{"key":"906_CR25","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","volume":"366","author":"Z Obermeyer","year":"2019","unstructured":"Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 447\u2013453 (2019).","journal-title":"Science"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00906-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00906-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00906-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T15:03:01Z","timestamp":1700406181000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00906-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,25]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["906"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00906-8","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,25]]},"assertion":[{"value":"14 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"I.G.C. reported serving on the bioethics advisory board of Illumina, serves as a bioethics consultant for Otsuka and for DawnLight, and serves on the bioethics council of Bayer. T.E. reported serving as co-founder and CIO of Tremau, a software company that builds products to enhance technology trust and safety.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"160"}}