{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T01:33:02Z","timestamp":1792805582489,"version":"4.5.0"},"reference-count":37,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T00:00:00Z","timestamp":1678665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Ethical and legal factors will have an important bearing on when and whether automation is appropriate in healthcare. There is a developing literature on the ethics of artificial intelligence (AI) in health, including specific legal or regulatory questions such as whether there is a right to an explanation of AI decision-making. However, there has been limited consideration of the specific ethical and legal factors that influence when, and in what form, human involvement may be required in the implementation of AI in a clinical pathway, and the views of the wide range of stakeholders involved. To address this question, we chose the exemplar of the pathway for the early detection of Barrett's Oesophagus (BE) and oesophageal adenocarcinoma, where Gehrung and colleagues have developed a \u201csemi-automated\u201d, deep-learning system to analyse samples from the Cytosponge<jats:sup>TM<\/jats:sup> TFF3 test (a minimally invasive alternative to endoscopy), where AI promises to mitigate increasing demands for pathologists' time and input.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We gathered a multidisciplinary group of stakeholders, including developers, patients, healthcare professionals and regulators, to obtain their perspectives on the ethical and legal issues that may arise using this exemplar.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The findings are grouped under six general themes: risk and potential harms; impacts on human experts; equity and bias; transparency and oversight; patient information and choice; accountability, moral responsibility and liability for error. Within these themes, a range of subtle and context-specific elements emerged, highlighting the importance of pre-implementation, interdisciplinary discussions and appreciation of pathway specific considerations.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>To evaluate these findings, we draw on the well-established principles of biomedical ethics identified by Beauchamp and Childress as a lens through which to view these results and their implications for personalised medicine. Our findings are not only relevant to this context but have implications for AI in digital pathology and healthcare more broadly.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fdgth.2023.1139210","type":"journal-article","created":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T04:55:48Z","timestamp":1678683348000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["Ethical and legal considerations influencing human involvement in the implementation of artificial intelligence in a clinical pathway: A multi-stakeholder perspective"],"prefix":"10.3389","volume":"5","author":[{"given":"Elizabeth","family":"Redrup Hill","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Colin","family":"Mitchell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tanya","family":"Brigden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alison","family":"Hall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,3,13]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: the convergence of human and artificial intelligence","volume":"25","author":"Topol E","year":"2019","journal-title":"Nat Med"},{"key":"B2","doi-asserted-by":"publisher","first-page":"e384","DOI":"10.1016\/S2589-7500(22)00003-6","article-title":"The medical algorithmic audit","volume":"4","author":"Xiaoxuan","year":"2022","journal-title":"Lancet Digit Health"},{"key":"B3","year":""},{"key":"B4","doi-asserted-by":"publisher","first-page":"113172","DOI":"10.1016\/j.socscimed.2020.113172","article-title":"The ethics of AI in healthcare: a mapping review","volume":"260","author":"Morley","year":"2020","journal-title":"Soc Sci Med"},{"key":"B5","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1056\/NEJMp1714229","article-title":"Implementing machine learning in health care- addressing ethical challenges","volume":"378","author":"Char D","year":"2019","journal-title":"N Engl J Med"},{"key":"B6","year":""},{"key":"B7","year":""},{"key":"B8","volume-title":"Ethical and societal implications of algorithms, data, and artificial intelligence: A roadmap for research","author":"Whittlestone","year":"2019"},{"key":"B9","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1038\/s41591-021-01287-910.1002\/dc.24354","article-title":"Role of TFF3 as an adjunct in the diagnosis of Barrett\u2019s Esophagus using a minimally invasive esophageal sampling device- The CytospongeTM","volume":"48","author":"Gehrung","year":"2020","journal-title":"Nat Med"},{"key":"B10","volume-title":"The principles of biomedical ethics","author":"Beauchamp T","year":"2001"},{"key":"B11","year":""},{"key":"B12","year":""},{"key":"B13","doi-asserted-by":"publisher","first-page":"E351","DOI":"10.1016\/S2589-7500(22)00004-8","article-title":"Validation and algorithmic audit of a deep learning system for the detection of proximal femoral fractures in patients in the emergency department: a diagnostic accuracy study","volume":"4","author":"Oakden-Rayner","year":"2022","journal-title":"Lancet Digit Health"},{"key":"B14","year":""},{"key":"B15","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1111\/cyt.12799","article-title":"The cytopathologist's Role in developing and evaluating artificial intelligence in cytopathology practice","volume":"31","author":"McAlpine E","year":"2020","journal-title":"Cytopathology"},{"key":"B16","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/j.amjmed.2017.10.035","article-title":"Artificial intelligence in medical practice: the question to the answer?","volume":"131","author":"Miller D","year":"2018","journal-title":"Am J Med"},{"key":"B17","doi-asserted-by":"publisher","first-page":"2353","DOI":"10.1001\/jama.2016.17438","article-title":"Adapting to artificial intelligence: radiologists and pathologists as information specialists","volume":"316","author":"Jha","year":"2016","journal-title":"J Am Med Assoc"},{"key":"B18","year":""},{"key":"B19","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1177\/0968533220945766","article-title":"Artificial intelligence in clinical decision-making: rethinking liability","volume":"20","author":"Smith","year":"2020","journal-title":"Med Law Int"},{"key":"B20","year":""},{"key":"B21","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1136\/jme.28.5.332-a","article-title":"Principles of biomedical ethics (book review)","volume":"28","author":"Holm","year":"2002","journal-title":"J Med Ethics"},{"key":"B22","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1038\/s41591-021-01624-y","article-title":"Clinical decisions using AI must consider patient values","volume":"28","author":"Birch","year":"2022","journal-title":"Nat Med"},{"key":"B23","year":""},{"key":"B24","year":""},{"key":"B25","year":""},{"key":"B26","year":""},{"key":"B27","year":""},{"key":"B28","year":""},{"key":"B29","year":""},{"key":"B30","year":""},{"key":"B31","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1093\/medlaw\/fwab046","article-title":"Differentiating negligent standards of care in diagnosis","volume":"30","author":"Liddell","year":"2022","journal-title":"Med Law Rev"},{"key":"B32","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1093\/ijlit\/eaz004","article-title":"Artificial intelligence in healthcare: a critical analysis of the legal and ethical implications","volume":"27","author":"Sch\u00f6nberger","year":"2019","journal-title":"IntJ Law Inf Technol"},{"key":"B33","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1136\/bmjqs-2018-008370","article-title":"Artificial intelligence, bias and clinical safety","volume":"28","author":"Challen","year":"2019","journal-title":"Br Med J"},{"key":"B34","year":""},{"key":"B35","year":""},{"key":"B36","doi-asserted-by":"publisher","first-page":"E138","DOI":"10.1001\/amajethics.2019.138","article-title":"Case commentary: how should clinicians communicate with patients about the roles of artificially intelligent team members?","volume":"21","author":"Schiff","year":"2019","journal-title":"AMA J Ethics"},{"key":"B37","year":""}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1139210\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,14]],"date-time":"2023-03-14T12:17:25Z","timestamp":1678796245000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1139210\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,13]]},"references-count":37,"alternative-id":["10.3389\/fdgth.2023.1139210"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2023.1139210","relation":{},"ISSN":["2673-253X"],"issn-type":[{"value":"2673-253X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,13]]},"article-number":"1139210"}}