{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T04:12:41Z","timestamp":1784002361304,"version":"3.55.0"},"reference-count":36,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2020,12,19]],"date-time":"2020-12-19T00:00:00Z","timestamp":1608336000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Artificial intelligence (AI) is increasingly of tremendous interest in the medical field. How-ever, failures of medical AI could have serious consequences for both clinical outcomes and the patient experience. These consequences could erode public trust in AI, which could in turn undermine trust in our healthcare institutions. This article makes 2 contributions. First, it describes the major conceptual, technical, and humanistic challenges in medical AI. Second, it proposes a solution that hinges on the education and accreditation of new expert groups who specialize in the development, verification, and operation of medical AI technologies. These groups will be required to maintain trust in our healthcare institutions.<\/jats:p>","DOI":"10.1093\/jamia\/ocaa268","type":"journal-article","created":{"date-parts":[[2020,10,13]],"date-time":"2020-10-13T12:19:39Z","timestamp":1602591579000},"page":"890-894","source":"Crossref","is-referenced-by-count":234,"title":["Trust and medical AI: the challenges we face and the expertise needed to overcome them"],"prefix":"10.1093","volume":"28","author":[{"given":"Thomas P","family":"Quinn","sequence":"first","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Geelong, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manisha","family":"Senadeera","sequence":"additional","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Geelong, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephan","family":"Jacobs","sequence":"additional","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Geelong, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon","family":"Coghlan","sequence":"additional","affiliation":[{"name":"Centre for AI and Digital Ethics, School of Computing and Information Systems, University of Melbourne, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vuong","family":"Le","sequence":"additional","affiliation":[{"name":"Applied Artificial Intelligence Institute, Deakin University, Geelong, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,12,19]]},"reference":[{"key":"2021031906032764600_ocaa268-B1","volume-title":"Ethics, Trust, and the Professions: Philosophical and Cultural Aspects","author":"Pellegrino","year":"1991"},{"issue":"4","key":"2021031906032764600_ocaa268-B2","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s12553-017-0179-1","article-title":"Google DeepMind and healthcare in an age of algorithms","volume":"7","author":"Powles","year":"2017","journal-title":"Health Technol"},{"issue":"5","key":"2021031906032764600_ocaa268-B3","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1007\/s11948-017-9975-2","article-title":"The ugly truth about ourselves and our robot creations: the problem of bias and social inequity","volume":"24","author":"Howard","year":"2018","journal-title":"Sci Eng Ethics"},{"key":"2021031906032764600_ocaa268-B4","first-page":"107332","article-title":"Understanding adversarial attacks on deep learning based medical image analysis systems","author":"Ma","year":"2020","journal-title":"Pattern Recogn"},{"issue":"3","key":"2021031906032764600_ocaa268-B5","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1093\/jamia\/ocz192","article-title":"A governance model for the application of AI in health care","volume":"27","author":"Reddy","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021031906032764600_ocaa268-B6","author":"Babel","year":"2019"},{"issue":"2","key":"2021031906032764600_ocaa268-B7","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s10994-013-5335-x","article-title":"From machine learning to machine reasoning","volume":"94","author":"Bottou","year":"2014","journal-title":"Mach Learn"},{"issue":"8","key":"2021031906032764600_ocaa268-B8","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1056\/NEJM198208193070808","article-title":"The computer and clinical judgment","volume":"307","author":"Barnett","year":"1982","journal-title":"N Engl J Med"},{"issue":"1","key":"2021031906032764600_ocaa268-B9","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1186\/s12916-019-1426-2","article-title":"Key challenges for delivering clinical impact with artificial intelligence","volume":"17","author":"Kelly","year":"2019","journal-title":"BMC Med"},{"key":"2021031906032764600_ocaa268-B10","volume-title":"The Patient as Person: Explorations in Medical Ethics","author":"Ramsey","year":"2002"},{"issue":"16","key":"2021031906032764600_ocaa268-B11","doi-asserted-by":"crossref","first-page":"2221","DOI":"10.1001\/jama.1992.03480160079038","article-title":"Four models of the physician-patient relationship","volume":"267","author":"Emanuel","year":"1992","journal-title":"JAMA"},{"key":"2021031906032764600_ocaa268-B12","volume-title":"Principles of Biomedical Ethics","author":"Beauchamp","year":"2001"},{"key":"2021031906032764600_ocaa268-B13","author":"Alvarez-Melis","year":"32       (); 2018; \u00e9,"},{"issue":"3","key":"2021031906032764600_ocaa268-B14","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1136\/medethics-2019-105586","article-title":"On the ethics of algorithmic decision-making in healthcare","volume":"46","author":"Grote","year":"2020","journal-title":"J Med Ethics"},{"issue":"7","key":"2021031906032764600_ocaa268-B15","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1093\/jamia\/ocaa053","article-title":"Explainable artificial intelligence models using real-world electronic health record data: a systematic scoping review","volume":"27","author":"Payrovnaziri","year":"2020","journal-title":"J Am Med Inform Assoc"},{"key":"2021031906032764600_ocaa268-B16","doi-asserted-by":"crossref","DOI":"10.1093\/jamia\/ocaa094","article-title":"Latent bias and the implementation of artificial intelligence in medicine","author":"DeCamp","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2021031906032764600_ocaa268-B17","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1136\/medethics-2018-105118","article-title":"Computer knows best? The need for value-flexibility in medical AI","volume":"45","author":"McDougall","year":"2019","journal-title":"J Med Ethics"},{"issue":"10","key":"2021031906032764600_ocaa268-B18","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.1007\/s11606-012-2077-6","article-title":"Shared decision making: a model for clinical practice","volume":"27","author":"Elwyn","year":"2012","journal-title":"J Gen Intern Med"},{"key":"2021031906032764600_ocaa268-B19","first-page":"1","article-title":"Artificial intelligence and patient-centered decision-making","author":"Bjerring","year":"2020","journal-title":"Philos Technol"},{"issue":"1","key":"2021031906032764600_ocaa268-B20","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s11019-019-09912-8","article-title":"The right to refuse diagnostics and treatment planning by artificial intelligence","volume":"23","author":"Ploug","year":"2020","journal-title":"Med Health Care Philos"},{"issue":"1","key":"2021031906032764600_ocaa268-B21","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1136\/amiajnl-2011-000089","article-title":"Automation bias: a systematic review of frequency, effect mediators, and mitigators","volume":"19","author":"Goddard","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"11","key":"2021031906032764600_ocaa268-B22","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1136\/medethics-2015-102928","article-title":"A definition and ethical evaluation of overdiagnosis","volume":"42","author":"Carter","year":"2016","journal-title":"J Med Ethics"},{"issue":"4","key":"2021031906032764600_ocaa268-B23","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1007\/s00146-015-0625-4","article-title":"Robots in aged care: a dystopian future?","volume":"31","author":"Sparrow","year":"2016","journal-title":"AI Soc"},{"issue":"1","key":"2021031906032764600_ocaa268-B24","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1111\/j.1527-2001.2009.01086.x","article-title":"Lifting the burden of women\u2019s care work: should robots replace the \u201chuman touch\u201d?","volume":"25","author":"Parks","year":"2010","journal-title":"Hypatia"},{"key":"2021031906032764600_ocaa268-B25","author":"Ii","year":"2017"},{"issue":"2","key":"2021031906032764600_ocaa268-B26","doi-asserted-by":"crossref","first-page":"295","DOI":"10.4103\/2141-9248.113688","article-title":"Defensive medicine: a bane to healthcare","volume":"3","author":"Sekhar","year":"2013","journal-title":"Ann Med Health Sci Res"},{"issue":"11","key":"2021031906032764600_ocaa268-B27","doi-asserted-by":"crossref","first-page":"e1002689","DOI":"10.1371\/journal.pmed.1002689","article-title":"Machine learning in medicine: addressing ethical challenges","volume":"15","author":"Vayena","year":"2018","journal-title":"PLoS Med"},{"key":"2021031906032764600_ocaa268-B28","author":"Umbrello AFD","year":"2018"},{"issue":"1","key":"2021031906032764600_ocaa268-B29","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1046\/j.1365-2702.2003.00662.x","article-title":"Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions","volume":"12","author":"Evans","year":"2003","journal-title":"J Clin Nurs"},{"key":"2021031906032764600_ocaa268-B30","article-title":"Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies","volume":"368","author":"Nagendran","year":"2020","journal-title":"BMJ"},{"issue":"2","key":"2021031906032764600_ocaa268-B31","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1609\/aimag.v40i2.2850","article-title":"DARPA\u2019s Explainable Artificial Intelligence (XAI) program","volume":"40","author":"Gunning","year":"2019","journal-title":"AIMag"},{"issue":"1","key":"2021031906032764600_ocaa268-B32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-018-0048-y","article-title":"With an eye to AI and autonomous diagnosis","volume":"1","author":"Keane","year":"2018","journal-title":"Npj Digit Med"},{"issue":"1","key":"2021031906032764600_ocaa268-B33","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1017\/S0963180119000847","article-title":"The ethics of medical AI and the physician-patient relationship","volume":"29","author":"Dalton-Brown","year":"2020","journal-title":"Camb Q Healthc Ethics"},{"key":"2021031906032764600_ocaa268-B34","year":"2019"},{"issue":"7","key":"2021031906032764600_ocaa268-B35","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MC.1993.274940","article-title":"An investigation of the Therac-25 accidents","volume":"26","author":"Leveson","year":"1993","journal-title":"Computer"},{"key":"2021031906032764600_ocaa268-B36","doi-asserted-by":"crossref","first-page":"18","DOI":"10.3352\/jeehp.2019.16.18","article-title":"What should medical students know about artificial intelligence in medicine?","volume":"16","author":"Park","year":"2019","journal-title":"J Educ Eval Health Prof"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/4\/890\/36642134\/ocaa268.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/4\/890\/36642134\/ocaa268.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T06:04:09Z","timestamp":1616133849000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/4\/890\/6042213"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,19]]},"references-count":36,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,12,19]]},"published-print":{"date-parts":[[2021,3,18]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa268","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,4,1]]},"published":{"date-parts":[[2020,12,19]]}}}