{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T10:40:44Z","timestamp":1782297644665,"version":"3.54.5"},"reference-count":44,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T00:00:00Z","timestamp":1656115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Social Sciences and Humanities Research Council","award":["430-2021-01108"],"award-info":[{"award-number":["430-2021-01108"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,9,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The accuracy of artificial intelligence (AI) in medicine and in pathology in particular has made major progress but little is known on how much these algorithms will influence pathologists\u2019 decisions in practice. The objective of this paper is to determine the reliance of pathologists on AI and to investigate whether providing information on AI impacts this reliance.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>The experiment using an online survey design. Under 3 conditions, 116 pathologists and pathology students were tasked with assessing the Gleason grade for a series of 12 prostate biopsies: (1) without AI recommendations, (2) with AI recommendations, and (3) with AI recommendations accompanied by information about the algorithm itself, specifically algorithm accuracy rate and algorithm decision-making process.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Participant responses were significantly more accurate with the AI decision aids than without (92% vs 87%, odds ratio 13.30, P\u2009&amp;lt;\u2009.01). Unexpectedly, the provision of information on the algorithm made no significant difference compared to AI without information. The reliance on AI correlated with general beliefs on AI\u2019s usefulness but not with particular assessments of the AI tool offered. Decisions were made faster when AI was provided.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>These results suggest that pathologists are willing to rely on AI regardless of accuracy or explanations. Generalization beyond the specific tasks and explanations provided will require further studies.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>This study suggests that the factors that influence the reliance on AI differ in practice from beliefs expressed by clinicians in surveys. Implementation of AI in prospective settings should take individual behaviors into account.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocac103","type":"journal-article","created":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T07:31:45Z","timestamp":1656142305000},"page":"1688-1695","source":"Crossref","is-referenced-by-count":31,"title":["Impact of artificial intelligence on pathologists\u2019 decisions: an experiment"],"prefix":"10.1093","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0581-4623","authenticated-orcid":false,"given":"Julien","family":"Meyer","sequence":"first","affiliation":[{"name":"School of Health Services Management, Ted Rogers School of Management , Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"April","family":"Khademi","sequence":"additional","affiliation":[{"name":"Department of Electrical, Computer, and Biomedical Engineering, Ryerson University , Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernard","family":"T\u00eatu","sequence":"additional","affiliation":[{"name":"D\u00e9partment de biologie m\u00e9dicale, Universit\u00e9 Laval , Qu\u00e9bec City, Quebec, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wencui","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Business administration, Gies College of Business, University of Illinois at Urbana-Champaign , Champaign, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pria","family":"Nippak","sequence":"additional","affiliation":[{"name":"School of Health Services Management, Ted Rogers School of Management , Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Remisch","sequence":"additional","affiliation":[{"name":"School of Health Services Management, Ted Rogers School of Management , Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,6,25]]},"reference":[{"issue":"5","key":"2022091407543381800_ocac103-B1","doi-asserted-by":"crossref","first-page":"e253\u201361","DOI":"10.1016\/S1470-2045(19)30154-8","article-title":"Digital pathology and artificial intelligence","volume":"20","author":"Niazi","year":"2019","journal-title":"Lancet Oncol"},{"issue":"4","key":"2022091407543381800_ocac103-B2","doi-asserted-by":"crossref","first-page":"R56","DOI":"10.1186\/bcr2615","article-title":"ImmunoRatio: a publicly available web application for quantitative image analysis of estrogen receptor (ER), progesterone receptor (PR), and Ki-67","volume":"12","author":"Tuominen","year":"2010","journal-title":"Breast Cancer Res"},{"issue":"2","key":"2022091407543381800_ocac103-B3","doi-asserted-by":"crossref","first-page":"233","DOI":"10.5858\/135.2.233","article-title":"Observer variability in the interpretation of HER2\/neu immunohistochemical expression with unaided and computer-aided digital microscopy","volume":"135","author":"Gavrielides","year":"2011","journal-title":"Arch Pathol Lab Med"},{"issue":"6","key":"2022091407543381800_ocac103-B4","doi-asserted-by":"crossref","first-page":"e15154","DOI":"10.2196\/15154","article-title":"Artificial intelligence and human trust in healthcare: focus on clinicians","volume":"22","author":"Asan","year":"2020","journal-title":"J Med Internet Res"},{"key":"2022091407543381800_ocac103-B5","doi-asserted-by":"crossref","first-page":"38","DOI":"10.4103\/jpi.jpi_53_18","article-title":"Artificial intelligence and digital pathology: challenges and opportunities","volume":"9","author":"Tizhoosh","year":"2018","journal-title":"J Pathol Inform"},{"issue":"3","key":"2022091407543381800_ocac103-B6","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/3468.844354","article-title":"A model for types and levels of human interaction with automation","volume":"30","author":"Parasuraman","year":"2000","journal-title":"IEEE Trans Syst Man Cybern A Syst Hum"},{"issue":"1","key":"2022091407543381800_ocac103-B7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4132\/jptm.2018.12.16","article-title":"Artificial intelligence in pathology","volume":"53","author":"Chang","year":"2019","journal-title":"J Pathol Transl Med"},{"key":"2022091407543381800_ocac103-B8","author":"Artificial Intelligence and Machine Learning (AI\/ML)-Enabled Medical Devices [Internet]","year":"2021"},{"issue":"1","key":"2022091407543381800_ocac103-B9","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1038\/s41746-019-0106-0","article-title":"Physician perspectives on integration of artificial intelligence into diagnostic pathology","volume":"2","author":"Sarwar","year":"2019","journal-title":"NPJ Digit Med"},{"issue":"1","key":"2022091407543381800_ocac103-B10","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1038\/s41591-018-0307-0","article-title":"The practical implementation of artificial intelligence technologies in medicine","volume":"25","author":"He","year":"2019","journal-title":"Nat Med"},{"issue":"5","key":"2022091407543381800_ocac103-B11","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1080\/17434440.2019.1610387","article-title":"Artificial Intelligence (AI) for the early detection of breast cancer: a scoping review to assess AI\u2019s potential in breast screening practice","volume":"16","author":"Houssami","year":"2019","journal-title":"Expert Rev Med Devices"},{"key":"2022091407543381800_ocac103-B12","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1007\/978-3-319-97982-3_9","volume-title":"Advances in Computational Intelligence Systems","author":"Vourgidis","year":"2019"},{"issue":"4 Suppl","key":"2022091407543381800_ocac103-B13","doi-asserted-by":"crossref","first-page":"S6-07","DOI":"10.1158\/1538-7445.SABCS16-S6-07","article-title":"Abstract S6-07: double blinded validation study to assess performance of IBM artificial intelligence platform, Watson for oncology in comparison with Manipal multidisciplinary tumour board\u2014first study of 638 breast cancer cases","volume":"77","author":"Somashekhar","year":"2017","journal-title":"Cancer Res"},{"issue":"22","key":"2022091407543381800_ocac103-B14","doi-asserted-by":"crossref","first-page":"2353","DOI":"10.1001\/jama.2016.17438","article-title":"Adapting to artificial intelligence: radiologists and pathologists as information specialists","volume":"316","author":"Jha","year":"2016","journal-title":"JAMA"},{"key":"2022091407543381800_ocac103-B15","doi-asserted-by":"publisher","author":"Holzinger","DOI":"10.48550\/arXiv.1712.06657"},{"issue":"8","key":"2022091407543381800_ocac103-B16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41591-020-0942-0","article-title":"Human\u2013computer collaboration for skin cancer recognition","volume":"26","author":"Tschandl","year":"2020","journal-title":"Nat Med"},{"key":"2022091407543381800_ocac103-B17","first-page":"399","article-title":"Artificial intelligence in the health care space: how we can trust what we cannot know","volume":"30","author":"Feldman","year":"2019","journal-title":"Stan L & Pol\u2019y. Rev"},{"issue":"2","key":"2022091407543381800_ocac103-B18","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1080\/0144929X.2016.1209242","article-title":"The effect of individual and task characteristics on decision aid reliance","volume":"36","author":"Parkes","year":"2017","journal-title":"Behav Inf Technol"},{"key":"2022091407543381800_ocac103-B19","first-page":"143","article-title":"Artificial intelligence in digital pathology: a roadmap to routine use in clinical practice","author":"Colling","year":"2019"},{"issue":"6","key":"2022091407543381800_ocac103-B20","first-page":"937","article-title":"Frontiers: machines vs. humans: the impact of artificial intelligence chatbot disclosure on customer purchases","volume":"38","author":"Luo","year":"2019","journal-title":"Mark Sci"},{"key":"2022091407543381800_ocac103-B21","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/978-3-319-90403-0_14","volume-title":"Human and Machine Learning: Visible, Explainable, Trustworthy and Transparent [Internet]","author":"Gretton","year":"2018"},{"issue":"1","key":"2022091407543381800_ocac103-B22","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1037\/xge0000033","article-title":"Algorithm aversion: people erroneously avoid algorithms after seeing them err","volume":"144","author":"Dietvorst","year":"2015","journal-title":"J Exp Psychol Gen"},{"key":"2022091407543381800_ocac103-B23","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.obhdp.2018.12.005","article-title":"Algorithm appreciation: people prefer algorithmic to human judgment","volume":"151","author":"Logg","year":"2019","journal-title":"Organ Behav Hum Decis Process"},{"issue":"3","key":"2022091407543381800_ocac103-B24","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1177\/0018720814547570","article-title":"Trust in automation: integrating empirical evidence on factors that influence trust","volume":"57","author":"Hoff","year":"2015","journal-title":"Hum Factors"},{"key":"2022091407543381800_ocac103-B25","first-page":"1001","article-title":"Investigating the barriers to physician adoption of an artificial intelligence-based decision support system in emergency care: an interpretative qualitative study","author":"Petitgand","year":"2020","journal-title":"Digit Pers Health Med"},{"key":"2022091407543381800_ocac103-B26","doi-asserted-by":"publisher","author":"Hoffman","year":"2018","DOI":"10.48550\/arXiv.1812.04608"},{"issue":"7","key":"2022091407543381800_ocac103-B27","doi-asserted-by":"crossref","first-page":"2374","DOI":"10.1109\/JBHI.2021.3088832","article-title":"Guest editorial explainable AI: towards fairness, accountability, transparency and trust in healthcare","volume":"25","author":"Shaban-Nejad","year":"2021","journal-title":"IEEE J Biomed Health Inform"},{"issue":"11","key":"2022091407543381800_ocac103-B28","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1038\/s41571-019-0252-y","article-title":"Artificial intelligence in digital pathology\u2014new tools for diagnosis and precision oncology","volume":"16","author":"Bera","year":"2019","journal-title":"Nat Rev Clin Oncol"},{"issue":"1","key":"2022091407543381800_ocac103-B29","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","article-title":"Trust in automation: designing for appropriate reliance","volume":"46","author":"Lee","year":"2004","journal-title":"Hum Factors"},{"key":"2022091407543381800_ocac103-B30","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1017\/S0140525X17000255","article-title":"Human-like machines: transparency and comprehensibility [Commentary]","volume":"40","author":"Patrzyk","year":"2017","journal-title":"Behav Brain Sci"},{"issue":"5","key":"2022091407543381800_ocac103-B31","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1177\/0018720811417254","article-title":"A meta-analysis of factors affecting trust in human-robot interaction","volume":"53","author":"Hancock","year":"2011","journal-title":"Hum Factors"},{"issue":"1","key":"2022091407543381800_ocac103-B32","first-page":"1","article-title":"Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer","volume":"2","author":"Nagpal","year":"2019","journal-title":"NPJ Digit Med"},{"key":"2022091407543381800_ocac103-B33"},{"key":"2022091407543381800_ocac103-B34"},{"issue":"1","key":"2022091407543381800_ocac103-B35","doi-asserted-by":"crossref","first-page":"12054","DOI":"10.1038\/s41598-018-30535-1","article-title":"Automated Gleason grading of prostate cancer tissue microarrays via deep learning","volume":"8","author":"Arvaniti","year":"2018","journal-title":"Sci Rep"},{"issue":"6","key":"2022091407543381800_ocac103-B36","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1097\/PAT.0000000000000315","article-title":"The prognostic significance of the 2014 International Society of Urological Pathology (ISUP) grading system for prostate cancer","volume":"47","author":"Samaratunga","year":"2015","journal-title":"Pathology"},{"issue":"2","key":"2022091407543381800_ocac103-B37","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/S1470-2045(19)30738-7","article-title":"Artificial intelligence for diagnosis and grading of prostate cancer in biopsies: a population-based, diagnostic study","volume":"21","author":"Str\u00f6m","year":"2020","journal-title":"Lancet Oncol"},{"issue":"9","key":"2022091407543381800_ocac103-B38","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.1097\/01.pas.0000173646.99337.b1","article-title":"The 2005 International Society of Urological Pathology (ISUP) consensus conference on Gleason grading of prostatic carcinoma","volume":"29","author":"Epstein","year":"2005","journal-title":"Am J Surg Pathol"},{"issue":"11","key":"2022091407543381800_ocac103-B39","doi-asserted-by":"crossref","first-page":"1828","DOI":"10.1001\/jamainternmed.2015.5231","article-title":"Diagnostic accuracy of digital screening mammography with and without computer-aided detection","volume":"175","author":"Lehman","year":"2015","journal-title":"JAMA Intern Med"},{"issue":"3","key":"2022091407543381800_ocac103-B40","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1136\/bmjqs-2018-008551","article-title":"Framing the challenges of artificial intelligence in medicine","volume":"28","author":"Yu","year":"2019","journal-title":"BMJ Qual Saf"},{"issue":"6","key":"2022091407543381800_ocac103-B41","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1016\/j.acra.2020.04.011","article-title":"Attitudes toward artificial intelligence among radiologists, IT specialists, and industry","volume":"28","author":"Jungmann","year":"2021","journal-title":"Acad Radiol"},{"issue":"1","key":"2022091407543381800_ocac103-B42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-021-84698-5","article-title":"A survey of clinicians on the use of artificial intelligence in ophthalmology, dermatology, radiology and radiation oncology","volume":"11","author":"Scheetz","year":"2021","journal-title":"Sci Rep"},{"issue":"6","key":"2022091407543381800_ocac103-B43","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1002\/cncr.30655","article-title":"Artificial intelligence platform for oncology could assist in treatment decisions","volume":"123","author":"Printz","year":"2017","journal-title":"Cancer"},{"key":"2022091407543381800_ocac103-B44","doi-asserted-by":"crossref","first-page":"102470","DOI":"10.1016\/j.media.2022.102470","article-title":"Explainable artificial intelligence (XAI) in deep learning-based medical image analysis","volume":"79","author":"van der Velden","year":"2022","journal-title":"Med Image Anal"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/10\/1688\/45798219\/ocac103.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/10\/1688\/45798219\/ocac103.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T07:55:33Z","timestamp":1663142133000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/10\/1688\/6617754"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,25]]},"references-count":44,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,6,25]]},"published-print":{"date-parts":[[2022,9,12]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac103","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,10,1]]},"published":{"date-parts":[[2022,6,25]]}}}