{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T07:07:38Z","timestamp":1775027258384,"version":"3.50.1"},"reference-count":22,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T00:00:00Z","timestamp":1691625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U22A20283"],"award-info":[{"award-number":["U22A20283"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Beijing-Tianjin-Hebei Basic Research Cooperation Project","award":["V1640331014004"],"award-info":[{"award-number":["V1640331014004"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["PKU2023XGK002"],"award-info":[{"award-number":["PKU2023XGK002"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,9,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Incorporating artificial intelligence (AI) into clinics brings the risk of automation bias, which potentially misleads the clinician\u2019s decision-making. The purpose of this study was to propose a potential strategy to mitigate automation bias.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>This was a laboratory study with a randomized cross-over design. The diagnosis of anterior cruciate ligament (ACL) rupture, a common injury, on magnetic resonance imaging (MRI) was used as an example. Forty clinicians were invited to diagnose 200 ACLs with and without AI assistance. The AI\u2019s correcting and misleading (automation bias) effects on the clinicians\u2019 decision-making processes were analyzed. An ordinal logistic regression model was employed to predict the correcting and misleading probabilities of the AI. We further proposed an AI suppression strategy that retracted AI diagnoses with a higher misleading probability and provided AI diagnoses with a higher correcting probability.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The AI significantly increased clinicians\u2019 accuracy from 87.2%\u00b113.1% to 96.4%\u00b11.9% (P\u2009&amp;lt;\u2009.001). However, the clinicians\u2019 errors in the AI-assisted round were associated with automation bias, accounting for 45.5% of the total mistakes. The automation bias was found to affect clinicians of all levels of expertise. Using a logistic regression model, we identified an AI output zone with higher probability to generate misleading diagnoses. The proposed AI suppression strategy was estimated to decrease clinicians\u2019 automation bias by 41.7%.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Although AI improved clinicians\u2019 diagnostic performance, automation bias was a serious problem that should be addressed in clinical practice. The proposed AI suppression strategy is a practical method for decreasing automation bias.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad118","type":"journal-article","created":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T15:31:28Z","timestamp":1691681488000},"page":"1684-1692","source":"Crossref","is-referenced-by-count":36,"title":["Artificial intelligence suppression as a strategy to mitigate artificial intelligence automation bias"],"prefix":"10.1093","volume":"30","author":[{"given":"Ding-Yu","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University , Beijing, China"},{"name":"Beijing Key Laboratory of Sports Injuries , Beijing, China"},{"name":"Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education , Beijing, China"}]},{"given":"Jia","family":"Ding","sequence":"additional","affiliation":[{"name":"Beijing Yizhun Medical AI Co., Ltd , Beijing, China"}]},{"given":"An-Lan","family":"Sun","sequence":"additional","affiliation":[{"name":"Beijing Yizhun Medical AI Co., Ltd , Beijing, China"}]},{"given":"Shang-Gui","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University , Beijing, China"},{"name":"Beijing Key Laboratory of Sports Injuries , Beijing, China"},{"name":"Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education , Beijing, China"}]},{"given":"Dong","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University , Beijing, China"},{"name":"Beijing Key Laboratory of Sports Injuries , Beijing, China"},{"name":"Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education , Beijing, China"}]},{"given":"Nan","family":"Li","sequence":"additional","affiliation":[{"name":"Research Center of Clinical Epidemiology, Peking University Third Hospital , Beijing, China"}]},{"given":"Jia-Kuo","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Sports Medicine, Peking University Third Hospital, Institute of Sports Medicine of Peking University , Beijing, China"},{"name":"Beijing Key Laboratory of Sports Injuries , Beijing, China"},{"name":"Engineering Research Center of Sports Trauma Treatment Technology and Devices, Ministry of Education , Beijing, China"}]}],"member":"286","published-online":{"date-parts":[[2023,8,10]]},"reference":[{"key":"2023092720012153900_ocad118-B1","author":"U.S. Food & Drug Administration","year":"2021"},{"issue":"4","key":"2023092720012153900_ocad118-B2","doi-asserted-by":"crossref","first-page":"e25759","DOI":"10.2196\/25759","article-title":"Role of artificial intelligence applications in real-life clinical practice: systematic review","volume":"23","author":"Yin","year":"2021","journal-title":"J Med Internet Res"},{"issue":"11","key":"2023092720012153900_ocad118-B3","doi-asserted-by":"crossref","first-page":"1472","DOI":"10.1016\/j.acra.2018.02.018","article-title":"Deep learning in radiology","volume":"25","author":"McBee","year":"2018","journal-title":"Acad Radiol"},{"key":"2023092720012153900_ocad118-B4","doi-asserted-by":"crossref","first-page":"102165","DOI":"10.1016\/j.artmed.2021.102165","article-title":"Artificial intelligence applied to support medical decisions for the automatic analysis of echocardiogram images: a systematic review","volume":"120","author":"de Siqueira","year":"2021","journal-title":"Artif Intell Med"},{"issue":"3","key":"2023092720012153900_ocad118-B5","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1148\/radiol.2021204021","article-title":"Artificial intelligence algorithm improves radiologist performance in skeletal age assessment: a prospective multicenter randomized controlled trial","volume":"301","author":"Eng","year":"2021","journal-title":"Radiology"},{"issue":"45","key":"2023092720012153900_ocad118-B6","doi-asserted-by":"crossref","first-page":"11591","DOI":"10.1073\/pnas.1806905115","article-title":"Deep neural network improves fracture detection by clinicians","volume":"115","author":"Lindsey","year":"2018","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"6","key":"2023092720012153900_ocad118-B7","doi-asserted-by":"crossref","first-page":"357","DOI":"10.7326\/M18-0249","article-title":"Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy: a prospective study","volume":"169","author":"Mori","year":"2018","journal-title":"Ann Intern Med"},{"issue":"8","key":"2023092720012153900_ocad118-B8","doi-asserted-by":"crossref","first-page":"1229","DOI":"10.1038\/s41591-020-0942-0","article-title":"Human\u2013computer collaboration for skin cancer recognition","volume":"26","author":"Tschandl","year":"2020","journal-title":"Nat Med"},{"issue":"6S","key":"2023092720012153900_ocad118-B9","doi-asserted-by":"crossref","first-page":"S6","DOI":"10.1016\/j.jelectrocard.2018.08.007","article-title":"Automation bias in medicine: the influence of automated diagnoses on interpreter accuracy and uncertainty when reading electrocardiograms","volume":"51","author":"Bond","year":"2018","journal-title":"J Electrocardiol"},{"key":"2023092720012153900_ocad118-B10","first-page":"289","author":"Cummings","year":"2004"},{"issue":"1","key":"2023092720012153900_ocad118-B11","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1136\/amiajnl-2011-000089","article-title":"Automation bias: a systematic review of frequency, effect mediators, and mitigators","volume":"19","author":"Goddard","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2023092720012153900_ocad118-B12","doi-asserted-by":"crossref","first-page":"e100081","DOI":"10.1136\/bmjhci-2019-100081","article-title":"Human factors challenges for the safe use of artificial intelligence in patient care","volume":"26","author":"Sujan","year":"2019","journal-title":"BMJ Health Care Inform"},{"issue":"2","key":"2023092720012153900_ocad118-B13","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1093\/jamia\/ocw105","article-title":"Automation bias and verification complexity: a systematic review","volume":"24","author":"Lyell","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2023092720012153900_ocad118-B14","doi-asserted-by":"crossref","first-page":"18","DOI":"10.3390\/bdcc5020018","article-title":"Deep automation bias: how to tackle a wicked problem of AI?","volume":"5","author":"Strau\u00df","year":"2021","journal-title":"Big Data Cogn Comput"},{"issue":"6","key":"2023092720012153900_ocad118-B15","doi-asserted-by":"crossref","first-page":"1502","DOI":"10.1177\/0363546516629944","article-title":"Incidence of anterior cruciate ligament tears and reconstruction: a 21-year population-based study","volume":"44","author":"Sanders","year":"2016","journal-title":"Am J Sports Med"},{"key":"2023092720012153900_ocad118-B16","author":"Xie","year":"2016"},{"key":"2023092720012153900_ocad118-B17","author":"Chopra","year":"2005"},{"key":"2023092720012153900_ocad118-B18","doi-asserted-by":"crossref","first-page":"S86","DOI":"10.1016\/j.jelectrocard.2019.08.006","article-title":"SPICED-ACS: study of the potential impact of a computer-generated ECG diagnostic algorithmic certainty index in STEMI diagnosis: towards transparent AI","volume":"57S","author":"Knoery","year":"2019","journal-title":"J Electrocardiol"},{"issue":"3","key":"2023092720012153900_ocad118-B19","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1177\/0272989X9201200306","article-title":"A method to describe physician decision thresholds and its application in examining the diagnosis of coronary artery disease based on exercise treadmill testing","volume":"12","author":"Plasencia","year":"1992","journal-title":"Med Decis Making"},{"issue":"20","key":"2023092720012153900_ocad118-B20","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.1056\/NEJM198005153022003","article-title":"The threshold approach to clinical decision making","volume":"302","author":"Pauker","year":"1980","journal-title":"N Engl J Med"},{"key":"2023092720012153900_ocad118-B21","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1038\/s41746-020-0232-8","article-title":"Impact of a deep learning assistant on the histopathologic classification of liver cancer","volume":"3","author":"Kiani","year":"2020","journal-title":"NPJ Digit Med"},{"key":"2023092720012153900_ocad118-B22","first-page":"99","volume-title":"Prospect Theory: An Analysis of Decision under Risk","author":"Kahneman","year":"2013"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/10\/1684\/51770189\/ocad118.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/30\/10\/1684\/51770189\/ocad118.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T20:37:51Z","timestamp":1695847071000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/30\/10\/1684\/7240558"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,10]]},"references-count":22,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,8,10]]},"published-print":{"date-parts":[[2023,9,25]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad118","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,10,1]]},"published":{"date-parts":[[2023,8,10]]}}}