{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T01:47:57Z","timestamp":1786672077654,"version":"3.56.0"},"reference-count":60,"publisher":"Oxford University Press (OUP)","issue":"2","funder":[{"DOI":"10.13039\/100008132","name":"HCF Research Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008132","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,3,1]]},"abstract":"<jats:p>Introduction: While potentially reducing decision errors, decision support systems can introduce new types of errors. Automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing. Most research originates from the human factors literature, where the prevailing view is that AB occurs only in multitasking environments.<\/jats:p>\n               <jats:p>Objectives: This review seeks to compare the human factors and health care literature, focusing on the apparent association of AB with multitasking and task complexity.<\/jats:p>\n               <jats:p>Data sources: EMBASE, Medline, Compendex, Inspec, IEEE Xplore, Scopus, Web of Science, PsycINFO, and Business Source Premiere from 1983 to 2015.<\/jats:p>\n               <jats:p>Study selection: Evaluation studies where task execution was assisted by automation and resulted in errors were included. Participants needed to be able to verify automation correctness and perform the task manually.<\/jats:p>\n               <jats:p>Methods: Tasks were identified and grouped. Task and automation type and presence of multitasking were noted. Each task was rated for its verification complexity.<\/jats:p>\n               <jats:p>Results: Of 890 papers identified, 40 met the inclusion criteria; 6 were in health care. Contrary to the prevailing human factors view, AB was found in single tasks, typically involving diagnosis rather than monitoring, and with high verification complexity.<\/jats:p>\n               <jats:p>Limitations: The literature is fragmented, with large discrepancies in how AB is reported. Few studies reported the statistical significance of AB compared to a control condition.<\/jats:p>\n               <jats:p>Conclusion: AB appears to be associated with the degree of cognitive load experienced in decision tasks, and appears to not be uniquely associated with multitasking. Strategies to minimize AB might focus on cognitive load reduction.<\/jats:p>","DOI":"10.1093\/jamia\/ocw105","type":"journal-article","created":{"date-parts":[[2016,8,12]],"date-time":"2016-08-12T03:08:57Z","timestamp":1470971337000},"page":"423-431","source":"Crossref","is-referenced-by-count":341,"title":["Automation bias and verification complexity: a systematic review"],"prefix":"10.1093","volume":"24","author":[{"given":"David","family":"Lyell","sequence":"first","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Enrico","family":"Coiera","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2016,8,11]]},"reference":[{"issue":"4","key":"2020110612370564400_ocw105-B1","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1007\/s11606-008-0504-5","article-title":"The effect of computerized physician order entry with clinical decision support on the rates of adverse drug events: a systematic review","volume":"23","author":"Wolfstadt","year":"2008","journal-title":"J General Int Med"},{"issue":"10","key":"2020110612370564400_ocw105-B2","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.1001\/jama.293.10.1223","article-title":"Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review","volume":"293","author":"Garg","year":"2005","journal-title":"JAMA"},{"key":"2020110612370564400_ocw105-B3","first-page":"20","article-title":"The safety and quality of decision support systems","volume":"45","author":"Coiera","year":"2006","journal-title":"Methods Inf Med"},{"issue":"7","key":"2020110612370564400_ocw105-B4","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1136\/bmjqs-2014-003484","article-title":"Technology, cognition and error","volume":"24","author":"Coiera","year":"2015","journal-title":"BMJ Qual Saf"},{"key":"2020110612370564400_ocw105-B5","first-page":"201","article-title":"Human decision makers and automated decision aids: made for each other","volume-title":"Automation and Human Performance: Theory and Applications","author":"Mosier","year":"1996"},{"issue":"1","key":"2020110612370564400_ocw105-B6","first-page":"1","article-title":"Performance consequences of automation-induced \u201ccomplacency.\u201d Int J Aviation Psychol","volume":"3","author":"Parasuraman","journal-title":"1993"},{"key":"2020110612370564400_ocw105-B7","volume-title":"NASA Aviation Safety Reporting System","author":"Billings","year":"1976"},{"issue":"3","key":"2020110612370564400_ocw105-B8","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1177\/0018720810376055","article-title":"Complacency and bias in human use of automation: an attentional integration","volume":"52","author":"Parasuraman","year":"2010","journal-title":"Human Factors"},{"key":"2020110612370564400_ocw105-B9","first-page":"1518","article-title":"Monitoring automation failures: effects of automation reliability and task complexity","author":"Molloy","year":"1992"},{"issue":"1","key":"2020110612370564400_ocw105-B10","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1136\/amiajnl-2011-000089","article-title":"Automation bias: a systematic review of frequency, effect mediators, and mitigators","volume":"19","author":"Goddard","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2020110612370564400_ocw105-B11","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1177\/0272989X9501500202","article-title":"The effects of computer-assisted electrocardiographic interpretation on physicians' diagnostic decisions","volume":"15","author":"Hillson","year":"1995","journal-title":"Med Decis Mak"},{"issue":"3","key":"2020110612370564400_ocw105-B12","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1177\/0272989X09333125","article-title":"The Effect of Erroneous Computer Interpretation of ECGs on Resident Decision Making","volume":"29","author":"Southern","year":"2009","journal-title":"Med Decis Mak"},{"issue":"5","key":"2020110612370564400_ocw105-B13","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1197\/jamia.M1279","article-title":"Computer decision support as a source of interpretation error: the case of electrocardiograms","volume":"10","author":"Tsai","year":"2003","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"2020110612370564400_ocw105-B14","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1016\/j.acra.2004.05.012","article-title":"Effects of incorrect computer-aided detection (CAD) output on human decision-making in mammography","volume":"11","author":"Alberdi","year":"2004","journal-title":"Acad Radiol"},{"issue":"1","key":"2020110612370564400_ocw105-B15","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1177\/0272989X12465490","article-title":"How to discriminate between computer-aided and computer-hindered decisions: a case study in mammography","volume":"33","author":"Povyakalo","year":"2013","journal-title":"Med Decis Mak"},{"issue":"9","key":"2020110612370564400_ocw105-B16","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1016\/j.amjmed.2004.06.024","article-title":"Misdiagnosis of atrial fibrillation and its clinical consequences","volume":"117","author":"Bogun","year":"2004","journal-title":"Am J Med"},{"key":"2020110612370564400_ocw105-B17","first-page":"212","author":"Bagheri","year":"2004"},{"issue":"4","key":"2020110612370564400_ocw105-B18","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1080\/14639220500535301","article-title":"Automation-induced complacency for monitoring highly reliable systems: the role of task complexity, system experience, and operator trust","volume":"8","author":"Bailey","year":"2007","journal-title":"Theoretical Issues Ergonomics Sci"},{"issue":"4","key":"2020110612370564400_ocw105-B19","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1518\/001872006779166280","article-title":"Comparison of a brain-based adaptive system and a manual adaptable system for invoking automation","volume":"48","author":"Bailey","year":"2006","journal-title":"Human Factors"},{"issue":"1","key":"2020110612370564400_ocw105-B20","first-page":"27","article-title":"Individual differences in complacency and monitoring for automation failures","volume":"3","author":"Prinzel","year":"2005","journal-title":"Individual Differences Res"},{"issue":"1","key":"2020110612370564400_ocw105-B21","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1518\/001872007779598082","article-title":"Effects of imperfect automation on decision making in a simulated command and control task","volume":"49","author":"Rovira","year":"2007","journal-title":"Hum Factors"},{"key":"2020110612370564400_ocw105-B22","first-page":"9","article-title":"Effects of automation reliability and training on automation-induced complacency and perceived mental workload","volume":"35","author":"Singh","year":"2009","journal-title":"J Indian Acad Appl Psychol"},{"issue":"13","key":"2020110612370564400_ocw105-B23","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1177\/154193120004401314","article-title":"Effects of Training and Automation Reliability on Monitoring Performance in a Flight Simulation Task","volume":"44","author":"Singh","year":"2000","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"2020110612370564400_ocw105-B24","first-page":"426","article-title":"Monitoring performance and mental workload in an automated system","author":"Singh","year":"2007"},{"key":"2020110612370564400_ocw105-B25","volume-title":"Considering Subjective Trust and Monitoring Behavior in Assessing Automation-induced \u201cComplacency.\u201d","author":"Bagheri","year":"2004"},{"issue":"4","key":"2020110612370564400_ocw105-B26","doi-asserted-by":"crossref","first-page":"264","DOI":"10.7326\/0003-4819-151-4-200908180-00135","article-title":"Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement","volume":"151","author":"Moher","year":"2009","journal-title":"Ann Int Med"},{"key":"2020110612370564400_ocw105-B27","doi-asserted-by":"crossref","first-page":"55:48","DOI":"10.1136\/bmj.d5928","article-title":"The Cochrane Collaboration\u2019s tool for assessing risk of bias in randomised trials","volume":"343","author":"Higgins","year":"2011","journal-title":"BMJ"},{"issue":"6","key":"2020110612370564400_ocw105-B28","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0039675","article-title":"Dopamine beta hydroxylase genotype identifies individuals less susceptible to bias in computer-assisted decision making","volume":"7","author":"Parasuraman","year":"2012","journal-title":"PLoS ONE"},{"issue":"1","key":"2020110612370564400_ocw105-B29","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/S0720-048X(03)00144-X","article-title":"Are unnecessary follow-up procedures induced by computer-aided diagnosis (CAD) in mammography? Comparison of mammographic diagnosis with and without use of CAD","volume":"51","author":"Marx","year":"2004","journal-title":"Eur J Radiol"},{"issue":"5","key":"2020110612370564400_ocw105-B30","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.ijmedinf.2014.01.001","article-title":"Automation bias: empirical results assessing influencing factors","volume":"83","author":"Goddard","year":"2014","journal-title":"Int J Med Inform"},{"key":"2020110612370564400_ocw105-B31","first-page":"13","article-title":"Study of the effects of clinical decision support system's incorrect advice and clinical case difficulty on users' decision making accuracy","volume":"164","author":"Golchin","year":"2011","journal-title":"Stud Health Technol Inform"},{"issue":"1998","key":"2020110612370564400_ocw105-B32","first-page":"128","author":"Harris"},{"issue":"1","key":"2020110612370564400_ocw105-B33","first-page":"151","article-title":"Performance feedback, mental workload and monitoring efficiency","volume":"36","author":"Singh","year":"2010","journal-title":"J Indian Acad Appl Psychol"},{"issue":"1-2","key":"2020110612370564400_ocw105-B34","first-page":"21","article-title":"Effects of manual training and automation reliability on automation induced complacency in flight simulation task","volume":"46","author":"Singh","year":"2001","journal-title":"Psychol Stud"},{"issue":"4","key":"2020110612370564400_ocw105-B35","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1006\/ijhc.1999.0349","article-title":"Accountability and automation bias","volume":"52","author":"Skitka","year":"2000","journal-title":"International J Hum Comp Stud"},{"issue":"5","key":"2020110612370564400_ocw105-B36","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1006\/ijhc.1999.0252","article-title":"Does automation bias decision-making?","volume":"51","author":"Skitka","year":"1999","journal-title":"Int J Hum Comp Stud"},{"issue":"1","key":"2020110612370564400_ocw105-B37","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1207\/S15327108IJAP1001_5","article-title":"Automation bias and errors: are crews better than individuals?","volume":"10","author":"Skitka","year":"2000","journal-title":"Int J Aviat Psychol"},{"issue":"1","key":"2020110612370564400_ocw105-B38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1207\/S15327108IJAP1101_1","article-title":"Aircrews and automation bias: The advantages of teamwork?","volume":"11","author":"Mosier","year":"2001","journal-title":"Int J Aviat Psychol"},{"issue":"1","key":"2020110612370564400_ocw105-B39","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1207\/s15327108ijap0801_3","article-title":"Automation bias: decision making and performance in high-tech cockpits","volume":"8","author":"Mosier","year":"1998","journal-title":"Int J Aviat Psychol"},{"issue":"4","key":"2020110612370564400_ocw105-B40","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1518\/001872006779166334","article-title":"Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information","volume":"48","author":"McGuirl","year":"2006","journal-title":"Hum Factors"},{"issue":"4","key":"2020110612370564400_ocw105-B41","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1518\/001872001775870403","article-title":"Supporting decision making and action selection under time pressure and uncertainty: the case of in-flight icing","volume":"43","author":"Sarter","year":"2001","journal-title":"Hum Factors"},{"issue":"2","key":"2020110612370564400_ocw105-B42","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1518\/001872001775900904","article-title":"Management by consent in human-machine systems: when and why it breaks down","volume":"43","author":"Olson","year":"2001","journal-title":"Human Factors"},{"issue":"4","key":"2020110612370564400_ocw105-B43","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1080\/10508414.2014.949205","article-title":"The duration of automation bias in a realistic setting","volume":"24","author":"de Boer","year":"2014","journal-title":"Int J Aviat Psychol"},{"issue":"1","key":"2020110612370564400_ocw105-B44","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1518\/0018720053653802","article-title":"Automation in future air traffic management: effects of decision aid reliability on controller performance and mental workload","volume":"47","author":"Metzger","year":"2005","journal-title":"Human Factors"},{"issue":"1","key":"2020110612370564400_ocw105-B45","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1080\/00140130601002658","article-title":"Effects of conflict alerting system reliability and task difficulty on pilots' conflict detection with cockpit display of traffic information","volume":"50","author":"Xu","year":"2007","journal-title":"Ergonomics"},{"issue":"9","key":"2020110612370564400_ocw105-B46","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1016\/j.ijhcs.2008.06.001","article-title":"Misuse of automated decision aids: complacency, automation bias and the impact of training experience","volume":"66","author":"Bahner","year":"2008","journal-title":"Int J Hum Comp Stud"},{"key":"2020110612370564400_ocw105-B47","first-page":"1330","article-title":"Misuse of diagnostic aids in process control: The effects of automation misses on complacency and automation bias","author":"Bahner","year":"2008"},{"issue":"1","key":"2020110612370564400_ocw105-B48","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1177\/1555343411433844","article-title":"Human performance consequences of automated decision aids: the impact of degree of automation and system experience","volume":"6","author":"Manzey","year":"2012","journal-title":"J Cogn Eng Decis Mak"},{"key":"2020110612370564400_ocw105-B49","first-page":"374","article-title":"Misuse of automation: the impact of system experience on complacency and automation bias in interaction with automated aids","author":"Reichenbach","year":"2010"},{"issue":"6","key":"2020110612370564400_ocw105-B50","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1177\/0018720811418222","article-title":"Human performance consequences of automated decision aids in states of sleep loss","volume":"53","author":"Reichenbach","year":"2011","journal-title":"Human Factors"},{"issue":"4","key":"2020110612370564400_ocw105-B51","first-page":"320","article-title":"Effects of response bias and judgment framing on operator use of an automated aid in a target detection task","volume":"17","author":"Rice","year":"2011","journal-title":"J Exp Psychol"},{"issue":"4","key":"2020110612370564400_ocw105-B52","doi-asserted-by":"crossref","first-page":"243","DOI":"10.3139\/120.110431","article-title":"Human factors perspective on the reliability of NDT in nuclear applications","volume":"55","author":"Bertovic","year":"2013","journal-title":"Mater Test"},{"issue":"6","key":"2020110612370564400_ocw105-B53","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1177\/0018720814522830","article-title":"Stages and levels of automation in support of space teleoperations","volume":"56","author":"Huiyang","year":"2014","journal-title":"Hum Factors"},{"issue":"3","key":"2020110612370564400_ocw105-B54","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1080\/14639220500370105","article-title":"The benefits of imperfect diagnostic automation: a synthesis of the literature","volume":"8","author":"Wickens","year":"2007","journal-title":"Theoretical Issues Ergonomics Sci"},{"issue":"3","key":"2020110612370564400_ocw105-B55","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1518\/001872006778606822","article-title":"Automation reliability in unmanned aerial vehicle control: a reliance-compliance model of automation dependence in high workload","volume":"48","author":"Dixon","year":"2006","journal-title":"Hum Factors"},{"key":"2020110612370564400_ocw105-B56","author":"Amalberti"},{"key":"2020110612370564400_ocw105-B57","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4419-8126-4","volume-title":"Cognitive Load Theory","author":"Sweller","year":"2011"},{"issue":"2\u20133","key":"2020110612370564400_ocw105-B58","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/S1386-5056(03)00040-6","article-title":"Which clinical decisions benefit from automation? A task complexity approach","volume":"70","author":"Sintchenko","year":"2003","journal-title":"Int J Med Inform"},{"issue":"5","key":"2020110612370564400_ocw105-B59","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1136\/bmjqs-2012-000783","article-title":"The science of interruption","volume":"21","author":"Coiera","year":"2012","journal-title":"BMJ Qual Saf"},{"key":"2020110612370564400_ocw105-B60","volume-title":"Automation Bias and Prescribing Decision Support\u2013rates, Mediators and Mitigators","author":"Goddard","year":"2012"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/2\/423\/34148461\/ocw105.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/2\/423\/34148461\/ocw105.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T17:47:53Z","timestamp":1604684873000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/24\/2\/423\/2631492"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8,11]]},"references-count":60,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2016,8,11]]},"published-print":{"date-parts":[[2017,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw105","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,3]]},"published":{"date-parts":[[2016,8,11]]}}}