{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T07:30:59Z","timestamp":1775547059043,"version":"3.50.1"},"reference-count":58,"publisher":"Oxford University Press (OUP)","issue":"2","funder":[{"name":"Australian National Health and Medical Research Council Centre","award":["1032664"],"award-info":[{"award-number":["1032664"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,3,1]]},"abstract":"<jats:p>Objective: To systematically review studies reporting problems with information technology (IT) in health care and their effects on care delivery and patient outcomes.<\/jats:p>\n               <jats:p>Materials and methods: We searched bibliographic databases including Scopus, PubMed, and Science Citation Index Expanded from January 2004 to December 2015 for studies reporting problems with IT and their effects. A framework called the information value chain, which connects technology use to final outcome, was used to assess how IT problems affect user interaction, information receipt, decision-making, care processes, and patient outcomes. The review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.<\/jats:p>\n               <jats:p>Results: Of the 34 studies identified, the majority (n\u2009=\u200914, 41%) were analyses of incidents reported from 6 countries. There were 7 descriptive studies, 9 ethnographic studies, and 4 case reports. The types of IT problems were similar to those described in earlier classifications of safety problems associated with health IT. The frequency, scale, and severity of IT problems were not adequately captured within these studies. Use errors and poor user interfaces interfered with the receipt of information and led to errors of commission when making decisions. Clinical errors involving medications were well characterized. Issues with system functionality, including poor user interfaces and fragmented displays, delayed care delivery. Issues with system access, system configuration, and software updates also delayed care. In 18 studies (53%), IT problems were linked to patient harm and death. Near-miss events were reported in 10 studies (29%).<\/jats:p>\n               <jats:p>Discussion and conclusion: The research evidence describing problems with health IT remains largely qualitative, and many opportunities remain to systematically study and quantify risks and benefits with regard to patient safety. The information value chain, when used in conjunction with existing classifications for health IT safety problems, can enhance measurement and should facilitate identification of the most significant risks to patient safety.<\/jats:p>","DOI":"10.1093\/jamia\/ocw154","type":"journal-article","created":{"date-parts":[[2016,10,11]],"date-time":"2016-10-11T14:19:40Z","timestamp":1476195580000},"page":"246-250","source":"Crossref","is-referenced-by-count":203,"title":["Problems with health information technology and their effects on care delivery and patient outcomes: a systematic review"],"prefix":"10.1093","volume":"24","author":[{"given":"Mi Ok","family":"Kim","sequence":"first","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}]},{"given":"Enrico","family":"Coiera","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}]},{"given":"Farah","family":"Magrabi","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia"}]}],"member":"286","published-online":{"date-parts":[[2017,2,13]]},"reference":[{"issue":"25","key":"2020110612435849400_ocw154-B1","doi-asserted-by":"crossref","first-page":"2526","DOI":"10.1056\/NEJMsa020847","article-title":"Improving safety with information technology","volume":"348","author":"Bates","year":"2003","journal-title":"New Engl J Med."},{"key":"2020110612435849400_ocw154-B2","volume-title":"Health IT and Patient Safety: Building Safer Systems for Better Care","author":"IOM (Institute of Medicine)","year":"2012"},{"issue":"4","key":"2020110612435849400_ocw154-B3","first-page":"113","article-title":"The role of the electronic health record in patient safety events","volume":"9","author":"Sparnon","year":"2012","journal-title":"PA-PSRS Patient Saf Advis."},{"key":"2020110612435849400_ocw154-B4","volume-title":"ECRI Institute PSO DEEP DIVE: Health Information Technology","author":"ECRI Institute PSO","year":"2012"},{"issue":"2","key":"2020110612435849400_ocw154-B5","first-page":"55","article-title":"Spotlight on electronic health record errors: papers or electronic hybrid workflows","volume":"10","author":"Sparnon","year":"2013","journal-title":"Pa Patient Saf Advis."},{"key":"2020110612435849400_ocw154-B6","volume-title":"Health Information Technology Adverse Event Reporting: Analysis of Two Databases","author":"ECRI Institute","year":"2014"},{"key":"2020110612435849400_ocw154-B7","author":"Castro","year":"2015"},{"issue":"5","key":"2020110612435849400_ocw154-B8","doi-asserted-by":"crossref","first-page":"1016","DOI":"10.1093\/jamia\/ocv138","article-title":"Effects of health information technology on patient outcomes: a systematic review","volume":"23","author":"Brenner","year":"2016","journal-title":"J Am Med Inform Assoc."},{"issue":"11","key":"2020110612435849400_ocw154-B9","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1016\/j.ijmedinf.2015.07.004","article-title":"Classification of antecedents towards safety use of health information technology: a systematic review","volume":"84","author":"Salahuddin","year":"2015","journal-title":"Int J Med Inform."},{"key":"2020110612435849400_ocw154-B10","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1201\/b13617","volume-title":"Guide to Health Informatics","author":"Coiera","year":"2015","edition":"3rd ed."},{"key":"2020110612435849400_ocw154-B11","article-title":"A New Informatics Geography","author":"Coiera","year":"2016","journal-title":"IMIA Yearbook Med Inform."},{"issue":"3","key":"2020110612435849400_ocw154-B12","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.ijmedinf.2014.12.003","article-title":"Clinical safety of England's national programme for IT: a retrospective analysis of all reported safety events 2005 to 2011","volume":"84","author":"Magrabi","year":"2015","journal-title":"Int J Med Inform."},{"issue":"6","key":"2020110612435849400_ocw154-B13","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1136\/jamia.2009.002444","article-title":"An analysis of computer-related patient safety incidents to inform the development of a classification","volume":"17","author":"Magrabi","year":"2010","journal-title":"J Am Med Inform Assoc."},{"issue":"1","key":"2020110612435849400_ocw154-B14","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1136\/amiajnl-2011-000369","article-title":"Using FDA reports to inform a classification for health information technology safety problems","volume":"19","author":"Magrabi","year":"2012","journal-title":"J Am Med Inform Assoc."},{"key":"2020110612435849400_ocw154-B15","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1136\/bmjqs-2015-004323","article-title":"Identifying patient safety problems associated with information technology in general practice: an analysis of incident reports","volume":"25","author":"Magrabi","year":"2016","journal-title":"BMJ Qual Saf."},{"issue":"1","key":"2020110612435849400_ocw154-B16","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1093\/intqhc\/mzn057","article-title":"Towards an international classification for patient safety: key concepts and terms","volume":"21","author":"Runciman","year":"2009","journal-title":"Int J Qual Health Care."},{"issue":"4","key":"2020110612435849400_ocw154-B17","doi-asserted-by":"crossref","first-page":"353","DOI":"10.2146\/ajhp050379","article-title":"Potential benefits and problems with computerized prescriber order entry: analysis of a voluntary medication error\u2013reporting database","volume":"63","author":"Zhan","year":"2006","journal-title":"Am J Health Syst Pharm."},{"issue":"9","key":"2020110612435849400_ocw154-B18","doi-asserted-by":"crossref","first-page":"843","DOI":"10.2146\/ajhp080208","article-title":"Medication errors resulting from computer entry by nonprescribers","volume":"66","author":"Santell","year":"2009","journal-title":"Am J Health Syst Pharm."},{"issue":"12","key":"2020110612435849400_ocw154-B19","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1016\/j.ijmedinf.2012.09.002","article-title":"Technology-related medication errors in a tertiary hospital: a 5-year analysis of reported medication incidents","volume":"81","author":"Samaranayake","year":"2012","journal-title":"Int J Med Inform."},{"issue":"e1","key":"2020110612435849400_ocw154-B20","doi-asserted-by":"crossref","first-page":"e63","DOI":"10.1136\/amiajnl-2013-001818","article-title":"Classification of medication incidents associated with information technology","volume":"21","author":"Cheung","year":"2014","journal-title":"J Am Med Inform Assoc."},{"issue":"4","key":"2020110612435849400_ocw154-B21","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1136\/bmjqs-2014-003555","article-title":"Computerised physician order entry\u2013related medication errors: analysis of reported errors and vulnerability testing of current systems","volume":"24","author":"Schiff","year":"2015","journal-title":"BMJ Qual Saf."},{"issue":"1","key":"2020110612435849400_ocw154-B22","doi-asserted-by":"crossref","first-page":"63","DOI":"10.4338\/ACI-2010-11-RA-0064","article-title":"Review of reported clinical information system adverse events in US Food and Drug Administration Databases","volume":"2","author":"Myers","year":"2011","journal-title":"Appl Clin Inform."},{"key":"2020110612435849400_ocw154-B23","first-page":"213","article-title":"What do radiology incident reports reveal about in-hospital communication processes and the use of health information technology? Stud Health Technol Inform","volume":"178","author":"Stewart","journal-title":"2012"},{"issue":"2","key":"2020110612435849400_ocw154-B24","doi-asserted-by":"crossref","first-page":"248","DOI":"10.4338\/ACI-2012-03-RA-0010","article-title":"Classifying health information technology patient safety related incidents: an approach used in Wales","volume":"3","author":"Warm","year":"2012","journal-title":"Appl Clin Inform."},{"issue":"2","key":"2020110612435849400_ocw154-B25","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.ijmedinf.2013.10.006","article-title":"Characteristics of health IT outage and suggested risk management strategies: an analysis of historical incident reports in China","volume":"83","author":"Lei","year":"2014","journal-title":"Int J Med Inform."},{"issue":"6","key":"2020110612435849400_ocw154-B26","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1136\/amiajnl-2013-002578","article-title":"An analysis of electronic health record-related patient safety concerns","volume":"21","author":"Meeks","year":"2014","journal-title":"J Am Med Inform Assoc."},{"issue":"10","key":"2020110612435849400_ocw154-B27","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1001\/jama.293.10.1197","article-title":"Role of computerized physician order entry systems in facilitating medication errors","volume":"293","author":"Koppel","year":"2005","journal-title":"JAMA."},{"issue":"4","key":"2020110612435849400_ocw154-B28","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1197\/jamia.M2373","article-title":"The extent and importance of unintended consequences related to computerized provider order entry","volume":"14","author":"Ash","year":"2007","journal-title":"J Am Med Inform Assoc."},{"issue":"10","key":"2020110612435849400_ocw154-B29","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1001\/archinternmed.2009.102","article-title":"Prescription errors and outcomes related to inconsistent information transmitted through computerized order entry: a prospective study","volume":"169","author":"Singh","year":"2009","journal-title":"Arch Intern Med."},{"issue":"6","key":"2020110612435849400_ocw154-B30","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1136\/amiajnl-2011-000255","article-title":"Factors contributing to an increase in duplicate medication order errors after CPOE implementation","volume":"18","author":"Wetterneck","year":"2011","journal-title":"J Am Med Inform Assoc."},{"issue":"6","key":"2020110612435849400_ocw154-B31","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.ijmedinf.2014.02.004","article-title":"E-prescribing errors in community pharmacies: exploring consequences and contributing factors","volume":"83","author":"Odukoya","year":"2014","journal-title":"Int J Med Inform."},{"issue":"12","key":"2020110612435849400_ocw154-B32","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.2146\/ajhp080389","article-title":"Evaluation of causes and frequency of medication errors during information technology downtime","volume":"66","author":"Hanuscak","year":"2009","journal-title":"Am J Health Syst Pharm."},{"issue":"9","key":"2020110612435849400_ocw154-B33","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1016\/j.ijmedinf.2013.05.008","article-title":"Unintended adverse consequences of introducing electronic health records in residential aged care homes","volume":"82","author":"Yu","year":"2013","journal-title":"Int J Med Inform."},{"issue":"1","key":"2020110612435849400_ocw154-B34","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1002\/jhrm.21146","article-title":"Electronic health record\u2013related safety concerns: a cross-sectional survey","volume":"34","author":"Menon","year":"2014","journal-title":"J Healthc Risk Manag."},{"issue":"615","key":"2020110612435849400_ocw154-B35","doi-asserted-by":"crossref","first-page":"e713","DOI":"10.3399\/bjgp13X673739","article-title":"The causes of prescribing errors in English general practices: a qualitative study","volume":"63","author":"Slight","year":"2013","journal-title":"Br J Gen Pract."},{"issue":"2","key":"2020110612435849400_ocw154-B36","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1197\/jamia.M1471","article-title":"Some unintended consequences of information technology in health care: the nature of patient care information system-related errors","volume":"11","author":"Ash","year":"2004","journal-title":"J Am Med Inform Assoc."},{"issue":"5","key":"2020110612435849400_ocw154-B37","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1197\/jamia.M2042","article-title":"Types of unintended consequences related to computerized provider order entry","volume":"13","author":"Campbell","year":"2006","journal-title":"J Am Med Inform Assoc."},{"issue":"5","key":"2020110612435849400_ocw154-B38","doi-asserted-by":"crossref","first-page":"1872","DOI":"10.1542\/peds.2006-0810","article-title":"Medication errors related to computerized order entry for children","volume":"118","author":"Walsh","year":"2006","journal-title":"Pediatrics."},{"issue":"4","key":"2020110612435849400_ocw154-B39","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1136\/jamia.2010.003335","article-title":"An unintended consequence of electronic prescriptions: prevalence and impact of internal discrepancies","volume":"17","author":"Palchuk","year":"2010","journal-title":"J Am Med Inform Assoc."},{"issue":"6","key":"2020110612435849400_ocw154-B40","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1136\/amiajnl-2011-000205","article-title":"Errors associated with outpatient computerized prescribing systems","volume":"18","author":"Nanji","year":"2011","journal-title":"J Am Med Inform Assoc."},{"issue":"6","key":"2020110612435849400_ocw154-B41","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1136\/amiajnl-2013-001745","article-title":"The safety of electronic prescribing: manifestations, mechanisms, and rates of system-related errors associated with two commercial systems in hospitals","volume":"20","author":"Westbrook","year":"2013","journal-title":"J Am Med Inform Assoc."},{"issue":"6","key":"2020110612435849400_ocw154-B42","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1542\/peds.2005-1287","article-title":"Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system","volume":"116","author":"Han","year":"2005","journal-title":"Pediatrics."},{"issue":"3","key":"2020110612435849400_ocw154-B43","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1197\/jamia.M1372","article-title":"Understanding implementation: the case of a computerized physician order entry system in a large Dutch university medical center","volume":"11","author":"Aarts","year":"2004","journal-title":"J Am Med Inform Assoc."},{"issue":"4","key":"2020110612435849400_ocw154-B44","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1197\/jamia.M1740","article-title":"Comprehensive analysis of a medication dosing error related to CPOE","volume":"12","author":"Horsky","year":"2005","journal-title":"J Am Med Inform Assoc."},{"issue":"7","key":"2020110612435849400_ocw154-B45","doi-asserted-by":"crossref","first-page":"510","DOI":"10.7326\/0003-4819-144-7-200604040-00010","article-title":"Computerization can create safety hazards: a bar-coding near miss","volume":"144","author":"McDonald","year":"2006","journal-title":"Ann Intern Med."},{"issue":"e1","key":"2020110612435849400_ocw154-B46","doi-asserted-by":"crossref","first-page":"e187","DOI":"10.1136\/amiajnl-2012-001494","article-title":"The hazard of software updates to clinical workstations: a natural experiment","volume":"20","author":"Landman","year":"2013","journal-title":"J Am Med Inform Assoc."},{"issue":"4","key":"2020110612435849400_ocw154-B47","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1136\/bmjqs-2015-004486","article-title":"Measuring and improving patient safety through health information technology: The Health IT Safety Framework","volume":"25","author":"Singh","year":"2016","journal-title":"BMJ Qual Saf."},{"issue":"10","key":"2020110612435849400_ocw154-B48","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1056\/NEJMhle1003134","article-title":"The disclosure dilemma: large-scale adverse events","volume":"363","author":"Dudzinski","year":"2010","journal-title":"New Engl J Med."},{"key":"2020110612435849400_ocw154-B49","article-title":"Safety and Ethics in Healthcare: a Guide to Getting It Right","author":"Runciman","year":"2007","journal-title":"Aldershot, UK: Ashgate Publishing;"},{"key":"2020110612435849400_ocw154-B50","first-page":"853","article-title":"Patient safety problems associated with heathcare information technology: an analysis of adverse events reported to the US Food and Drug Administration","volume":"2011","author":"Magrabi","year":"2011","journal-title":"AMIA Ann Symp Proc."},{"issue":"1","key":"2020110612435849400_ocw154-B51","doi-asserted-by":"crossref","first-page":"e1001164","DOI":"10.1371\/journal.pmed.1001164","article-title":"Effects of two commercial electronic prescribing systems on prescribing error rates in hospital in-patients: a before and after study","volume":"9","author":"Westbrook","year":"2012","journal-title":"PLoS Med."},{"issue":"1","key":"2020110612435849400_ocw154-B52","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1542\/peds.2006-0367","article-title":"Computerized provider order entry implementation: no association with increased mortality rates in an intensive care unit","volume":"118","author":"Del Beccaro","year":"2006","journal-title":"Pediatrics."},{"issue":"2","key":"2020110612435849400_ocw154-B53","first-page":"70","article-title":"The contribution of sociotechnical factors to health information technology-related sentinel events","volume":"42","author":"Castro","year":"2016","journal-title":"Jt Comm J Qual Patient Saf."},{"issue":"3","key":"2020110612435849400_ocw154-B54","doi-asserted-by":"crossref","first-page":"331","DOI":"10.4338\/ACI-2013-04-RA-0024","article-title":"STARE-HI: statement on reporting of evaluation studies in health informatics: explanation and elaboration","volume":"4","author":"Brender","year":"2013","journal-title":"Appl Clin Inform."},{"issue":"5","key":"2020110612435849400_ocw154-B55","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.ijmedinf.2014.01.001","article-title":"Automation bias: empirical results assessing influencing factors","volume":"83","author":"Goddard","year":"2014","journal-title":"Int J Med Inform."},{"issue":"1","key":"2020110612435849400_ocw154-B56","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.jcrc.2007.01.004","article-title":"Downtime procedures for a clinical information system: a critical issue","volume":"22","author":"Nelson","year":"2007","journal-title":"J Crit Care."},{"issue":"3","key":"2020110612435849400_ocw154-B57","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1136\/qshc.2002.004101","article-title":"Crisis management during anaesthesia: the development of an anaesthetic crisis management manual","volume":"14","author":"Runciman","year":"2005","journal-title":"Qual Saf Health Care."},{"key":"2020110612435849400_ocw154-B58","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1016\/j.jbi.2015.12.016","article-title":"Measuring the effects of computer downtime on hospital pathology processes","volume":"59","author":"Wang","year":"2016","journal-title":"J Biomed Inform."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/2\/246\/34148984\/ocw154.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/2\/246\/34148984\/ocw154.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:17:23Z","timestamp":1604686643000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/24\/2\/246\/2723147"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,2,13]]},"references-count":58,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2017,2,13]]},"published-print":{"date-parts":[[2017,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw154","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,3]]},"published":{"date-parts":[[2017,2,13]]}}}