{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T16:11:43Z","timestamp":1771258303104,"version":"3.50.1"},"reference-count":50,"publisher":"Georg Thieme Verlag KG","issue":"03","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Despite the proven usefulness of appropriate clinical decision support (CDS) alerts, many CDS systems fire excessive, clinically irrelevant alerts that are often ignored by clinicians. We have developed a method to suppress false-positive alerts based on prior drug tolerance but encountered substantial barriers to integrating the method into widely adopted commercial electronic health record (EHR) systems.<\/jats:p><jats:p>This study aimed to describe the challenges faced while attempting to integrate our method into the CDS infrastructure of two commercial EHR systems and provide recommendations for future research and CDS design.<\/jats:p><jats:p>Using a multifaceted approach, we investigated (1) the use of emergent CDS standards (e.g., CDS Hooks) to create a scalable solution to augment off-the-shelf EHR-based alerts with patient-specific custom alerts, (2) customize CDS rules of commercial medication knowledge bases (MKBs) to reduce false-positive alerts, and (3) manually inactivate allergy documentation in patients with prior drug tolerance.<\/jats:p><jats:p>We were unable to implement the standards-based approach because support for CDS Hooks was found to be tailored to specific scenarios that involve the creation of new drug allergy alerts (DAAs) but not the suppression of vendor-supplied DAAs. Likewise, we were unable to suppress alerts imported from MKBs into the EHR systems investigated because these systems do not support discrete clinical documentation changes that drive DAAs. Lastly, we determined that although manually inactivating allergy documentation in patients with prior drug tolerance is possible, doing so requires the impractical solution of creating and maintaining individual rules for each drug at the ingredient level.<\/jats:p><jats:p>We describe the barriers that precluded implementation of a novel method to suppress clinically irrelevant CDS alerts in two commercial EHR systems. Overcoming these barriers will require a more flexible CDS infrastructure, as well as collaboration and shared responsibility across diverse stakeholders.<\/jats:p>","DOI":"10.1055\/a-2546-5954","type":"journal-article","created":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T00:11:56Z","timestamp":1740787916000},"page":"575-582","source":"Crossref","is-referenced-by-count":2,"title":["Challenges to Reduce Alert Burden Using Current Decision Support Infrastructure in Two Commercial EHR Systems: Lessons Learned and Path Forward"],"prefix":"10.1055","volume":"16","author":[{"given":"Tiago K.","family":"Colicchio","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics and Data Science, University of Alabama at Birmingham, Birmingham, Alabama, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"ElHalta","sequence":"additional","affiliation":[{"name":"Department of Pharmacy Services, University of Utah, Salt Lake City, Utah, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guilherme Del","family":"Fiol","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kensaku","family":"Kawamoto","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Howard R.","family":"Strasberg","sequence":"additional","affiliation":[{"name":"Clinical Effectiveness, Wolters Kluwer Health, San Diego, California, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James J.","family":"Cimino","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics and Data Science, University of Alabama at Birmingham, Birmingham, Alabama, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"194","published-online":{"date-parts":[[2025,6,25]]},"reference":[{"issue":"12","key":"ref1","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.1136\/bmjqs-2020-012283","article-title":"The effectiveness of interruptive prescribing alerts in ambulatory CPOE to change prescriber behaviour & improve safety","volume":"30","author":"O Cerqueira","year":"2021","journal-title":"BMJ Qual Saf"},{"key":"ref2","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.ijmedinf.2017.05.011","article-title":"A systematic review of the effectiveness of interruptive medication prescribing alerts in hospital CPOE systems to change prescriber behavior and improve patient safety","volume":"105","author":"N Page","year":"2017","journal-title":"Int J Med Inform"},{"key":"ref3","first-page":"339","article-title":"A successful model and visual design for creating context-aware drug-drug interaction alerts","volume":"2011","author":"J DD Duke","year":"2011","journal-title":"AMIA Annu Symp Proc"},{"issue":"03","key":"ref4","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1136\/amiajnl-2012-001073","article-title":"Adherence to drug-drug interaction alerts in high-risk patients: a trial of context-enhanced alerting","volume":"20","author":"J D Duke","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"ref5","first-page":"380","article-title":"Overriding drug-drug interaction alerts in clinical decision support systems: A scoping review","volume":"290","author":"L V Zapata","year":"2022","journal-title":"Stud Health Technol Inform"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"104673","DOI":"10.1016\/j.ijmedinf.2021.104673","article-title":"A systematic review of drug allergy alert systems","volume":"159","author":"M Luri","year":"2022","journal-title":"Int J Med Inform"},{"issue":"03","key":"ref7","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1093\/jamia\/ocv143","article-title":"Rising drug allergy alert overrides in electronic health records: an observational retrospective study of a decade of experience","volume":"23","author":"M Topaz","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"02","key":"ref8","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1093\/jamia\/ocw072","article-title":"Alert override as a habitual behavior - a new perspective on a persistent problem","volume":"24","author":"M T Baysari","year":"2017","journal-title":"J Am Med Inform Assoc"},{"key":"ref9","first-page":"1488","article-title":"When an alert is not an alert: A pilot study to characterize behavior and cognition associated with medication alerts","volume":"2018","author":"T J Reese","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"issue":"06","key":"ref10","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1093\/jamia\/ocaa034","article-title":"High-priority drug-drug interaction clinical decision support overrides in a newly implemented commercial computerized provider order-entry system: Override appropriateness and adverse drug events","volume":"27","author":"H Edrees","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"09","key":"ref11","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1136\/bmjqs-2017-007531","article-title":"Prospective evaluation of medication-related clinical decision support over-rides in the intensive care unit","volume":"27","author":"A Wong","year":"2018","journal-title":"BMJ Qual Saf"},{"issue":"04","key":"ref12","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1007\/s40264-018-0756-x","article-title":"Evaluation of harm associated with high dose-range clinical decision support overrides in the intensive care unit","volume":"42","author":"A Wong","year":"2019","journal-title":"Drug Saf"},{"issue":"03","key":"ref13","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1055\/s-0042-1748856","article-title":"Clinical decision support stewardship: best practices and techniques to monitor and improve interruptive alerts","volume":"13","author":"J D Chaparro","year":"2022","journal-title":"Appl Clin Inform"},{"issue":"01","key":"ref14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1055\/s-0039-3402715","article-title":"Reducing alert burden in electronic health records: State of the Art Recommendations from Four Health Systems","volume":"11","author":"J D McGreevey III","year":"2020","journal-title":"Appl Clin Inform"},{"issue":"08","key":"ref15","doi-asserted-by":"crossref","first-page":"662","DOI":"10.2146\/ajhp100465","article-title":"Customizing clinical decision support to prevent excessive drug-drug interaction alerts","volume":"68","author":"J R Horn","year":"2011","journal-title":"Am J Health Syst Pharm"},{"issue":"01","key":"ref16","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1093\/jamia\/ocaa279","article-title":"Optimizing clinical decision support alerts in electronic medical records: a systematic review of reported strategies adopted by hospitals","volume":"28","author":"B A Van Dort","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"09","key":"ref17","doi-asserted-by":"crossref","first-page":"2858","DOI":"10.1016\/j.jaip.2020.04.059","article-title":"Penicillin allergy delabeling: A multidisciplinary opportunity","volume":"8","author":"M L Staicu","year":"2020","journal-title":"J Allergy Clin Immunol Pract"},{"issue":"01","key":"ref18","first-page":"1","article-title":"Nursing interventions as part of an integral pharmaceutical care team","volume":"35","author":"L Anoz-Jim\u00e9nez","year":"2011","journal-title":"Farm Hosp"},{"issue":"04","key":"ref19","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1310\/hpj4804-302","article-title":"Impact of a pharmacist-driven protocol to improve drug allergy documentation at a university hospital","volume":"48","author":"C Burrell","year":"2013","journal-title":"Hosp Pharm"},{"issue":"08","key":"ref20","doi-asserted-by":"crossref","first-page":"2919","DOI":"10.1016\/j.jaip.2019.04.052","article-title":"Clinical decision support improved allergy documentation of antibiotic test dose results","volume":"7","author":"A Wright","year":"2019","journal-title":"J Allergy Clin Immunol Pract"},{"issue":"09","key":"ref21","doi-asserted-by":"crossref","first-page":"1108","DOI":"10.1017\/ice.2021.329","article-title":"Incidence of interruptive penicillin allergy alerts in patients with previously documented beta-lactam exposure: Potential for leveraging the electronic health record to identify erroneous allergies","volume":"43","author":"N Van Groningen","year":"2022","journal-title":"Infect Control Hosp Epidemiol"},{"key":"ref22","doi-asserted-by":"crossref","first-page":"104508","DOI":"10.1016\/j.jbi.2023.104508","article-title":"Beyond the override: Using evidence of previous drug tolerance to suppress drug allergy alerts; a retrospective study of opioid alerts","volume":"147","author":"T K Colicchio","year":"2023","journal-title":"J Biomed Inform"},{"issue":"03","key":"ref23","doi-asserted-by":"crossref","first-page":"802","DOI":"10.4338\/ACI-2013-12-RA-0103","article-title":"Drug interaction alert override rates in the Meaningful Use era: no evidence of progress","volume":"5","author":"A D Bryant","year":"2014","journal-title":"Appl Clin Inform"},{"key":"ref24","first-page":"624","article-title":"A pragmatic guide to establishing clinical decision support governance and addressing decision support fatigue: a case study","volume":"2018","author":"K Kawamanto","year":"2018","journal-title":"AMIA Annu Symp proc"},{"issue":"05","key":"ref25","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1093\/jamia\/ocx115","article-title":"Medication-related clinical decision support alert overrides in inpatients","volume":"25","author":"K C Nanji","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref26","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1097\/01720610-201201000-00003","article-title":"Prescribing opioids safely in patients with an opiate allergy","volume":"25","author":"L DeDea","year":"2012","journal-title":"JAAPA"},{"issue":"06","key":"ref27","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1197\/jamia.M1556","article-title":"Characteristics and consequences of drug allergy alert overrides in a computerized physician order entry system","volume":"11","author":"T C Hsieh","year":"2004","journal-title":"J Am Med Inform Assoc"},{"issue":"03","key":"ref28","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1111\/cea.12177","article-title":"Allergy to illicit drugs and narcotics","volume":"44","author":"S Swerts","year":"2014","journal-title":"Clin Exp Allergy"},{"key":"ref29","first-page":"242","article-title":"High override rate for opioid drug-allergy interaction alerts: Current trends and recommendations for future","volume":"216","author":"M Topaz","year":"2015","journal-title":"Stud Health Technol Inform"},{"issue":"09","key":"ref30","doi-asserted-by":"crossref","first-page":"1490","DOI":"10.1111\/imj.15209","article-title":"Documentation of adverse drug reactions to opioids in an electronic health record","volume":"51","author":"J M Inglis","year":"2021","journal-title":"Intern Med J"},{"key":"ref31","first-page":"95","article-title":"The usage of OHDSI OMOP - A scoping review","volume":"283","author":"I Reinecke","year":"2021","journal-title":"Stud Health Technol Inform"},{"key":"ref32","first-page":"309","article-title":"Semantically oriented EHR navigation with a patient specific knowledge base and a clinical context ontology","volume":"2023","author":"T K Colicchio","year":"2024","journal-title":"AMIA Annu Symp Proc"},{"issue":"08","key":"ref34","doi-asserted-by":"crossref","first-page":"1796","DOI":"10.1093\/jamia\/ocab070","article-title":"Contemporary clinical decision support standards using Health Level Seven International Fast Healthcare Interoperability Resources","volume":"28","author":"H R Strasberg","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"ref35","doi-asserted-by":"crossref","first-page":"104749","DOI":"10.1016\/j.ijmedinf.2022.104749","article-title":"Coordinated use of Health Level 7 standards to support clinical decision support: Case study with shared decision making and drug-drug interactions","volume":"162","author":"H Thiess","year":"2022","journal-title":"Int J Med Inform"},{"issue":"01","key":"ref36","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1055\/s-0040-1701986","article-title":"Clinical decision support and implications for the clinician burnout crisis","volume":"29","author":"I Jankovic","year":"2020","journal-title":"Yearb Med Inform"},{"issue":"01","key":"ref37","doi-asserted-by":"crossref","first-page":"130","DOI":"10.7326\/0003-4819-100-1-130","article-title":"Reminders to physicians from an introspective computer medical record. A two-year randomized trial","volume":"100","author":"C J McDonald","year":"1984","journal-title":"Ann Intern Med"},{"key":"ref38","first-page":"856","article-title":"Enterprise-wide drug-drug interaction alerting system","volume":"2003","author":"J A Greim","year":"2003","journal-title":"AMIA Annu Symp Proc"},{"key":"ref39","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/S1386-5056(02)00110-7","article-title":"Decision support in medicine: lessons from the HELP system","volume":"69","author":"P J Haug","year":"2003","journal-title":"Int J Med Inform"},{"issue":"06","key":"ref40","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1056\/NEJMp1006114","article-title":"The \u201cmeaningful use\u201d regulation for electronic health records","volume":"363","author":"D Blumenthal","year":"2010","journal-title":"N Engl J Med"},{"issue":"06","key":"ref41","doi-asserted-by":"crossref","first-page":"e13313","DOI":"10.2196\/13313","article-title":"Unintended consequences of nationwide electronic health record adoption: challenges and opportunities in the post-Meaningful Use era","volume":"21","author":"T K Colicchio","year":"2019","journal-title":"J Med Internet Res"},{"issue":"08","key":"ref42","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.3174\/ajnr.A3247","article-title":"Meaningful Use","volume":"33","author":"N Anumula","year":"2012","journal-title":"AJNR Am J Neuroradiol"},{"issue":"S 01","key":"ref43","first-page":"S103","article-title":"Clinical decision support: a 25 year retrospective and a 25 year vision","volume":"1","author":"B Middleton","year":"2016","journal-title":"Yearb Med Inform"},{"issue":"04","key":"ref44","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1056\/NEJM199801223380406","article-title":"A computer-assisted management program for antibiotics and other antiinfective agents","volume":"338","author":"R S Evans","year":"1998","journal-title":"N Engl J Med"},{"key":"ref45","first-page":"178","article-title":"Computer surveillance of hospital-acquired infections: a 25 year update","volume":"2009","author":"R S Evans","year":"2009","journal-title":"AMIA Annu Symp Proc"},{"issue":"02","key":"ref46","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1055\/s-0040-1710310","article-title":"Twilighted Homegrown Systems: The experience of six traditional electronic health record developers in the post-Meaningful Use era","volume":"11","author":"T K Colicchio","year":"2020","journal-title":"Appl Clin Inform"},{"issue":"10","key":"ref47","doi-asserted-by":"crossref","first-page":"2197","DOI":"10.1001\/archinte.1990.00390210145031","article-title":"Desensitization in the management of vancomycin hypersensitivity","volume":"150","author":"R Y Lin","year":"1990","journal-title":"Arch Intern Med"},{"issue":"01","key":"ref48","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1055\/s-0041-1726502","article-title":"New standards for clinical decision support: A survey of the state of implementation","volume":"30","author":"P Taber","year":"2021","journal-title":"Yearb Med Inform"},{"issue":"05","key":"ref49","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1093\/jamia\/ocv073","article-title":"Cross-vendor evaluation of key user-defined clinical decision support capabilities: a scenario-based assessment of certified electronic health records with guidelines for future development","volume":"22","author":"A B McCoy","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"01","key":"ref51","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.emc.2021.09.001","article-title":"Drug hypersensitivity reactions","volume":"40","author":"R G Wilkerson","year":"2022","journal-title":"Emerg Med Clin North Am"},{"issue":"12","key":"ref52","doi-asserted-by":"crossref","first-page":"2310","DOI":"10.1377\/hlthaff.2010.1111","article-title":"Clinical decision support systems could be modified to reduce \u2018alert fatigue\u2019 while still minimizing the risk of litigation","volume":"30","author":"A S Kesselheim","year":"2011","journal-title":"Health Aff (Millwood)"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/a-2546-5954.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T23:13:00Z","timestamp":1750893180000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/a-2546-5954"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,28]]},"references-count":50,"journal-issue":{"issue":"03","published-online":{"date-parts":[[2025,5,28]]},"published-print":{"date-parts":[[2025,5]]}},"URL":"https:\/\/doi.org\/10.1055\/a-2546-5954","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,2,28]]},"published":{"date-parts":[[2025,2,28]]}}}