{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T07:50:06Z","timestamp":1772869806608,"version":"3.50.1"},"reference-count":57,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T00:00:00Z","timestamp":1722297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Conduct a scoping review of research studies that describe rule-based clinical decision support (CDS) malfunctions.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>In April 2022, we searched three bibliographic databases (MEDLINE, CINAHL, and Embase) for literature referencing CDS malfunctions. We coded the identified malfunctions according to an existing CDS malfunction taxonomy and added new categories for factors not already captured. We also extracted and summarized information related to the CDS system, such as architecture, data source, and data format.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Twenty-eight articles met inclusion criteria, capturing 130 malfunctions. Architectures used included stand-alone systems (eg, web-based calculator), integrated systems (eg, best practices alerts), and service-oriented architectures (eg, distributed systems like SMART or CDS Hooks). No standards-based CDS malfunctions were identified. The \u201cCause\u201d category of the original taxonomy includes three new types (organizational policy, hardware error, and data source) and two existing causes were expanded to include additional layers. Only 29 malfunctions (22%) described the potential impact of the malfunction on patient care.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>While a substantial amount of research on CDS exists, our review indicates there is a limited focus on CDS malfunctions, with even less attention on malfunctions associated with modern delivery architectures such as SMART and CDS Hooks.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>CDS malfunctions can and do occur across several different care delivery architectures. To account for advances in health information technology, existing taxonomies of CDS malfunctions must be continually updated. This will be especially important for service-oriented architectures, which connect several disparate systems, and are increasing in use.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae187","type":"journal-article","created":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T00:02:41Z","timestamp":1722384161000},"page":"2405-2413","source":"Crossref","is-referenced-by-count":7,"title":["A scoping review of rule-based clinical decision support malfunctions"],"prefix":"10.1093","volume":"31","author":[{"given":"Jeritt G","family":"Thayer","sequence":"first","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia , Philadelphia, PA 19146, United States"},{"name":"McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston , Houston, TX 77030, United States"},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA 19104, United States"}]},{"given":"Amy","family":"Franklin","sequence":"additional","affiliation":[{"name":"McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston , Houston, TX 77030, United States"}]},{"given":"Jeffrey M","family":"Miller","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia , Philadelphia, PA 19146, United States"}]},{"given":"Robert W","family":"Grundmeier","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia , Philadelphia, PA 19146, United States"},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA 19104, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2351-1538","authenticated-orcid":false,"given":"Deevakar","family":"Rogith","sequence":"additional","affiliation":[{"name":"McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston , Houston, TX 77030, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6844-145X","authenticated-orcid":false,"given":"Adam","family":"Wright","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37203, United States"},{"name":"Department of Medicine, Vanderbilt University Medical Center , Nashville, TN 37232, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,7,30]]},"reference":[{"issue":"11","key":"2024092007524876300_ocae187-B1","doi-asserted-by":"publisher","first-page":"2379","DOI":"10.1093\/jamia\/ocab171","article-title":"The ecosystem of apps and software integrated with certified health information technology","volume":"28","author":"Barker","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2024092007524876300_ocae187-B2"},{"issue":"5","key":"2024092007524876300_ocae187-B3","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1093\/jamia\/ocv189","article-title":"SMART on FHIR: a standards-based, interoperable apps platform for electronic health records","volume":"23","author":"Mandel","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2024092007524876300_ocae187-B4","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1197\/jamia.M2298","article-title":"Proposal for fulfilling strategic objectives of the U.S. roadmap for national action on decision support through a service-oriented architecture leveraging HL7 services","volume":"14","author":"Kawamoto","year":"2007","journal-title":"J Am Med Inform Assoc"},{"key":"2024092007524876300_ocae187-B5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ijmedinf.2016.12.005","article-title":"Opening the Duke electronic health record to apps: Implementing SMART on FHIR","volume":"99","author":"Bloomfield","year":"2017","journal-title":"Int J Med Inform"},{"key":"2024092007524876300_ocae187-B6","doi-asserted-by":"publisher","first-page":"104749","DOI":"10.1016\/j.ijmedinf.2022.104749","article-title":"Coordinated use of health level 7 standards to support clinical decision support: case study with shared decision making and drug\u2013drug interactions","volume":"162","author":"Thiess","year":"2022","journal-title":"Int J Med Inform"},{"issue":"4","key":"2024092007524876300_ocae187-B7","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1093\/jamia\/ocaa006","article-title":"The impact of transitioning from availability of outside records within electronic health records to integration of local and outside records within electronic health records","volume":"27","author":"Adler-Milstein","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2024092007524876300_ocae187-B8","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1377\/hlthaff.2020.01497","article-title":"A survey of health information exchange organizations in advance of a nationwide connectivity framework","volume":"40","author":"Adler-Milstein","year":"2021","journal-title":"Health Aff (Millwood)"},{"issue":"11","key":"2024092007524876300_ocae187-B9","doi-asserted-by":"publisher","first-page":"e41750","DOI":"10.2196\/41750","article-title":"The patient role in a federal national-scale health information exchange","volume":"24","author":"Mandel","year":"2022","journal-title":"J Med Internet Res"},{"issue":"4","key":"2024092007524876300_ocae187-B10","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1145\/2466486.2482856","article-title":"There\u2019s just no getting around it: you\u2019re building a distributed system","volume":"11","author":"Cavage","year":"2013","journal-title":"Queue"},{"issue":"10","key":"2024092007524876300_ocae187-B11","first-page":"42","article-title":"The five rights of clinical decision support: CDS tools helpful for meeting meaningful use","volume":"84","author":"Campbell","year":"2013","journal-title":"J AHIMA"},{"issue":"11","key":"2024092007524876300_ocae187-B12","doi-asserted-by":"publisher","first-page":"901","DOI":"10.1016\/j.ijmedinf.2015.08.008","article-title":"Lessons learned from implementing service-oriented clinical decision support at four sites: A qualitative study","volume":"84","author":"Wright","year":"2015","journal-title":"Int J Med Inform"},{"issue":"6","key":"2024092007524876300_ocae187-B13","doi-asserted-by":"publisher","first-page":"1068","DOI":"10.1093\/jamia\/ocw005","article-title":"Analysis of clinical decision support system malfunctions: a case series and survey","volume":"23","author":"Wright","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2024092007524876300_ocae187-B14","doi-asserted-by":"publisher","first-page":"910","DOI":"10.4338\/ACI-2017-01-RA-0006","article-title":"Clinical decisions support malfunctions in a commercial electronic health record","volume":"8","author":"Kassakian","year":"2017","journal-title":"Appl Clin Inform"},{"issue":"2","key":"2024092007524876300_ocae187-B15","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1055\/s-0039-1683985","article-title":"Assessing the safety of custom web-based clinical decision support systems in electronic health records: a case study","volume":"10","author":"Thayer","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"1","key":"2024092007524876300_ocae187-B16","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1093\/jamia\/ocy139","article-title":"Cranky comments: detecting clinical decision support malfunctions through free-text override reasons","volume":"26","author":"Aaron","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2024092007524876300_ocae187-B17","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1093\/jamia\/ocx106","article-title":"Clinical decision support alert malfunctions: analysis and empirically derived taxonomy","volume":"25","author":"Wright","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2024092007524876300_ocae187-B18","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1145\/102792.102801","article-title":"Understanding fault-tolerant distributed systems","volume":"34","author":"Cristian","year":"1991","journal-title":"Commun ACM"},{"issue":"1","key":"2024092007524876300_ocae187-B19","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1080\/1364557032000119616","article-title":"Scoping studies: towards a methodological framework","volume":"8","author":"Arksey","year":"2005","journal-title":"Int J Soc Res Methodol"},{"key":"2024092007524876300_ocae187-B20","doi-asserted-by":"publisher","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"issue":"Suppl 3","key":"2024092007524876300_ocae187-B21","doi-asserted-by":"publisher","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","article-title":"A new sociotechnical model for studying health information technology in complex adaptive healthcare systems","volume":"19","author":"Sittig","year":"2010","journal-title":"Qual Saf Health Care"},{"issue":"10","key":"2024092007524876300_ocae187-B22","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1016\/j.ijmedinf.2008.01.004","article-title":"A four-phase model of the evolution of clinical decision support architectures","volume":"77","author":"Wright","year":"2008","journal-title":"Int J Med Inform"},{"issue":"3366","key":"2024092007524876300_ocae187-B23","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1126\/science.130.3366.9","article-title":"Reasoning foundations of medical diagnosis; symbolic logic, probability, and value theory aid our understanding of how physicians reason","volume":"130","author":"Ledley","year":"1959","journal-title":"Science"},{"issue":"4","key":"2024092007524876300_ocae187-B24","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1136\/jamia.1998.0050357","article-title":"The guideline interchange format: a model for representing guidelines","volume":"5","author":"Ohno-Machado","year":"1998","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2024092007524876300_ocae187-B25","first-page":"76","article-title":"Arden syntax for medical logic modules","volume":"8","author":"Hripcsak","year":"1991","journal-title":"MD Comput"},{"key":"2024092007524876300_ocae187-B26"},{"issue":"3","key":"2024092007524876300_ocae187-B27","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1093\/jamia\/ocz196","article-title":"Using electronic health record audit logs to study clinical activity: a systematic review of aims, measures, and methods","volume":"27","author":"Rule","year":"2020","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2024092007524876300_ocae187-B28","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1093\/intqhc\/mzn038","article-title":"Analysis of overridden alerts in a drug\u2013drug interaction detection system","volume":"20","author":"Mille","year":"2008","journal-title":"Int J Qual Health Care"},{"key":"2024092007524876300_ocae187-B29","first-page":"339","article-title":"Clinical performance of a rule-based decision support system for mechanical ventilation of ARDS patients","author":"Thomsen","year":"1993","journal-title":"Proc Symp Comput Appl Med Care"},{"key":"2024092007524876300_ocae187-B30","first-page":"773","article-title":"Analysis of a failed clinical decision support system for management of congestive heart failure","author":"Wadhwa","year":"2008","journal-title":"AMIA Annu Symp Proc AMIA Symp"},{"issue":"17","key":"2024092007524876300_ocae187-B31","doi-asserted-by":"publisher","first-page":"1578","DOI":"10.1001\/archinternmed.2010.324","article-title":"Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial","volume":"170","author":"Strom","year":"2010","journal-title":"Arch Intern Med"},{"issue":"6","key":"2024092007524876300_ocae187-B32","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1136\/amiajnl-2011-000255","article-title":"Factors contributing to an increase in duplicate medication order errors after CPOE implementation","volume":"18","author":"Wetterneck","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"12","key":"2024092007524876300_ocae187-B33","doi-asserted-by":"publisher","first-page":"929","DOI":"10.1016\/j.ijmedinf.2014.08.006","article-title":"Impact of a clinical decision support system for high-alert medications on the prevention of prescription errors","volume":"83","author":"Lee","year":"2014","journal-title":"Int J Med Inform"},{"issue":"5","key":"2024092007524876300_ocae187-B34","doi-asserted-by":"publisher","first-page":"958","DOI":"10.1093\/jamia\/ocw188","article-title":"Orders on file but no labs drawn: investigation of machine and human errors caused by an interface idiosyncrasy","volume":"24","author":"Schreiber","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2024092007524876300_ocae187-B35","doi-asserted-by":"publisher","first-page":"564","DOI":"10.1093\/jamia\/ocx096","article-title":"Unintended adverse consequences of a clinical decision support system: two cases","volume":"25","author":"Stone","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2024092007524876300_ocae187-B36","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1055\/s-0038-1632397","article-title":"The value of monitoring clinical decision support interventions","volume":"9","author":"Yoshida","year":"2018","journal-title":"Appl Clin Inform"},{"issue":"ck1","key":"2024092007524876300_ocae187-B37","doi-asserted-by":"publisher","first-page":"1763","DOI":"10.3233\/SHTI190636","article-title":"Continuous improvement of clinical decision support via an embedded survey tool","volume":"264","author":"Rubins","year":"2019","journal-title":"Stud Health Technol Inform"},{"issue":"3","key":"2024092007524876300_ocae187-B38","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1093\/ajcp\/aqz163","article-title":"An electronic strategy for eliminating unnecessary duplicate genetic testing","volume":"153","author":"Riley","year":"2020","journal-title":"Am J Clin Pathol"},{"issue":"1","key":"2024092007524876300_ocae187-B39","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1055\/s-0041-1722918","article-title":"Algorithmic detection of Boolean logic errors in clinical decision support statements","volume":"12","author":"Wright","year":"2021","journal-title":"Appl Clin Inform"},{"issue":"1","key":"2024092007524876300_ocae187-B40","doi-asserted-by":"publisher","first-page":"e21712","DOI":"10.2196\/21712","article-title":"Giving your electronic health record a checkup after COVID-19: a practical framework for reviewing clinical decision support in light of the telemedicine expansion","volume":"9","author":"Feldman","year":"2021","journal-title":"JMIR Med Inform"},{"issue":"7","key":"2024092007524876300_ocae187-B41","doi-asserted-by":"publisher","first-page":"1844","DOI":"10.1016\/j.jaip.2022.03.026","article-title":"Allergy safety events in healthcare: development and application of a classification schema based on retrospective review","volume":"10","author":"Phadke","year":"2022","journal-title":"J Allergy Clin Immunol Pract"},{"issue":"3","key":"2024092007524876300_ocae187-B42","doi-asserted-by":"publisher","first-page":"434","DOI":"10.4187\/respcare.07573","article-title":"Electronic medical record-based pager notification reduces excess oxygen exposure in mechanically ventilated subjects","volume":"66","author":"Pannu","year":"2021","journal-title":"Respir Care"},{"issue":"2","key":"2024092007524876300_ocae187-B43","first-page":"S268","article-title":"Implementing an electronic clinical decision support tool to reduce low value imaging for backpain INA large safety net health system","volume":"31","author":"Mafi","year":"2016","journal-title":"J Gen Int Med"},{"issue":"496","key":"2024092007524876300_ocae187-B44","first-page":"838","article-title":"Automated quality checks on repeat prescribing","volume":"53","author":"Rogers","year":"2003","journal-title":"Br J Gen Pract"},{"key":"2024092007524876300_ocae187-B45","author":"Chan","year":"2005"},{"issue":"11","key":"2024092007524876300_ocae187-B46","doi-asserted-by":"publisher","first-page":"1375","DOI":"10.1093\/jamia\/ocz133","article-title":"Importance of clinical decision support system response time monitoring: a case report","volume":"26","author":"Rubins","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2024092007524876300_ocae187-B47","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1177\/1932296816676501","article-title":"A mobile computerized decision support system to prevent hypoglycemia in hospitalized patients with type 2 diabetes mellitus","volume":"11","author":"Spat","year":"2017","journal-title":"J Diabetes Sci Technol"},{"issue":"11","key":"2024092007524876300_ocae187-B48","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph16111926","article-title":"The safer prescription of opioids tool (SPOT): a novel clinical decision support digital health platform for opioid conversion in palliative and end of life care\u2014a single-centre pilot study","volume":"16","author":"Flint","year":"2019","journal-title":"Int J Environ Res Public Health"},{"issue":"Suppl 4","key":"2024092007524876300_ocae187-B49","doi-asserted-by":"publisher","first-page":"e199","DOI":"10.1097\/01.JU.0000555325.43407.15","article-title":"\"hidden\" computer decision support system alters urologic surgery VTE rate","volume":"201","author":"Patel","year":"2019","journal-title":"J Urol"},{"issue":"12","key":"2024092007524876300_ocae187-B50","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.2146\/ajhp080389","article-title":"Evaluation of causes and frequency of medication errors during information technology downtime","volume":"66","author":"Hanuscak","year":"2009","journal-title":"Am J Health Syst Pharm"},{"issue":"4","key":"2024092007524876300_ocae187-B51","doi-asserted-by":"publisher","first-page":"S133","DOI":"10.1016\/j.annemergmed.2013.07.200","article-title":"Computerized decision-support decreases vancomycin underdosing errors with modest effect on dosing accuracy in critically ill patients in the emergency department","volume":"62","author":"Mohr","year":"2013","journal-title":"Ann Emer Med"},{"key":"2024092007524876300_ocae187-B52"},{"key":"2024092007524876300_ocae187-B53"},{"issue":"8","key":"2024092007524876300_ocae187-B54","doi-asserted-by":"publisher","first-page":"1796","DOI":"10.1093\/jamia\/ocab070","article-title":"Contemporary clinical decision support standards using Health Level Seven International Fast Healthcare Interoperability Resources","volume":"28","author":"Strasberg","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2024092007524876300_ocae187-B55"},{"key":"2024092007524876300_ocae187-B56","volume-title":"Introduction to Healthcare Quality Management","author":"Spath","year":"2018","edition":"3rd ed"},{"issue":"7","key":"2024092007524876300_ocae187-B57","doi-asserted-by":"publisher","first-page":"862","DOI":"10.1093\/jamia\/ocy041","article-title":"Using statistical anomaly detection models to find clinical decision support malfunctions","volume":"25","author":"Ray","year":"2018","journal-title":"J Am Med Inform Assoc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2405\/59206335\/ocae187.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/10\/2405\/59206335\/ocae187.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T07:53:16Z","timestamp":1726818796000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/10\/2405\/7724060"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,30]]},"references-count":57,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,7,30]]},"published-print":{"date-parts":[[2024,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae187","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,10]]},"published":{"date-parts":[[2024,7,30]]}}}