{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,18]],"date-time":"2025-04-18T04:19:02Z","timestamp":1744949942584,"version":"3.40.4"},"reference-count":21,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2025,2,4]],"date-time":"2025-02-04T00:00:00Z","timestamp":1738627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Science","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>To assess the prevalence of recommended design elements in implemented electronic health record (EHR) interruptive alerts across pediatric care settings.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We conducted a 3-phase mixed-methods cross-sectional study. Phase 1 involved developing a codebook for alert content classification. Phase 2 identified the most frequently interruptive alerts at participating sites. Phase 3 applied the codebook to classify alerts. Inter-rater reliability (IRR) for the codebook and descriptive statistics for alert design contents were reported.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We classified alert content on design elements such as the rationale for the alert's appearance, the hazard of ignoring it, directive versus informational content, administrative purpose, and whether it aligned with one of the Institute of Medicine\u2019s (IOM) domains of healthcare quality. Most design elements achieved an IRR above 0.7, with the exceptions for identifying directive content outside of an alert (IRR 0.58) and whether an alert was for administrative purposes only (IRR 0.36). IRR was poor for all IOM domains except equity. Institutions varied widely in the number of unique alerts and their designs. 78% of alerts stated their purpose, over half were directive, and 13% were informational. Only 2%-20% of alerts explained the consequences of inaction.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>This study raises important questions about the optimal balance of alert functions and desirable features of alert representation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Our study provides the first multi-center analysis of EHR alert design elements in pediatric care settings, revealing substantial variation in content and design. These findings underline the need for future research to experimentally explore EHR alert design best practices to improve efficiency and effectiveness.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaf013","type":"journal-article","created":{"date-parts":[[2025,2,4]],"date-time":"2025-02-04T16:11:18Z","timestamp":1738685478000},"page":"682-688","source":"Crossref","is-referenced-by-count":0,"title":["Alert design in the real world: a cross-sectional analysis of interruptive alerting at 9 academic pediatric health systems"],"prefix":"10.1093","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2109-5769","authenticated-orcid":false,"given":"Swaminathan","family":"Kandaswamy","sequence":"first","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine , Atlanta, GA 30322,","place":["United States"]}]},{"given":"Julia K W","family":"Yarahuan","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine , Atlanta, GA 30322,","place":["United States"]},{"name":"Division of Hospital Medicine, Children\u2019s Healthcare of Atlanta , Atlanta, GA 30329,","place":["United States"]}]},{"given":"Elizabeth A","family":"Dobler","sequence":"additional","affiliation":[{"name":"Department of Clinical Informatics, Ann and Robert H Lurie Children's Hospital of Chicago , Chicago, IL 60611,","place":["United States"]},{"name":"Department of Pediatrics, Northwestern University Feinberg School of Medicine , Chicago, IL 60611,","place":["United States"]}]},{"given":"Matthew J","family":"Molloy","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Cincinnati College of Medicine , Cincinnati, OH 45221,","place":["United States"]},{"name":"Division of Hospital Medicine and Biomedical Informatics, Cincinnati Children\u2019s Hospital Medical Center , Cincinnati, OH 45229,","place":["United States"]}]},{"given":"Lindsey A","family":"Knake","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Division of Neonatology, University of Iowa , Iowa City, IA 52242,","place":["United States"]},{"name":"Stead Family Children's Hospital , Iowa City, IA 52242,","place":["United States"]}]},{"given":"Sean M","family":"Hernandez","sequence":"additional","affiliation":[{"name":"Department of General Internal Medicine, Wake Forest School of Medicine , Winston-Salem, NC 27101,","place":["United States"]},{"name":"Primary Care, Miami Veteran\u2019s Affairs , Miami, FL 33125,","place":["United States"]}]},{"given":"Anne A","family":"Fallon","sequence":"additional","affiliation":[{"name":"Division of Pediatric Hospital Medicine, Department of Pediatrics, University of Rochester Medical Center , Rochester, NY 14642,","place":["United States"]}]},{"given":"Lauren M","family":"Hess","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Baylor College of Medicine , Houston, TX 77030,","place":["United States"]},{"name":"Pediatric Hospital Medicine, Texas Children\u2019s Hospital , Houston, TX 77030,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2292-9147","authenticated-orcid":false,"given":"Allison B","family":"McCoy","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Vanderbilt University Medical Center , Nashville, TN 37232,","place":["United States"]}]},{"given":"Regine M","family":"Fortunov","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Baylor College of Medicine , Houston, TX 77030,","place":["United States"]},{"name":"Division of Neonatology, Texas Children\u2019s Hospital , Houston, TX 77030,","place":["United States"]}]},{"given":"Eric S","family":"Kirkendall","sequence":"additional","affiliation":[{"name":"Department of General Internal Medicine, Wake Forest School of Medicine , Winston-Salem, NC 27101,","place":["United States"]},{"name":"Department of Pediatrics, Wake Forest School of Medicine , Winston-Salem, NC 27101,","place":["United States"]}]},{"given":"Naveen","family":"Muthu","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine , Atlanta, GA 30322,","place":["United States"]},{"name":"Division of Hospital Medicine, Children\u2019s Healthcare of Atlanta , Atlanta, GA 30329,","place":["United States"]}]},{"given":"Evan W","family":"Orenstein","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine , Atlanta, GA 30322,","place":["United States"]},{"name":"Division of Hospital Medicine, Children\u2019s Healthcare of Atlanta , Atlanta, GA 30329,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3392-2795","authenticated-orcid":false,"given":"Adam C","family":"Dziorny","sequence":"additional","affiliation":[{"name":"Division of Pediatric Hospital Medicine, Department of Pediatrics, University of Rochester Medical Center , Rochester, NY 14642,","place":["United States"]},{"name":"Division of Critical Care Medicine, Golisano Children\u2019s Hospital at Strong , Rochester, NY 14642,","place":["United States"]}]},{"given":"Juan D","family":"Chaparro","sequence":"additional","affiliation":[{"name":"Division of Clinical Informatics, Nationwide Children\u2019s Hospital , Columbus, OH 43205,","place":["United States"]},{"name":"Department of Pediatrics, The Ohio State University College of Medicine , Columbus, OH 43210,","place":["United States"]}]}],"member":"286","published-online":{"date-parts":[[2025,2,4]]},"reference":[{"key":"2025041716422176700_ocaf013-B1","doi-asserted-by":"crossref","DOI":"10.4324\/9781498757461","volume-title":"Improving Outcomes with Clinical Decision Support: An Implementer\u2019s Guide","author":"Osheroff","year":"2012"},{"year":"2007","key":"2025041716422176700_ocaf013-B2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-38319-4"},{"key":"2025041716422176700_ocaf013-B3","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1111\/j.1742-6723.2008.01149.x","article-title":"Improving adherence to asthma clinical guidelines and discharge documentation from emergency departments: implementation of a dynamic and integrated electronic decision support system","volume":"21","author":"Kwok","year":"2009","journal-title":"Emerg Med Australas."},{"key":"2025041716422176700_ocaf013-B4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1001\/jama.1995.03530010043033","article-title":"Incidence of adverse drug events and potential adverse drug events: implications for prevention","volume":"274","author":"Bates","year":"1995","journal-title":"JAMA"},{"key":"2025041716422176700_ocaf013-B5","doi-asserted-by":"crossref","first-page":"m3216","DOI":"10.1136\/bmj.m3216","article-title":"Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials","volume":"370","author":"Kwan","year":"2020","journal-title":"BMJ."},{"key":"2025041716422176700_ocaf013-B6","doi-asserted-by":"publisher","first-page":"2654","DOI":"10.1093\/jamia\/ocab179","article-title":"Alert burden in pediatric hospitals: a cross-sectional analysis of six academic pediatric health systems using novel metrics","volume":"28","author":"Orenstein","year":"2021","journal-title":"J Am Med Inform Assoc"},{"year":"2020","key":"2025041716422176700_ocaf013-B7"},{"key":"2025041716422176700_ocaf013-B8","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1001\/jamapediatrics.2016.5123","article-title":"Video analysis of factors associated with response time to physiologic monitor alarms in a children\u2019s hospital","volume":"171","author":"Bonafide","year":"2017","journal-title":"JAMA Pediatr"},{"key":"2025041716422176700_ocaf013-B9","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1055\/s-0042-1748856","article-title":"Clinical decision support stewardship: best practices and techniques to monitor and improve interruptive alerts","volume":"13","author":"Chaparro","year":"2022","journal-title":"Appl Clin Inform"},{"key":"2025041716422176700_ocaf013-B10","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1186\/s13012-018-0772-3","article-title":"The GUIDES checklist: development of a tool to improve the successful use of guideline-based computerised clinical decision support","volume":"13","author":"Van de Velde","year":"2018","journal-title":"Implement Sci"},{"key":"2025041716422176700_ocaf013-B11","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1177\/1541931200044028101","article-title":"An integrative approach to warnings research","volume":"44","author":"Edworthy","year":"2000","journal-title":"Proc Hum Factors Ergon Soc Annu Meet"},{"journal-title":"Crossing the Quality Chasm a New Health System for the 21st Century","year":"2001","author":"Institute of Medicine (U.S.) & Committee on Quality of Health Care in America.\u00a0","key":"2025041716422176700_ocaf013-B12"},{"key":"2025041716422176700_ocaf013-B13","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1055\/s-0039-3402757","article-title":"Reducing interruptive alert burden using quality improvement methodology","volume":"11","author":"Chaparro","year":"2020","journal-title":"Appl Clin Inform"},{"key":"2025041716422176700_ocaf013-B14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1055\/s-0039-3402715","article-title":"Reducing alert burden in electronic health records: state of the art recommendations from four health systems","volume":"11","author":"McGreevey","year":"2020","journal-title":"Appl Clin Inform"},{"year":"2017","key":"2025041716422176700_ocaf013-B15"},{"key":"2025041716422176700_ocaf013-B16","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1542\/hpeds.2020-003509","article-title":"Physiologic monitor alarm burden and nurses\u2019 subjective workload in a children\u2019s hospital","volume":"11","author":"Rasooly","year":"2021","journal-title":"Hosp Pediatr"},{"key":"2025041716422176700_ocaf013-B17","doi-asserted-by":"crossref","first-page":"21501319231166921","DOI":"10.1177\/21501319231166921","article-title":"Burnout related to electronic health record use in primary care","volume":"14","author":"Budd","year":"2023","journal-title":"J Prim Care Community Health."},{"key":"2025041716422176700_ocaf013-B18","doi-asserted-by":"crossref","first-page":"753","DOI":"10.7326\/M16-0961","article-title":"Allocation of physician time in ambulatory practice: a time and motion study in 4 specialties","volume":"165","author":"Sinsky","year":"2016","journal-title":"Ann Intern Med"},{"key":"2025041716422176700_ocaf013-B19","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1136\/bmj.38398.500764.8F","article-title":"Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success","volume":"330","author":"Kawamoto","year":"2005","journal-title":"BMJ"},{"key":"2025041716422176700_ocaf013-B20","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1197\/jamia.M1370","article-title":"Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality","volume":"10","author":"Bates","year":"2003","journal-title":"J Am Med Inform Assoc."},{"key":"2025041716422176700_ocaf013-B21","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1136\/jamia.2010.005264","article-title":"A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems","volume":"17","author":"Phansalkar","year":"2010","journal-title":"J Am Med Inform Assoc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/32\/4\/682\/61750727\/ocaf013.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/32\/4\/682\/61750727\/ocaf013.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,17]],"date-time":"2025-04-17T20:42:43Z","timestamp":1744922563000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/32\/4\/682\/7998587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,4]]},"references-count":21,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,2,4]]},"published-print":{"date-parts":[[2025,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaf013","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2025,4]]},"published":{"date-parts":[[2025,2,4]]}}}