{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T10:47:15Z","timestamp":1777027635362,"version":"3.51.4"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T00:00:00Z","timestamp":1634601600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,11,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Excessive electronic health record (EHR) alerts reduce the salience of actionable alerts. Little is known about the frequency of interruptive alerts across health systems and how the choice of metric affects which users appear to have the highest alert burden.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>(1) Analyze alert burden by alert type, care setting, provider type, and individual provider across 6 pediatric health systems. (2) Compare alert burden using different metrics.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We analyzed interruptive alert firings logged in EHR databases at 6 pediatric health systems from 2016\u20132019 using 4 metrics: (1) alerts per patient encounter, (2) alerts per inpatient-day, (3) alerts per 100 orders, and (4) alerts per unique clinician days (calendar days with at least 1 EHR log in the system). We assessed intra- and interinstitutional variation and how alert burden rankings differed based on the chosen metric.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Alert burden varied widely across institutions, ranging from 0.06 to 0.76 firings per encounter, 0.22 to 1.06 firings per inpatient-day, 0.98 to 17.42 per 100 orders, and 0.08 to 3.34 firings per clinician day logged in the EHR. Custom alerts accounted for the greatest burden at all 6 sites. The rank order of institutions by alert burden was similar regardless of which alert burden metric was chosen. Within institutions, the alert burden metric choice substantially affected which provider types and care settings appeared to experience the highest alert burden.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Estimates of the clinical areas with highest alert burden varied substantially by institution and based on the metric used.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab179","type":"journal-article","created":{"date-parts":[[2021,9,11]],"date-time":"2021-09-11T11:08:55Z","timestamp":1631358535000},"page":"2654-2660","source":"Crossref","is-referenced-by-count":25,"title":["Alert burden in pediatric hospitals: a cross-sectional analysis of six academic pediatric health systems using novel metrics"],"prefix":"10.1093","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3756-8575","authenticated-orcid":false,"given":"Evan W","family":"Orenstein","sequence":"first","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA"},{"name":"Division of Hospital Medicine, Children\u2019s Healthcare of Atlanta, Atlanta, Georgia, USA"}]},{"given":"Swaminathan","family":"Kandaswamy","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA"}]},{"given":"Naveen","family":"Muthu","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA"},{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"given":"Juan D","family":"Chaparro","sequence":"additional","affiliation":[{"name":"Division of Clinical Informatics, Nationwide Children\u2019s Hospital, Columbus, Ohio, USA"},{"name":"Department of Pediatrics, The Ohio State University, Columbus, Ohio, USA"}]},{"given":"Philip A","family":"Hagedorn","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Cincinnati, Cincinnati, Ohio, USA"},{"name":"Division of Hospital Medicine, Cincinnati Children\u2019s Hospital Medical Center, Cincinnati, Ohio, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3392-2795","authenticated-orcid":false,"given":"Adam C","family":"Dziorny","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Rochester School of Medicine, Rochester, New York, USA"},{"name":"Division of Critical Care Medicine, Golisano Children\u2019s Hospital at Strong, Rochester, New York, USA"}]},{"given":"Adam","family":"Moses","sequence":"additional","affiliation":[{"name":"Center for Healthcare Innovation, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA"}]},{"given":"Sean","family":"Hernandez","sequence":"additional","affiliation":[{"name":"Center for Healthcare Innovation, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA"},{"name":"Department of General Internal Medicine, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA"}]},{"given":"Amina","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"given":"Hannah B","family":"Huth","sequence":"additional","affiliation":[{"name":"Center for Healthcare Innovation, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0911-0823","authenticated-orcid":false,"given":"Jonathan M","family":"Beus","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA"},{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia, Philadelphia, Pennsylvania, USA"}]},{"given":"Eric S","family":"Kirkendall","sequence":"additional","affiliation":[{"name":"Center for Healthcare Innovation, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA"},{"name":"Department of Pediatrics, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA"}]}],"member":"286","published-online":{"date-parts":[[2021,10,19]]},"reference":[{"issue":"25","key":"2021120106305552900_ocab179-B1","doi-asserted-by":"crossref","first-page":"2526","DOI":"10.1056\/NEJMsa020847","article-title":"Improving safety with information technology","volume":"348","author":"Bates","year":"2003","journal-title":"N Engl J Med"},{"issue":"6","key":"2021120106305552900_ocab179-B2","doi-asserted-by":"crossref","first-page":"e207385","DOI":"10.1001\/jamanetworkopen.2020.7385","article-title":"Association of electronic health record use with physician fatigue and efficiency","volume":"3","author":"Khairat","year":"2020","journal-title":"JAMA Netw Open"},{"issue":"3","key":"2021120106305552900_ocab179-B3","doi-asserted-by":"crossref","first-page":"686","DOI":"10.4338\/ACI-2017-01-RA-0003","article-title":"Electronic health record alert-related workload as a predictor of burnout in primary care providers","volume":"8","author":"Gregory","year":"2017","journal-title":"Appl Clin Inform"},{"issue":"1","key":"2021120106305552900_ocab179-B4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.7326\/0003-4819-157-1-201207030-00450","article-title":"Effect of clinical decision-support systems","volume":"157","author":"Bright","year":"2012","journal-title":"Ann Intern Med"},{"issue":"1","key":"2021120106305552900_ocab179-B5","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1001\/jamainternmed.2018.5859","article-title":"Assessment of a targeted electronic health record intervention to reduce telemetry duration","volume":"179","author":"Najafi","year":"2019","journal-title":"JAMA Intern Med"},{"key":"2021120106305552900_ocab179-B6","article-title":"Effect of point-of-care computer reminders on physician behaviour: a systematic review","volume":"23","author":"Shojania","year":"2010","journal-title":"CMAJ"},{"issue":"03","key":"2021120106305552900_ocab179-B7","doi-asserted-by":"crossref","first-page":"802","DOI":"10.4338\/ACI-2013-12-RA-0103","article-title":"Drug interaction alert override rates in the Meaningful Use era: no evidence of progress","volume":"05","author":"Bryant","year":"2014","journal-title":"Appl Clin Inform"},{"key":"2021120106305552900_ocab179-B8","first-page":"345","author":"Mccoy"},{"key":"2021120106305552900_ocab179-B9","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1093\/jamia\/ocw072","article-title":"Alert override as a habitual behavior - a new perspective on a persistent problem","volume":"24","author":"Baysari","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2021120106305552900_ocab179-B10","doi-asserted-by":"crossref","first-page":"e1970","DOI":"10.1542\/peds.2012-3252","article-title":"A clinical case of electronic health record drug alert fatigue: consequences for patient outcome","volume":"131","author":"Carspecken","year":"2013","journal-title":"Pediatrics"},{"issue":"2","key":"2021120106305552900_ocab179-B11","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1197\/jamia.M1809","article-title":"Overriding of drug safety alerts in computerized physician order entry","volume":"13","author":"van der Sijs","year":"2006","journal-title":"J Am Med Inform Assoc"},{"key":"2021120106305552900_ocab179-B12","first-page":"541","article-title":"Optimization of drug-drug interaction alert rules in a pediatric hospital\u2019s electronic health record system using a visual analytics dashboard","volume":"21","author":"Simpao","year":"2014","journal-title":"J. Am. Med. Informatics Assoc"},{"key":"2021120106305552900_ocab179-B13","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1038\/nbt.3180","article-title":"Federalist principles for healthcare data networks","volume":"33","author":"Mandl","year":"2015","journal-title":"Nat Biotechnol"},{"key":"2021120106305552900_ocab179-B14","first-page":"46","article-title":"Reducing intrusive alert burden using quality improvement methodology","author":"Chaparro","year":"2020"},{"issue":"6","key":"2021120106305552900_ocab179-B15","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1002\/jhm.2331","article-title":"Association between exposure to nonactionable physiologic monitor alarms and response time in a children\u2019s hospital","volume":"10","author":"Bonafide","year":"2015","journal-title":"J Hosp Med"},{"issue":"2","key":"2021120106305552900_ocab179-B16","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1001\/jamapediatrics.2019.5001","article-title":"Association between mobile telephone interruptions and medication administration errors in a pediatric intensive care unit","volume":"174","author":"Bonafide","year":"2020","journal-title":"JAMA Pediatr"},{"issue":"5","key":"2021120106305552900_ocab179-B17","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1111\/j.1747-0803.2009.00328.x","article-title":"Development of a pediatric cardiology quality improvement collaborative: from inception to implementation. From the joint council on congenital heart disease quality Improvement task force","volume":"4","author":"Kugler","year":"2009","journal-title":"Congenit Heart Dis"},{"issue":"3","key":"2021120106305552900_ocab179-B18","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1016\/j.kint.2019.10.015","article-title":"A prospective multi-center quality improvement initiative (NINJA) indicates a reduction in nephrotoxic acute kidney injury in hospitalized children","volume":"97","author":"Goldstein","year":"2020","journal-title":"Kidney Int"},{"key":"2021120106305552900_ocab179-B19","first-page":"1","article-title":"International electronic health record-derived COVID-19 clinical course profiles: the 4CE consortium. NPJ Digit","volume":"3","author":"Brat","year":"2020","journal-title":"Med"},{"issue":"2","key":"2021120106305552900_ocab179-B20","doi-asserted-by":"crossref","first-page":"141","DOI":"10.2337\/cd19-0032","article-title":"Establishment of the T1D Exchange Quality Improvement Collaborative (T1DX-QI)","volume":"38","author":"Alonso","year":"2020","journal-title":"Clin Diabetes"},{"issue":"4","key":"2021120106305552900_ocab179-B21","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1002\/cpt.1754","article-title":"Analytic and data sharing options in real-world multidatabase studies of comparative effectiveness and safety of medical products","volume":"107","author":"Toh","year":"2020","journal-title":"Clin Pharmacol Ther"},{"issue":"4","key":"2021120106305552900_ocab179-B22","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1093\/aje\/kwy265","article-title":"Validity of privacy-protecting analytical methods that use only aggregate-level information to conduct multivariable-adjusted analysis in distributed data networks","volume":"188","author":"Li","year":"2019","journal-title":"Am J Epidemiol"},{"key":"2021120106305552900_ocab179-B23","doi-asserted-by":"crossref","first-page":"103421","DOI":"10.1016\/j.jbi.2020.103421","article-title":"FAIR data sharing: the roles of common data elements and harmonization","volume":"107","author":"Kush","year":"2020","journal-title":"J Biomed Inform"},{"issue":"4","key":"2021120106305552900_ocab179-B24","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1136\/amiajnl-2014-002743","article-title":"PEDSnet: a national pediatric learning health system","volume":"21","author":"Forrest","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2021120106305552900_ocab179-B25"},{"key":"2021120106305552900_ocab179-B26","first-page":"281","article-title":"Federating clinical data from six pediatric hospitals: process and initial results for microbiology from the PHIS+ consortium","volume":"2012","author":"Gouripeddi","year":"2012","journal-title":"AMIA Annu Symp Proc"},{"key":"2021120106305552900_ocab179-B27"},{"issue":"11","key":"2021120106305552900_ocab179-B28","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1016\/j.ijmedinf.2012.04.003","article-title":"Use of order sets in inpatient computerized provider order entry systems: a comparative analysis of usage patterns at seven sites","volume":"81","author":"Wright","year":"2012","journal-title":"Int J Med Inform"},{"issue":"12","key":"2021120106305552900_ocab179-B29","first-page":"987","article-title":"When order sets do not align with clinician workflow: assessing practice patterns in the electronic health record","volume":"28","author":"Li","year":"2019","journal-title":"BMJ Qual Saf"},{"key":"2021120106305552900_ocab179-B30","first-page":"348","article-title":"Quantifying and visualizing nursing flowsheet documentation burden in acute and critical care","volume":"2018","author":"Collins","year":"2018","journal-title":"AMIA Annu Symp Proc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/28\/12\/2654\/41325322\/ocab179.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/28\/12\/2654\/41325322\/ocab179.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T10:01:46Z","timestamp":1638352906000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/12\/2654\/6401984"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,19]]},"references-count":30,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,10,19]]},"published-print":{"date-parts":[[2021,11,25]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab179","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,12,1]]},"published":{"date-parts":[[2021,10,19]]}}}