{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T02:58:27Z","timestamp":1792810707467,"version":"4.5.0"},"reference-count":41,"publisher":"Georg Thieme Verlag KG","issue":"01","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Appl Clin Inform"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n          Objectives\u2003Clinical decision support (CDS) has promise for the implementation of antimicrobial stewardship programs (ASPs) in the emergency department (ED). We sought to assess the usability of a newly developed automated CDS to improve guideline-adherent antibiotic prescribing for pediatric community-acquired pneumonia (CAP) and urinary tract infection (UTI).<\/jats:p><jats:p>\n          Methods\u2003We conducted comparative usability testing between an automated, prototype CDS-enhanced discharge order set and standard order set, for pediatric CAP and UTI antibiotic prescribing. After an extensive user-centered design process, the prototype CDS was integrated into the electronic health record, used passive activation, and embedded locally adapted prescribing guidelines. Participants were randomized to interact with three simulated ED scenarios of children with CAP or UTI, across both systems. Measures included task completion, decision-making and usability errors, clinical actions (order set use and correct antibiotic selection), as well as objective measures of system usability, utility, and workload using the National Aeronautics and Space Administration Task Load Index (NASA-TLX). The prototype CDS was iteratively refined to optimize usability and workflow.<\/jats:p><jats:p>\n          Results\u2003Usability testing in 21 ED clinical providers demonstrated that, compared to the standard order sets, providers preferred the prototype CDS, with improvements in domains such as explanations of suggested antibiotic choices (p\u2009&lt;\u20090.001) and provision of additional resources on antibiotic prescription (p\u2009&lt;\u20090.001). Simulated use of the CDS also led to overall improved guideline-adherent prescribing, with a 31% improvement for CAP. A trend was present toward absolute workload reduction. Using the NASA-TLX, workload scores for the current system were median 26, interquartile ranges (IQR): 11 to 41 versus median 25, and IQR: 10.5 to 39.5 for the CDS system (p\u2009=\u20090.117).<\/jats:p><jats:p>\n          Conclusion\u2003Our CDS-enhanced discharge order set for ED antibiotic prescribing was strongly preferred by users, improved the accuracy of antibiotic prescribing, and trended toward reduced provider workload. The CDS was optimized for impact on guideline-adherent antibiotic prescribing from the ED and end-user acceptability to support future evaluative trials of ED ASPs.<\/jats:p>","DOI":"10.1055\/s-0042-1760082","type":"journal-article","created":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T23:51:42Z","timestamp":1675900302000},"page":"108-118","source":"Crossref","is-referenced-by-count":17,"title":["Evaluation of an Antimicrobial Stewardship Decision Support for Pediatric Infections"],"prefix":"10.1055","volume":"14","author":[{"given":"Erin A.","family":"McGonagle","sequence":"additional","affiliation":[{"name":"Department of Pediatrics and Emergency Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dean J.","family":"Karavite","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert W.","family":"Grundmeier","sequence":"additional","affiliation":[{"name":"Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah K.","family":"Schmidt","sequence":"additional","affiliation":[{"name":"Department of Pediatrics and Emergency Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Larissa S.","family":"May","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, University of California at Davis School of Medicine, Davis, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel M.","family":"Cohen","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, The Ohio State University School of Medicine, Columbus, Ohio, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea T.","family":"Cruz","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Baylor College of Medicine, Houston, Texas, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shin-Ping","family":"Tu","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of California at Davis School of Medicine, Davis, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lalit","family":"Bajaj","sequence":"additional","affiliation":[{"name":"Department of Pediatrics and Emergency Medicine, University of Colorado School of Medicine, Aurora, Colorado, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter S.","family":"Dayan","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine and Pediatrics, Columbia University College of Physicians and Surgeons, New York, New York, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rakesh D.","family":"Mistry","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Colorado School of Medicine, Aurora, Colorado, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2023,2,8]]},"reference":[{"key":"ref1","volume-title":"Antibiotic Resistance Threats in the United States","author":"CDC","year":"2019"},{"issue":"17","key":"ref2","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1001\/jama.2016.4151","article-title":"Prevalence of inappropriate antibiotic prescriptions among us ambulatory care visits, 2010-2011","volume":"315","author":"K E Fleming-Dutra","year":"2016","journal-title":"JAMA"},{"issue":"02","key":"ref3","doi-asserted-by":"crossref","first-page":"e20181056","DOI":"10.1542\/peds.2018-1056","article-title":"Antibiotic prescribing for children in United States Emergency Departments: 2009-2014","volume":"143","author":"N M Poole","year":"2019","journal-title":"Pediatrics"},{"issue":"06","key":"ref4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.15585\/mmwr.rr6506a1","article-title":"Core elements of outpatient antibiotic stewardship","volume":"65","author":"G V Sanchez","year":"2016","journal-title":"MMWR Recomm Rep"},{"issue":"04","key":"ref5","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1086\/665010","article-title":"Policy statement on antimicrobial stewardship by the Society for Healthcare Epidemiology of America (SHEA), the Infectious Diseases Society of America (IDSA), and the Pediatric Infectious Diseases Society (PIDS)","volume":"33","author":"Society for Healthcare Epidemiology of America","year":"2012","journal-title":"Infect Control Hosp Epidemiol"},{"issue":"S 05","key":"ref6","first-page":"S397","article-title":"Combating antimicrobial resistance: policy recommendations to save lives","volume":"52","author":"B Spellberg","year":"2011","journal-title":"Clin Infect Dis"},{"issue":"11","key":"ref7","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1093\/cid\/cis242","article-title":"Impact of an antimicrobial stewardship intervention on shortening the duration of therapy for community-acquired pneumonia","volume":"54","author":"E Avdic","year":"2012","journal-title":"Clin Infect Dis"},{"issue":"09","key":"ref8","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1086\/502278","article-title":"Favorable impact of a multidisciplinary antibiotic management program conducted during 7 years","volume":"24","author":"P Carling","year":"2003","journal-title":"Infect Control Hosp Epidemiol"},{"issue":"S 01","key":"ref9","first-page":"S4","article-title":"Antimicrobial stewardship for inpatient facilities","volume":"6","author":"C A Ohl","year":"2011","journal-title":"J Hosp Med"},{"issue":"01","key":"ref11","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.annemergmed.2012.09.002","article-title":"A call to action for antimicrobial stewardship in the emergency department: approaches and strategies","volume":"62","author":"L May","year":"2013","journal-title":"Ann Emerg Med"},{"issue":"05","key":"ref12","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1001\/jamapediatrics.2015.79","article-title":"The battle against antimicrobial resistance: time for the emergency department to join the fight","volume":"169","author":"R D Mistry","year":"2015","journal-title":"JAMA Pediatr"},{"issue":"04","key":"ref13","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1017\/ice.2017.3","article-title":"Current state of antimicrobial stewardship in children's hospital emergency departments","volume":"38","author":"R D Mistry","year":"2017","journal-title":"Infect Control Hosp Epidemiol"},{"issue":"11","key":"ref14","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.1016\/j.ajic.2017.06.005","article-title":"Working at the intersection of context, culture, and technology: provider perspectives on antimicrobial stewardship in the emergency department using electronic health record clinical decision support","volume":"45","author":"P Chung","year":"2017","journal-title":"Am J Infect Control"},{"issue":"04","key":"ref15","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1055\/s-0040-1715893","article-title":"Considerations for designing EHR-embedded clinical decision support systems for antimicrobial stewardship in pediatric emergency departments","volume":"11","author":"M Ozkaynak","year":"2020","journal-title":"Appl Clin Inform"},{"key":"ref16","first-page":"218","article-title":"Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces","author":"A W Kushniruk","year":"1997","journal-title":"Proc AMIA Annu Fall Symp"},{"issue":"06","key":"ref17","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1093\/jamia\/ocv050","article-title":"Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors","volume":"22","author":"R M Ratwani","year":"2015","journal-title":"J Am Med Inform Assoc"},{"issue":"05","key":"ref18","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1093\/jamia\/ocaa329","article-title":"Advancing electronic health record vendor usability maturity: progress and next steps","volume":"28","author":"A Z Hettinger","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"05","key":"ref19","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1197\/jamia.M2384","article-title":"Unintended consequences of information technologies in health care\u2014an interactive sociotechnical analysis","volume":"14","author":"M I Harrison","year":"2007","journal-title":"J Am Med Inform Assoc"},{"issue":"03","key":"ref20","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.mayocp.2019.09.024","article-title":"The association between perceived electronic health record usability and professional burnout among US physicians","volume":"95","author":"E R Melnick","year":"2020","journal-title":"Mayo Clin Proc"},{"issue":"05","key":"ref21","doi-asserted-by":"crossref","first-page":"974","DOI":"10.1093\/jamia\/ocaa339","article-title":"A systematic review of contributing factors of and solutions to electronic health record-related impacts on physician well-being","volume":"28","author":"O T Nguyen","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"ref22","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1136\/bmj.38398.500764.8F","article-title":"Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success","volume":"330","author":"K Kawamoto","year":"2005","journal-title":"BMJ"},{"issue":"01","key":"ref23","doi-asserted-by":"crossref","first-page":"29","DOI":"10.7326\/0003-4819-157-1-201207030-00450","article-title":"Effect of clinical decision-support systems: a systematic review","volume":"157","author":"T J Bright","year":"2012","journal-title":"Ann Intern Med"},{"issue":"01","key":"ref24","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1186\/s13012-022-01199-3","article-title":"Do providers use computerized clinical decision support systems? A systematic review and meta-regression of clinical decision support uptake","volume":"17","author":"A Kouri","year":"2022","journal-title":"Implement Sci"},{"issue":"01","key":"ref25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1055\/s-0038-1676587","article-title":"CDS in a learning health care system: identifying physicians' reasons for rejection of best-practice recommendations in pneumonia through computerized clinical decision support","volume":"10","author":"B E Jones","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"07","key":"ref26","doi-asserted-by":"crossref","first-page":"e25","DOI":"10.1093\/cid\/cir531","article-title":"The management of community-acquired pneumonia in infants and children older than 3 months of age: clinical practice guidelines by the Pediatric Infectious Diseases Society and the Infectious Diseases Society of America","volume":"53","author":"J S Bradley","year":"2011","journal-title":"Clin Infect Dis"},{"issue":"03","key":"ref27","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1542\/peds.2011-1330","article-title":"Urinary tract infection: clinical practice guideline for the diagnosis and management of the initial UTI in febrile infants and children 2 to 24 months","volume":"128","author":"K B Roberts","year":"2011","journal-title":"Pediatrics"},{"key":"ref28","volume-title":"Improving Medication Use and Outcomes with Clinical Decision Support: A Step by Step Guide. 1st ed","author":"J A Osheroff","year":"2009"},{"key":"ref29","volume-title":"Usability Engineering: Scenario-Based Development of Human-Computer Interaction","author":"M B Rosson","year":"2001"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.jbi.2018.01.001","article-title":"Ten factors to consider when developing usability scenarios and tasks for health information technology","volume":"78","author":"A L Russ","year":"2018","journal-title":"J Biomed Inform"},{"key":"ref31","volume-title":"Cox, Gertrude M, Experimental Designs","author":"W G Cochran","year":"1957"},{"key":"ref33","volume-title":"Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research","author":"S G Hart","year":"1988"},{"issue":"09","key":"ref34","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1177\/154193120605000909","article-title":"NASA-task load index (NASA-TLX); 20 years later","volume":"50","author":"S G Hart","year":"2006","journal-title":"Proc Hum Factors Ergon Soc Annu Meet"},{"issue":"09","key":"ref35","doi-asserted-by":"crossref","first-page":"e19472","DOI":"10.2196\/19472","article-title":"Validation of the Raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) questionnaire to assess perceived workload in patient monitoring tasks: pooled analysis study using mixed models","volume":"22","author":"S Said","year":"2020","journal-title":"J Med Internet Res"},{"issue":"04","key":"ref36","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1055\/s-0038-1675179","article-title":"User testing an information foraging tool for ambulatory surgical site infection surveillance","volume":"9","author":"D J Karavite","year":"2018","journal-title":"Appl Clin Inform"},{"issue":"01","key":"ref37","doi-asserted-by":"crossref","first-page":"e1919301","DOI":"10.1001\/jamanetworkopen.2019.19301","article-title":"Association of health record visualizations with physicians' cognitive load when prioritizing hospitalized patients","volume":"3","author":"A H Pollack","year":"2020","journal-title":"JAMA Netw Open"},{"key":"ref39","volume-title":"How to Report Statistics in Medicine: Annotated Guidelines for Authors, Editors, and Reviewers","author":"T A Lang","year":"2006"},{"issue":"04","key":"ref40","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1177\/014662168801200410","article-title":"Set correlation and contingency tables","volume":"12","author":"J Cohen","year":"1988","journal-title":"Appl Psychol Meas"},{"issue":"11","key":"ref41","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1016\/j.ijmedinf.2012.02.009","article-title":"Integrating usability testing and think-aloud protocol analysis with \u201cnear-live\u201d clinical simulations in evaluating clinical decision support","volume":"81","author":"A C Li","year":"2012","journal-title":"Int J Med Inform"},{"issue":"02","key":"ref42","doi-asserted-by":"crossref","first-page":"e14","DOI":"10.2196\/humanfactors.4537","article-title":"Usability testing of a complex clinical decision support tool in the emergency department: lessons learned","volume":"2","author":"A Press","year":"2015","journal-title":"JMIR Human Factors"},{"key":"ref43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijmedinf.2017.06.003","article-title":"\u201cThink aloud\u201d and \u201cNear live\u201d usability testing of two complex clinical decision support tools","volume":"106","author":"S Richardson","year":"2017","journal-title":"Int J Med Inform"},{"issue":"01","key":"ref44","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1055\/s-0040-1718757","article-title":"User-centered design in pediatric acute care settings antimicrobial stewardship","volume":"12","author":"M J Ward","year":"2021","journal-title":"Appl Clin Inform"}],"container-title":["Applied Clinical Informatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0042-1760082.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T23:52:38Z","timestamp":1675900358000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0042-1760082"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1]]},"references-count":41,"journal-issue":{"issue":"01","published-online":{"date-parts":[[2023,1,4]]},"published-print":{"date-parts":[[2023,1]]}},"URL":"https:\/\/doi.org\/10.1055\/s-0042-1760082","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1869-0327"],"issn-type":[{"value":"1869-0327","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1]]}}}