{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,18]],"date-time":"2026-11-18T17:50:08Z","timestamp":1795024208029,"version":"4.10.2"},"reference-count":28,"publisher":"American Academy of Pediatrics (AAP)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,2,1]]},"abstract":"<jats:sec>\n                  <jats:title>BACKGROUND AND OBJECTIVE<\/jats:title>\n                  <jats:p>This study aimed to develop and evaluate an algorithm to reduce the chart review burden of improvement efforts by automatically labeling antibiotic selection as either guideline-concordant or -discordant based on electronic health record data for patients with community-acquired pneumonia (CAP).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>METHODS<\/jats:title>\n                  <jats:p>We developed a 3-part algorithm using structured and unstructured data to assess adherence to an institutional CAP clinical practice guideline. The algorithm was applied to retrospective data for patients seen with CAP from 2017 to 2019 at a tertiary children\u2019s hospital. Performance metrics included positive predictive value (precision), sensitivity (recall), and F1 score (harmonized mean), with macro-weighted averages. Two physician reviewers independently assigned \u201cactual\u201d labels based on manual chart review.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>RESULTS<\/jats:title>\n                  <jats:p>Of 1345 patients with CAP, 893 were included in the training cohort and 452 in the validation cohort. Overall, the model correctly labeled 435 of 452 (96%) patients. Of the 286 patients who met guideline inclusion criteria, 193 (68%) were labeled as having received guideline-concordant antibiotics, 48 (17%) were labeled as likely in a scenario in which deviation from the clinical practice guideline was appropriate, and 45 (16%) were given the final label of \u201cpossibly discordant, needs review.\u201d The sensitivity was 0.96, the positive predictive value was 0.97, and the F1 was 0.96.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>CONCLUSIONS<\/jats:title>\n                  <jats:p>An automated algorithm that uses structured and unstructured electronic health record data can accurately assess the guideline concordance of antibiotic selection for CAP. This tool has the potential to improve the efficiency of improvement efforts by reducing the manual chart review needed for quality measurement.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1542\/hpeds.2023-007418","type":"journal-article","created":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T08:07:26Z","timestamp":1706602046000},"page":"137-145","source":"Crossref","is-referenced-by-count":9,"title":["An Algorithm to Assess Guideline Concordance of Antibiotic Choice in Community-Acquired Pneumonia"],"prefix":"10.1542","volume":"14","author":[{"given":"Julia K.W.","family":"Yarahuan","sequence":"first","affiliation":[{"name":"Department of Pediatrics, Divisions of aGeneral Pediatrics"},{"name":"bDepartment of Pediatrics, Emory University School of Medicine and Division of Hospital Medicine, Children\u2019s Healthcare of Atlanta, Atlanta, Georgia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susannah","family":"Kisvarday","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Divisions of aGeneral Pediatrics"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eugene","family":"Kim","sequence":"additional","affiliation":[{"name":"cDepartment of Anesthesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam P.","family":"Yan","sequence":"additional","affiliation":[{"name":"dHematology and Oncology"},{"name":"eDepartment of Pediatrics, The University of Toronto and Division of Hematology Oncology, The Hospital of Sick Children, Toronto, Ontario, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mari M.","family":"Nakamura","sequence":"additional","affiliation":[{"name":"fInfectious Diseases"},{"name":"gAntimicrobial Stewardship Program"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah B.","family":"Jones","sequence":"additional","affiliation":[{"name":"gAntimicrobial Stewardship Program"},{"name":"hDepartment of Pharmacy, Boston Children\u2019s Hospital, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan D.","family":"Hron","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Divisions of aGeneral Pediatrics"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"417","published-online":{"date-parts":[[2024,1,30]]},"reference":[{"key":"2024020102581236900_B1","author":"World Health Organization"},{"issue":"3","key":"2024020102581236900_B2","doi-asserted-by":"crossref","first-page":"e212007","DOI":"10.1001\/jamanetworkopen.2021.2007","article-title":"Assessment of the appropriateness of antimicrobial use in US hospitals","volume":"4","author":"Magill","year":"2021","journal-title":"JAMA Netw Open"},{"issue":"5","key":"2024020102581236900_B3","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1007\/s11908-016-0521-1","article-title":"Recent developments in pediatric community-acquired pneumonia","volume":"18","author":"McCulloh","year":"2016","journal-title":"Curr Infect Dis Rep"},{"issue":"9","key":"2024020102581236900_B4","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1542\/pir.2016-0183","article-title":"Management of pediatric community-acquired bacterial pneumonia","volume":"38","author":"Messinger","year":"2017","journal-title":"Pediatr Rev"},{"key":"2024020102581236900_B5","author":"Choosing Wisely"},{"key":"2024020102581236900_B6","author":"The Children\u2019s Hospital of Philadelphia"},{"key":"2024020102581236900_B7","author":"Seattle Children\u2019s Hospital"},{"issue":"7","key":"2024020102581236900_B8","doi-asserted-by":"crossref","first-page":"e25","DOI":"10.1093\/cid\/cir531","article-title":"The management of community-acquired pneumonia in infants and children older than 3 months of age: clinical practice guidelines by the Pediatric Infectious Diseases Society and the Infectious Diseases Society of America","volume":"53","author":"Bradley","year":"2011","journal-title":"Clin Infect Dis"},{"issue":"7","key":"2024020102581236900_B9","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1186\/2047-783X-16-7-315","article-title":"Guideline-adherent initial intravenous antibiotic therapy for hospital-acquired\/ventilator-associated pneumonia is clinically superior, saves lives and is cheaper than non guideline adherent therapy","volume":"16","author":"Wilke","year":"2011","journal-title":"Eur J Med Res"},{"issue":"16","key":"2024020102581236900_B10","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1093\/eurheartj\/ehi251","article-title":"Adherence to guidelines is a predictor of outcome in chronic heart failure: the MAHLER survey","volume":"26","author":"Komajda","year":"2005","journal-title":"Eur Heart J"},{"issue":"3","key":"2024020102581236900_B11","doi-asserted-by":"crossref","first-page":"e597","DOI":"10.1542\/peds.2011-1533","article-title":"Impact of a guideline on management of children hospitalized with community-acquired pneumonia","volume":"129","author":"Newman","year":"2012","journal-title":"Pediatrics"},{"issue":"1","key":"2024020102581236900_B12","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1186\/s40064-016-3057-9","article-title":"Venous thromboembolism prophylaxis in patients undergoing abdominal and pelvic cancer surgery: adherence and compliance to ACCP guidelines in DIONYS registry","volume":"5","author":"Geahchan","year":"2016","journal-title":"Springerplus"},{"issue":"6","key":"2024020102581236900_B13","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1016\/j.jogn.2016.07.005","article-title":"Adherence to the women\u2019s preventive services guidelines in the affordable care act","volume":"45","author":"Tinkle","year":"2016","journal-title":"J Obstet Gynecol Neonatal Nurs"},{"issue":"8","key":"2024020102581236900_B14","first-page":"II2","article-title":"Changing provider behavior: an overview of systematic reviews of interventions","volume":"39","author":"Grimshaw","year":"2001","journal-title":"Med Care"},{"issue":"1","key":"2024020102581236900_B15","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1542\/peds.2014-3047","article-title":"Antibiotic choice for children hospitalized with pneumonia and adherence to national guidelines","volume":"136","author":"Williams","year":"2015","journal-title":"Pediatrics"},{"issue":"3","key":"2024020102581236900_B16","first-page":"88","article-title":"Challenges of medical record abstraction in a long-term follow-up study","volume":"48","author":"Ahmed","year":"2021","journal-title":"J Registry Manag"},{"key":"2024020102581236900_B17","author":"R Core Team; R Foundation for Statistical Computing"},{"key":"2024020102581236900_B18","author":"RStudio Team; RStudio, PBC"},{"key":"2024020102581236900_B19","author":"Wickham"},{"key":"2024020102581236900_B20","author":"World Health Organization"},{"issue":"5","key":"2024020102581236900_B21","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1093\/jamia\/ocv180","article-title":"Extracting information from the text of electronic medical records to improve case detection: a systematic review","volume":"23","author":"Ford","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2024020102581236900_B22","author":"Grandini"},{"issue":"12","key":"2024020102581236900_B23","doi-asserted-by":"crossref","first-page":"2716","DOI":"10.1093\/jamia\/ocab170","article-title":"Extracting social determinants of health from electronic health records using natural language processing: a systematic review","volume":"28","author":"Patra","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2024020102581236900_B24","doi-asserted-by":"crossref","first-page":"ooac114","DOI":"10.1093\/jamiaopen\/ooac114","article-title":"Development and evaluation of an interoperable natural language processing system for identifying pneumonia across clinical settings of care and institutions","volume":"5","author":"Chapman","year":"2022","journal-title":"JAMIA Open"},{"key":"2024020102581236900_B25","doi-asserted-by":"crossref","first-page":"836733","DOI":"10.3389\/fdgth.2022.836733","article-title":"A method to advance adolescent sexual health research: automated algorithm finds sexual history documentation","volume":"4","author":"Robertson","year":"2022","journal-title":"Front Digit Health"},{"issue":"10","key":"2024020102581236900_B26","doi-asserted-by":"crossref","first-page":"e13377","DOI":"10.1371\/journal.pone.0013377","article-title":"Combining free text and structured electronic medical record entries to detect acute respiratory infections","volume":"5","author":"DeLisle","year":"2010","journal-title":"PLoS One"},{"issue":"3","key":"2024020102581236900_B27","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1093\/jamia\/ocab236","article-title":"Sepsis prediction, early detection, and identification using clinical text for machine learning: a systematic review","volume":"29","author":"Yan","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2024020102581236900_B28","author":"Chiticariu"}],"container-title":["Hospital Pediatrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article-pdf\/14\/2\/137\/1593633\/hpeds.2023-007418.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article-pdf\/14\/2\/137\/1593633\/hpeds.2023-007418.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T02:58:40Z","timestamp":1706756320000},"score":1,"resource":{"primary":{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article\/14\/2\/137\/196492\/An-Algorithm-to-Assess-Guideline-Concordance-of"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,30]]},"references-count":28,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,1,30]]},"published-print":{"date-parts":[[2024,2,1]]}},"URL":"https:\/\/doi.org\/10.1542\/hpeds.2023-007418","relation":{},"ISSN":["2154-1663","2154-1671"],"issn-type":[{"value":"2154-1663","type":"print"},{"value":"2154-1671","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,30]]}}}