{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T06:24:24Z","timestamp":1768458264164,"version":"3.49.0"},"reference-count":48,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T00:00:00Z","timestamp":1677024000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec><jats:title>Objective<\/jats:title><jats:p>Chest radiographs are frequently used to diagnose community-acquired pneumonia (CAP) for children in the acute care setting. Natural language processing (NLP)-based tools may be incorporated into the electronic health record and combined with other clinical data to develop meaningful clinical decision support tools for this common pediatric infection. We sought to develop and internally validate NLP algorithms to identify pediatric chest radiograph (CXR) reports with pneumonia.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>We performed a retrospective study of encounters for patients from six pediatric hospitals over a 3-year period. We utilized six NLP techniques: word embedding, support vector machines, extreme gradient boosting (XGBoost), light gradient boosting machines Na\u00efve Bayes and logistic regression. We evaluated their performance of each model from a validation sample of 1,350 chest radiographs developed as a stratified random sample of 35% admitted and 65% discharged patients when both using expert consensus and diagnosis codes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Of 172,662 encounters in the derivation sample, 15.6% had a discharge diagnosis of pneumonia in a primary or secondary position. The median patient age in the derivation sample was 3.7 years (interquartile range, 1.4\u20139.5 years). In the validation sample, 185\/1350 (13.8%) and 205\/1350 (15.3%) were classified as pneumonia by content experts and by diagnosis codes, respectively. Compared to content experts, Na\u00efve Bayes had the highest sensitivity (93.5%) and XGBoost had the highest F1 score (72.4). Compared to a diagnosis code of pneumonia, the highest sensitivity was again with the Na\u00efve Bayes (80.1%), and the highest F1 score was with the support vector machine (53.0%).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>NLP algorithms can accurately identify pediatric pneumonia from radiography reports. Following external validation and implementation into the electronic health record, these algorithms can facilitate clinical decision support and inform large database research.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fdgth.2023.1104604","type":"journal-article","created":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T05:48:55Z","timestamp":1677044935000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["The development of a novel natural language processing tool to identify pediatric chest radiograph reports with pneumonia"],"prefix":"10.3389","volume":"5","author":[{"given":"Nancy","family":"Rixe","sequence":"first","affiliation":[]},{"given":"Adam","family":"Frisch","sequence":"additional","affiliation":[]},{"given":"Zhendong","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Judith M.","family":"Martin","sequence":"additional","affiliation":[]},{"given":"Srinivasan","family":"Suresh","sequence":"additional","affiliation":[]},{"given":"Todd A.","family":"Florin","sequence":"additional","affiliation":[]},{"given":"Sriram","family":"Ramgopal","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,2,22]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1016\/S0140-6736(05)71877-8","article-title":"WHO estimates of the causes of death in children","volume":"365","author":"Bryce","year":"2005","journal-title":"Lancet"},{"key":"B2","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.idc.2017.11.002","article-title":"Pediatric community-acquired pneumonia in the United States: changing epidemiology, diagnostic and therapeutic challenges, and areas for future research","volume":"32","author":"Katz","year":"2018","journal-title":"Infect Dis Clin North Am"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2016-1019","article-title":"Predicting severe pneumonia outcomes in children","volume":"138","author":"Williams","year":"2016","journal-title":"Pediatrics"},{"key":"B4","doi-asserted-by":"publisher","first-page":"851","DOI":"10.1001\/jamapediatrics.2013.186","article-title":"Identifying pediatric community-acquired pneumonia hospitalizations: accuracy of administrative billing codes","volume":"167","author":"Williams","year":"2013","journal-title":"JAMA Pediatr"},{"key":"B5","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.1097\/INF.0b013e31825f2b10","article-title":"Variability in processes of care and outcomes among children hospitalized with community-acquired pneumonia","volume":"31","author":"Brogan","year":"2012","journal-title":"Pediatr Infect Dis J"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2018-0236","article-title":"Negative chest radiography and risk of pneumonia","volume":"142","author":"Lipsett","year":"2018","journal-title":"Pediatrics"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2019-2816","article-title":"Trends in chest radiographs for pneumonia in emergency departments","volume":"145","author":"Geanacopoulos","year":"2020","journal-title":"Pediatrics"},{"key":"B8","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1542\/peds.2014-3047","article-title":"Antibiotic choice for children hospitalized with pneumonia and adherence to national guidelines","volume":"136","author":"Williams","year":"2015","journal-title":"Pediatrics"},{"key":"B9","doi-asserted-by":"publisher","first-page":"e1141","DOI":"10.1542\/peds.2013-1614","article-title":"Narrow vs broad-spectrum antimicrobial therapy for children hospitalized with pneumonia","volume":"132","author":"Williams","year":"2013","journal-title":"Pediatrics"},{"key":"B10","doi-asserted-by":"publisher","first-page":"e823","DOI":"10.1542\/peds.2012-1285","article-title":"Influence of hospital guidelines on management of children hospitalized with pneumonia","volume":"130","author":"Neuman","year":"2012","journal-title":"Pediatrics"},{"key":"B11","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1093\/cid\/ciy031","article-title":"Validation of the pediatric infectious diseases society-infectious diseases society of America severity criteria in children with community-acquired pneumonia","volume":"67","author":"Florin","year":"2018","journal-title":"Clin Infect Dis"},{"key":"B12","doi-asserted-by":"publisher","first-page":"29","DOI":"10.7326\/0003-4819-157-1-201207030-00450","article-title":"Effect of clinical decision-support systems: a systematic review","volume":"157","author":"Bright","year":"2012","journal-title":"Ann Intern Med"},{"key":"B13","doi-asserted-by":"publisher","first-page":"2038","DOI":"10.1016\/j.cgh.2019.10.013","article-title":"Development of an automated algorithm to generate guideline-based recommendations for follow-up colonoscopy","volume":"18","author":"Karwa","year":"2020","journal-title":"Clin Gastroenterol Hepatol"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1257","DOI":"10.1016\/j.cgh.2014.05.013","article-title":"Current and future applications of natural language processing in the field of digestive diseases","volume":"12","author":"Hou","year":"2014","journal-title":"Clin Gastroenterol Hepatol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41390-022-02226.5","article-title":"Artificial intelligence-based clinical decision support in pediatrics","author":"Ramgopal","year":"2022","journal-title":"Pediatr Res"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1097\/CCM.0b013e3181b030d9","article-title":"Validation of the infectious disease society of America\/American thoracic society 2007 guidelines for severe community-acquired pneumonia","volume":"37","author":"Brown","year":"2009","journal-title":"Crit Care Med"},{"key":"B17","doi-asserted-by":"publisher","first-page":"e162","DOI":"10.2196\/jmir.6887","article-title":"Enhancing comparative effectiveness research with automated pediatric pneumonia detection in a multi-institutional clinical repository: a PHIS+ pilot study","volume":"19","author":"Meystre","year":"2017","journal-title":"J Med Internet Res"},{"key":"B18","doi-asserted-by":"publisher","first-page":"314","DOI":"10.1016\/j.jbi.2005.02.003","article-title":"Extracting information on pneumonia in infants using natural language processing of radiology reports","volume":"38","author":"Mendon\u00e7a","year":"2005","journal-title":"J Biomed Inform"},{"key":"B19","first-page":"994","author":"Narus","year":"2011"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1097\/CCE.0000000000000186","article-title":"Maximum Pao2 in the first 72\u2005h of intensive care is associated with risk-adjusted mortality in pediatric patients undergoing mechanical ventilation","volume":"2","author":"Pelletier","year":"2020","journal-title":"Crit Care Explor"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2431-14-199","article-title":"Pediatric complex chronic conditions classification system version 2: updated for ICD-10 and complex medical technology dependence and transplantation","volume":"14","author":"Feudtner","year":"2014","journal-title":"BMC Pediatr"},{"key":"B22","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1002\/jhm.949","article-title":"Differences in designations of observation care in US freestanding children\u2019s hospitals: are they virtual or real?","volume":"7","author":"Macy","year":"2012","journal-title":"J Hosp Med"},{"key":"B23","author":"Mikolov","year":""},{"key":"B24","author":"\u0158eh\u016f\u0159ek","year":""},{"key":"B25","first-page":"785","author":"Chen","year":"2016"},{"key":"B26","year":""},{"key":"B27","year":""},{"key":"B28","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach Learn"},{"key":"B29","volume-title":"Machine learning with R","author":"Lantz","year":"2019"},{"key":"B30","year":""},{"key":"B31","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1038\/s41746-020-0221-y","article-title":"An overview of clinical decision support systems: benefits, risks, and strategies for success","volume":"3","author":"Sutton","year":"2020","journal-title":"NPJ Digit Med"},{"key":"B32","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1136\/amiajnl-2011-000464","article-title":"Natural language processing: an introduction","volume":"18","author":"Nadkarni","year":"2011","journal-title":"J Am Med Informatics Assoc"},{"key":"B33","first-page":"1130","article-title":"Natural language processing and machine learning to enable clinical decision support for treatment of pediatric pneumonia","volume":"2020","author":"Smith","year":"2020","journal-title":"AMIA Annu Symp Proc"},{"key":"B34","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1136\/jamia.2000.0070593","article-title":"Automatic detection of acute bacterial pneumonia from chest x-ray reports","volume":"7","author":"Fiszman","year":"2000","journal-title":"J Am Med Informatics Assoc"},{"key":"B35","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1002\/pds.3418","article-title":"Natural language processing to identify pneumonia from radiology reports","volume":"22","author":"Dublin","year":"2013","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"B36","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1097\/00006454-199607000-00008","article-title":"Reliability of the chest radiograph in the diagnosis of lower respiratory infections in young children","volume":"15","author":"Davies","year":"1996","journal-title":"Pediatr Infect Dis J"},{"key":"B37","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/s10140-009-0854-2","article-title":"Intraobserver and interobserver agreement of the interpretation of pediatric chest radiographs","volume":"17","author":"Johnson","year":"2010","journal-title":"Emerg Radiol"},{"key":"B38","doi-asserted-by":"publisher","first-page":"94","DOI":"10.2307\/30141996","article-title":"Respiratory isolation of tuberculosis patients using clinical guidelines and an automated clinical decision support system","volume":"19","author":"Knirsch","year":"1998","journal-title":"Infect Control Hosp Epidemiol"},{"key":"B39","doi-asserted-by":"publisher","first-page":"2857","DOI":"10.1093\/jac\/dku191","article-title":"Impact of a computerized decision support system on compliance with guidelines on antibiotics prescribed for urinary tract infections in emergency departments: a multicentre prospective before-and-after controlled interventional study","volume":"69","author":"Demonchy","year":"2014","journal-title":"J Antimicrob Chemother."},{"key":"B40","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1197\/jamia.M3170","article-title":"Computerized clinical decision support for prescribing: provision does not guarantee uptake","volume":"17","author":"Moxey","year":"2010","journal-title":"J Am Med Informatics Assoc"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1097\/INF.0000000000003361","article-title":"Development of the novel pneumonia risk score to predict radiographic pneumonia in children","author":"Lipsett","year":"2021","journal-title":"Pediatr Infect Dis J"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2021-051405","article-title":"A prediction model for pediatric radiographic pneumonia","volume":"149","author":"Ramgopal","year":"2022","journal-title":"Pediatrics"},{"key":"B43","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1001\/jama.2018.17163","article-title":"Clinical decision support in the era of artificial intelligence","volume":"320","author":"Shortliffe","year":"2018","journal-title":"J Am Med Assoc"},{"key":"B44","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1148\/rg.2016150080","article-title":"Natural language processing technologies in radiology research and clinical applications","volume":"36","author":"Cai","year":"2016","journal-title":"Radiographics"},{"key":"B45","doi-asserted-by":"publisher","first-page":"2579","DOI":"10.1016\/j.procs.2013.05.444","article-title":"Comparative performance analysis of machine learning classifiers in detection of childhood pneumonia using chest radiographs","volume":"18","author":"Sousa","year":"2013","journal-title":"Procedia Comput Sci"},{"key":"B46","doi-asserted-by":"publisher","first-page":"e0253239","DOI":"10.1371\/journal.pone.0253239","article-title":"Deep learning for classification of pediatric chest radiographs by WHO\u2019s standardized methodology","volume":"16","author":"Chen","year":"2021","journal-title":"PLoS ONE"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1007\/s00247-022-05368-1443w","article-title":"Pediatric chest radiograph interpretation: how far has artificial intelligence come? A systematic literature review","author":"Padash","year":"2022","journal-title":"Pediatr Radiol"},{"key":"B48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1472-6947-11-51","article-title":"Predicting disease risks from highly imbalanced data using random forest","volume":"11","author":"Khalilia","year":"2011","journal-title":"BMC Med Inform Decis Mak"}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1104604\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T05:48:58Z","timestamp":1677044938000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1104604\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,22]]},"references-count":48,"alternative-id":["10.3389\/fdgth.2023.1104604"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2023.1104604","relation":{},"ISSN":["2673-253X"],"issn-type":[{"value":"2673-253X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,22]]},"article-number":"1104604"}}