{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T07:14:36Z","timestamp":1788506076294,"version":"build-2803163510"},"reference-count":21,"publisher":"Ovid Technologies (Wolters Kluwer Health)","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:sec>\n                    <jats:title>Objectives:<\/jats:title>\n                    <jats:p>Firearm injuries are a leading cause of pediatric mortality, but may not be adequately identified by International Classification of Diseases (ICD) codes. Natural language processing (NLP) could improve identification. We derived an NLP model from medical narratives and compared the sensitivity and specificity of ICD codes and the NLP models to identify pediatric acute firearm injury (AFI).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>Retrospective study of ED visits by patients (aged 0 to 17\u00a0y) presenting to 7 pediatric emergency departments (ED) with a potential AFI between 2011 and 2019. A medical narrative review was performed to identify AFI narratives. These narratives, plus randomly selected narratives, underwent language feature extraction with logistic regression to identify topics significantly associated with the categories. Two Random Forest models were created: model 1 on all narratives associated with a potential AFI and model 2 using the confirmed AFI narratives. Model 2 was then applied to a new, unreviewed selection of random narratives. A second round of medical narrative review was performed on the random narratives, including those identified by model 2 as AFI. Sensitivity and specificity of ICD and NLP for the identification of AFI were calculated.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>A total of 2407 ED visits for potential AFI were identified. Of those, 1183 narratives were annotated by narrative review as AFI. In the randomly selected narratives (n=1150), 47 additional AFI were identified, 16 by NLP and 31 by narrative review, for a total of 1230 AFI. ICD codes correctly identified 1171 (95.2%) AFI, with a sensitivity of 95.2% (93.8% to 96.3%) and specificity of 93.5% (92.6% to 94.4%). NLP correctly identified 1041 (84.6%) AFIs in the final data set with a sensitivity of 84.6% (82.5% to 86.6%) and specificity of 94.7% (93.8% to 95.5%).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>ICD and NLP both had acceptable sensitivity and specificity for identifying pediatric AFI. Future directions include evaluating newer NLP models to address false positives and the identification of the intent of injury.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/pec.0000000000003695","type":"journal-article","created":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T07:00:10Z","timestamp":1788505210000},"update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":0,"title":["Comparing ICD Codes and Traditional Natural Language Processing to Identify Acute Pediatric Firearm Injury"],"prefix":"10.1097","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6659-695X","authenticated-orcid":false,"given":"Katie A.","family":"Donnelly","sequence":"first","affiliation":[{"name":"Children\u2019s National Hospital, The George Washington University, Washington, DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sukanya","family":"Joshi","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marci","family":"Fornari","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Cooper University Hospital, Cooper Medical School of Rowan University, Camden, NJ"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Megan M.","family":"Attridge","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Ann & Robert H. Lurie Children\u2019s Hospital, Northwestern University Feinberg School of Medicine, Chicago, IL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sharath C.","family":"Guntuku","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Larry","family":"Cook","sequence":"additional","affiliation":[{"name":"University of Utah, Salt Lake, UT"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Monika K.","family":"Goyal","sequence":"additional","affiliation":[{"name":"Children\u2019s National Hospital, The George Washington University, Washington, DC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth R.","family":"Alpern","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Ann & Robert H. Lurie Children\u2019s Hospital, Northwestern University Feinberg School of Medicine, Chicago, IL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"with the PECARN Registry Study Group and the FACTS Consortium","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2026,9,4]]},"reference":[{"key":"R1-20260904","doi-asserted-by":"crossref","first-page":"1955","DOI":"10.1056\/NEJMc2201761","article-title":"Current causes of death in children and adolescents in the United States","volume":"386","author":"Goldstick","year":"2022","journal-title":"N Engl J Med"},{"key":"R2-20260904","article-title":"Firearm-related injuries and deaths in children and youth: injury prevention and harm reduction","volume":"150","author":"Lee","year":"2022","journal-title":"Pediatrics"},{"key":"R3-20260904","doi-asserted-by":"crossref","first-page":"573","DOI":"10.7326\/M19-2441","article-title":"Firearm-related injury and death in the United States: a call to action from the nation\u2019s leading physician and public health professional organizations","volume":"171","author":"McLean","year":"2019","journal-title":"Ann Intern Med"},{"key":"R4-20260904","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1001\/jama.2016.16215","article-title":"Funding and publication of research on gun violence and other leading causes of death","volume":"317","author":"Stark","year":"2017","journal-title":"JAMA"},{"issue":"3-4","key":"R5-20260904","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1177\/1527154415603358","article-title":"Challenges associated with using large data sets for quality assessment and research in clinical settings","volume":"16","author":"Cohen","year":"2015","journal-title":"Policy Polit Nurs Pract"},{"issue":"5 II","key":"R6-20260904","doi-asserted-by":"crossref","first-page":"1620","DOI":"10.1111\/j.1475-6773.2005.00444.x","article-title":"Measuring diagnoses: ICD code accuracy","volume":"40","author":"O\u2019Malley","year":"2005","journal-title":"Health Serv Res"},{"key":"R7-20260904","doi-asserted-by":"crossref","first-page":"e2246429","DOI":"10.1001\/jamanetworkopen.2022.46429","article-title":"Assessment of the accuracy of firearm injury intent coding at 3 US hospitals","volume":"5","author":"Miller","year":"2022","journal-title":"JAMA Netw Open"},{"issue":"1","key":"R8-20260904","doi-asserted-by":"crossref","first-page":"e306","DOI":"10.1097\/PEC.0000000000002272","article-title":"Determining intentionality of pediatric firearm injuries by International Classification of Disease Code","volume":"38","author":"Donnelly","year":"2022","journal-title":"Pediatr Emerg Care"},{"key":"R9-20260904","doi-asserted-by":"crossref","first-page":"12","DOI":"10.3352\/jeehp.2013.10.12","article-title":"The retrospective chart review: important methodological considerations","volume":"10","author":"Vassar","year":"2013","journal-title":"J Educ Eval Health Prof"},{"key":"R10-20260904","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1136\/amiajnl-2011-000464","article-title":"Natural language processing: an introduction","volume":"18","author":"Nadkarni","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"R11-20260904","doi-asserted-by":"crossref","first-page":"3713","DOI":"10.1007\/s11042-022-13428-4","article-title":"Natural language processing: state of the art, current trends and challenges","volume":"82","author":"Khurana","year":"2023","journal-title":"Multimed Tools Appl"},{"issue":"4","key":"R12-20260904","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1007\/s00167-022-07272-0","article-title":"Natural language processing: using artificial intelligence to understand human language in orthopedics","volume":"31","author":"Pruneski","year":"2023","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"key":"R13-20260904","doi-asserted-by":"crossref","first-page":"104282","DOI":"10.1016\/j.jbi.2023.104282","article-title":"Natural language processing for clinical notes in dentistry: a systematic review","volume":"138","author":"Pethani","year":"2023","journal-title":"J Biomed Inform"},{"issue":"7","key":"R14-20260904","doi-asserted-by":"crossref","first-page":"e2524154","DOI":"10.1001\/jamanetworkopen.2025.24154","article-title":"AI-driven injury reporting in pediatric emergency departments","volume":"8","author":"Singh","year":"2025","journal-title":"JAMA Netw Open"},{"key":"R15-20260904","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1055\/s-0038-1651496","article-title":"Pediatric Emergency Care Applied Research Network. The Pediatric Emergency Care Applied Research Network Registry: a multicenter electronic health record registry of pediatric emergency care","volume":"9","author":"Deakyne Davies","year":"2018","journal-title":"Appl Clin Inform"},{"issue":"9","key":"R19-20260904","doi-asserted-by":"crossref","first-page":"e0273222","DOI":"10.1371\/journal.pone.0273222","article-title":"COVID-19 contact tracing app reviews reveal concerns and motivations around adoption","volume":"17","author":"Dixon","year":"2022","journal-title":"PLoS One"},{"key":"R20-20260904","first-page":"993","article-title":"Latent Dirichlet Allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J Mach Learn Res"},{"key":"R22-20260904","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1037\/met0000349","article-title":"Closed-and open-vocabulary approaches to text analysis: a review, quantitative comparison, and recommendations","volume":"26","author":"Eichstaedt","year":"2021","journal-title":"Psychol Methods"},{"issue":"4","key":"R24-20260904","doi-asserted-by":"crossref","first-page":"e235870","DOI":"10.1001\/jamanetworkopen.2023.5870","article-title":"Classifying firearm injury intent in electronic hospital records using natural language processing","volume":"6","author":"MacPhaul","year":"2023","journal-title":"JAMA Netw Open"},{"issue":"4","key":"R25-20260904","doi-asserted-by":"crossref","first-page":"ooae120","DOI":"10.1093\/jamiaopen\/ooae120","article-title":"Assessing the use of unstructured electronic health record data to identify exposure to firearm violence","volume":"7","author":"Cook","year":"2024","journal-title":"JAMA Open"},{"key":"R26-20260904","first-page":"383","article-title":"Youth exposure to endemic community gun violence: a systematic review","volume":"7","author":"Bancalari","year":"2022","journal-title":"Adol Res Rev"}],"container-title":["Pediatric Emergency Care"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.1097\/PEC.0000000000003695","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T07:00:13Z","timestamp":1788505213000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.1097\/PEC.0000000000003695"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,4]]},"references-count":21,"URL":"https:\/\/doi.org\/10.1097\/pec.0000000000003695","relation":{},"ISSN":["0749-5161","1535-1815"],"issn-type":[{"value":"0749-5161","type":"print"},{"value":"1535-1815","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,4]]},"assertion":[{"value":"2026-05-04","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-08-15","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}