{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T23:28:31Z","timestamp":1777764511585,"version":"3.51.4"},"reference-count":36,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2019,1,2]],"date-time":"2019-01-02T00:00:00Z","timestamp":1546387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Alcohol misuse is present in over a quarter of trauma patients. Information in the clinical notes of the electronic health record of trauma patients may be used for phenotyping tasks with natural language processing (NLP) and supervised machine learning. The objective of this study is to train and validate an NLP classifier for identifying patients with alcohol misuse.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>An observational cohort of 1422 adult patients admitted to a trauma center between April 2013 and November 2016. Linguistic processing of clinical notes was performed using the clinical Text Analysis and Knowledge Extraction System. The primary analysis was the binary classification of alcohol misuse. The Alcohol Use Disorders Identification Test served as the reference standard.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The data corpus comprised 91\u2009045 electronic health record notes and 16\u2009091 features. In the final machine learning classifier, 16 features were selected from the first 24 hours of notes for identifying alcohol misuse. The classifier\u2019s performance in the validation cohort had an area under the receiver-operating characteristic curve of 0.78 (95% confidence interval [CI], 0.72 to 0.85). Sensitivity and specificity were at 56.0% (95% CI, 44.1% to 68.0%) and 88.9% (95% CI, 84.4% to 92.8%). The Hosmer-Lemeshow goodness-of-fit test demonstrates the classifier fits the data well (P\u2009=\u2009.17). A simpler rule-based keyword approach had a decrease in sensitivity when compared with the NLP classifier from 56.0% to 18.2%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The NLP classifier has adequate predictive validity for identifying alcohol misuse in trauma centers. External validation is needed before its application to augment screening.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocy166","type":"journal-article","created":{"date-parts":[[2018,11,17]],"date-time":"2018-11-17T20:14:20Z","timestamp":1542485660000},"page":"254-261","source":"Crossref","is-referenced-by-count":87,"title":["Natural language processing and machine learning to identify alcohol misuse from the electronic health record in trauma patients: development and internal validation"],"prefix":"10.1093","volume":"26","author":[{"given":"Majid","family":"Afshar","sequence":"first","affiliation":[{"name":"Health Sciences Division, Burn and Shock Trauma Research Institute, Stritch School of Medicine, Loyola University, Maywood, Illinois, USA"},{"name":"Health Sciences Division, Center for Health Outcomes and Informatics Research, Loyola University, Maywood, Illinois, USA"},{"name":"Department of Public Health Sciences, Stritch School of Medicine, Loyola University, Maywood, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Phillips","sequence":"additional","affiliation":[{"name":"Department\u00a0of Computer Science, Loyola University, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Niranjan","family":"Karnik","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Rush University Medical Center, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeanne","family":"Mueller","sequence":"additional","affiliation":[{"name":"Department of Surgery, Loyola University Medical Center, Maywood, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"To","sequence":"additional","affiliation":[{"name":"Health Sciences Division, Burn and Shock Trauma Research Institute, Stritch School of Medicine, Loyola University, Maywood, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard","family":"Gonzalez","sequence":"additional","affiliation":[{"name":"Department of Surgery, Loyola University Medical Center, Maywood, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ron","family":"Price","sequence":"additional","affiliation":[{"name":"Health Sciences Division, Center for Health Outcomes and Informatics Research, Loyola University, Maywood, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard","family":"Cooper","sequence":"additional","affiliation":[{"name":"Department\u00a0of Computer Science, Loyola University, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cara","family":"Joyce","sequence":"additional","affiliation":[{"name":"Health Sciences Division, Center for Health Outcomes and Informatics Research, Loyola University, Maywood, Illinois, USA"},{"name":"Department\u00a0of Computer Science, Loyola University, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dmitriy","family":"Dligach","sequence":"additional","affiliation":[{"name":"Health Sciences Division, Center for Health Outcomes and Informatics Research, Loyola University, Maywood, Illinois, USA"},{"name":"Department of Public Health Sciences, Stritch School of Medicine, Loyola University, Maywood, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,1,2]]},"reference":[{"key":"2020110613060678100_ocy166-B1","doi-asserted-by":"crossref","first-page":"E109","DOI":"10.5888\/pcd11.130293","article-title":"Contribution of excessive alcohol consumption to deaths and years of potential life lost in the United States","volume":"11","author":"Stahre","year":"2014","journal-title":"Prev Chronic Dis"},{"key":"2020110613060678100_ocy166-B2","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.drugalcdep.2014.12.016","article-title":"Changes in alcohol consumption: United States, 2001\u20132002 to 2012\u20132013","volume":"148","author":"Dawson","year":"2015","journal-title":"Drug Alcohol Depend"},{"issue":"4","key":"2020110613060678100_ocy166-B3","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1097\/TA.0000000000000825","article-title":"Alcohol exposure, injury, and death in trauma patients","volume":"79","author":"Afshar","year":"2015","journal-title":"J Trauma Acute Care Surg"},{"issue":"5","key":"2020110613060678100_ocy166-B4","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1097\/SLA.0000000000000339","article-title":"A multisite randomized controlled trial of brief intervention to reduce drinking in the trauma care setting: how brief is brief?","volume":"259","author":"Field","year":"2014","journal-title":"Ann Surg"},{"issue":"5","key":"2020110613060678100_ocy166-B5","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1111\/add.12492","article-title":"Disseminating alcohol screening and brief intervention at trauma centers: a policy-relevant cluster randomized effectiveness trial","volume":"109","author":"Zatzick","year":"2014","journal-title":"Addiction"},{"issue":"4","key":"2020110613060678100_ocy166-B6","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1097\/00000658-199910000-00003","article-title":"Alcohol interventions in a trauma center as a means of reducing the risk of injury recurrence","volume":"230","author":"Gentilello","year":"1999","journal-title":"Ann Surg"},{"issue":"4","key":"2020110613060678100_ocy166-B7","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1007\/s12178-012-9137-8","article-title":"Brief history of quality movement in US healthcare","volume":"5","author":"Marjoua","year":"2012","journal-title":"Curr Rev Musculoskelet Med"},{"key":"2020110613060678100_ocy166-B8","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.jsat.2015.06.005","article-title":"Cost of screening, brief intervention, and referral to treatment in health care settings","volume":"60","author":"Barbosa","year":"2016","journal-title":"J Subst Abuse Treat"},{"issue":"5","key":"2020110613060678100_ocy166-B9","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1016\/j.jbi.2009.08.007","article-title":"What can natural language processing do for clinical decision support?","volume":"42","author":"Demner-Fushman","year":"2009","journal-title":"J Biomed Inform"},{"issue":"1","key":"2020110613060678100_ocy166-B10","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1055\/s-0038-1626725","article-title":"Development and validation of a natural language processing tool to identify patients treated for pneumonia across VA emergency departments","volume":"9","author":"Jones","year":"2018","journal-title":"Appl Clin Inform"},{"issue":"2","key":"2020110613060678100_ocy166-B11","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1212\/WNL.0000000000003490","article-title":"Large-scale identification of patients with cerebral aneurysms using natural language processing","volume":"88","author":"Castro","year":"2017","journal-title":"Neurology"},{"issue":"12","key":"2020110613060678100_ocy166-B12","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1016\/j.ijmedinf.2015.09.002","article-title":"Using natural language processing to identify problem usage of prescription opioids","volume":"84","author":"Carrell","year":"2015","journal-title":"Int J Med Inform"},{"issue":"1","key":"2020110613060678100_ocy166-B13","doi-asserted-by":"crossref","first-page":"214","DOI":"10.15265\/IY-2017-029","article-title":"Capturing the patient\u2019s perspective: a review of advances in natural language processing of health-related text","volume":"26","author":"Gonzalez-Hernandez","year":"2017","journal-title":"Yearb Med Inform"},{"issue":"6","key":"2020110613060678100_ocy166-B14","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1111\/j.1360-0443.1993.tb02093.x","article-title":"Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption\u2013II","volume":"88","author":"Saunders","year":"1993","journal-title":"Addiction"},{"issue":"6","key":"2020110613060678100_ocy166-B15","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1093\/oxfordjournals.alcalc.a008195","article-title":"Identifying hazardous or harmful alcohol use in medical admissions: a comparison of audit, cage and brief mast","volume":"31","author":"MacKenzie","year":"1996","journal-title":"Alcohol Alcohol"},{"issue":"4","key":"2020110613060678100_ocy166-B16","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1097\/01.TA.0000086650.27490.4B","article-title":"Comparison of trauma center patient self-reports and proxy reports on the Alcohol Use Identification Test (AUDIT)","volume":"56","author":"Donovan","year":"2004","journal-title":"J Trauma"},{"issue":"2","key":"2020110613060678100_ocy166-B17","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1111\/j.1530-0277.2006.00295.x","article-title":"The alcohol use disorders identification test: an update of research findings","volume":"31","author":"Reinert","year":"2007","journal-title":"Alcohol Clin Exp Res"},{"issue":"11","key":"2020110613060678100_ocy166-B18","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1097\/01.ALC.0000145696.58084.08","article-title":"Gender differences in the performance of a computerized version of the alcohol use disorders identification test in subcritically injured patients who are admitted to the emergency department","volume":"28","author":"Neumann","year":"2004","journal-title":"Alcohol Clin Exp Res"},{"issue":"2","key":"2020110613060678100_ocy166-B19","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1111\/j.1530-0277.2002.tb02534.x","article-title":"The Alcohol Use Disorders Identification Test (AUDIT): a review of recent research","volume":"26","author":"Reinert","year":"2002","journal-title":"Alcohol Clin Exp Res"},{"issue":"12","key":"2020110613060678100_ocy166-B20","doi-asserted-by":"crossref","first-page":"e113152","DOI":"10.1371\/journal.pone.0113152","article-title":"Comparison of self-reported alcohol consumption to phosphatidylethanol measurement among HIV-infected patients initiating antiretroviral treatment in southwestern Uganda","volume":"9","author":"Bajunirwe","year":"2014","journal-title":"PLoS One"},{"key":"2020110613060678100_ocy166-B21","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1186\/1471-2458-14-1297","article-title":"Drinking pattern is more strongly associated with under-reporting of alcohol consumption than socio-demographic factors: evidence from a mixed-methods study","volume":"14","author":"Boniface","year":"2014","journal-title":"BMC Public Health"},{"key":"2020110613060678100_ocy166-B22","unstructured":"National Institute on Alcohol Abuse and Alcoholism. NIAAA Council Approves Definition of Binge Drinking. NIAAA Newsletter, No. 3, Winter 2004. Available at: http:\/\/pubs.niaaa.nih.gov\/publications\/Newsletter\/winter2004\/Newsletter_Number3.pdf. Accessed July 19, 2018."},{"issue":"2","key":"2020110613060678100_ocy166-B23","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1111\/add.12755","article-title":"Relative risk of injury from acute alcohol consumption: modeling the dose-response relationship in emergency department data from 18 countries","volume":"110","author":"Cherpitel","year":"2015","journal-title":"Addiction"},{"issue":"5","key":"2020110613060678100_ocy166-B24","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/jamia.2009.001560","article-title":"Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications","volume":"17","author":"Savova","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613060678100_ocy166-B25","first-page":"2825","article-title":"Scikit-learn: marchine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"issue":"1","key":"2020110613060678100_ocy166-B26","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","article-title":"Assessing the performance of prediction models: a framework for traditional and novel measures","volume":"21","author":"Steyerberg","year":"2010","journal-title":"Epidemiology"},{"issue":"10","key":"2020110613060678100_ocy166-B27","doi-asserted-by":"crossref","first-page":"2704","DOI":"10.1007\/s10620-017-4714-8","article-title":"Comparison of ICD-9 codes for depression and alcohol misuse to survey instruments suggests these codes should be used with caution","volume":"62","author":"Boscarino","year":"2017","journal-title":"Dig Dis Sci"},{"issue":"3","key":"2020110613060678100_ocy166-B28","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.addbeh.2011.11.006","article-title":"Readiness to change, drinking, and negative consequences among Polish SBIRT patients","volume":"37","author":"Korcha","year":"2012","journal-title":"Addict Behav"},{"issue":"3","key":"2020110613060678100_ocy166-B29","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1093\/alcalc\/agl022","article-title":"Patient attitudes towards self-report and biomarker alcohol screening by primary care physicians","volume":"41","author":"Miller","year":"2006","journal-title":"Alcohol Alcohol"},{"key":"2020110613060678100_ocy166-B30","first-page":"CD004033","article-title":"Thiamine for Wernicke-Korsakoff Syndrome in people at risk from alcohol abuse","volume":"1)","author":"Day","year":"2004","journal-title":"Cochrane Database Syst Rev"},{"issue":"3","key":"2020110613060678100_ocy166-B31","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1080\/10550490590949433","article-title":"Alcohol use disorder and illicit drug use in admissions to general hospitals in the United States","volume":"14","author":"Smothers","year":"2005","journal-title":"Am J Addict"},{"issue":"1","key":"2020110613060678100_ocy166-B32","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1001\/jamapsychiatry.2015.2132","article-title":"Epidemiology of DSM-5 drug use disorder: results from the national epidemiologic survey on alcohol and related conditions-III","volume":"73","author":"Grant","year":"2016","journal-title":"JAMA Psychiatry"},{"issue":"4","key":"2020110613060678100_ocy166-B33","first-page":"1","article-title":"Substance use patterns and unprotected sex among street-involved youth in a Canadian setting: a prospective cohort study","volume":"16","author":"Cheng","year":"2016","journal-title":"BMC Public Health"},{"key":"2020110613060678100_ocy166-B34","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/j.drugalcdep.2018.04.021","article-title":"Substance use and homelessness among emergency department patients","volume":"188","author":"Doran","year":"2018","journal-title":"Drug Alcohol Depend"},{"issue":"2","key":"2020110613060678100_ocy166-B35","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1111\/dar.12104","article-title":"Associations between alcohol, smoking, socioeconomic status and comorbidities: evidence from the 45 and up Study","volume":"33","author":"Bonevski","year":"2014","journal-title":"Drug Alcohol Rev"},{"key":"2020110613060678100_ocy166-B36","volume-title":"Alcohol and other drug screening of hospitalized trauma patients","author":"Treatment Improvement Protocol (TIP) Series 16"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/3\/254\/34151362\/ocy166.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/3\/254\/34151362\/ocy166.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,15]],"date-time":"2020-11-15T12:14:49Z","timestamp":1605442489000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/3\/254\/5271068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,2]]},"references-count":36,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,1,2]]},"published-print":{"date-parts":[[2019,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocy166","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,3]]},"published":{"date-parts":[[2019,1,2]]}}}