{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T12:26:53Z","timestamp":1784723213200,"version":"3.55.0"},"reference-count":24,"publisher":"Oxford University Press (OUP)","issue":"3-4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,2,27]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n               <jats:sec>\n                  <jats:title>Introduction<\/jats:title>\n                  <jats:p>The prevalence of tobacco use in the Veteran population and among Veterans Health Administration patients remains high, resulting in significant health and economic consequences. This problem has generated many tobacco research studies and clinical interventions, which often rely upon tobacco use status data previously recorded in electronic health records (EHR). Therefore, the consistency and reliability of these data are critical. The Veterans Health Administration uses an extensive EHR system where tobacco use status can be documented either as free text (FT) or as health factors (HF). The current literature assessing the reliability of HF and FT data is limited. This analysis evaluated the agreement between HF and FT tobacco use status data.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>This retrospective study included Veterans who underwent coronary revascularization and had tobacco use statuses recorded as both HF and FT. These statuses were categorized as \u201cCurrent,\u201d \u201cFormer,\u201d or \u201cNever.\u201d The closest recorded status to the index date (date of revascularization procedure) for each subject in both datasets was chosen, and Cohen\u2019s kappa statistic was calculated to measure the agreement between HF and FT. Implausible tobacco use status changes within each dataset were quantified to assess trustworthiness. Agreement between HF and FT data was first measured for all subjects (n\u2009=\u20091,095), which included those who had implausible status changes in either dataset and then measured again for subjects (n\u2009=\u2009770) without any implausible status changes in either dataset. This study was exempt from institutional review board review.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Overall, 14.3% and 17.7% of all subjects had implausible tobacco use status changes in HF and FT data, respectively. For all subjects (n\u2009=\u20091,095), including those with implausible data, there was \u201cmoderate\u201d agreement between HF and FT data (kappa\u2009=\u20090.49; 95% CI, 0.44\u20130.53). For subjects without implausible data (n\u2009=\u2009770), the strength of agreement between HF and FT data was \u201cgood\u201d (kappa\u2009=\u20090.64; 95% CI, 0.59\u20130.69).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Agreement between HF and FT data that document the tobacco use statuses of Veterans varied because of implausible data. HF data had fewer implausible tobacco use statuses, but FT data were recorded more frequently. Although HF and FT data can be reasonably relied upon to determine the tobacco use statuses of Veterans, researchers and clinicians must be aware of implausible data and consider methods to overcome this limitation. Future studies should investigate the ways of improving the consistency of EHR documentation by health care providers and benchmark HF and FT data against a gold standard like biochemical verification to determine accuracy.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/milmed\/usad290","type":"journal-article","created":{"date-parts":[[2023,7,28]],"date-time":"2023-07-28T17:38:01Z","timestamp":1690565881000},"page":"e509-e514","source":"Crossref","is-referenced-by-count":3,"title":["Reliability of\u00a0Electronic Health Records in\u00a0Recording Veterans\u2019 Tobacco Use Status"],"prefix":"10.1093","volume":"189","author":[{"given":"Daniel","family":"Sun","sequence":"first","affiliation":[{"name":"Tampa VA Clinical Research and Education Center, James A. Haley Veterans\u2019 Hospital , Tampa, FL 33612, USA"},{"name":"College of Public Health, University of South Florida , Tampa, FL 33612, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"Basi","sequence":"additional","affiliation":[{"name":"Tampa VA Clinical Research and Education Center, James A. Haley Veterans\u2019 Hospital , Tampa, FL 33612, USA"},{"name":"Georgetown University School of Medicine, Georgetown University , Washington, DC 20057, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Judah","family":"Kreinbrook","sequence":"additional","affiliation":[{"name":"Tampa VA Clinical Research and Education Center, James A. Haley Veterans\u2019 Hospital , Tampa, FL 33612, USA"},{"name":"Duke University School of Medicine, Duke University , Durham, NC 27710, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rahul","family":"Mhaskar","sequence":"additional","affiliation":[{"name":"Office of Research, Morsani College of Medicine, University of South Florida , Tampa, FL 33602, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5405-8820","authenticated-orcid":false,"given":"Fabio","family":"Leonelli","sequence":"additional","affiliation":[{"name":"Tampa VA Clinical Research and Education Center, James A. Haley Veterans\u2019 Hospital , Tampa, FL 33612, USA"},{"name":"Cardiology Department, James A. Haley Veterans\u2019 Hospital, University of South Florida , Tampa, FL 33612, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,7,28]]},"reference":[{"key":"2024022722273305500_R1","article-title":"Tobacco use","author":"Centers for Disease Control and Prevention"},{"issue":"1","key":"2024022722273305500_R2","doi-asserted-by":"publisher","first-page":"7","DOI":"10.15585\/mmwr.mm6701a2","article-title":"Tobacco product use among military Veterans\u2014United States, 2010\u20132015","volume":"67","author":"Odani","year":"2018","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"12","key":"2024022722273305500_R3","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1093\/ntr\/ntu187","article-title":"Health care expenditures attributable to smoking in\u00a0military Veterans","volume":"13","author":"Barnett","year":"2015","journal-title":"Nicotine Tob Res"},{"key":"2024022722273305500_R4","doi-asserted-by":"publisher","DOI":"10.1093\/milmed\/usad017","article-title":"Use of\u00a0Veterans Health Administration structured data to identify patients eligible for\u00a0lung cancer screening","author":"Gundle","year":"2023","journal-title":"Mil Med"},{"issue":"12","key":"2024022722273305500_R5","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1093\/ntr\/ntr206","article-title":"Validating smoking data from the Veteran\u2019s Affairs health factors dataset, an electronic data source","volume":"13","author":"McGinnis","year":"2011","journal-title":"Nicotine Tob Res"},{"issue":"11","key":"2024022722273305500_R6","doi-asserted-by":"publisher","first-page":"1228","DOI":"10.1007\/s11606-017-4144-5","article-title":"Validation of\u00a0Veterans Affairs electronic medical record smoking data among Iraq- and\u00a0Afghanistan-era Veterans","volume":"32","author":"Calhoun","year":"2017","journal-title":"J Gen Intern Med"},{"key":"2024022722273305500_R7","first-page":"1392","article-title":"Challenges with collecting smoking status in\u00a0electronic health records","volume":"2017","author":"Polubriaginof","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"issue":"1","key":"2024022722273305500_R8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-018-0501-2","article-title":"Validating the use of\u00a0Veterans Affairs tobacco health factors for\u00a0assessing change in\u00a0smoking status: accuracy, availability, and\u00a0approach","volume":"18","author":"Melzer","year":"2018","journal-title":"BMC Med Res Methodol"},{"issue":"3","key":"2024022722273305500_R9","doi-asserted-by":"publisher","first-page":"1507","DOI":"10.1177\/1460458219882259","article-title":"Validity of\u00a0Veterans Health Administration structured data to determine accurate smoking status","volume":"26","author":"Golden","year":"2020","journal-title":"Health Informatics J"},{"key":"2024022722273305500_R10","article-title":"Using health factors data for\u00a0VA health services research","volume-title":"Technical Report 28","author":"Barnett","year":"2014"},{"key":"2024022722273305500_R11","volume-title":"Practical Statistics for Medical Research","author":"Altman","year":"1991"},{"key":"2024022722273305500_R12","doi-asserted-by":"crossref","DOI":"10.1002\/0471445428","volume-title":"Statistical Methods for Rates and Proportions","author":"Fleiss","year":"2003"},{"issue":"1","key":"2024022722273305500_R13","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and\u00a0dimensions of\u00a0electronic health record data quality assessment: enabling reuse for\u00a0clinical research","volume":"20","author":"Weiskopf","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2024022722273305500_R14","article-title":"Statistical Software Version 22.007","author":"MedCalc\u00ae","year":"2023"},{"issue":"Fall","key":"2024022722273305500_R15","article-title":"Impact of\u00a0electronic health record systems on\u00a0information integrity: quality and\u00a0safety implications","volume":"10","author":"Bowman","year":"2013","journal-title":"Perspect Health Inf Manag"},{"issue":"5","key":"2024022722273305500_R16","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1197\/jamia.M2042","article-title":"Types of\u00a0unintended consequences related to computerized provider order entry","volume":"13","author":"Campbell","year":"2006","journal-title":"J Am Med Inform Assoc"},{"key":"2024022722273305500_R17","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0221-y","article-title":"An overview of\u00a0clinical decision support systems: benefits, risks, and\u00a0strategies for\u00a0success","volume":"3","author":"Sutton","year":"2020","journal-title":"NPJ Digit Med"},{"issue":"1","key":"2024022722273305500_R18","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1136\/tobaccocontrol-2020-056438","article-title":"Machine learning applications in\u00a0tobacco research: a scoping review","volume":"32","author":"Fu","year":"2021","journal-title":"Tob Control"},{"issue":"Suppl","key":"2024022722273305500_R19","doi-asserted-by":"publisher","first-page":"S128","DOI":"10.1016\/j.jbi.2015.08.002","article-title":"Adapting existing natural language processing resources for\u00a0cardiovascular risk factors identification in\u00a0clinical notes","volume":"58","author":"Khalifa","year":"2015","journal-title":"J Biomed Inform"},{"issue":"1","key":"2024022722273305500_R20","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1055\/s-0038-1627475","article-title":"The reliability of\u00a0electronic health record data used for\u00a0obstetrical research","volume":"9","author":"Altman","year":"2018","journal-title":"Appl Clin Inform"},{"key":"2024022722273305500_R21","first-page":"903","article-title":"Towards augmenting structured EHR data: a comparison of\u00a0manual chart review and\u00a0patient self-report","volume":"2019","author":"Weiskopf","year":"2019","journal-title":"AMIA Annu Symp Proc"},{"key":"2024022722273305500_R22","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2021.104622","article-title":"Comparing automated vs. manual data collection for\u00a0COVID-specific medications from electronic health records","volume":"157","author":"Yin","year":"2022","journal-title":"Int J Med Inform"},{"issue":"7","key":"2024022722273305500_R23","doi-asserted-by":"publisher","first-page":"1086","DOI":"10.1093\/ntr\/ntz132","article-title":"Biochemical verification of\u00a0tobacco use and\u00a0abstinence: 2019 update","volume":"22","author":"Benowitz","year":"2020","journal-title":"Nicotine Tob Res"},{"issue":"12","key":"2024022722273305500_R24","doi-asserted-by":"publisher","first-page":"1467","DOI":"10.1093\/ntr\/ntx250","article-title":"Smoking cessation benefit utilization: comparing methodologies for\u00a0measurement using New York State\u2019s Medicaid data","volume":"20","author":"Malloy","year":"2018","journal-title":"Nicotine Tob Res"}],"container-title":["Military Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/milmed\/article-pdf\/189\/3-4\/e509\/56773611\/usad290.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/milmed\/article-pdf\/189\/3-4\/e509\/56773611\/usad290.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,27]],"date-time":"2024-02-27T23:28:03Z","timestamp":1709076483000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/milmed\/article\/189\/3-4\/e509\/7233252"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,28]]},"references-count":24,"journal-issue":{"issue":"3-4","published-online":{"date-parts":[[2023,7,28]]},"published-print":{"date-parts":[[2024,2,27]]}},"URL":"https:\/\/doi.org\/10.1093\/milmed\/usad290","relation":{},"ISSN":["0026-4075","1930-613X"],"issn-type":[{"value":"0026-4075","type":"print"},{"value":"1930-613X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3,1]]},"published":{"date-parts":[[2023,7,28]]}}}