{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T10:49:56Z","timestamp":1789728596778,"version":"4.0.1"},"reference-count":22,"publisher":"JMIR Publications Inc.","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Bioinform Biotech"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Venous thromboembolism (VTE) is a preventable, common vascular disease that has been estimated to affect up to 900,000 people per year. It has been associated with risk factors such as recent surgery, cancer, and hospitalization. VTE surveillance for patient management and safety can be improved via natural language processing (NLP). NLP tools have the ability to access electronic medical records, identify patients that meet the VTE case definition, and subsequently enter the relevant information into a database for hospital review.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>We aimed to evaluate the performance of a VTE identification model of IDEAL-X (Information and Data Extraction Using Adaptive Learning; Emory University)\u2014an NLP tool\u2014in automatically classifying cases of VTE by \u201creading\u201d unstructured text from diagnostic imaging records collected from 2012 to 2014.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>After accessing imaging records from pilot surveillance systems for VTE from Duke University and the University of Oklahoma Health Sciences Center (OUHSC), we used a VTE identification model of IDEAL-X to classify cases of VTE that had previously been manually classified. Experts reviewed the technicians\u2019 comments in each record to determine if a VTE event occurred. The performance measures calculated (with 95% CIs) were accuracy, sensitivity, specificity, and positive and negative predictive values. Chi-square tests of homogeneity were conducted to evaluate differences in performance measures by site, using a significance level of .05.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The VTE model of IDEAL-X \u201cread\u201d 1591 records from Duke University and 1487 records from the OUHSC, for a total of 3078 records. The combined performance measures were 93.7% accuracy (95% CI 93.7%-93.8%), 96.3% sensitivity (95% CI 96.2%-96.4%), 92% specificity (95% CI 91.9%-92%), an 89.1% positive predictive value (95% CI 89%-89.2%), and a 97.3% negative predictive value (95% CI 97.3%-97.4%). The sensitivity was higher at Duke University (97.9%, 95% CI 97.8%-98%) than at the OUHSC (93.3%, 95% CI 93.1%-93.4%; P&lt;.001), but the specificity was higher at the OUHSC (95.9%, 95% CI 95.8%-96%) than at Duke University (86.5%, 95% CI 86.4%-86.7%; P&lt;.001).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The VTE model of IDEAL-X accurately classified cases of VTE from the pilot surveillance systems of two separate health systems in Durham, North Carolina, and Oklahoma City, Oklahoma. NLP is a promising tool for the design and implementation of an automated, cost-effective national surveillance system for VTE. Conducting public health surveillance at a national scale is important for measuring disease burden and the impact of prevention measures. We recommend additional studies to identify how integrating IDEAL-X in a medical record system could further automate the surveillance process.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/36877","type":"journal-article","created":{"date-parts":[[2022,7,21]],"date-time":"2022-07-21T05:35:26Z","timestamp":1658381726000},"page":"e36877","source":"Crossref","is-referenced-by-count":10,"title":["Exploring the Applicability of Using Natural Language Processing to Support Nationwide Venous Thromboembolism Surveillance: Model Evaluation Study"],"prefix":"10.2196","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8670-7730","authenticated-orcid":false,"given":"Aaron","family":"Wendelboe","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6583-9243","authenticated-orcid":false,"given":"Ibrahim","family":"Saber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5018-7940","authenticated-orcid":false,"given":"Justin","family":"Dvorak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6493-2796","authenticated-orcid":false,"given":"Alys","family":"Adamski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6942-9700","authenticated-orcid":false,"given":"Natalie","family":"Feland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5548-5429","authenticated-orcid":false,"given":"Nimia","family":"Reyes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7018-906X","authenticated-orcid":false,"given":"Karon","family":"Abe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6193-4585","authenticated-orcid":false,"given":"Thomas","family":"Ortel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5126-0991","authenticated-orcid":false,"given":"Gary","family":"Raskob","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2022,8,5]]},"reference":[{"issue":"22","key":"ref1","first-page":"401","volume":"61","year":"2012","journal-title":"MMWR Morb Mortal Wkly Rep"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1007\/s11239-009-0378-3"},{"key":"ref3","unstructured":"MaynardGPreventing hospital-associated venous thromboembolism: a guide for effective quality improvement, 2nd edAgency for Healthcare Research and Quality2016082021-02-18https:\/\/www.ahrq.gov\/sites\/default\/files\/publications\/files\/vteguide.pdf"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1177\/1358863X18821159"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1055\/s-0040-1722189"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1016\/j.jamcollsurg.2010.07.007"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1016\/s1553-7250(07)33037-7"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0000000000000524"},{"key":"ref9","unstructured":"Percent of hospitals, by type, that possess certified health ITOffice of the National Coordinator for Health Information Technology2021-05-25https:\/\/dashboard.healthit.gov\/quickstats\/pages\/certified-electronic-health-record-technology-in-hospitals.php"},{"key":"ref10","unstructured":"Office-based physician electronic health record adoptionOffice of the National Coordinator for Health Information Technology2021-02-18https:\/\/www.healthit.gov\/data\/quickstats\/office-based-physician-electronic-health-record-adoption"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2011.1204"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2014-002768"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0000000000000346"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0000000000000831"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1016\/j.ahj.2015.06.004"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1055\/s-0039-1693711"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1002\/sim.6148"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.2196\/medinform.8662"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.2196\/medinform.7235"},{"key":"ref20","first-page":"975","volume":"2013","author":"Hinz, ERM","year":"2013","journal-title":"AMIA Annu Symp Proc"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1007\/s11239-017-1532-y"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.3390\/medicina56100506"}],"container-title":["JMIR Bioinformatics and Biotechnology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/bioinform.jmir.org\/2022\/1\/e36877","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:00:09Z","timestamp":1782842409000},"score":1,"resource":{"primary":{"URL":"https:\/\/bioinform.jmir.org\/2022\/1\/e36877"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,5]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.2196\/36877","relation":{},"ISSN":["2563-3570"],"issn-type":[{"value":"2563-3570","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,5]]}}}