{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T09:45:06Z","timestamp":1788860706194,"version":"build-2803163510"},"reference-count":21,"publisher":"Oxford University Press (OUP)","issue":"9","license":[{"start":{"date-parts":[[2020,7,18]],"date-time":"2020-07-18T00:00:00Z","timestamp":1595030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100000245","name":"Michael Smith Foundation for Health Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000245","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100015752","name":"BC Lung Association","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100015752","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,11,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>The online Tuberculin Skin Test\/Interferon Gamma Release Assay (TST\/IGRA) Interpreter V3.0 (TSTin3D), a tool for estimating the risk of active tuberculosis (TB) in individuals with latent TB infection (LTBI), has been in use for more than a decade, but its predictive performance has never been evaluated.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>People with a positive TST or IGRA result from 1985 to 2015 were identified using a health data linkage that involved migrants to British Columbia, Canada. Comorbid conditions at the time of LTBI testing were identified from physician claims, hospitalizations, vital statistics, outpatient prescriptions, and kidney and HIV databases. The risk of developing active TB within 2 and 5 years was estimated using TSTin3D. The discrimination and calibration of these estimates were evaluated.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>A total of 37 163 individuals met study inclusion criteria; 10.4% were tested by IGRA. Generally, the TSTin3D algorithm assigned higher risks to demographic and clinical groups known to have higher active TB risks. Concordance estimates ranged from 0.66 to 0.68 in 2- and 5-year time frames. Comparing predicted to observed counts suggests that TSTin3D overestimates active TB risks and that overestimation increases over time (with relative bias of 3% and 12% in 2- and 5-year periods, respectively). Calibration plots also suggest that overestimation increases toward the upper end of the risk spectrum.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>TSTin3D can discriminate adequately between people who developed and did not develop active TB in this linked database of migrants with predominately positive skin tests. Further work is needed to improve TSTin3D\u2019s calibration.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/cid\/ciaa780","type":"journal-article","created":{"date-parts":[[2020,6,14]],"date-time":"2020-06-14T11:07:34Z","timestamp":1592132854000},"page":"e3486-e3495","source":"Crossref","is-referenced-by-count":6,"title":["How Well Does TSTin3D Predict Risk of Active Tuberculosis in the Canadian Immigrant Population? An External Validation Study"],"prefix":"10.1093","volume":"73","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3710-5773","authenticated-orcid":false,"given":"Joseph H","family":"Puyat","sequence":"first","affiliation":[{"name":"School of Population and Public Health, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hennady P","family":"Shulha","sequence":"additional","affiliation":[{"name":"BC Centre for Disease Control, Vancouver, British Columbia, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Balshaw","sequence":"additional","affiliation":[{"name":"George & Fay Yee Centre for Healthcare Innovation, Winnipeg, Manitoba, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathon R","family":"Campbell","sequence":"additional","affiliation":[{"name":"Department of Epidemiology, Biostatistics, and Occupational Health, Faculty of Medicine, McGill University, Montreal, Quebec, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"Law","sequence":"additional","affiliation":[{"name":"Department of Global Health and Social Medicine, Harvard Medical School, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Menzies","sequence":"additional","affiliation":[{"name":"Department of Medicine, Faculty of Medicine, McGill University, Montreal, Quebec, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James C","family":"Johnston","sequence":"additional","affiliation":[{"name":"School of Population and Public Health, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada"},{"name":"BC Centre for Disease Control and Division of Respiratory Medicine, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,7,18]]},"reference":[{"key":"2021110300353633200_CIT0001","first-page":"263","article-title":"Global epidemiology of tuberculosis and progress toward achieving global targets\u20142017","volume-title":"MMWR Morb Mortal Wkly Rep","author":"MacNeil","year":"2019"},{"key":"2021110300353633200_CIT0002","first-page":"20","volume-title":"The end TB strategy","author":"World Health Organization","year":"2014"},{"key":"2021110300353633200_CIT0003","doi-asserted-by":"crossref","DOI":"10.1186\/s12916-016-0595-5","article-title":"The impact of migration on tuberculosis epidemiology and control in high-income countries: a review","volume-title":"BMC Med","author":"Pareek","year":"2016"},{"key":"2021110300353633200_CIT0004","doi-asserted-by":"crossref","first-page":"E939","DOI":"10.1503\/cmaj.090302","article-title":"Tuberculosis: evidence review for newly arriving immigrants and refugees","volume":"183","author":"Greenaway","year":"2011","journal-title":"CMAJ"},{"key":"2021110300353633200_CIT0005","first-page":"498","article-title":"Thinking in three dimensions: a web-based algorithm to aid the interpretation of tuberculin skin test results","volume":"12","author":"Menzies","year":"2008","journal-title":"Int J Tuberc Lung Dis"},{"key":"2021110300353633200_CIT0006","article-title":"Canadian Tuberculosis Standards","author":"Public Health Agency of Canada and Canadian Lung Association\/Canadian Thoracic Society.","year":"2014"},{"key":"2021110300353633200_CIT0007","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.i3140","article-title":"External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges","volume-title":"BMJ","author":"Riley","year":"2016"},{"key":"2021110300353633200_CIT0008","author":"Population Data BC"},{"key":"2021110300353633200_CIT0009","first-page":"e013488","article-title":"Predicting tuberculosis risk in the foreign-born population of British Columbia, Canada: study protocol for a retrospective population-based cohort study","volume-title":"BMJ Open","author":"Ronald","year":"2016"},{"key":"2021110300353633200_CIT0010","doi-asserted-by":"crossref","first-page":"2101","DOI":"10.1093\/cid\/ciz188","article-title":"Estimated impact of World Health Organization latent tuberculosis screening guidelines in a region with a low tuberculosis incidence: retrospective cohort study","volume":"69","author":"Ronald","year":"2019","journal-title":"Clin Infect Dis"},{"key":"2021110300353633200_CIT0011","doi-asserted-by":"crossref","first-page":"E209","DOI":"10.1503\/cmaj.170817","article-title":"Demographic predictors of active tuberculosis in people migrating to British Columbia, Canada: a retrospective cohort study","volume":"190","author":"Ronald","year":"2018","journal-title":"CMAJ"},{"key":"2021110300353633200_CIT0012","first-page":"387","article-title":"TB in foreign-born patients","volume":"54","author":"Roth","year":"2012","journal-title":"BC Med J"},{"key":"2021110300353633200_CIT0013"},{"key":"2021110300353633200_CIT0014","article-title":"External validation of a Cox prognostic model: principles and methods","volume":"13:33","author":"Royston","year":"2013","journal-title":"BMC Med Res Methodol"},{"key":"2021110300353633200_CIT0015","doi-asserted-by":"crossref","first-page":"1692","DOI":"10.1177\/0962280213497434","article-title":"Assessing calibration of prognostic risk scores","volume":"25","author":"Crowson","year":"2016","journal-title":"Stat Methods Med Res"},{"key":"2021110300353633200_CIT0016","volume-title":"Regression modeling strategies: with applications to linear models, logistic and ordinal regression, and survival analysis","author":"Harrell","edition":"2"},{"key":"2021110300353633200_CIT0017","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1002\/sim.4154","article-title":"On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data","volume":"30","author":"Uno","year":"2011","journal-title":"Stat Med"},{"key":"2021110300353633200_CIT0018","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1037\/0033-2909.112.1.155","article-title":"A power primer","volume":"112","author":"Cohen","year":"1992","journal-title":"Psychol Bull"},{"key":"2021110300353633200_CIT0019","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1177\/0093854816678898","article-title":"Primer on risk assessment and the statistics used to evaluate its accuracy","volume":"44","author":"Helmus","year":"2017","journal-title":"Crim Justice Behav"},{"key":"2021110300353633200_CIT0020","author":"Therneau","year":"2020"},{"key":"2021110300353633200_CIT0021","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1016\/S0895-4356(03)00207-5","article-title":"External validation is necessary in prediction research: a clinical example","volume":"56","author":"Bleeker","year":"2003","journal-title":"J Clin Epidemiol"}],"container-title":["Clinical Infectious Diseases"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/cid\/advance-article-pdf\/doi\/10.1093\/cid\/ciaa780\/33674695\/ciaa780.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/cid\/article-pdf\/73\/9\/e3486\/41057324\/ciaa780.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/cid\/article-pdf\/73\/9\/e3486\/41057324\/ciaa780.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,3]],"date-time":"2021-11-03T00:38:06Z","timestamp":1635899886000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/cid\/article\/73\/9\/e3486\/5859579"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,18]]},"references-count":21,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,7,18]]},"published-print":{"date-parts":[[2021,11,2]]}},"URL":"https:\/\/doi.org\/10.1093\/cid\/ciaa780","relation":{},"ISSN":["1058-4838","1537-6591"],"issn-type":[{"value":"1058-4838","type":"print"},{"value":"1537-6591","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,11,1]]},"published":{"date-parts":[[2020,7,18]]}}}