{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T20:59:57Z","timestamp":1767905997156,"version":"3.49.0"},"reference-count":37,"publisher":"The Journal of Rheumatology","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Rheumatol"],"published-print":{"date-parts":[[2020,1]]},"abstract":"<jats:sec><jats:title>Objective.<\/jats:title><jats:p>Observational axial spondyloarthritis (axSpA) research in large datasets has been limited by a lack of adequate methods for identifying patients with axSpA, because there are no billing codes in the United States for most subtypes of axSpA. The objective of this study was to develop methods to accurately identify patients with axSpA in a large dataset.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods.<\/jats:title><jats:p>The study population included 600 chart-reviewed veterans, with and without axSpA, in the Veterans Health Administration between January 1, 2005, and June 30, 2015. AxSpA identification algorithms were developed with variables anticipated by clinical experts to be predictive of an axSpA diagnosis [demographics, billing codes, healthcare use, medications, laboratory results, and natural language processing (NLP) for key SpA features]. Random Forest and 5-fold cross validation were used for algorithm development and testing in the training subset (n = 451). The algorithms were additionally tested in an independent testing subset (n = 149).<\/jats:p><\/jats:sec><jats:sec><jats:title>Results.<\/jats:title><jats:p>Three algorithms were developed: Full algorithm, High Feasibility algorithm, and Spond NLP algorithm. In the testing subset, the areas under the curve with the receiver-operating characteristic analysis were 0.96, 0.94, and 0.86, for the Full algorithm, High Feasibility algorithm, and Spond NLP algorithm, respectively. Algorithm sensitivities ranged from 85.0% to 95.0%, specificities from 78.0% to 93.6%, and accuracies from 82.6% to 91.3%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion.<\/jats:title><jats:p>Novel axSpA identification algorithms performed well in classifying patients with axSpA. These algorithms offer a range of performance and feasibility attributes that may be appropriate for a broad array of axSpA studies. Additional research is required to validate the algorithms in other cohorts.<\/jats:p><\/jats:sec>","DOI":"10.3899\/jrheum.181005","type":"journal-article","created":{"date-parts":[[2019,3,15]],"date-time":"2019-03-15T16:34:18Z","timestamp":1552667658000},"page":"42-49","source":"Crossref","is-referenced-by-count":15,"title":["Identification of Axial Spondyloarthritis Patients in a Large Dataset: The Development and Validation of Novel Methods"],"prefix":"10.3899","volume":"47","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4563-0845","authenticated-orcid":false,"given":"Jessica A.","family":"Walsh","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5922-9553","authenticated-orcid":false,"given":"Shaobo","family":"Pei","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gopi","family":"Penmetsa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jared Lareno","family":"Hansen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6640-9173","authenticated-orcid":false,"given":"Grant W.","family":"Cannon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1494-2376","authenticated-orcid":false,"given":"Daniel O.","family":"Clegg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian C.","family":"Sauer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"2262","published-online":{"date-parts":[[2019,3,15]]},"reference":[{"key":"2022092307201003000_47.1.42.1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.23876\/j.krcp.2017.36.1.3","article-title":"Medical big data: promise and challenges","volume":"36","author":"Lee","year":"2017","journal-title":"Kidney Res Clin Pract"},{"key":"2022092307201003000_47.1.42.2","doi-asserted-by":"publisher","DOI":"10.1016\/j.berh.2014.10.007"},{"key":"2022092307201003000_47.1.42.3","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1007\/s12016-017-8637-0","article-title":"Unmet needs in axial spondyloarthritis","volume":"55","author":"Lubrano","year":"2018","journal-title":"Clin Rev Allergy Immunol"},{"key":"2022092307201003000_47.1.42.4","doi-asserted-by":"crossref","first-page":"369","DOI":"10.2217\/cer-2017-0076","article-title":"Treatment patterns of biologics in US patients with ankylosing spondylitis: descriptive analyses from a claims database","volume":"7","author":"Walsh","year":"2018","journal-title":"J Comp Eff Res"},{"key":"2022092307201003000_47.1.42.5","doi-asserted-by":"crossref","first-page":"1769","DOI":"10.1007\/s10067-016-3231-z","article-title":"Ankylosing spondylitis diagnosis in US patients with back pain: identifying providers involved and factors associated with rheumatology referral delay","volume":"35","author":"Deodhar","year":"2016","journal-title":"Clin Rheumatol"},{"key":"2022092307201003000_47.1.42.6","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1002\/acr.23478","article-title":"Incident spine surgery in patients with ankylosing spondylitis: a secondary cohort analysis of a nationwide, population-based health claims database","volume":"70","author":"Lu","year":"2018","journal-title":"Arthritis Care Res"},{"key":"2022092307201003000_47.1.42.7","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1002\/acr.22934","article-title":"Cervical spinal fracture and other diagnoses associated with mortality in hospitalized ankylosing spondylitis patients","volume":"69","author":"Wysham","year":"2017","journal-title":"Arthritis Care Res"},{"key":"2022092307201003000_47.1.42.8","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1097\/BOR.0000000000000475","article-title":"Epidemiology of axial spondyloarthritis: an update","volume":"30","author":"Wang","year":"2018","journal-title":"Curr Opin Rheumatol"},{"key":"2022092307201003000_47.1.42.9","doi-asserted-by":"crossref","unstructured":"Baraliakos X Braun J . Non-radiographic axial spondyloarthritis and ankylosing spondylitis: what are the similarities and differences? RMD Open 2015;Suppl 1: e000053.","DOI":"10.1136\/rmdopen-2015-000053"},{"key":"2022092307201003000_47.1.42.10","doi-asserted-by":"publisher","DOI":"10.1097\/MAJ.0b013e318294457f"},{"issue":"Suppl 73","key":"2022092307201003000_47.1.42.11","first-page":"S132","article-title":"Axial spondyloarthritis: thoughts about nomenclature and treatment targets","volume":"4","author":"Braun","year":"2012","journal-title":"Clin Exp Rheumatol"},{"key":"2022092307201003000_47.1.42.12","doi-asserted-by":"publisher","DOI":"10.1136\/ard.2009.108233"},{"key":"2022092307201003000_47.1.42.13","doi-asserted-by":"publisher","DOI":"10.1097\/BOR.0000000000000071"},{"key":"2022092307201003000_47.1.42.14","first-page":"770","article-title":"Non-radiographic axial spondyloarthritis","volume":"17","author":"Slobodin","year":"2015","journal-title":"Isr Med Assoc J"},{"key":"2022092307201003000_47.1.42.15","doi-asserted-by":"crossref","unstructured":"Sarmiento RF Dernoncourt F . Improving patient cohort identification using natural language processing. In: Secondary analysis of electronic health records. New York: Springer, Cham; 2016:405\u201317.","DOI":"10.1007\/978-3-319-43742-2_28"},{"key":"2022092307201003000_47.1.42.16","doi-asserted-by":"publisher","DOI":"10.1002\/acr.20184"},{"key":"2022092307201003000_47.1.42.17","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.1002\/acr.23140","article-title":"Identifying axial spondyloarthritis in electronic medical records of US veterans","volume":"69","author":"Walsh","year":"2017","journal-title":"Arthritis Care Res"},{"key":"2022092307201003000_47.1.42.18","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1186\/s12891-018-2211-7","article-title":"Cohort identification of axial spondyloarthritis in a large healthcare dataset: current and future methods","volume":"19","author":"Walsh","year":"2018","journal-title":"BMC Musculoskelet Disord"},{"key":"2022092307201003000_47.1.42.19","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.2014.0054"},{"key":"2022092307201003000_47.1.42.20","unstructured":"U.S. Department of Veterans Affairs . VA Informatics and Computing Infrastructure (VINCI). [Internet. Accessed June 10, 2019.] Available from: www.hsrd.research.va.gov\/for_researchers\/vinci"},{"key":"2022092307201003000_47.1.42.21","doi-asserted-by":"publisher","DOI":"10.1002\/acr.22456"},{"key":"2022092307201003000_47.1.42.22","unstructured":"R Core Team . The R Project for Statistical Computing. [Internet. Accessed June 10, 2019.] www.R-project.org"},{"key":"2022092307201003000_47.1.42.23","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781107415324.004"},{"key":"2022092307201003000_47.1.42.24","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbs034"},{"key":"2022092307201003000_47.1.42.25","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbs006"},{"key":"2022092307201003000_47.1.42.26","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1109\/TPAMI.2009.187","article-title":"Sensitivity analysis of kappa-fold cross validation in prediction error estimation","volume":"32","author":"Rodr\u00edguez","year":"2010","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"2022092307201003000_47.1.42.27","unstructured":"Chang CC Lin CJ . LIBSVM \u2014 a library for support vector machines. [Internet. Accessed June 10, 2019.] Available from: www.csie.ntu.edu.tw\/~cjlin\/libsvm"},{"key":"2022092307201003000_47.1.42.28","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s12859-016-0900-5","article-title":"An experimental study of the intrinsic stability of random forest variable importance measures","volume":"17","author":"Wang","year":"2016","journal-title":"BMC Bioinformatics"},{"key":"2022092307201003000_47.1.42.29","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2015.12.029"},{"key":"2022092307201003000_47.1.42.30","first-page":"768","article-title":"Bootstrap tutorial","volume":"9","author":"Varian","year":"2005","journal-title":"Math J"},{"key":"2022092307201003000_47.1.42.31","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001915"},{"key":"2022092307201003000_47.1.42.32","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocu050"},{"key":"2022092307201003000_47.1.42.33","doi-asserted-by":"publisher","DOI":"10.3899\/jrheum.170554"},{"key":"2022092307201003000_47.1.42.34","doi-asserted-by":"publisher","DOI":"10.3899\/jrheum.140675"},{"key":"2022092307201003000_47.1.42.35","doi-asserted-by":"publisher","DOI":"10.1002\/acr.20629"},{"key":"2022092307201003000_47.1.42.36","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1002\/pds.3720","article-title":"The use of natural language processing of infusion notes to identify outpatient infusions","volume":"24","author":"Nelson","year":"2015","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"2022092307201003000_47.1.42.37","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1002\/pds.3815","article-title":"Errata to NLP study of infusion notes to identify outpatient infusions in the VA","volume":"24","author":"Sauer","year":"2015","journal-title":"Pharmacoepidemiol Drug Saf"}],"container-title":["The Journal of Rheumatology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.3899\/jrheum.181005","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,23]],"date-time":"2022-09-23T14:24:48Z","timestamp":1663943088000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.jrheum.org\/lookup\/doi\/10.3899\/jrheum.181005"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,15]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1,1]]},"published-print":{"date-parts":[[2020,1]]}},"alternative-id":["10.3899\/jrheum.181005"],"URL":"https:\/\/doi.org\/10.3899\/jrheum.181005","relation":{},"ISSN":["0315-162X","1499-2752"],"issn-type":[{"value":"0315-162X","type":"print"},{"value":"1499-2752","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,15]]}}}