{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,2]],"date-time":"2026-11-02T14:03:10Z","timestamp":1793628190075,"version":"4.5.1"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005006","name":"Asan Institute for Life Sciences, Asan Medical Center","doi-asserted-by":"crossref","award":["2020IP0025"],"award-info":[{"award-number":["2020IP0025"]}],"id":[{"id":"10.13039\/501100005006","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003052","name":"Ministry of Trade, Industry and Energy","doi-asserted-by":"crossref","award":["20004927"],"award-info":[{"award-number":["20004927"]}],"id":[{"id":"10.13039\/501100003052","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Arthritis Res Ther"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>We developed a model to predict remissions in patients treated with biologic disease-modifying anti-rheumatic drugs (bDMARDs) and to identify important clinical features associated with remission using explainable artificial intelligence (XAI).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We gathered the follow-up data of 1204 patients treated with bDMARDs (etanercept, adalimumab, golimumab, infliximab, abatacept, and tocilizumab) from the Korean College of Rheumatology Biologics and Targeted Therapy Registry. Remission was predicted at 1-year follow-up using baseline clinical data obtained at the time of enrollment. Machine learning methods (e.g., lasso, ridge, support vector machine, random forest, and XGBoost) were used for the predictions. The Shapley additive explanation (SHAP) value was used for interpretability of the predictions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The ranges for accuracy and area under the receiver operating characteristic of the newly developed machine learning model for predicting remission were 52.8\u201372.9% and 0.511\u20130.694, respectively. The Shapley plot in XAI showed that the impacts of the variables on predicting remission differed for each bDMARD. The most important features were age for adalimumab, rheumatoid factor for etanercept, erythrocyte sedimentation rate for infliximab and golimumab, disease duration for abatacept, and C-reactive protein for tocilizumab, with mean SHAP values of \u2212 0.250, \u2212 0.234, \u2212 0.514, \u2212 0.227, \u2212 0.804, and 0.135, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Our proposed machine learning model successfully identified clinical features that were predictive of remission in each of the bDMARDs. This approach may be useful for improving treatment outcomes by identifying clinical information related to remissions in patients with rheumatoid arthritis.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13075-021-02567-y","type":"journal-article","created":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:02:54Z","timestamp":1625529774000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":66,"title":["Machine learning model for identifying important clinical features for predicting remission in patients with rheumatoid arthritis treated with biologics"],"prefix":"10.1186","volume":"23","author":[{"given":"Bon San","family":"Koo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seongho","family":"Eun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kichul","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyemin","family":"Yoon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaelin","family":"Hong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Do-Hoon","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seokchan","family":"Hong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong-Gil","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chang-Keun","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Yoo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0205-6492","authenticated-orcid":false,"given":"Ji Seon","family":"Oh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,7,6]]},"reference":[{"issue":"6","key":"2567_CR1","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1136\/annrheumdis-2019-216655","volume":"79","author":"JS Smolen","year":"2020","unstructured":"Smolen JS, Landewe RBM, Bijlsma JWJ, Burmester GR, Dougados M, Kerschbaumer A, et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2019 update. Ann Rheum Dis. 2020;79(6):685\u201399. https:\/\/doi.org\/10.1136\/annrheumdis-2019-216655.","journal-title":"Ann Rheum Dis"},{"issue":"3","key":"2567_CR2","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1111\/1756-185X.13513","volume":"22","author":"CS Lau","year":"2019","unstructured":"Lau CS, Chia F, Dans L, Harrison A, Hsieh TY, Jain R, et al. 2018 update of the APLAR recommendations for treatment of rheumatoid arthritis. Int J Rheum Dis. 2019;22(3):357\u201375. https:\/\/doi.org\/10.1111\/1756-185X.13513.","journal-title":"Int J Rheum Dis"},{"issue":"1","key":"2567_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/art.39480","volume":"68","author":"JA Singh","year":"2016","unstructured":"Singh JA, Saag KG, Bridges SL Jr, Akl EA, Bannuru RR, Sullivan MC, et al. 2015 American College of Rheumatology Guideline for the Treatment of Rheumatoid Arthritis. Arthritis Rheumatol. 2016;68(1):1\u201326. https:\/\/doi.org\/10.1002\/art.39480.","journal-title":"Arthritis Rheumatol"},{"issue":"5","key":"2567_CR4","doi-asserted-by":"publisher","first-page":"1400","DOI":"10.1002\/art.20217","volume":"50","author":"EC Keystone","year":"2004","unstructured":"Keystone EC, Kavanaugh AF, Sharp JT, Tannenbaum H, Hua Y, Teoh LS, et al. Radiographic, clinical, and functional outcomes of treatment with adalimumab (a human anti-tumor necrosis factor monoclonal antibody) in patients with active rheumatoid arthritis receiving concomitant methotrexate therapy: a randomized, placebo-controlled, 52-week trial. Arthritis Rheum. 2004;50(5):1400\u201311. https:\/\/doi.org\/10.1002\/art.20217.","journal-title":"Arthritis Rheum"},{"issue":"4","key":"2567_CR5","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1056\/NEJM199901283400401","volume":"340","author":"ME Weinblatt","year":"1999","unstructured":"Weinblatt ME, Kremer JM, Bankhurst AD, Bulpitt KJ, Fleischmann RM, Fox RI, et al. A trial of etanercept, a recombinant tumor necrosis factor receptor:Fc fusion protein, in patients with rheumatoid arthritis receiving methotrexate. N Engl J Med. 1999;340(4):253\u20139. https:\/\/doi.org\/10.1056\/NEJM199901283400401.","journal-title":"N Engl J Med"},{"issue":"9","key":"2567_CR6","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1136\/ard.2007.083675","volume":"67","author":"W Kievit","year":"2008","unstructured":"Kievit W, Adang EM, Fransen J, Kuper HH, van de Laar MA, Jansen TL, et al. The effectiveness and medication costs of three anti-tumour necrosis factor alpha agents in the treatment of rheumatoid arthritis from prospective clinical practice data. Ann Rheum Dis. 2008;67(9):1229\u201334. https:\/\/doi.org\/10.1136\/ard.2007.083675.","journal-title":"Ann Rheum Dis"},{"issue":"4","key":"2567_CR7","doi-asserted-by":"publisher","first-page":"177","DOI":"10.4110\/in.2015.15.4.177","volume":"15","author":"YJ Park","year":"2015","unstructured":"Park YJ, Chung MK, Hwang D, Kim WU. Proteomics in rheumatoid arthritis research. Immune Netw. 2015;15(4):177\u201385. https:\/\/doi.org\/10.4110\/in.2015.15.4.177.","journal-title":"Immune Netw"},{"issue":"1","key":"2567_CR8","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1093\/rheumatology\/kez113","volume":"59","author":"D Plant","year":"2020","unstructured":"Plant D, Barton A. Adding value to real-world data: the role of biomarkers. Rheumatology (Oxford). 2020;59(1):31\u20138. https:\/\/doi.org\/10.1093\/rheumatology\/kez113.","journal-title":"Rheumatology (Oxford)"},{"issue":"4","key":"2567_CR9","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1080\/1744666X.2020.1740594","volume":"16","author":"M Sutcliffe","year":"2020","unstructured":"Sutcliffe M, Radley G, Barton A. Personalized medicine in rheumatic diseases: how close are we to being able to use genetic biomarkers to predict response to TNF inhibitors? Expert Rev Clin Immunol. 2020;16(4):389\u201396. https:\/\/doi.org\/10.1080\/1744666X.2020.1740594.","journal-title":"Expert Rev Clin Immunol"},{"issue":"12","key":"2567_CR10","doi-asserted-by":"publisher","first-page":"1987","DOI":"10.1002\/art.41056","volume":"71","author":"Y Guan","year":"2019","unstructured":"Guan Y, Zhang H, Quang D, Wang Z, Parker SCJ, Pappas DA, et al. Machine learning to predict anti-tumor necrosis factor drug responses of rheumatoid arthritis patients by integrating clinical and genetic markers. Arthritis Rheumatol. 2019;71(12):1987\u201396. https:\/\/doi.org\/10.1002\/art.41056.","journal-title":"Arthritis Rheumatol"},{"issue":"3","key":"2567_CR11","doi-asserted-by":"publisher","first-page":"e190606","DOI":"10.1001\/jamanetworkopen.2019.0606","volume":"2","author":"B Norgeot","year":"2019","unstructured":"Norgeot B, Glicksberg BS, Trupin L, Lituiev D, Gianfrancesco M, Oskotsky B, et al. Assessment of a deep learning model based on electronic health record data to forecast clinical outcomes in patients with rheumatoid arthritis. JAMA Netw Open. 2019;2(3):e190606. https:\/\/doi.org\/10.1001\/jamanetworkopen.2019.0606.","journal-title":"JAMA Netw Open"},{"key":"2567_CR12","unstructured":"Lundberg SM, Erion GG, Lee S-I: Consistent individualized feature attribution for tree ensembles. In: arXiv e-prints. 2018: arXiv:1802.03888."},{"issue":"Suppl 2","key":"2567_CR13","first-page":"1153","volume":"73","author":"K Shin","year":"2014","unstructured":"Shin K, Choi SJ, Kwak S-K, Park Y-B, Sung Y-K, Choi C-B, et al. AB1066\u00a0Korean Biologics Registry of Patients with Systemic Rheumatic Disease (KOBIO): a nationwide registry to assess adverse events associated with biologic treatment in Korea. Ann Rheum Dis. 2014;73(Suppl 2):1153\u20134.","journal-title":"Ann Rheum Dis"},{"issue":"1","key":"2567_CR14","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc B (Methodological). 1996;58(1):267\u201388. https:\/\/doi.org\/10.1111\/j.2517-6161.1996.tb02080.x.","journal-title":"J R Stat Soc B (Methodological)"},{"issue":"3","key":"2567_CR15","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1023\/A:1018628609742","volume":"9","author":"JAK Suykens","year":"1999","unstructured":"Suykens JAK, Vandewalle J. Least squares support vector machine classifiers. Neural Process Lett. 1999;9(3):293\u2013300. https:\/\/doi.org\/10.1023\/A:1018628609742.","journal-title":"Neural Process Lett"},{"key":"2567_CR16","unstructured":"Liaw A, Wiener M. Classification and regression by randomForest. R News. 2002;2\/3:18\u20132. http:\/\/cran.rproject.org\/doc\/Rnews\/Rnews_2002-3.pdf."},{"key":"2567_CR17","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1145\/2939672.2939785","volume-title":"Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"T Chen","year":"2016","unstructured":"Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco: Association for Computing Machinery; 2016. p. 785\u201394."},{"key":"2567_CR18","unstructured":"Lundberg SM, Lee S-I.. A unified approach to interpreting model predictions. In: Guyon I, et al, editors. Advances in Neural Information Processing Systems. Long Beach: NIPS; 2017. p. 4765\u20134774. http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-modelpredictions.pdf."},{"key":"2567_CR19","unstructured":"Arrow KJ, Barankin EW, Blackwell D, Bott R, Dalkey N, Dresher M, Gale D, Gillies DB, Glicksberg I, Gross O et al: Contributions to the theory of games (AM-28), Volume II: Princeton University Press; 1953."},{"issue":"2","key":"2567_CR20","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1136\/annrheumdis-2013-204016","volume":"74","author":"Y Tanaka","year":"2015","unstructured":"Tanaka Y, Hirata S, Kubo S, Fukuyo S, Hanami K, Sawamukai N, et al. Discontinuation of adalimumab after achieving remission in patients with established rheumatoid arthritis: 1-year outcome of the HONOR study. Ann Rheum Dis. 2015;74(2):389\u201395. https:\/\/doi.org\/10.1136\/annrheumdis-2013-204016.","journal-title":"Ann Rheum Dis"},{"issue":"8","key":"2567_CR21","doi-asserted-by":"publisher","first-page":"1466","DOI":"10.1093\/rheumatology\/kew179","volume":"55","author":"N Vastesaeger","year":"2016","unstructured":"Vastesaeger N, Kutzbach AG, Amital H, Pavelka K, Lazaro MA, Moots RJ, et al. Prediction of remission and low disease activity in disease-modifying anti-rheumatic drug-refractory patients with rheumatoid arthritis treated with golimumab. Rheumatol (Oxford). 2016;55(8):1466\u201376. https:\/\/doi.org\/10.1093\/rheumatology\/kew179.","journal-title":"Rheumatol (Oxford)"},{"issue":"Suppl 7A","key":"2567_CR22","doi-asserted-by":"publisher","first-page":"50S","DOI":"10.1016\/j.amjmed.2003.12.012","volume":"116","author":"A Wilson","year":"2004","unstructured":"Wilson A, Yu HT, Goodnough LT, Nissenson AR. Prevalence and outcomes of anemia in rheumatoid arthritis: a systematic review of the literature. Am J Med. 2004;116(Suppl 7A):50S\u20137S.","journal-title":"Am J Med"},{"issue":"4","key":"2567_CR23","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1136\/annrheumdis-2012-202709","volume":"73","author":"B Moller","year":"2014","unstructured":"Moller B, Scherer A, Forger F, Villiger PM, Finckh A. Swiss Clinical Quality Management Program for Rheumatic D: Anaemia may add information to standardised disease activity assessment to predict radiographic damage in rheumatoid arthritis: a prospective cohort study. Ann Rheum Dis. 2014;73(4):691\u20136. https:\/\/doi.org\/10.1136\/annrheumdis-2012-202709.","journal-title":"Ann Rheum Dis"},{"issue":"11","key":"2567_CR24","doi-asserted-by":"publisher","first-page":"2020","DOI":"10.1093\/rheumatology\/kes184","volume":"51","author":"H Canhao","year":"2012","unstructured":"Canhao H, Rodrigues AM, Mourao AF, Martins F, Santos MJ, Canas-Silva J, et al. Comparative effectiveness and predictors of response to tumour necrosis factor inhibitor therapies in rheumatoid arthritis. Rheumatology (Oxford). 2012;51(11):2020\u20136. https:\/\/doi.org\/10.1093\/rheumatology\/kes184.","journal-title":"Rheumatology (Oxford)"},{"issue":"1","key":"2567_CR25","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1136\/ard.2007.084715","volume":"68","author":"C Potter","year":"2009","unstructured":"Potter C, Hyrich KL, Tracey A, Lunt M, Plant D, Symmons DP, et al. Association of rheumatoid factor and anti-cyclic citrullinated peptide positivity, but not carriage of shared epitope or PTPN22 susceptibility variants, with anti-tumour necrosis factor response in rheumatoid arthritis. Ann Rheum Dis. 2009;68(1):69\u201374. https:\/\/doi.org\/10.1136\/ard.2007.084715.","journal-title":"Ann Rheum Dis"},{"issue":"5","key":"2567_CR26","doi-asserted-by":"publisher","first-page":"826","DOI":"10.1093\/rheumatology\/kev421","volume":"55","author":"BV Cuppen","year":"2016","unstructured":"Cuppen BV, Welsing PM, Sprengers JJ, Bijlsma JW, Marijnissen AC, van Laar JM, et al. Personalized biological treatment for rheumatoid arthritis: a systematic review with a focus on clinical applicability. Rheumatology (Oxford). 2016;55(5):826\u201339. https:\/\/doi.org\/10.1093\/rheumatology\/kev421.","journal-title":"Rheumatology (Oxford)"},{"issue":"4","key":"2567_CR27","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1093\/rheumatology\/ker300","volume":"51","author":"PP Tak","year":"2012","unstructured":"Tak PP. A personalized medicine approach to biologic treatment of rheumatoid arthritis: a preliminary treatment algorithm. Rheumatology (Oxford). 2012;51(4):600\u20139. https:\/\/doi.org\/10.1093\/rheumatology\/ker300.","journal-title":"Rheumatology (Oxford)"}],"container-title":["Arthritis Research &amp; Therapy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13075-021-02567-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13075-021-02567-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13075-021-02567-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:03:15Z","timestamp":1625529795000},"score":1,"resource":{"primary":{"URL":"https:\/\/arthritis-research.biomedcentral.com\/articles\/10.1186\/s13075-021-02567-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,6]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["2567"],"URL":"https:\/\/doi.org\/10.1186\/s13075-021-02567-y","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-273642\/v1","asserted-by":"object"}]},"ISSN":["1478-6362"],"issn-type":[{"value":"1478-6362","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,6]]},"assertion":[{"value":"24 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The patients provided informed consent prior to registration. Ethical approvals for the KOBIO-RA were obtained from the institutional review boards of all 38 participating institutions, including the Institutional Review Board of Inje University Seoul Paik Hospital (PAIK 2018-11-005).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"178"}}