{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T18:35:51Z","timestamp":1791052551105,"version":"4.1.0"},"reference-count":33,"publisher":"BMJ","issue":"2","license":[{"start":{"date-parts":[[2021,5,30]],"date-time":"2021-05-30T00:00:00Z","timestamp":1622332800000},"content-version":"unspecified","delay-in-days":29,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["RMD Open"],"accepted":{"date-parts":[[2021,5,7]]},"published-print":{"date-parts":[[2021,5]]},"abstract":"<jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>To develop a prediction model to guide annual assessment of systemic sclerosis (SSc) patients tailored in accordance to disease activity.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>A machine learning approach was used to develop a model that can identify patients without disease progression. SSc patients included in the prospective Leiden SSc cohort and fulfilling the ACR\/EULAR 2013 criteria were included. Disease progression was defined as progression in \u22651 organ system, and\/or start of immunosuppression or death. Using elastic-net-regularisation, and including 90 independent clinical variables (100% complete), we trained the model on 75% and validated it on 25% of the patients, optimising on negative predictive value (NPV) to minimise the likelihood of missing progression. Probability cutoffs were identified for low and high risk for disease progression by expert assessment.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Of the 492 SSc patients (follow-up range: 2\u201310\u2009years), disease progression during follow-up was observed in 52% (median time 4.9\u2009years). Performance of the model in the test set showed an AUC-ROC of 0.66. Probability score cutoffs were defined: low risk for disease progression (&lt;0.197, NPV:1.0; 29% of patients), intermediate risk (0.197\u20130.223, NPV:0.82; 27%) and high risk (&gt;0.223, NPV:0.78; 44%). The relevant variables for the model were: previous use of cyclophosphamide or corticosteroids, start with immunosuppressive drugs, previous gastrointestinal progression, previous cardiovascular event, pulmonary arterial hypertension, modified Rodnan Skin Score, creatine kinase and diffusing capacity for carbon monoxide.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>Our machine-learning-assisted model for progression enabled us to classify 29% of SSc patients as \u2018low risk\u2019. In this group, annual assessment programmes could be less extensive than indicated by international guidelines.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/rmdopen-2020-001524","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T15:16:06Z","timestamp":1622474166000},"page":"e001524","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":10,"title":["New risk model is able to identify patients with a low risk of progression in systemic sclerosis"],"prefix":"10.1136","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4228-012X","authenticated-orcid":false,"given":"Nina Marijn","family":"van Leeuwen","sequence":"first","affiliation":[{"name":"Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Maurits","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sophie","family":"Liem","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacopo","family":"Ciaffi","sequence":"additional","affiliation":[{"name":"Medicine and Rheumatology Unit, IRCCS Istituto Ortopedico Rizzoli, Bologna, Emilia-Romagna, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nina","family":"Ajmone Marsan","sequence":"additional","affiliation":[{"name":"Cardiology, Leiden University Medical Center, Leiden, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maarten","family":"Ninaber","sequence":"additional","affiliation":[{"name":"Pulmonology, Leiden University Medical Center, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cornelia","family":"Allaart","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Henrike","family":"Gillet van Dongen","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, Medisch Centrum Haaglanden, Den Haag, Zuid-Holland, The Netherlands"},{"name":"LangeLand Hospital, Zoetermeer, Zuid-Holland, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robbert","family":"Goekoop","sequence":"additional","affiliation":[{"name":"Rheumatology, HagaZiekenhuis, The Hague, Zuid-Holland, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7033-7520","authenticated-orcid":false,"given":"Tom","family":"Huizinga","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7494-3023","authenticated-orcid":false,"given":"Rachel","family":"Knevel","sequence":"additional","affiliation":[{"name":"Rheumatology, Brigham and Women's Hospital, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeska","family":"De Vries-Bouwstra","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, Leiden University Medical Center, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2021,5,31]]},"reference":[{"key":"2025090313454865000_7.2.e001524.1","doi-asserted-by":"publisher","DOI":"10.1038\/nrdp.2015.2"},{"key":"2025090313454865000_7.2.e001524.2","doi-asserted-by":"publisher","DOI":"10.1136\/annrheumdis-2019-215145"},{"key":"2025090313454865000_7.2.e001524.3","doi-asserted-by":"publisher","DOI":"10.1016\/j.berh.2009.12.002"},{"key":"2025090313454865000_7.2.e001524.4","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/s13075-020-2113-6","article-title":"Early trajectories of skin thickening are associated with severity and mortality in systemic sclerosis","volume":"22","author":"Ledoult","year":"2020","journal-title":"Arthritis Res Ther"},{"key":"2025090313454865000_7.2.e001524.5","doi-asserted-by":"publisher","DOI":"10.1136\/annrheumdis-2019-215787"},{"key":"2025090313454865000_7.2.e001524.6","doi-asserted-by":"publisher","DOI":"10.1136\/annrheumdis-2018-213201"},{"key":"2025090313454865000_7.2.e001524.7","doi-asserted-by":"publisher","DOI":"10.1183\/13993003.00522-2017"},{"key":"2025090313454865000_7.2.e001524.8","doi-asserted-by":"publisher","DOI":"10.1136\/rmdopen-2018-000826"},{"key":"2025090313454865000_7.2.e001524.9","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1002\/art.40027","article-title":"Early mortality in a multinational systemic sclerosis inception cohort","volume":"69","author":"Hao","year":"2017","journal-title":"Arthritis Rheumatol"},{"key":"2025090313454865000_7.2.e001524.10","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1093\/rheumatology\/kez005","article-title":"Prognostic properties of anti-topoisomerase antibodies in patients identified by the ACR\/EULAR 2013 systemic sclerosis criteria","volume":"58","author":"Boonstra","year":"2019","journal-title":"Rheumatology"},{"key":"2025090313454865000_7.2.e001524.11","doi-asserted-by":"publisher","DOI":"10.1136\/rmdopen-2015-000159"},{"key":"2025090313454865000_7.2.e001524.12","first-page":"1573","article-title":"Criteria for the classification of early systemic sclerosis","volume":"28","author":"LeRoy","year":"2001","journal-title":"J Rheumatol"},{"key":"2025090313454865000_7.2.e001524.13","first-page":"1281","article-title":"Inter and intraobserver variability of total skin thickness score (modified Rodnan TSS) in systemic sclerosis","volume":"22","author":"Clements","year":"1995","journal-title":"J Rheumatol"},{"key":"2025090313454865000_7.2.e001524.14","doi-asserted-by":"publisher","DOI":"10.1002\/1529-0131(200103)44:3<653::AID-ANR114>3.0.CO;2-Q"},{"key":"2025090313454865000_7.2.e001524.15","unstructured":"Ware JE , Kosinski M , Keller S . SF-36 physical and mental health summary scales: a user\u2019s manual: Health Assessment Lab, 1994."},{"key":"2025090313454865000_7.2.e001524.16","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2006.07.001"},{"key":"2025090313454865000_7.2.e001524.17","doi-asserted-by":"publisher","DOI":"10.1136\/ard.2007.070532"},{"key":"2025090313454865000_7.2.e001524.18","doi-asserted-by":"publisher","DOI":"10.1007\/s10067-013-2321-4"},{"key":"2025090313454865000_7.2.e001524.19","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-199711000-00002"},{"key":"2025090313454865000_7.2.e001524.20","first-page":"1574","article-title":"Kwaliteit van leven meten in economische evaluaties: Het Nederlands EQ-5D-tarief","volume":"149","author":"Lamers","year":"2005","journal-title":"Ned Tijdschr Geneeskd"},{"key":"2025090313454865000_7.2.e001524.21","article-title":"Translation, cross-cultural adaptation, and validation of the UCLA scleroderma clinical trial Consortium gastrointestinal tract instrument (SCTC GIT) 2.0 into Dutch","volume":"32","author":"Meijs","year":"2014","journal-title":"Clin Exp Rheumatol"},{"key":"2025090313454865000_7.2.e001524.22","doi-asserted-by":"publisher","DOI":"10.1002\/art.22987"},{"key":"2025090313454865000_7.2.e001524.23","doi-asserted-by":"publisher","DOI":"10.1002\/art.1780230510"},{"key":"2025090313454865000_7.2.e001524.24","doi-asserted-by":"publisher","DOI":"10.1136\/annrheumdis-2013-204424"},{"key":"2025090313454865000_7.2.e001524.25","doi-asserted-by":"publisher","DOI":"10.1183\/13993003.01032-2015"},{"key":"2025090313454865000_7.2.e001524.26","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1002\/art.40809","article-title":"Generation of a core set of items to develop classification criteria for scleroderma renal crisis using consensus methodology","volume":"71","author":"Butler","year":"2019","journal-title":"Arthritis Rheumatol"},{"key":"2025090313454865000_7.2.e001524.27","doi-asserted-by":"publisher","DOI":"10.1183\/13993003.02026-2019"},{"key":"2025090313454865000_7.2.e001524.28","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1903076"},{"key":"2025090313454865000_7.2.e001524.29","doi-asserted-by":"publisher","DOI":"10.1136\/rmdopen-2016-000384"},{"key":"2025090313454865000_7.2.e001524.30","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2014.6368"},{"key":"2025090313454865000_7.2.e001524.31","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1016\/S2213-2600(20)30318-0","article-title":"Tocilizumab in systemic sclerosis: a randomised, double-blind, placebo-controlled, phase 3 trial","volume":"8","author":"Khanna","year":"2020","journal-title":"Lancet Respir Med"},{"key":"2025090313454865000_7.2.e001524.32","doi-asserted-by":"crossref","first-page":"1350","DOI":"10.1002\/art.41294","article-title":"Safety and efficacy of Lenabasum in a phase II, randomized, placebo-controlled trial in adults with systemic sclerosis","volume":"72","author":"Spiera","year":"2020","journal-title":"Arthritis Rheumatol"},{"key":"2025090313454865000_7.2.e001524.33","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J Royal Statistical Soc B"}],"container-title":["RMD Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/rmdopen-2020-001524","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T20:45:55Z","timestamp":1756932355000},"score":1,"resource":{"primary":{"URL":"https:\/\/rmdopen.bmj.com\/lookup\/doi\/10.1136\/rmdopen-2020-001524"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,5,31]]},"published-print":{"date-parts":[[2021,5]]}},"alternative-id":["10.1136\/rmdopen-2020-001524"],"URL":"https:\/\/doi.org\/10.1136\/rmdopen-2020-001524","relation":{},"ISSN":["2056-5933"],"issn-type":[{"value":"2056-5933","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5]]}}}