{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T01:01:13Z","timestamp":1788829273855,"version":"build-2803163510"},"reference-count":24,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T00:00:00Z","timestamp":1689811200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U22A2023"],"award-info":[{"award-number":["U22A2023"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61971447"],"award-info":[{"award-number":["61971447"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["81421004"],"award-info":[{"award-number":["81421004"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["81301268"],"award-info":[{"award-number":["81301268"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004826","name":"Beijing Natural Science Foundation","doi-asserted-by":"publisher","award":["JQ18023"],"award-info":[{"award-number":["JQ18023"]}],"id":[{"id":"10.13039\/501100004826","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fundamental Research Funds for the Central Public-interest Scientific Institution of Chinese Academy of Medical Sciences","award":["2021-PT320-002"],"award-info":[{"award-number":["2021-PT320-002"]}]},{"name":"CAMS Innovation Fund for Medical Sciences","award":["2021-I2M-1\u2013005"],"award-info":[{"award-number":["2021-I2M-1\u2013005"]}]},{"name":"National High Level Hospital Clinical Research Funding","award":["2022-PUMCH-D-002, 2022-PUMCH-C-009"],"award-info":[{"award-number":["2022-PUMCH-D-002, 2022-PUMCH-C-009"]}]},{"name":"National High Level Hospital Clinical Research Funding","award":["2022-PUMCH-A-225"],"award-info":[{"award-number":["2022-PUMCH-A-225"]}]},{"name":"National High Level Hospital Clinical Research Funding","award":["2022-PUMCH-B-064"],"award-info":[{"award-number":["2022-PUMCH-B-064"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>We aimed to investigate the value of deep learning (DL) models based on multimodal ultrasonographic (US) images to quantify RA activity.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>Static greyscale (SGS), dynamic greyscale (DGS), static power Doppler (SPD) and dynamic power Doppler (DPD) US images were collected and evaluated by two expert radiologists according to the EULAR\u2013OMERACT Synovitis Scoring system. Four DL models were developed based on the ResNet-type structure, evaluated on two separate test cohorts, and finally compared with the performance of 12 radiologists with different levels of experience.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In total, 1244 images were used for the model training, and 152 and 354 for testing (cohort 1 and 2, respectively). The best-performing models for the scores of 0\/1\/2\/3 were the DPD, SGS, DGS and SPD models, respectively (Area Under the receiver operating characteristic Curve [AUC]\u2009=\u20090.87\/0.95\/0.74\/0.95; no significant differences). All the DL models provided results comparable to the experienced radiologists on a per-image basis (intraclass correlation coefficient: 0.239\u20130.756, P\u2009&amp;lt;\u20090.05). The SPD model performed better than the SGS one on test cohort 1 (score of 0\/2\/3: AUC\u2009=\u20090.82\/0.67\/0.95 vs 0.66\/0.66\/0.75, respectively) and test cohort 2 (score of 0: AUC\u2009=\u20090.89 vs 0.81). The dynamic DL models performed better than the static ones in most of the scoring processes and were more accurate than the most of senior radiologists, especially the DPD model.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>DL models based on multimodal US images allow a quantitative and objective assessment of RA activity. Dynamic DL models in particular have potential value in assisting radiologists to improve the accuracy of RA US-based grading.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/rheumatology\/kead366","type":"journal-article","created":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T19:03:49Z","timestamp":1689879829000},"page":"866-873","source":"Crossref","is-referenced-by-count":21,"title":["Deep learning-based automatic scoring models for the disease activity of rheumatoid arthritis based on multimodal ultrasound images"],"prefix":"10.1093","volume":"63","author":[{"given":"Xuelei","family":"He","sequence":"first","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"},{"name":"School of Information Sciences and Technology, Northwest University , Xi\u2019an, Shaanxi Province, People\u2019s Republic of China"},{"name":"CAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenyang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4541-9898","authenticated-orcid":false,"given":"Qian","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rui","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jian","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Rheumatology and Immunology, Aerospace Center Hospital, Peking University Aerospace School of Clinical Medicine , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yixiu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenhong","family":"Qi","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Na","family":"Su","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yao","family":"Wei","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Gui","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianchu","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1511-7952","authenticated-orcid":false,"given":"Xinping","family":"Tian","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3883-2318","authenticated-orcid":false,"given":"Xiaofeng","family":"Zeng","sequence":"additional","affiliation":[{"name":"Department of Rheumatology, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxin","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kun","family":"Wang","sequence":"additional","affiliation":[{"name":"CAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meng","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College , Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,7,20]]},"reference":[{"key":"2024030205503460900_kead366-B1","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1016\/S0140-6736(10)60826-4","article-title":"Rheumatoid arthritis","volume":"376","author":"Scott","year":"2010","journal-title":"Lancet"},{"key":"2024030205503460900_kead366-B2","doi-asserted-by":"crossref","first-page":"2023","DOI":"10.1016\/S0140-6736(16)30173-8","article-title":"Rheumatoid arthritis","volume":"388","author":"Smolen","year":"2016","journal-title":"Lancet"},{"key":"2024030205503460900_kead366-B3","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1136\/annrheumdis-2015-207524","article-title":"Treating rheumatoid arthritis to target: 2014 update of the recommendations of an international task force","volume":"75","author":"Smolen","year":"2016","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B4","doi-asserted-by":"crossref","first-page":"e000428","DOI":"10.1136\/rmdopen-2016-000428","article-title":"Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce\u2014Part 1: definition and development of a standardised, consensus-based scoring system","volume":"3","author":"D\u2019Agostino","year":"2017","journal-title":"RMD Open"},{"key":"2024030205503460900_kead366-B5","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.1136\/annrheumdis-2016-209646","article-title":"Novel algorithms for the pragmatic use of ultrasound in the management of patients with rheumatoid arthritis: from diagnosis to remission","volume":"75","author":"D'Agostino","year":"2016","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B6","doi-asserted-by":"crossref","first-page":"804","DOI":"10.1136\/annrheumdis-2012-203158","article-title":"EULAR recommendations for the use of imaging of the joints in the clinical management of rheumatoid arthritis","volume":"72","author":"Colebatch","year":"2013","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B7","doi-asserted-by":"crossref","first-page":"840","DOI":"10.1136\/annrheumdis-2020-219816","article-title":"EULAR recommendations for the reporting of ultrasound studies in rheumatic and musculoskeletal diseases (RMDs)","volume":"80","author":"Costantino","year":"2021","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B8","doi-asserted-by":"crossref","first-page":"1974","DOI":"10.1136\/annrheumdis-2017-211585","article-title":"The 2017 EULAR standardised procedures for ultrasound imaging in rheumatology","volume":"76","author":"M\u00f6ller","year":"2017","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B9","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1136\/annrheumdis-2016-210815","article-title":"EULAR recommendations for the use of imaging in the clinical management of peripheral joint osteoarthritis","volume":"76","author":"Sakellariou","year":"2017","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B10","doi-asserted-by":"crossref","first-page":"1763","DOI":"10.1136\/annrheumdis-2015-207709","article-title":"Value of ultrasonography as a marker of early response to abatacept in patients with rheumatoid arthritis and an inadequate response to methotrexate: results from the APPRAISE study","volume":"75","author":"D'Agostino","year":"2016","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B11","doi-asserted-by":"crossref","first-page":"e56","DOI":"10.1136\/annrheumdis-2018-213278","article-title":"Forward to the past: ultrasound might be necessary in some patients with rheumatoid arthritis","volume":"78","author":"Gadeholt","year":"2019","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B12","doi-asserted-by":"crossref","first-page":"i4205","DOI":"10.1136\/bmj.i4205","article-title":"Ultrasound in management of rheumatoid arthritis: ARCTIC randomised controlled strategy trial","volume":"354","author":"Haavardsholm","year":"2016","journal-title":"BMJ"},{"key":"2024030205503460900_kead366-B13","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1136\/ard.2004.030387","article-title":"Interobserver reliability of rheumatologists performing musculoskeletal ultrasonography: results from a EULAR \u201cTrain the trainers\u201d course","volume":"64","author":"Scheel","year":"2005","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B14","doi-asserted-by":"crossref","first-page":"e000427","DOI":"10.1136\/rmdopen-2016-000427","article-title":"Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce\u2014Part 2: reliability and application to multiple joints of a standardised consensus-based scoring system","volume":"3","author":"Terslev","year":"2017","journal-title":"RMD Open"},{"key":"2024030205503460900_kead366-B15","doi-asserted-by":"crossref","first-page":"1995","DOI":"10.1136\/ard.2011.152926","article-title":"Examination of intra and interrater reliability with a new ultrasonographic reference atlas for scoring of synovitis in patients with rheumatoid arthritis","volume":"70","author":"Hammer","year":"2011","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B16","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med Image Anal"},{"key":"2024030205503460900_kead366-B17","doi-asserted-by":"crossref","first-page":"e000891","DOI":"10.1136\/rmdopen-2018-000891","article-title":"Neural networks for automatic scoring of arthritis disease activity on ultrasound images","volume":"5","author":"Andersen","year":"2019","journal-title":"RMD Open"},{"key":"2024030205503460900_kead366-B18","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1136\/annrheumdis-2019-216636","article-title":"Applying cascaded convolutional neural network design further enhances automatic scoring of arthritis disease activity on ultrasound images from rheumatoid arthritis patients","volume":"79","author":"Christensen","year":"2020","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B19","doi-asserted-by":"crossref","first-page":"1238","DOI":"10.1002\/acr.21679","article-title":"Reliability of the novel 7-joint ultrasound score: results from an inter-and intraobserver study performed by rheumatologists","volume":"64","author":"Ohrndorf","year":"2012","journal-title":"Arthritis Care Res"},{"key":"2024030205503460900_kead366-B20","first-page":"248","author":"Deng","year":"2009"},{"key":"2024030205503460900_kead366-B21","doi-asserted-by":"crossref","first-page":"283","DOI":"10.3390\/jcm10020283","article-title":"A Pragmatic application of ultrasonography for the assessment of disease activity in patients with early inflammatory arthritis","volume":"10","author":"Nam","year":"2021","journal-title":"J Clin Med"},{"key":"2024030205503460900_kead366-B22","doi-asserted-by":"crossref","first-page":"2799","DOI":"10.1007\/s10067-017-3662-1","article-title":"Reliability of ultrasound grading traditional score and new global OMERACT-EULAR score system (GLOESS): results from an inter-and intra-reading exercise by rheumatologists","volume":"36","author":"Ventura-R\u00edos","year":"2017","journal-title":"Clinical rheumatology"},{"key":"2024030205503460900_kead366-B23","doi-asserted-by":"crossref","first-page":"1658","DOI":"10.1136\/ard.2005.051250","article-title":"Assessing the intra-and inter-reader reliability of dynamic ultrasound images in power Doppler ultrasonography","volume":"65","author":"Koski","year":"2006","journal-title":"Ann Rheum Dis"},{"key":"2024030205503460900_kead366-B24","doi-asserted-by":"crossref","first-page":"1284","DOI":"10.1136\/ard.2003.012393","article-title":"Detection of small joint synovitis by ultrasonography: the learning curve of rheumatologists","volume":"63","author":"d\u2019Agostino","year":"2004","journal-title":"Ann Rheum Dis"}],"container-title":["Rheumatology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/rheumatology\/advance-article-pdf\/doi\/10.1093\/rheumatology\/kead366\/51003006\/kead366.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/rheumatology\/article-pdf\/63\/3\/866\/56818803\/kead366.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/rheumatology\/article-pdf\/63\/3\/866\/56818803\/kead366.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,2]],"date-time":"2024-03-02T05:51:45Z","timestamp":1709358705000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/rheumatology\/article\/63\/3\/866\/7227068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,20]]},"references-count":24,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,7,20]]},"published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/rheumatology\/kead366","relation":{},"ISSN":["1462-0324","1462-0332"],"issn-type":[{"value":"1462-0324","type":"print"},{"value":"1462-0332","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3,1]]},"published":{"date-parts":[[2023,7,20]]}}}