{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T20:05:39Z","timestamp":1760731539214,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,8,4]],"date-time":"2022-08-04T00:00:00Z","timestamp":1659571200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Italian Ministry of Health"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Objective: To assess the reliability of the myeloma spine and bone damage score (MSBDS) across multiple readers with different levels of expertise and from different institutions. Methods: A reliability exercise, including 104 data sets of static images and complete CT examinations of patients affected by multiple myeloma (MM), was performed. A complementary imaging atlas provided detailed examples of the MSBDS scores, including low-risk and high-risk lesions. A total of 15 readers testing the MSBDS were evaluated. ICC estimates and their 95% confidence intervals were calculated based on mean rating (k = 15), absolute agreement, a two-way random-effects model and Cronbach\u2019s alpha. Results: Overall, the ICC correlation coefficient was 0.87 (95% confidence interval: 0.79\u20130.92), and the Cronbach\u2019s alpha was 0.93 (95% confidence interval: 0.94\u20130.97). Global inter- and intra-observer agreement among the 15 readers with scores below or equal to 6 points and scores above 6 points were 0.81 (95% C.I.: 0.72\u20130.86) and 0.94 (95% C.I.:0.91\u20130.98), respectively. Conclusion: We present a consensus-based semiquantitative scoring systems for CT in MM with a complementary CT imaging atlas including detailed examples of relevant scoring techniques. We found substantial agreement among readers with different levels of experience, thereby supporting the role of the MSBDS for possible large-scale applications. Significance and Innovations \u2022 Based on previous work and definitions of the MSBDS, we present real-life reliability data for quantitative bone damage assessment in multiple myeloma (MM) patients on CT. \u2022 In this study, reliability for the MSBDS, which was tested on 15 readers with different levels of expertise and from different institutions, was shown to be moderate to excellent. \u2022 The complementary CT imaging atlas is expected to enhance unified interpretations of the MSBDS between different professionals dealing with MM patients in their routine clinical practice.<\/jats:p>","DOI":"10.3390\/diagnostics12081894","type":"journal-article","created":{"date-parts":[[2022,8,4]],"date-time":"2022-08-04T21:52:48Z","timestamp":1659649968000},"page":"1894","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Myeloma Spine and Bone Damage Score (MSBDS) on Whole-Body Computed Tomography (WBCT): Multiple Reader Agreement in a Multicenter Reliability Study"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1736-0697","authenticated-orcid":false,"given":"Alberto Stefano","family":"Tagliafico","sequence":"first","affiliation":[{"name":"Department of Health Sciences, University of Genoa, 16132 Genoa, Italy"},{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2478-8878","authenticated-orcid":false,"given":"Clarissa","family":"Valle","sequence":"additional","affiliation":[{"name":"School of Medicine, University Milano Bicocca, 20126 Milan, Italy"},{"name":"Department of Diagnostic Radiology, Papa Giovanni XXIII Hospital, 24127 Bergamo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5335-9429","authenticated-orcid":false,"given":"Pietro Andrea","family":"Bonaffini","sequence":"additional","affiliation":[{"name":"School of Medicine, University Milano Bicocca, 20126 Milan, Italy"},{"name":"Department of Diagnostic Radiology, Papa Giovanni XXIII Hospital, 24127 Bergamo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ali","family":"Attieh","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1937-9116","authenticated-orcid":false,"given":"Matteo","family":"Bauckneht","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, University of Genoa, 16132 Genoa, Italy"},{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0508-6344","authenticated-orcid":false,"given":"Liliana","family":"Belgioia","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, University of Genoa, 16132 Genoa, Italy"},{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bianca","family":"Bignotti","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2487-248X","authenticated-orcid":false,"given":"Nicole","family":"Brunetti","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, University of Genoa, 16132 Genoa, Italy"},{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6616-0347","authenticated-orcid":false,"given":"Alessandro","family":"Bonsignore","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, University of Genoa, 16132 Genoa, Italy"},{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enrico","family":"Capaccio","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sara","family":"De Giorgis","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, University of Genoa, 16132 Genoa, Italy"},{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessandro","family":"Garlaschi","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Silvia","family":"Morbelli","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, University of Genoa, 16132 Genoa, Italy"},{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9732-8288","authenticated-orcid":false,"given":"Federica","family":"Rossi","sequence":"additional","affiliation":[{"name":"Department of Radiology, Ospedale Santa Corona, 17027 Pietra Ligure, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1587-2763","authenticated-orcid":false,"given":"Lorenzo","family":"Torri","sequence":"additional","affiliation":[{"name":"Department of Vascular Surgery, AOU Pisana, 56124 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6017-9968","authenticated-orcid":false,"given":"Simone","family":"Caprioli","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"},{"name":"Department of Internal Medicine, University of Genoa, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simona","family":"Tosto","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1530-6729","authenticated-orcid":false,"given":"Michele","family":"Cea","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"},{"name":"Department of Internal Medicine, University of Genoa, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9143-3714","authenticated-orcid":false,"given":"Alida","family":"Dominietto","sequence":"additional","affiliation":[{"name":"Ospedale Policlinico San Martino, 16132 Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1053\/j.sult.2020.08.019","article-title":"Multiple Myeloma: Role of Imaging in Diagnosis, Staging, and Treatment Response Assessment","volume":"42","author":"Nassar","year":"2021","journal-title":"Semin. Ultrasound CT MR"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1055\/a-0897-3966","article-title":"Multiple Myeloma Guidelines and Their Recent Updates: Implications for Imaging","volume":"191","author":"Mosebach","year":"2019","journal-title":"Rofo"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Salwender, H., Bertsch, U., Weisel, K., Duerig, J., Kunz, C., Benner, A., Blau, I.W., Raab, M.S., Hillengass, J., and Hose, D. (2019). Rationale and design of the German-Speaking myeloma multicenter group (GMMG) trial HD6: A randomized phase III trial on the effect of elotuzumab in VRD induction\/consolidation and lenalidomide maintenance in patients with newly diagnosed myeloma. BMC Cancer, 19.","DOI":"10.1186\/s12885-019-5600-x"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"108739","DOI":"10.1016\/j.ejrad.2019.108739","article-title":"Differentiating diffuse from focal pattern on Computed Tomography in multiple myeloma: Added value of a Radiomics approach","volume":"121","author":"Tagliafico","year":"2019","journal-title":"Eur. J. Radiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"S80","DOI":"10.1016\/j.clml.2017.02.018","article-title":"High-Risk Multiple Myeloma: Definition and Management","volume":"17","author":"Joseph","year":"2017","journal-title":"Clin. Lymphoma Myeloma Leuk."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2863","DOI":"10.1200\/JCO.2015.61.2267","article-title":"Revised International Staging System for Multiple Myeloma: A Report From International Myeloma Working Group","volume":"33","author":"Palumbo","year":"2015","journal-title":"J. Clin. Oncol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1002\/jmri.27637","article-title":"Prediction of High-Risk Cytogenetic Status in Multiple Myeloma Based on Magnetic Resonance Imaging: Utility of Radiomics and Comparison of Machine Learning Methods","volume":"54","author":"Liu","year":"2021","journal-title":"J. Magn. Reson. Imaging"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1097\/MNM.0000000000001259","article-title":"99mTc-sestamibi SPECT\/CT and 18F-FDG-PET\/CT have similar performance but different imaging patterns in newly diagnosed multiple myeloma","volume":"41","author":"Mosci","year":"2020","journal-title":"Nucl. Med. Commun."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"223","DOI":"10.4329\/wjr.v13.i7.223","article-title":"Imaging in multiple myeloma: Computed tomography or magnetic resonance imaging?","volume":"13","author":"Tagliafico","year":"2021","journal-title":"World J. Radiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1080\/16078454.2021.1926101","article-title":"Feasibility of six cycles of lenalidomide-based triplet induction before stem cell collection for newly diagnosed transplant-eligible multiple myeloma","volume":"26","author":"Yoshihara","year":"2021","journal-title":"Hematology"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tagliafico, A.S., Dominietto, A., Belgioia, L., Campi, C., Schenone, D., and Piana, M. (2021). Quantitative Imaging and Radiomics in Multiple Myeloma: A Potential Opportunity?. Medicina, 57.","DOI":"10.3390\/medicina57020094"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tagliafico, A.S., Belgioia, L., Bonsignore, A., Rossi, F., Succio, G., Bignotti, B., and Dominietto, A. (2020). Subspecialty Second-Opinion in Multiple Myeloma CT: Emphasis on Clinically Significant Lytic Lesions. Medicina, 56.","DOI":"10.3390\/medicina56040195"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1186\/s40644-020-00306-1","article-title":"Development and definition of a simplified scoring system in patients with multiple myeloma undergoing stem cells transplantation on standard computed tomography: Myeloma spine and bone damage score (MSBDS)","volume":"20","author":"Tagliafico","year":"2020","journal-title":"Cancer Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Shoukri, M.M., Colak, D., Kaya, N., and Donner, A. (2008). Comparison of two dependent within subject coefficients of variation to evaluate the reproducibility of measurement devices. BMC Med. Res. Methodol., 8.","DOI":"10.1186\/1471-2288-8-24"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: Uses in assessing rater reliability","volume":"86","author":"Shrout","year":"1979","journal-title":"Psychol. Bull."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Christiansen, S.N., \u00d8stergaard, M., Slot, O., Fana, V., and Terslev, L. (2022). Retrospective longitudinal assessment of the ultrasound gout lesions using the OMERACT semi-Quantitative scoring system. Rheumatology.","DOI":"10.1093\/rheumatology\/keac179"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Di Matteo, A., Cipolletta, E., Destro Castaniti, G.M., Smerilli, G., Airoldi, C., Aydin, S.Z., Becciolini, A., Bonfiglioli, K., Bruns, A., and Carrara, G. (2022). Reliability assessment of the definition of ultrasound enthesitis in SpA: Results of a large, multicentre, international web-Based study. Rheumatology.","DOI":"10.1093\/rheumatology\/keac162"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e418","DOI":"10.1200\/EDBK_159009","article-title":"Updated Diagnostic Criteria and Staging System for Multiple Myeloma","volume":"35","author":"Rajkumar","year":"2016","journal-title":"Am. Soc. Clin. Oncol. Educ. Book"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"272","DOI":"10.5312\/wjo.v5.i3.272","article-title":"Imaging of multiple myeloma: Current concepts","volume":"5","author":"Derlin","year":"2014","journal-title":"World J. Orthop."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/978-3-540-85772-3_6","article-title":"Monoclonal gammopathy and smoldering multiple myeloma: Diagnosis, staging, prognosis, management","volume":"183","author":"Hillengass","year":"2011","journal-title":"Recent Results Cancer Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s00256-021-03841-5","article-title":"Imaging of treatment response and minimal residual disease in multiple myeloma: State of the art WB-MRI and PET\/CT","volume":"51","author":"Lecouvet","year":"2022","journal-title":"Skelet. Radiol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1080\/14737140.2019.1674142","article-title":"The evolving role of maintenance therapy following autologous stem cell transplantation in multiple myeloma","volume":"19","author":"Merz","year":"2019","journal-title":"Expert Rev. Anticancer Ther."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4961","DOI":"10.1007\/s00520-022-06896-9","article-title":"Symptom clusters and quality of life in ambulatory patients with multiple myeloma","volume":"30","author":"Chen","year":"2022","journal-title":"Support. Care Cancer"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.clml.2022.01.009","article-title":"Patient-Reported Outcomes in Randomized Controlled Trials of Patients with Multiple Myeloma: A Systematic Literature Review of Studies Published Between 2014 and 2021","volume":"22","author":"Efficace","year":"2022","journal-title":"Clin. Lymphoma Myeloma Leuk."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5239","DOI":"10.1007\/s00520-022-06943-5","article-title":"A cross-Sectional observational study of health-Related quality of life in adults with multiple myeloma","volume":"30","author":"LeBlanc","year":"2022","journal-title":"Support. Care Cancer"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"901","DOI":"10.3390\/curroncol29020077","article-title":"An Individualized Exercise Intervention for People with Multiple Myeloma-Study Protocol of a Randomized Waitlist-Controlled Trial","volume":"29","author":"Nicol","year":"2022","journal-title":"Curr. Oncol."},{"key":"ref_29","first-page":"253","article-title":"Clinical Practice Guideline: Patients With Multiple Myeloma or Monoclonal Gammopathy of Undetermined Significance-Diagnosis, Treatment, and Follow Up","volume":"119","author":"Piechotta","year":"2022","journal-title":"Dtsch. Arztebl. Int."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"577","DOI":"10.4103\/ajns.AJNS_192_16","article-title":"Utility of Computed Tomography-Guided Biopsy in Evaluation of Metastatic Spinal Lesions","volume":"13","author":"Feroz","year":"2018","journal-title":"Asian J. Neurosurg."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"bcr2017223611","DOI":"10.1136\/bcr-2017-223611","article-title":"Treatment of relapsed multiple myeloma complicated by cardiac extramedullary plasmacytoma with D-PACE chemotherapy","volume":"2018","author":"Toocheck","year":"2018","journal-title":"BMJ Case Rep."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e12327","DOI":"10.1097\/MD.0000000000012327","article-title":"Multiple myeloma with pathologically proven skull plasmacytoma after a mild head injury: Case report","volume":"97","author":"Yang","year":"2018","journal-title":"Medicine"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"310","DOI":"10.2214\/AJR.21.26534","article-title":"Prediction of Early Treatment Response in Multiple Myeloma Using MY-RADS Total Burden Score, ADC, and Fat Fraction From Whole-Body MRI: Impact of Anemia on Predictive Performance","volume":"218","author":"Dong","year":"2022","journal-title":"AJR Am. J. Roentgenol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1148\/radiol.2019181949","article-title":"Guidelines for Acquisition, Interpretation, and Reporting of Whole-Body MRI in Myeloma: Myeloma Response Assessment and Diagnosis System (MY-RADS)","volume":"291","author":"Messiou","year":"2019","journal-title":"Radiology"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/s00256-021-03755-2","article-title":"Myeloma Response Assessment and Diagnosis System (MY-RADS): Strategies for practice implementation","volume":"51","author":"Mulligan","year":"2022","journal-title":"Skelet. Radiol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"109154","DOI":"10.1016\/j.ejrad.2020.109154","article-title":"Spectrum of magnetic resonance imaging findings in transplanted multiple myeloma patients with hip\/pelvic pain (according to MY-RADS): A single center experience","volume":"130","author":"Rossi","year":"2020","journal-title":"Eur. J. Radiol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"E1221","DOI":"10.1097\/BRS.0b013e3181e16ae2","article-title":"A novel classification system for spinal instability in neoplastic disease: An evidence-Based approach and expert consensus from the Spine Oncology Study Group","volume":"35","author":"Fisher","year":"2010","journal-title":"Spine"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/12\/8\/1894\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:04:13Z","timestamp":1760141053000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/12\/8\/1894"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,4]]},"references-count":37,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["diagnostics12081894"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics12081894","relation":{},"ISSN":["2075-4418"],"issn-type":[{"type":"electronic","value":"2075-4418"}],"subject":[],"published":{"date-parts":[[2022,8,4]]}}}