{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,2]],"date-time":"2026-11-02T18:22:14Z","timestamp":1793643734705,"version":"4.5.1"},"reference-count":30,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:00:00Z","timestamp":1652140800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurol."],"abstract":"<jats:sec><jats:title>Purpose<\/jats:title><jats:p>Lesion number and burden can predict the long-term outcome of multiple sclerosis, while the localization of the lesions is also a good predictive marker of disease progression. These biomarkers are used in studies and in clinical practice, but the reproducibility of lesion count is not well-known.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>In total, five raters evaluated T2 hyperintense lesions in 140 patients with multiple sclerosis in six localizations: periventricular, juxtacortical, deep white matter, infratentorial, spinal cord, and optic nerve. Black holes on T1-weighted images and brain atrophy were subjectively measured on a binary scale. Reproducibility was measured using the intraclass correlation coefficient (ICC). ICCs were also calculated for the four most accurate raters to see how one outlier can influence the results.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Overall, moderate reproducibility (ICC 0.5\u20130.75) was shown, which did not improve considerably when the most divergent rater was excluded. The areas that produced the worst results were the optic nerve region (ICC: 0.118) and atrophy judgment (ICC: 0.364). Comparing high- and low-lesion burdens in each region revealed that the ICC is higher when the lesion count is in the mid-range. In the periventricular and deep white matter area, where lesions are common, higher ICC was found in patients who had a lower lesion count. On the other hand, juxtacortical lesions and black holes that are less common showed higher ICC when the subjects had more lesions. This difference was significant in the juxtacortical region when the most accurate raters compared patients with low (ICC: 0.406 CI: 0.273\u20130.546) and high (0.702 CI: 0.603\u20130.785) lesion loads.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>Lesion classification showed high variability by location and overall moderate reproducibility. The excellent range was not achieved, owing to the fact that some areas showed poor performance. Hence, putting effort toward the development of artificial intelligence for the evaluation of lesion burden should be considered.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fneur.2022.843377","type":"journal-article","created":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T06:23:22Z","timestamp":1652163802000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Reproducibility of Lesion Count in Various Subregions on MRI Scans in Multiple Sclerosis"],"prefix":"10.3389","volume":"13","author":[{"given":"Bence","family":"Bozsik","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eszter","family":"T\u00f3th","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilona","family":"Poly\u00e1k","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fanni","family":"Kerekes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikoletta","family":"Szab\u00f3","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Krisztina","family":"Bencsik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"P\u00e9ter","family":"Kliv\u00e9nyi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zsigmond Tam\u00e1s","family":"Kincses","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,5,10]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1016\/S1474-4422(15)00393-2","article-title":"MRI criteria for the diagnosis of multiple sclerosis: MAGNIMS consensus guidelines","volume":"15","author":"Filippi","year":"2016","journal-title":"Lancet Neurol."},{"key":"B2","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1016\/S1474-4422(17)30470-2","article-title":"Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria","volume":"17","author":"Thompson","year":"2018","journal-title":"Lancet Neurol."},{"key":"B3","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1016\/j.msard.2018.03.002","article-title":"Lesion accumulation is predictive of long-term cognitive decline in multiple sclerosis","volume":"21","author":"Ouellette","year":"2018","journal-title":"Mult Scler Relat Disord."},{"key":"B4","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1136\/jnnp-2011-301178","article-title":"Relationship between early clinical characteristics and long term disability outcomes: 16 year cohort study (follow-up) of the pivotal interferon \u03b2-1b trial in multiple sclerosis","volume":"83","author":"Goodin","year":"2012","journal-title":"J Neurol Neurosurg Psychiatry."},{"key":"B5","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1177\/1352458516642314","article-title":"Combining clinical and magnetic resonance imaging markers enhances prediction of 12-year disability in multiple sclerosis","volume":"23","author":"Uher","year":"2017","journal-title":"Mult Scler."},{"key":"B6","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1148\/radiol.2019181719","article-title":"Longitudinal characterization of cortical lesion development and evolution in multiple sclerosis with 7.0-T","volume":"291","author":"Treaba","year":"2019","journal-title":"MRI Radiol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"2952","DOI":"10.1093\/brain\/aws246","article-title":"Cortical lesion load associates with progression of disability in multiple sclerosis","volume":"135","author":"Calabrese","year":"2012","journal-title":"Brain"},{"key":"B8","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/j.msard.2016.05.012","article-title":"A lesion topography-based approach to predict the outcomes of patients with multiple sclerosis treated with Interferon Beta","volume":"8","author":"Galassi","year":"2016","journal-title":"Mult Scler Relat Disord."},{"key":"B9","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1001\/archneur.61.2.217","article-title":"Infratentorial lesions predict long-term disability in patients with initial findings suggestive of multiple sclerosis","volume":"61","author":"Minneboo","year":"2004","journal-title":"Arch Neurol."},{"key":"B10","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.msard.2019.01.039","article-title":"Highly active multiple sclerosis: An update","volume":"30","author":"D\u00edaz","year":"2019","journal-title":"Mult Scler Relat Disord."},{"key":"B11","first-page":"371","article-title":"Effect of template reporting of brain MRIs for multiple sclerosis on report thoroughness and neurologist-rated quality: results of a prospective quality improvement project","volume-title":"J Am Coll Radiol.","author":"Dickerson","year":"2017"},{"key":"B12","doi-asserted-by":"publisher","first-page":"24","DOI":"10.2214\/AJR.17.18451","article-title":"Do MRI structured reports for multiple sclerosis contain adequate information for clinical decision making?","volume":"210","author":"Alessandrino","year":"2018","journal-title":"AJR Am J Roentgenol."},{"key":"B13","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1007\/s002340050762","article-title":"Interobserver agreement for diagnostic MRI criteria in suspected multiple sclerosis","volume":"41","author":"Barkhof","year":"1999","journal-title":"Neuroradiology."},{"key":"B14","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1191\/1352458503ms956oa","article-title":"Interobserver agreement on Poser's and the new McDonald's diagnostic criteria for multiple sclerosis","volume":"9","author":"Zipoli","year":"2003","journal-title":"Mult Scler."},{"key":"B15","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1007\/s00330-006-0303-5","article-title":"Interobserver agreement on the radiological criteria of the International Panel on the diagnosis of multiple sclerosis","volume":"17","author":"Korteweg","year":"2007","journal-title":"Eur Radiol."},{"key":"B16","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1002\/ana.22366","article-title":"Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria","volume":"69","author":"Polman","year":"2011","journal-title":"Ann Neurol."},{"key":"B17","doi-asserted-by":"publisher","first-page":"81","DOI":"10.18071\/isz.71.0081","article-title":"The role of MRI in measuring the effectivity of disease modifying treatments II","volume":"71","author":"Kincses","year":"2018","journal-title":"Ideggyogy Sz."},{"key":"B18","doi-asserted-by":"publisher","first-page":"77","DOI":"10.18071\/isz.71.0077","article-title":"The role of MRI in measuring the effectivity of disease modifying treatments I","volume":"71","author":"T\u00f3th","year":"2018","journal-title":"Ideggyogy Sz."},{"key":"B19","first-page":"155","article-title":"Erratum to \u201cA Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research\u201d","volume-title":"J Chiropr Med","author":"Terry","year":"2016"},{"key":"B20","doi-asserted-by":"publisher","first-page":"e0172923","DOI":"10.1371\/journal.pone.0172923","article-title":"Reliability of cortical lesion detection on double inversion recovery MRI applying the MAGNIMS-Criteria in multiple sclerosis patients within a 16-months period","volume":"12","author":"Faizy","year":"2017","journal-title":"PLoS ONE."},{"key":"B21","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1177\/1352458509102907","article-title":"Accumulation of cortical lesions in MS: relation with cognitive impairment","volume":"15","author":"Roosendaal","year":"2009","journal-title":"Mult Scler."},{"key":"B22","doi-asserted-by":"publisher","first-page":"1004","DOI":"10.1001\/jamaneurol.2015.1241","article-title":"Association of cortical lesion burden on 7-T magnetic resonance imaging with cognition and disability in multiple sclerosis","volume":"72","author":"Harrison","year":"2015","journal-title":"JAMA Neurol."},{"key":"B23","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1055\/s-2006-931847","article-title":"Double inversion recovery brain imaging at 3T: diagnostic value in the detection of multiple sclerosis lesions","volume":"28","author":"Wattjes","year":"2007","journal-title":"AJNR Am J Neuroradiol."},{"key":"B24","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1007\/s00234-011-0886-7","article-title":"Segmentation of multiple sclerosis lesions in MR images: a review","volume":"54","author":"Mortazavi","year":"2012","journal-title":"Neuroradiology."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1109\/TMI.2011.2114671","article-title":"Trimmed-likelihood estimation for focal lesions and tissue segmentation in multisequence MRI for multiple sclerosis","volume":"30","author":"Garc\u00eda-Lorenzo","year":"2011","journal-title":"IEEE Trans Med Imaging."},{"key":"B26","doi-asserted-by":"publisher","first-page":"1031","DOI":"10.1007\/s00234-015-1552-2","article-title":"A toolbox for multiple sclerosis lesion segmentation","volume":"57","author":"Roura","year":"2015","journal-title":"Neuroradiology."},{"key":"B27","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1016\/j.nicl.2015.05.003","article-title":"Automatic segmentation and volumetry of multiple sclerosis brain lesions from MR images","volume":"8","author":"Jain","year":"2015","journal-title":"Neuroimage Clin."},{"key":"B28","article-title":"Bayesian inference for structured additive regres- sion models for large-scale problems with applications to medical imaging","volume-title":"Munich: Ludwig-Maximilians University, Munich.","author":"Schmidt","year":"2017"},{"key":"B29","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/j.neuroimage.2016.07.018","article-title":"BIANCA (Brain Intensity AbNormality Classification Algorithm): A new tool for automated segmentation of white matter hyperintensities","volume":"141","author":"Griffanti","year":"2016","journal-title":"Neuroimage."},{"key":"B30","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1016\/j.nicl.2015.05.001","article-title":"Rotation-invariant multi-contrast non-local means for MS lesion segmentation","volume":"8","author":"Guizard","year":"2015","journal-title":"Neuroimage Clin."}],"container-title":["Frontiers in Neurology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2022.843377\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T06:23:26Z","timestamp":1652163806000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fneur.2022.843377\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,10]]},"references-count":30,"alternative-id":["10.3389\/fneur.2022.843377"],"URL":"https:\/\/doi.org\/10.3389\/fneur.2022.843377","relation":{},"ISSN":["1664-2295"],"issn-type":[{"value":"1664-2295","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,10]]},"article-number":"843377"}}