{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T10:13:28Z","timestamp":1784196808321,"version":"3.55.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T00:00:00Z","timestamp":1763596800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T00:00:00Z","timestamp":1763596800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To evaluate the inter-rater reliability of the Visually AcceSAble Rembrandt Images (VASARI) feature set in glioma imaging assessment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and methods<\/jats:title>\n                    <jats:p>Three board-certified radiologists independently analyzed 33 adult type glioma cases (20 glioblastomas, seven astrocytomas, five oligodendrogliomas, and one undefined subtype glioma) using 26 VASARI features and three additional non-VASARI features. Inter-rater reliability was assessed using Fleiss\u2019 kappa and Gwet\u2019s AC with conditional confidence intervals. Ordinal weighting was applied to relevant features.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>High inter-rater reliability was observed for multifocality, enhancement quality, cyst presence, enhanced tumor crossing of midline, and calvarial remodeling. There was poor agreement for diffusion characteristics, hemorrhage presence, involvement of eloquent brain regions, and T1\/FLAIR ratio. Several features, including ependymal invasion and tumor size, showed borderline reliability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Inter-rater reliability varied across the 29 features evaluated for glioma imaging. Eleven features demonstrated high reliability, and four showed poor agreement. The remaining features exhibited varying levels of reliability, with some falling in a borderline range, indicating areas for potential improvement in standardization and assessment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Clinical trial number<\/jats:title>\n                    <jats:p>N\/A.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12880-025-01941-5","type":"journal-article","created":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T16:32:52Z","timestamp":1763656372000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Assessing inter-rater reliability of MRI features in glioma: a multi-radiologist agreement study"],"prefix":"10.1186","volume":"25","author":[{"given":"Alisa","family":"Mohebbi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saeed","family":"Mohammadzadeh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amir Hessam","family":"Zare","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zahra","family":"Moradi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ali Abbasian","family":"Ardakani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Afshin","family":"Mohammadi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,11,20]]},"reference":[{"key":"1941_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-031-23705-8_1","volume":"1405","author":"LM Wang","year":"2023","unstructured":"Wang LM, Englander ZK, Miller ML, Bruce JN. Malignant glioma. Adv Exp Med Biol. 2023;1405:1\u201330.","journal-title":"Adv Exp Med Biol"},{"issue":"suppl4","key":"1941_CR2","doi-asserted-by":"publisher","first-page":"iv1","DOI":"10.1093\/neuonc\/noy131","volume":"20","author":"QT Ostrom","year":"2018","unstructured":"Ostrom QT, Gittleman H, Truitt G, Boscia A, Kruchko C, Barnholtz-Sloan JS. CBTRUS statistical report: primary brain and other central nervous system tumors diagnosed in the United States in 2011\u20132015. Neuro Oncol. 2018;20(suppl4):iv1\u201386.","journal-title":"Neuro Oncol"},{"issue":"1","key":"1941_CR3","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1007\/s00701-025-06593-6","volume":"167","author":"A Falk Delgado","year":"2025","unstructured":"Falk Delgado A. Advances of MR imaging in glioma: what the neurosurgeon needs to know. Acta Neurochir. 2025;167(1):174.","journal-title":"Acta Neurochir"},{"issue":"23","key":"1941_CR4","doi-asserted-by":"publisher","first-page":"37884","DOI":"10.18632\/oncotarget.14180","volume":"8","author":"YC Hu","year":"2017","unstructured":"Hu YC, Yan LF, Sun Q, Liu ZC, Wang SM, Han Y, et al. Comparison between ultra-high and conventional mono b-value DWI for preoperative glioma grading. Oncotarget. 2017;8(23):37884\u201395.","journal-title":"Oncotarget"},{"issue":"7","key":"1941_CR5","doi-asserted-by":"publisher","first-page":"11832","DOI":"10.3390\/ijms150711832","volume":"15","author":"K Parvez","year":"2014","unstructured":"Parvez K, Parvez A, Zadeh G. The diagnosis and treatment of pseudoprogression, radiation necrosis and brain tumor recurrence. Int J Mol Sci. 2014;15(7):11832\u201346.","journal-title":"Int J Mol Sci"},{"key":"1941_CR6","doi-asserted-by":"crossref","unstructured":"Almalki YE, Basha MAA, Metwally MI, Zeed NA, Nada MG, Alduraibi SK et al. Validating brain tumor reporting and data system (BT-RADS) as a diagnostic tool for glioma follow-up after surgery. Biomedicines. 2024;12(4).","DOI":"10.3390\/biomedicines12040887"},{"issue":"3","key":"1941_CR7","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1016\/j.rxeng.2024.03.002","volume":"66","author":"A Pons-Escoda","year":"2024","unstructured":"Pons-Escoda A, Majos C, Smits M, Oleaga L. Presurgical diagnosis of diffuse gliomas in adults: Post-WHO 2021 practical perspectives from radiologists in neuro-oncology units. Radiologia (Engl Ed). 2024;66(3):260\u201377.","journal-title":"Radiologia (Engl Ed)"},{"issue":"5","key":"1941_CR8","doi-asserted-by":"publisher","first-page":"e249018","DOI":"10.1148\/rycan.249018","volume":"6","author":"ML Wegscheid","year":"2024","unstructured":"Wegscheid ML, Jennings JW. VASARI glioma features: insights into their impact and performance. Radiol Imaging Cancer. 2024;6(5):e249018.","journal-title":"Radiol Imaging Cancer"},{"key":"1941_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41582-021-00510-y","volume":"17","author":"M Smits","year":"2021","unstructured":"Smits M. MRI biomarkers in neuro-oncology. Nat Reviews Neurol. 2021;17:1\u201315.","journal-title":"Nat Reviews Neurol"},{"issue":"8","key":"1941_CR10","doi-asserted-by":"publisher","first-page":"3306","DOI":"10.1007\/s00330-018-5314-5","volume":"28","author":"SC Thust","year":"2018","unstructured":"Thust SC, Heiland S, Falini A, J\u00e4ger HR, Waldman AD, Sundgren PC, et al. Glioma imaging in europe: A survey of 220 centres and recommendations for best clinical practice. Eur Radiol. 2018;28(8):3306\u201317.","journal-title":"Eur Radiol"},{"issue":"52","key":"1941_CR11","doi-asserted-by":"publisher","first-page":"e23766","DOI":"10.1097\/MD.0000000000023766","volume":"99","author":"L Wang","year":"2020","unstructured":"Wang L, Wei L, Wang J, Li N, Gao Y, Ma H, et al. Evaluation of perfusion MRI value for tumor progression assessment after glioma radiotherapy: A systematic review and meta-analysis. Med (Baltim). 2020;99(52):e23766.","journal-title":"Med (Baltim)"},{"issue":"8","key":"1941_CR12","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.3174\/ajnr.A8274","volume":"45","author":"A Azizova","year":"2024","unstructured":"Azizova A, Prysiazhniuk Y, Wamelink I, Petr J, Barkhof F, Keil VC. Ten years of VASARI glioma features: systematic review and meta-analysis of their impact and performance. AJNR Am J Neuroradiol. 2024;45(8):1053\u201362.","journal-title":"AJNR Am J Neuroradiol"},{"key":"1941_CR13","unstructured":"Scarpace L, Flanders A, Jain R, Mikkelsen T, Andrews D. Data from REMBRANDT [Data set]. The Cancer Imaging Archive. 2019."},{"key":"1941_CR14","unstructured":"Gwet K. Handbook of inter-rater reliability: the definitive guide to measuring the extent of agreement among raters. 2012."},{"issue":"1","key":"1941_CR15","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1038\/s41597-022-01415-1","volume":"9","author":"A Sayah","year":"2022","unstructured":"Sayah A, Bencheqroun C, Bhuvaneshwar K, Belouali A, Bakas S, Sako C, et al. Enhancing the REMBRANDT MRI collection with expert segmentation labels and quantitative radiomic features. Sci Data. 2022;9(1):338.","journal-title":"Sci Data"},{"issue":"4","key":"1941_CR16","first-page":"626","volume":"40","author":"KM Schmainda","year":"2019","unstructured":"Schmainda KM, Prah MA, Hu LS, Quarles CC, Semmineh N, Rand SD, et al. Moving toward a consensus DSC-MRI protocol: validation of a low\u2013flip angle single-dose option as a reference standard for brain tumors. Am J Neuroradiol. 2019;40(4):626\u201333.","journal-title":"Am J Neuroradiol"},{"key":"1941_CR17","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.clinimag.2022.10.011","volume":"93","author":"B Sacli-Bilmez","year":"2023","unstructured":"Sacli-Bilmez B, Firat Z, Topcuoglu OM, Yaltirik K, Ture U, Ozturk-Isik E. Identifying overall survival in 98 glioblastomas using VASARI features at 3T. Clin Imaging. 2023;93:86\u201392.","journal-title":"Clin Imaging"},{"issue":"1","key":"1941_CR18","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1186\/s40644-024-00754-z","volume":"24","author":"Y Han","year":"2024","unstructured":"Han Y, Wang YY, Yang Y, Qiao SQ, Liu ZC, Cui GB, et al. Association between dichotomized VASARI feature and overall survival in glioblastoma patients: a single-institution propensity score matching analysis. Cancer Imaging: Official Publication Int Cancer Imaging Soc. 2024;24(1):109.","journal-title":"Cancer Imaging: Official Publication Int Cancer Imaging Soc"},{"key":"1941_CR19","doi-asserted-by":"publisher","first-page":"16822","DOI":"10.1038\/srep16822","volume":"5","author":"E Rios Velazquez","year":"2015","unstructured":"Rios Velazquez E, Meier R, Dunn WD Jr., Alexander B, Wiest R, Bauer S, et al. Fully automatic GBM segmentation in the TCGA-GBM dataset: prognosis and correlation with VASARI features. Sci Rep. 2015;5:16822.","journal-title":"Sci Rep"},{"key":"1941_CR20","doi-asserted-by":"crossref","unstructured":"Peeken JC, Hesse J, Haller B, Kessel KA, N\u00fcsslin F, Combs SE. Semantic imaging features predict disease progression and survival in glioblastoma multiforme patients. Strahlentherapie und Onkologie: Organ der Deutschen Rontgengesellschaft. 2018;194(6):580\u201390.","DOI":"10.1007\/s00066-018-1276-4"},{"key":"1941_CR21","doi-asserted-by":"publisher","first-page":"4129","DOI":"10.1007\/s00330-017-4789-9","volume":"27","author":"BR van Dijken","year":"2017","unstructured":"van Dijken BR, van Laar PJ, Holtman GA, van der Hoorn A. Diagnostic accuracy of magnetic resonance imaging techniques for treatment response evaluation in patients with high-grade glioma, a systematic review and meta-analysis. Eur Radiol. 2017;27:4129\u201344.","journal-title":"Eur Radiol"},{"key":"1941_CR22","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.mri.2020.09.017","volume":"74","author":"Y Lu","year":"2020","unstructured":"Lu Y, Patel M, Natarajan K, Ughratdar I, Sanghera P, Jena R, et al. Machine learning-based radiomic, clinical and semantic feature analysis for predicting overall survival and MGMT promoter methylation status in patients with glioblastoma. Magn Reson Imaging. 2020;74:161\u201370.","journal-title":"Magn Reson Imaging"},{"issue":"6","key":"1941_CR23","doi-asserted-by":"publisher","first-page":"796","DOI":"10.5152\/dir.2021.20624","volume":"27","author":"\u0130\u00d6 Yeni\u00e7eri","year":"2021","unstructured":"Yeni\u00e7eri \u0130\u00d6, Y\u0131ld\u0131z ME, \u00d6zduman K, Danyeli AE, Pamir MN, Din\u00e7er A. The reliability and interobserver reproducibility of T2\/FLAIR mismatch in the diagnosis of IDH-mutant Astrocytomas. Diagn Interventional Radiol. 2021;27(6):796.","journal-title":"Diagn Interventional Radiol"},{"issue":"4","key":"1941_CR24","doi-asserted-by":"publisher","first-page":"101190","DOI":"10.1016\/j.neurad.2024.03.001","volume":"51","author":"NY Ebaid","year":"2024","unstructured":"Ebaid NY, Ahmed RN, Assy MM, Amin MI, Eldin AMA, Alsowey AM, et al. Diagnostic validity and reliability of BT-RADS in the management of recurrent high-grade glioma. J Neuroradiol. 2024;51(4):101190.","journal-title":"J Neuroradiol"},{"key":"1941_CR25","doi-asserted-by":"publisher","first-page":"1267615","DOI":"10.3389\/fradi.2023.1267615","volume":"3","author":"F Sanvito","year":"2023","unstructured":"Sanvito F, Kaufmann TJ, Cloughesy TF, Wen PY, Ellingson BM. Standardized brain tumor imaging protocols for clinical trials: current recommendations and tips for integration. Front Radiol. 2023;3:1267615.","journal-title":"Front Radiol"},{"issue":"1","key":"1941_CR26","doi-asserted-by":"publisher","first-page":"19898","DOI":"10.1038\/s41598-019-56333-x","volume":"9","author":"P Due-T\u00f8nnessen","year":"2019","unstructured":"Due-T\u00f8nnessen P, Pinho MC, Emblem KE, Hald JK, Kanoto M, Abildgaard A, et al. The impact of MRI features and observer confidence on the treatment decision-making for patients with untreated glioma. Sci Rep. 2019;9(1):19898.","journal-title":"Sci Rep"},{"issue":"1","key":"1941_CR27","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/s40644-023-00638-8","volume":"24","author":"NH Setyawan","year":"2024","unstructured":"Setyawan NH, Choridah L, Nugroho HA, Malueka RG, Dwianingsih EK. Beyond invasive biopsies: using VASARI MRI features to predict grade and molecular parameters in gliomas. Cancer Imaging: Official Publication Int Cancer Imaging Soc. 2024;24(1):3.","journal-title":"Cancer Imaging: Official Publication Int Cancer Imaging Soc"},{"key":"1941_CR28","doi-asserted-by":"crossref","unstructured":"Wegscheid ML, Jennings JW. VASARI glioma features: insights into their impact and performance. Radiol: Imaging Cancer. 2024;6(5):e249018.","DOI":"10.1148\/rycan.249018"},{"issue":"8","key":"1941_CR29","doi-asserted-by":"publisher","first-page":"5320","DOI":"10.1007\/s00330-024-10611-z","volume":"34","author":"A Pons-Escoda","year":"2024","unstructured":"Pons-Escoda A, Garcia-Ruiz A, Naval-Baudin P, Martinez-Zalacain I, Castell J, Camins A, et al. Differentiating IDH-mutant Astrocytomas and 1p19q-codeleted oligodendrogliomas using DSC-PWI: high performance through cerebral blood volume and percentage of signal recovery percentiles. Eur Radiol. 2024;34(8):5320\u201330.","journal-title":"Eur Radiol"},{"issue":"8","key":"1941_CR30","doi-asserted-by":"publisher","first-page":"1267","DOI":"10.1007\/s00234-024-03385-0","volume":"66","author":"A Pons-Escoda","year":"2024","unstructured":"Pons-Escoda A, Naval-Baudin P, Viveros M, Flores-Casaperalta S, Martinez-Zalaca\u00edn I, Plans G, et al. DSC-PWI presurgical differentiation of grade 4 Astrocytoma and glioblastoma in young adults: rCBV percentile analysis across enhancing and non-enhancing regions. Neuroradiology. 2024;66(8):1267\u201377.","journal-title":"Neuroradiology"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-025-01941-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-025-01941-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-025-01941-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T13:16:47Z","timestamp":1781615807000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s12880-025-01941-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,20]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["1941"],"URL":"https:\/\/doi.org\/10.1186\/s12880-025-01941-5","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,20]]},"assertion":[{"value":"2 December 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 September 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 November 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All participants provided written informed consent. We adhered to the principles outlined in the Declaration of Helsinki. Institutional review board of the Thomas Jefferson University approved our dataset.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Human ethics and consent to participate"}},{"value":"N\/A.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Animal study"}},{"value":"N\/A.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"480"}}