{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,6]],"date-time":"2026-11-06T14:07:03Z","timestamp":1793974023064,"version":"4.8.0"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T00:00:00Z","timestamp":1730851200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T00:00:00Z","timestamp":1730851200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Eur Radiol"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Purpose<\/jats:title>\n            <jats:p>The purpose of this study was to assess the inter-reader agreement of the breast imaging reporting and data system (BI-RADS) contrast-enhanced mammography (CEM) lexicon.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Materials and methods<\/jats:title>\n            <jats:p>In this IRB-approved, single-center, retrospective study, three breast radiologists, each with different levels of experience, reviewed 462 lesions in 421 routine clinical CEM according to the fifth edition of the BI-RADS lexicon for mammography and to the first version of the BI-RADS lexicon for CEM. Readers were blinded to patient outcomes and evaluated breast and lesion features on low-energy (LE) images (breast density, type of lesion, associated architectural distortion), lesion features on recombined (RC) images (type of enhancement, characteristic of mass enhancement, non-mass enhancement or enhancing asymmetry), and provided a final BI-RADS assessment. The inter-reader agreement was calculated for each evaluated feature using Fleiss\u2019 kappa coefficient. Sensitivity and specificity were calculated.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>The inter-reader agreement was moderate to substantial for breast density (\u0138\u2009=\u20090.569), type of lesion on LE images (\u0138\u2009=\u20090.654), and type of enhancement (\u0138\u2009=\u20090.664). There was a moderate to substantial agreement on CEM mass enhancement descriptors. The agreement was fair to moderate for non-mass enhancement and enhancing asymmetry descriptors. Inter-reader agreement for LE and LE with RC BI-RADS assessment was moderate (\u0138\u2009=\u20090.421) and fair (\u0138\u2009=\u20090.364). Diagnostic performance was good and comparable for all readers.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Inter-reader agreement of the CEM lexicon was moderate to substantial for most features. There was a low agreement for some RC descriptors, such as non-mass enhancement and enhancing asymmetry, and BI-RADS assessment, but this did not impact the diagnostic performance.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Key Points<\/jats:title>\n            <jats:p>\n              <jats:bold>\n                <jats:italic>Question<\/jats:italic>\n              <\/jats:bold>\n              <jats:italic>Data on the reproducibility and inter-reader agreement for the first version of the BI-RADS lexicon dedicated to CEM are missing<\/jats:italic>.<\/jats:p>\n            <jats:p>\n              <jats:bold>\n                <jats:italic>Finding<\/jats:italic>\n              <\/jats:bold>\n              <jats:italic>The inter-reader agreement for the lexicon was overall substantial to moderate, but it was lower for the descriptors for non-mass enhancement and enhancing asymmetry<\/jats:italic>.<\/jats:p>\n            <jats:p>\n              <jats:bold>\n                <jats:italic>Clinical relevance<\/jats:italic>\n              <\/jats:bold>\n              <jats:italic>A common lexicon simplifies communication between specialists in clinical practice. The good inter-reader agreement confirms the effectiveness of the CEM-BIRADS in ensuring consistent communication. Detailed definitions of some descriptors (non-mass, enhancing asymmetry) are needed to ensure higher agreements<\/jats:italic>.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s00330-024-11176-7","type":"journal-article","created":{"date-parts":[[2024,11,6]],"date-time":"2024-11-06T22:02:34Z","timestamp":1730930554000},"page":"2378-2386","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Inter-reader agreement of the BI-RADS CEM lexicon"],"prefix":"10.1007","volume":"35","author":[{"given":"Calogero","family":"Zarcaro","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ambra","family":"Santonocito","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Layla","family":"Zeitouni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francesca","family":"Ferrara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Panagiotis","family":"Kapetas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruxandra-Iulia","family":"Milos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas H.","family":"Helbich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3755-5398","authenticated-orcid":false,"given":"Pascal A. T.","family":"Baltzer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paola","family":"Clauser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,11,6]]},"reference":[{"key":"11176_CR1","unstructured":"D\u2019Orsi C, Sickles EA, Mendelson EB et al (2013) ACR BI-RADS\u00ae Atlas, breast imaging reporting and data system. American College of Radiology, Reston"},{"key":"11176_CR2","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1148\/radiol.2021201948","volume":"299","author":"MS Jochelson","year":"2021","unstructured":"Jochelson MS, Lobbes MBI (2021) Contrast-enhanced mammography: state of the art. Radiology 299:36\u201348. https:\/\/doi.org\/10.1148\/radiol.2021201948","journal-title":"Radiology"},{"key":"11176_CR3","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1053\/j.sult.2017.08.005","volume":"39","author":"BK Patel","year":"2018","unstructured":"Patel BK, Lobbes MBI, Lewin J (2018) Contrast enhanced spectral mammography: a review. Semin Ultrasound CT MR 39:70\u201379. https:\/\/doi.org\/10.1053\/j.sult.2017.08.005","journal-title":"Semin Ultrasound CT MR"},{"key":"11176_CR4","doi-asserted-by":"publisher","DOI":"10.1186\/bcr3210","volume":"14","author":"C Dromain","year":"2012","unstructured":"Dromain C, Thibault F, Diekmann F et al (2012) Dual-energy contrast-enhanced digital mammography: initial clinical results of a multireader, multicase study. Breast Cancer Res 14:R94. https:\/\/doi.org\/10.1186\/bcr3210","journal-title":"Breast Cancer Res"},{"key":"11176_CR5","doi-asserted-by":"publisher","first-page":"4371","DOI":"10.1007\/s00330-016-4336-0","volume":"26","author":"UC Lalji","year":"2016","unstructured":"Lalji UC, Houben IPL, Prevos R et al (2016) Contrast-enhanced spectral mammography in recalls from the Dutch breast cancer screening program: validation of results in a large multireader, multicase study. Eur Radiol 26:4371\u20134379. https:\/\/doi.org\/10.1007\/s00330-016-4336-0","journal-title":"Eur Radiol"},{"key":"11176_CR6","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.231991","volume":"311","author":"WA Berg","year":"2024","unstructured":"Berg WA, Berg JM, Bandos AI et al (2024) Addition of contrast-enhanced mammography to tomosynthesis for breast cancer detection in women with a personal history of breast cancer: prospective TOCEM trial interim analysis. Radiology 311:e231991. https:\/\/doi.org\/10.1148\/radiol.231991","journal-title":"Radiology"},{"key":"11176_CR7","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1148\/radiol.212530","volume":"305","author":"N P\u00f6tsch","year":"2022","unstructured":"P\u00f6tsch N, Vatteroni G, Clauser P et al (2022) Contrast-enhanced mammography versus contrast-enhanced breast MRI: a systematic review and meta-analysis. Radiology 305:94\u2013103. https:\/\/doi.org\/10.1148\/radiol.212530","journal-title":"Radiology"},{"key":"11176_CR8","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1148\/radiol.2019190887","volume":"293","author":"JH Sumkin","year":"2019","unstructured":"Sumkin JH, Berg WA, Carter GJ et al (2019) Diagnostic performance of MRI, molecular breast imaging, and contrast-enhanced mammography in women with newly diagnosed breast cancer. Radiology 293:531\u2013540. https:\/\/doi.org\/10.1148\/radiol.2019190887","journal-title":"Radiology"},{"key":"11176_CR9","unstructured":"Lee CH, Phillips J, Sung JS et al (2022) CONTRAST ENHANCED MAMMOGRAPHY (CEM) (A supplement to ACR BI-RADS\u00ae Mammography 2013). American College of Radiology, Reston"},{"key":"11176_CR10","unstructured":"Sickles EA, D\u2019Orsi CJ, Bassett L et al (2022) ACR BI-RADS\u00ae mammography. In: ACR BI-RADS\u00ae Atlas, breast imaging reporting and data system, 5th edn. American College of Radiology, Reston"},{"key":"11176_CR11","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1037\/h0031619","volume":"76","author":"JL Fleiss","year":"1971","unstructured":"Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psychol Bull 76:378\u2013382. https:\/\/doi.org\/10.1037\/h0031619","journal-title":"Psychol Bull"},{"key":"11176_CR12","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159\u2013174","journal-title":"Biometrics"},{"key":"11176_CR13","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.2214\/AJR.14.13047","volume":"204","author":"LJ Grimm","year":"2015","unstructured":"Grimm LJ, Anderson AL, Baker JA et al (2015) Interobserver variability between breast imagers using the fifth edition of the BI-RADS MRI lexicon. AJR Am J Roentgenol 204:1120\u20131124. https:\/\/doi.org\/10.2214\/AJR.14.13047","journal-title":"AJR Am J Roentgenol"},{"key":"11176_CR14","doi-asserted-by":"publisher","first-page":"1382","DOI":"10.1002\/jmri.22567","volume":"33","author":"SA Jansen","year":"2011","unstructured":"Jansen SA, Shimauchi A, Zak L et al (2011) The diverse pathology and kinetics of mass, nonmass, and focus enhancement on MR imaging of the breast. J Magn Reson Imaging 33:1382\u20131389. https:\/\/doi.org\/10.1002\/jmri.22567","journal-title":"J Magn Reson Imaging"},{"key":"11176_CR15","doi-asserted-by":"publisher","first-page":"1178","DOI":"10.2214\/AJR.17.18086","volume":"209","author":"SA Chikarmane","year":"2017","unstructured":"Chikarmane SA, Michaels AY, Giess CS (2017) Revisiting nonmass enhancement in breast MRI: analysis of outcomes and follow-up using the updated BI-RADS atlas. AJR Am J Roentgenol 209:1178\u20131184. https:\/\/doi.org\/10.2214\/AJR.17.18086","journal-title":"AJR Am J Roentgenol"},{"key":"11176_CR16","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1159\/000478899","volume":"12","author":"T Knogler","year":"2017","unstructured":"Knogler T, Homolka P, Hoernig M et al (2017) Application of BI-RADS descriptors in contrast-enhanced dual-energy mammography: comparison with MRI. Breast Care 12:212\u2013216. https:\/\/doi.org\/10.1159\/000478899","journal-title":"Breast Care"},{"key":"11176_CR17","doi-asserted-by":"publisher","first-page":"4337","DOI":"10.3390\/cancers14174337","volume":"14","author":"L Nicosia","year":"2022","unstructured":"Nicosia L, Bozzini AC, Palma S et al (2022) A score to predict the malignancy of a breast lesion based on different contrast enhancement patterns in contrast-enhanced spectral mammography. Cancers (Basel) 14:4337. https:\/\/doi.org\/10.3390\/cancers14174337","journal-title":"Cancers (Basel)"},{"key":"11176_CR18","doi-asserted-by":"publisher","first-page":"1769","DOI":"10.2214\/ajr.174.6.1741769","volume":"174","author":"WA Berg","year":"2000","unstructured":"Berg WA, Campassi C, Langenberg P, Sexton MJ (2000) Breast imaging reporting and data system: inter- and intraobserver variability in feature analysis and final assessment. AJR Am J Roentgenol 174:1769\u20131777. https:\/\/doi.org\/10.2214\/ajr.174.6.1741769","journal-title":"AJR Am J Roentgenol"},{"key":"11176_CR19","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/j.breast.2004.12.004","volume":"14","author":"S Ciatto","year":"2005","unstructured":"Ciatto S, Houssami N, Apruzzese A et al (2005) Categorizing breast mammographic density: intra- and interobserver reproducibility of BI-RADS density categories. Breast 14:269\u2013275. https:\/\/doi.org\/10.1016\/j.breast.2004.12.004","journal-title":"Breast"},{"key":"11176_CR20","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.ejro.2018.04.002","volume":"5","author":"A Alikhassi","year":"2018","unstructured":"Alikhassi A, Esmaili Gourabi H, Baikpour M (2018) Comparison of inter- and intra-observer variability of breast density assessments using the fourth and fifth editions of breast imaging reporting and data system. Eur J Radiol Open 5:67\u201372. https:\/\/doi.org\/10.1016\/j.ejro.2018.04.002","journal-title":"Eur J Radiol Open"},{"key":"11176_CR21","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.acra.2016.09.010","volume":"24","author":"AY Lee","year":"2017","unstructured":"Lee AY, Wisner DJ, Aminololama-Shakeri S et al (2017) Inter-reader variability in the use of BI-RADS descriptors for suspicious findings on diagnostic mammography: a multi-institution study of 10 academic radiologists. Acad Radiol 24:60\u201366. https:\/\/doi.org\/10.1016\/j.acra.2016.09.010","journal-title":"Acad Radiol"},{"key":"11176_CR22","doi-asserted-by":"publisher","first-page":"1465","DOI":"10.1259\/bjr\/21256379","volume":"85","author":"A Redondo","year":"2012","unstructured":"Redondo A, Comas M, Maci\u00e0 F et al (2012) Inter- and intraradiologist variability in the BI-RADS assessment and breast density categories for screening mammograms. Br J Radiol 85:1465\u20131470. https:\/\/doi.org\/10.1259\/bjr\/21256379","journal-title":"Br J Radiol"},{"key":"11176_CR23","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1148\/radiol.211412","volume":"302","author":"A Cozzi","year":"2022","unstructured":"Cozzi A, Magni V, Zanardo M et al (2022) Contrast-enhanced mammography: a systematic review and meta-analysis of diagnostic performance. Radiology 302:568\u2013581. https:\/\/doi.org\/10.1148\/radiol.211412","journal-title":"Radiology"}],"container-title":["European Radiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-024-11176-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00330-024-11176-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00330-024-11176-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T11:06:21Z","timestamp":1745492781000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00330-024-11176-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,6]]},"references-count":23,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["11176"],"URL":"https:\/\/doi.org\/10.1007\/s00330-024-11176-7","relation":{},"ISSN":["1432-1084"],"issn-type":[{"value":"1432-1084","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,6]]},"assertion":[{"value":"23 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 August 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 October 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The scientific guarantor of this publication is Paola Clauser.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Guarantor"}},{"value":"The authors of this manuscript declare relationships with the following companies: P.C.: speaker for Siemens Healthineers. P.C. is also a member of the Scientific Editorial Board for European Radiology (section: Breast) and as such did not participate in the selection nor review processes for this article.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"No complex statistical methods were necessary for this paper.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Statistics and biometry"}},{"value":"Written informed consent was waived by the Institutional Review Board due to the retrospective nature of the study.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}},{"value":"Institutional Review Board approval was obtained (2112\/2020).","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":7,"name":"Ethics","group":{"name":"EthicsHeading","label":"Study subjects or cohorts overlap"}},{"order":8,"name":"Ethics","group":{"name":"EthicsHeading","label":"Methodology"}}]}}