{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T22:01:37Z","timestamp":1773180097110,"version":"3.50.1"},"reference-count":24,"publisher":"Oxford University Press (OUP)","issue":"1153","license":[{"start":{"date-parts":[[2023,12,12]],"date-time":"2023-12-12T00:00:00Z","timestamp":1702339200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Industrial Centre for Artificial Intelligence Research in Digital Diagnostics"},{"DOI":"10.13039\/100014013","name":"UK Research and Innovation","doi-asserted-by":"publisher","award":["104690"],"award-info":[{"award-number":["104690"]}],"id":[{"id":"10.13039\/100014013","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,1,23]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>To determine factors influencing reader agreement in breast screening and investigate the relationship between agreement level and patient outcomes.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>Reader pair agreement for 83\u2009265 sets of mammograms from the Scottish Breast Screening service (2015-2020) was evaluated using Cohen\u2019s kappa statistic. Each mammography examination was read by two readers, per routine screening practice, with the second initially blinded but able to choose to view the first reader\u2019s opinion. If the two readers disagreed, a third reader arbitrated. Variation in reader agreement was examined by: whether the reader acted as the first or second reader, reader experience, and recall, cancer detection and arbitration recall rate.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Readers\u2019 opinions varied by whether they acted as the first or second reader. Furthermore, reader 2 was more likely to agree with reader 1 if reader 1 was more experienced than they were, and less likely to agree if they themselves were more experienced than reader 1 (P\u2009&amp;lt;\u2009.001). Agreement was not significantly associated with cancer detection rate, overall recall rate or arbitration recall rates (P\u2009&amp;gt;\u2009.05). Lower agreement between readers led to a higher arbiter workload (P\u2009&amp;lt;\u2009.001).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>In mammography screening, the second reader\u2019s opinion is influenced by the first reader\u2019s opinion, with the degree of influence dependent on the readers\u2019 relative experience levels.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Advances in knowledge<\/jats:title>\n                  <jats:p>While less-experienced readers relied on their more experienced reading partner, no adverse impact on service outcomes was observed. Allowing access to the first reader\u2019s opinion may benefit newly qualified readers, but reduces independent evaluation, which may lower cancer detection rates.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bjr\/tqad024","type":"journal-article","created":{"date-parts":[[2024,1,10]],"date-time":"2024-01-10T00:12:33Z","timestamp":1704845553000},"page":"120-125","source":"Crossref","is-referenced-by-count":2,"title":["Service and clinical impacts of reader bias in breast cancer screening: a retrospective study"],"prefix":"10.1093","volume":"97","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9616-4231","authenticated-orcid":false,"given":"Clarisse F","family":"de Vries","sequence":"first","affiliation":[{"name":"Aberdeen Centre for Health Data Science, University of Aberdeen , Aberdeen AB25 2ZD, United Kingdom"},{"name":"Aberdeen Biomedical Imaging Centre, University of Aberdeen , Aberdeen AB25 2ZN, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roger T","family":"Staff","sequence":"additional","affiliation":[{"name":"National Health Service Grampian (NHSG), Aberdeen Royal Infirmary , Aberdeen AB25 2ZN, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaroslaw A","family":"Dymiter","sequence":"additional","affiliation":[{"name":"Grampian Data Safe Haven (DaSH), University of Aberdeen , Aberdeen AB25 2ZD, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Moragh","family":"Boyle","sequence":"additional","affiliation":[{"name":"Aberdeen Centre for Health Data Science, University of Aberdeen , Aberdeen AB25 2ZD, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lesley A","family":"Anderson","sequence":"additional","affiliation":[{"name":"Aberdeen Centre for Health Data Science, University of Aberdeen , Aberdeen AB25 2ZD, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerald","family":"Lip","sequence":"additional","affiliation":[{"name":"National Health Service Grampian (NHSG), Aberdeen Royal Infirmary , Aberdeen AB25 2ZN, United Kingdom"},{"name":"North East Scotland Breast Screening Centre , Aberdeen AB25 2XF, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"name":"the iCAIRD Radiology Collaboration","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Corri","family":"Black","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alison D.","family":"Murray","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katie","family":"Wilde","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James D","family":"Blackwood","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claire","family":"Butterly","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Zurowski","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jon","family":"Eilbeck","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Colin","family":"McSkimming","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,12,12]]},"reference":[{"issue":"6","key":"2024012406371003000_tqad024-B1","doi-asserted-by":"crossref","first-page":"394","DOI":"10.3322\/caac.21492","article-title":"Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"68","author":"Bray","year":"2018","journal-title":"CA Cancer J Clin"},{"issue":"3","key":"2024012406371003000_tqad024-B2","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1148\/radiol.11110469","article-title":"Swedish two-county trial: impact of mammographic screening on breast cancer mortality during 3 decades","volume":"260","author":"Tab\u00e1r","year":"2011","journal-title":"Radiology"},{"key":"2024012406371003000_tqad024-B3","author":"Cancer Research UK. Breast Screening","year":"2019"},{"issue":"2","key":"2024012406371003000_tqad024-B4","first-page":"74","article-title":"European guidelines for quality assurance in breast cancer screening and diagnosis. Summary document","volume":"4","author":"Perry","year":"2008","journal-title":"Oncol Clin Pract"},{"issue":"10","key":"2024012406371003000_tqad024-B5","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1016\/j.acra.2010.05.007","article-title":"Radiologists' perceptions of computer aided detection versus double reading for mammography interpretation","volume":"17","author":"Onega","year":"2010","journal-title":"Acad Radiol"},{"issue":"1106","key":"2024012406371003000_tqad024-B6","doi-asserted-by":"crossref","first-page":"20190610","DOI":"10.1259\/bjr.20190610","article-title":"Double reading in breast cancer screening: considerations for policy-making","volume":"93","author":"Taylor-Phillips","year":"2020","journal-title":"Br J Radiol"},{"issue":"3","key":"2024012406371003000_tqad024-B7","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1016\/j.ejca.2014.12.008","article-title":"Blinded double reading yields a higher programme sensitivity than non-blinded double reading at digital screening mammography: a prospected population based study in the south of The Netherlands","volume":"51","author":"Klompenhouwer","year":"2015","journal-title":"Eur J Cancer"},{"issue":"7","key":"2024012406371003000_tqad024-B8","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1038\/bjc.2015.295","article-title":"Comparison of the diagnostic workup of women referred at non-blinded or blinded double reading in a population-based screening mammography programme in the south of the Netherlands","volume":"113","author":"Weber","year":"2015","journal-title":"Br J Cancer"},{"issue":"5","key":"2024012406371003000_tqad024-B9","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.2214\/ajr.180.5.1801461","article-title":"Increase in cancer detection and recall rates with independent double interpretation of screening mammography","volume":"180","author":"Harvey","year":"2003","journal-title":"AJR Am J Roentgenol"},{"issue":"5","key":"2024012406371003000_tqad024-B10","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.2214\/ajr.174.5.1741257","article-title":"Accuracy of screening mammography using single versus independent double interpretation","volume":"174","author":"Taplin","year":"2000","journal-title":"AJR Am J Roentgenol"},{"issue":"5","key":"2024012406371003000_tqad024-B11","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1016\/j.breast.2015.06.004","article-title":"Arbitration of discrepant BI-RADS 0 recalls by a third reader at screening mammography lowers recall rate but not the cancer detection rate and sensitivity at blinded and non-blinded double reading","volume":"24","author":"Klompenhouwer","year":"2015","journal-title":"Breast"},{"issue":"10","key":"2024012406371003000_tqad024-B12","doi-asserted-by":"crossref","first-page":"2821","DOI":"10.1007\/s00330-015-3711-6","article-title":"Discrepant screening mammography assessments at blinded and non-blinded double reading: impact of arbitration by a third reader on screening outcome","volume":"25","author":"Klompenhouwer","year":"2015","journal-title":"Eur Radiol"},{"issue":"3","key":"2024012406371003000_tqad024-B13","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1258\/0969141054855337","article-title":"The role of arbitration of discordant reports at double reading of screening mammograms","volume":"12","author":"Ciatto","year":"2005","journal-title":"J Med Screen"},{"issue":"1","key":"2024012406371003000_tqad024-B14","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1007\/s11547-010-0606-0","article-title":"On the role of arbitration of discordant double readings of screening mammography: experience from two Italian programmes","volume":"116","author":"Caumo","year":"2011","journal-title":"Radiol Med"},{"issue":"1","key":"2024012406371003000_tqad024-B15","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1007\/s00330-021-07965-z","article-title":"Optimising breast cancer screening reading: blinding the second reader to the first reader\u2019s decisions","volume":"32","author":"Cooper","year":"2022","journal-title":"Eur Radiol"},{"key":"2024012406371003000_tqad024-B16","author":"European Commission Initiative on Breast Cancer (ECIBC). European Guidelines on Breast Cancer Screening and Diagnosis","year":"2023"},{"key":"2024012406371003000_tqad024-B17","author":"NHS England","year":"2023"},{"issue":"1","key":"2024012406371003000_tqad024-B18","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educational and Psychological Measurement"},{"key":"2024012406371003000_tqad024-B19","author":"R Core Team","year":"2022"},{"key":"2024012406371003000_tqad024-B20","author":"Gamer","year":"2019"},{"issue":"1","key":"2024012406371003000_tqad024-B21","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1148\/radiol.2020192212","article-title":"Range of radiologist performance in a population-based screening cohort of 1 million digital mammography examinations","volume":"297","author":"Salim","year":"2020","journal-title":"Radiology"},{"key":"2024012406371003000_tqad024-B22","author":"Public Health Scotland. Scottish Breast Screening Programme Statistics","year":"2023"},{"issue":"3","key":"2024012406371003000_tqad024-B23","doi-asserted-by":"crossref","first-page":"e220146","DOI":"10.1148\/ryai.220146","article-title":"Impact of different mammography systems on artificial intelligence performance in breast cancer screening","volume":"5","author":"de Vries","year":"2023","journal-title":"Radiol Artif Intell"},{"issue":"4","key":"2024012406371003000_tqad024-B24","doi-asserted-by":"crossref","first-page":"e222176","DOI":"10.1148\/radiol.222176","article-title":"Automation bias in mammography: the impact of artificial intelligence BI-RADS suggestions on reader performance","volume":"307","author":"Dratsch","year":"2023","journal-title":"Radiology"}],"container-title":["British Journal of Radiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bjr\/advance-article-pdf\/doi\/10.1093\/bjr\/tqad024\/54587160\/tqad024.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bjr\/article-pdf\/97\/1153\/120\/56353319\/tqad024.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bjr\/article-pdf\/97\/1153\/120\/56353319\/tqad024.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,24]],"date-time":"2024-01-24T06:37:36Z","timestamp":1706078256000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bjr\/article\/97\/1153\/120\/7470408"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,12]]},"references-count":24,"journal-issue":{"issue":"1153","published-online":{"date-parts":[[2023,12,12]]},"published-print":{"date-parts":[[2024,1,23]]}},"URL":"https:\/\/doi.org\/10.1093\/bjr\/tqad024","relation":{},"ISSN":["0007-1285","1748-880X"],"issn-type":[{"value":"0007-1285","type":"print"},{"value":"1748-880X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,12,12]]}}}