{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T17:50:35Z","timestamp":1777917035862,"version":"3.51.4"},"reference-count":29,"publisher":"SAGE Publications","issue":"7","license":[{"start":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T00:00:00Z","timestamp":1722297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T00:00:00Z","timestamp":1722297600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Med Decis Making"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>To develop a model that simulates radiologist assessments and use it to explore whether pairing readers based on their individual performance characteristics could optimize screening performance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Logistic regression models were designed and used to model individual radiologist assessments. For model evaluation, model-predicted individual performance metrics and paired disagreement rates were compared against the observed data using Pearson correlation coefficients. The logistic regression models were subsequently used to simulate different screening programs with reader pairing based on individual true-positive rates (TPR) and\/or false-positive rates (FPR). For this, retrospective results from breast cancer screening programs employing double reading in Sweden, England, and Norway were used. Outcomes of random pairing were compared against those composed of readers with similar and opposite TPRs\/FPRs, with positive assessments defined by either reader flagging an examination as abnormal.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The analysis data sets consisted of 936,621 (Sweden), 435,281 (England), and 1,820,053 (Norway) examinations. There was good agreement between the model-predicted and observed radiologists\u2019 TPR and FPR (\n                      <jats:italic toggle=\"yes\">r<\/jats:italic>\n                      \u2009\u2265\u20090.969). Model-predicted negative-case disagreement rates showed high correlations (\n                      <jats:italic toggle=\"yes\">r<\/jats:italic>\n                      \u2009\u2265\u20090.709), whereas positive-case disagreement rates had lower correlation levels due to sparse data (\n                      <jats:italic toggle=\"yes\">r<\/jats:italic>\n                      \u2009\u2265\u20090.532). Pairing radiologists with similar FPR characteristics (Sweden: 4.50% [95% confidence interval: 4.46%\u20134.54%], England: 5.51% [5.47%\u20135.56%], Norway: 8.03% [7.99%\u20138.07%]) resulted in significantly lower FPR than with random pairing (Sweden: 4.74% [4.70%\u20134.78%], England: 5.76% [5.71%\u20135.80%], Norway: 8.30% [8.26%\u20138.34%]), reducing examinations sent to consensus\/arbitration while the TPR did not change significantly. Other pairing strategies resulted in equal or worse performance than random pairing.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Logistic regression models accurately predicted screening mammography assessments and helped explore different radiologist pairing strategies. Pairing readers with similar modeled FPR characteristics reduced the number of examinations unnecessarily sent to consensus\/arbitration without significantly compromising the TPR.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Highlights<\/jats:title>\n                    <jats:list list-type=\"bullet\">\n                      <jats:list-item>\n                        <jats:p>A logistic-regression model can be derived that accurately predicts individual and paired reader performance during mammography screening reading.<\/jats:p>\n                      <\/jats:list-item>\n                      <jats:list-item>\n                        <jats:p>Pairing screening mammography radiologists with similar false-positive characteristics reduced false-positive rates with no significant loss in true positives and may reduce the number of examinations unnecessarily sent to consensus\/arbitration.<\/jats:p>\n                      <\/jats:list-item>\n                    <\/jats:list>\n                  <\/jats:sec>","DOI":"10.1177\/0272989x241264572","type":"journal-article","created":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T07:01:35Z","timestamp":1722322895000},"page":"828-842","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Modeling Radiologists\u2019 Assessments to Explore Pairing Strategies for Optimized Double Reading of Screening Mammograms"],"prefix":"10.1177","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6668-7819","authenticated-orcid":false,"given":"Jessie J. J.","family":"Gommers","sequence":"first","affiliation":[{"name":"Department of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Craig K.","family":"Abbey","sequence":"additional","affiliation":[{"name":"Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fredrik","family":"Strand","sequence":"additional","affiliation":[{"name":"Department of Oncology-Pathology, Karolinska Institute, Stockholm, Sweden"},{"name":"Breast Radiology, Karolinska University Hospital, Stockholm, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sian","family":"Taylor-Phillips","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David J.","family":"Jenkinson","sequence":"additional","affiliation":[{"name":"Warwick Medical School, University of Warwick, Coventry, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marthe","family":"Larsen","sequence":"additional","affiliation":[{"name":"Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Solveig","family":"Hofvind","sequence":"additional","affiliation":[{"name":"Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway"},{"name":"Department of Health and Care Sciences, UiT The Arctic University of Norway, Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mireille J. M.","family":"Broeders","sequence":"additional","affiliation":[{"name":"Dutch Expert Center for Screening (LRCB), Nijmegen, The Netherlands"},{"name":"IQ Health Science Department, Radboud University Medical Center, Nijmegen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ioannis","family":"Sechopoulos","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, Radboud University Medical Center, Nijmegen, The Netherlands"},{"name":"Dutch Expert Center for Screening (LRCB), Nijmegen, The Netherlands"},{"name":"Technical Medicine Center, University of Twente, Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2024,7,30]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1258\/jms.2012.012078"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2015.13183"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1158\/1055-9965.EPI-13-0320"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMsr1504363"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2018171010"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41416-018-0195-6"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-022-08711-9"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-054005"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","unstructured":"Sharma N Ng AY James JJ et al. Retrospective large-scale evaluation of an AI system as an independent reader for double reading in breast cancer screening. medRxiv. 2021.02.26.21252537. 2022. DOI: 10.1101\/2021.02.26.21252537.","DOI":"10.1101\/2021.02.26.21252537"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-022-08909-x"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2020.3321"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2018.06.017"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-014-3102-4"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.222691"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.12532"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.7150\/thno.5138"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12282-022-01335-3"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2533082308"},{"issue":"424","key":"e_1_3_3_20_2","article-title":"Numerical recipes in C: the art of scientific computing","volume":"104","author":"Birchenhall C.","year":"1994","unstructured":"Birchenhall C. Numerical recipes in C: the art of scientific computing. Econ J. 1994;104(424):725\u20136.","journal-title":"Econ J"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.1998.10480550"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10549-006-9319-4"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-019-00278-0"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1186\/1745-6215-15-17"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2016.5257"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2020192212"},{"key":"e_1_3_3_27_2","volume-title":"BreastScreen Norway: 25 Years of Organized Screening","author":"Bj\u00f8rnson EW","year":"2022","unstructured":"Bj\u00f8rnson EW, Holen \u00c5, Sagstad S, et al. BreastScreen Norway: 25 Years of Organized Screening. Oslo: Cancer Registry of Norway; 2022."},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1002\/mp.13161"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.2214\/ajr.180.5.1801461"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejca.2008.02.016"}],"container-title":["Medical Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X241264572","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0272989X241264572","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X241264572","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:02:58Z","timestamp":1777658578000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0272989X241264572"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,30]]},"references-count":29,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["10.1177\/0272989X241264572"],"URL":"https:\/\/doi.org\/10.1177\/0272989x241264572","relation":{},"ISSN":["0272-989X","1552-681X"],"issn-type":[{"value":"0272-989X","type":"print"},{"value":"1552-681X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,30]]}}}