{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T12:43:03Z","timestamp":1760013783891},"reference-count":10,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,2,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>An audit of a breast imaging practice must be based on data with accepted definitions and rules so that the comparisons between breast imaging facilities and interpretive staff are comparable. The four basic data points for calculating these metrics are true positive (TP), true negative (TN), false positive (FP), and false negative (FN). For mammography, the definition of \u201ctrue\u201d is the presence of a proven malignancy within a year of the exam. The presence or absence of breast cancer within a year of the exam and an increase in patient mobility between different facilities may render the calculation of sensitivity and specificity difficult for most facilities unless a regional cancer registry is available.Thus, the metrics that can be easily calculated within a facility are recall rate (all the positive interpretations divided by all the exams read), positive predictive value (PPV) 1 = percentage of abnormal screening exams that result in a diagnosis of cancer within a year, PPV2 = percentage of all diagnostic exams recommended for biopsy and cancer discovered within a year, PPV3 = benign tissue diagnosis and no cancer within a year, and the cancer detection rate (the true positive exams per one thousand exams). Intuitively, one may assume that accuracy (TP + TN\/TP + FP + TN + FN) is the best metric for an interpreter. However, this can produce spurious results. The most accurate method to determine a reader\u2019s skills is the use of the receiver operating characteristic (ROC) curve, which clearly presents, in graphic form, the relationship between the four basic data points.<\/jats:p>","DOI":"10.1093\/jbi\/wbz080","type":"journal-article","created":{"date-parts":[[2020,1,2]],"date-time":"2020-01-02T14:17:57Z","timestamp":1577974677000},"page":"2-6","source":"Crossref","is-referenced-by-count":4,"title":["The Clinically Relevant Breast Imaging Audit"],"prefix":"10.1093","volume":"2","author":[{"given":"Carl Joseph","family":"D\u2019Orsi","sequence":"first","affiliation":[{"name":"Emory University School of Medicine, Department of Radiology, Atlanta, GA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,1,2]]},"reference":[{"key":"2020071606220450700_CIT0001","article-title":"ACR BI-RADS Atlas follow-up and outcome monitoring.","volume-title":"ACR-BI-RADS Atlas, Breast Imaging Reporting and Data System","author":"Sickles","year":"2013"},{"key":"2020071606220450700_CIT0002","volume-title":"ACR BI-RADS Ultrasound In: ACR BI-RADS Atlas, Breast Imaging Reporting and Data System","author":"Mendelson","year":"2013"},{"issue":"1","key":"2020071606220450700_CIT0003","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1148\/radiol.2016161174","article-title":"National performance benchmarks for modern screening digital mammography: update from the Breast Cancer Surveillance Consortium","volume":"283","author":"Lehman","year":"2017","journal-title":"Radiol"},{"issue":"1","key":"2020071606220450700_CIT0004","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1148\/radiol.2017161519","article-title":"National performance benchmarks for modern diagnostic digital mammography: update from the Breast Cancer Surveillance Consortium","volume":"283","author":"Sprague","year":"2017","journal-title":"Radiol"},{"issue":"1","key":"2020071606220450700_CIT0005","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1148\/radiol.2017170181","article-title":"2017 Breast Cancer Surveillance Consortium reports on interpretive performance at screening and diagnostic mammography: welcome new data, but not as benchmarks for practice","volume":"283","author":"D\u2019Orsi","year":"2017","journal-title":"Radiol"},{"issue":"4","key":"2020071606220450700_CIT0006","doi-asserted-by":"crossref","first-page":"883","DOI":"10.2214\/AJR.15.14312","article-title":"The national mammography database: preliminary data","volume":"206","author":"Lee","year":"2016","journal-title":"AJR Am J Roentgenol"},{"issue":"2","key":"2020071606220450700_CIT0007","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1148\/radiol.10091636","article-title":"Identifying minimally acceptable interpretive performance criteria for screening mammography","volume":"255","author":"Carney","year":"2010","journal-title":"Radiol"},{"issue":"2","key":"2020071606220450700_CIT0008","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1148\/radiol.12121216","article-title":"Diagnostic mammography: identifying minimally acceptable interpretive performance criteria","volume":"267","author":"Carney","year":"2013","journal-title":"Radiol"},{"issue":"4","key":"2020071606220450700_CIT0009","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/S0001-2998(78)80014-2","article-title":"Basic principles of ROC analysis","volume":"8","author":"Metz","year":"1978","journal-title":"Semin Nucl Med"},{"issue":"4","key":"2020071606220450700_CIT0010","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/S0001-2998(78)80015-4","article-title":"General problems in medical decision making with comments on ROC analysis","volume":"8","author":"Lusted","year":"1978","journal-title":"Semin Nucl Med"}],"container-title":["Journal of Breast Imaging"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jbi\/article-pdf\/2\/1\/2\/33502092\/wbz080.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jbi\/article-pdf\/2\/1\/2\/33502092\/wbz080.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,7,16]],"date-time":"2020-07-16T11:01:46Z","timestamp":1594897306000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jbi\/article\/2\/1\/2\/5693949"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1]]},"references-count":10,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1,2]]},"published-print":{"date-parts":[[2020,2,4]]}},"URL":"https:\/\/doi.org\/10.1093\/jbi\/wbz080","relation":{},"ISSN":["2631-6110","2631-6129"],"issn-type":[{"value":"2631-6110","type":"print"},{"value":"2631-6129","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,1]]},"published":{"date-parts":[[2020,1]]}}}