{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T12:24:36Z","timestamp":1788870276796,"version":"build-2803163510"},"reference-count":24,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2015,4,1]],"date-time":"2015-04-01T00:00:00Z","timestamp":1427846400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100001026","name":"National Breast Cancer Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001026","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Med Imag Rad Onc"],"published-print":{"date-parts":[[2015,8]]},"abstract":"Abstract<\/jats:title>\n \n Introduction<\/jats:title>\n Test sets have been increasingly utilised to augment clinical audit in breast screening programmes; however, their relationship has never been satisfactorily understood. This study examined the relationship between mammographic test set performance and clinical audit data.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n Clinical audit data over a 2\u2010year period was generated for each of 20 radiologists. Sixty mammographic examinations, consisting of 40 normal and 20 cancer cases, formed the test set. Readers located any identifiable cancer, and levels of confidence were scored from 2 to 5, where a score of 3 and above is considered a recall rating. Jackknifing free response operating characteristic (\n JAFROC<\/jats:styled-content>\n ) figure\u2010of\u2010merit (\n FOM<\/jats:styled-content>\n ), location sensitivity and specificity were calculated for individual readers and then compared with clinical audit values using Spearman's rho.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n JAFROC FOM<\/jats:styled-content>\n showed significant correlations to: recall rate at a first round of screening (\n r<\/jats:italic>\n \u2009=\u20090.51;\n P<\/jats:italic>\n \u2009=\u20090.02); rate of small invasive cancers per 10\u2009000 reads (\n r<\/jats:italic>\n \u2009=\u20090.5;\n P<\/jats:italic>\n \u2009=\u20090.02); percentage of all cancers read that were not recalled (\n r<\/jats:italic>\n \u2009=\u2009\u22120.51;\n P<\/jats:italic>\n \u2009=\u20090.02); and sensitivity (\n r<\/jats:italic>\n \u2009=\u20090.51;\n P<\/jats:italic>\n \u2009=\u20090.02). Location sensitivity demonstrated significant correlations with: rate of small invasive cancers per 10\u2009000 reads (\n r<\/jats:italic>\n \u2009=\u20090.46;\n P<\/jats:italic>\n \u2009=\u20090.04); rate of\n DCIS<\/jats:styled-content>\n (ductal carcinoma in situ) per 10\u2009000 reads (\n r<\/jats:italic>\n \u2009=\u20090.44;\n P<\/jats:italic>\n \u2009=\u20090.05); detection rate of all invasive cancers and\n DCIS<\/jats:styled-content>\n per 10\u2009000 reads (\n r<\/jats:italic>\n \u2009=\u20090.54;\n P<\/jats:italic>\n \u2009=\u20090.01); percentage of all cancers read that were not recalled (\n r<\/jats:italic>\n \u2009=\u2009\u22120.57;\n P<\/jats:italic>\n \u2009=\u20090.009); and sensitivity (\n r<\/jats:italic>\n \u2009=\u20090.57;\n P<\/jats:italic>\n \u2009=\u20090.009). No other significant relationships were noted.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusion<\/jats:title>\n Performance indicators from test set demonstrate significant correlations with specific aspects of clinical performance, although caution needs to be exercised when generalising test set specificity to the clinical situation.<\/jats:p>\n <\/jats:sec>","DOI":"10.1111\/1754-9485.12301","type":"journal-article","created":{"date-parts":[[2015,4,2]],"date-time":"2015-04-02T16:04:26Z","timestamp":1427990666000},"page":"403-410","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Certain performance values arising from mammographic test set readings correlate well with clinical audit"],"prefix":"10.1111","volume":"59","author":[{"given":"BaoLin Pauline","family":"Soh","sequence":"first","affiliation":[{"name":"Department of Diagnostic Radiology Singapore General Hospital Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Warwick Bruce","family":"Lee","sequence":"additional","affiliation":[{"name":"Cancer Institute NSW Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claudia","family":"Mello\u2010Thoms","sequence":"additional","affiliation":[{"name":"Medical Image Optimisation and Perception Group (MIOPeG) Discipline of Medical Radiation Sciences (C42) University of Sydney Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kriscia","family":"Tapia","sequence":"additional","affiliation":[{"name":"Medical Image Optimisation and Perception Group (MIOPeG) Discipline of Medical Radiation Sciences (C42) University of Sydney Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Ryan","sequence":"additional","affiliation":[{"name":"Ziltron Dublin Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wai Tak","family":"Hung","sequence":"additional","affiliation":[{"name":"Cancer Institute NSW Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Graham","family":"Thompson","sequence":"additional","affiliation":[{"name":"Cancer Institute NSW Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rob","family":"Heard","sequence":"additional","affiliation":[{"name":"Medical Image Optimisation and Perception Group (MIOPeG) Discipline of Medical Radiation Sciences (C42) University of Sydney Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick","family":"Brennan","sequence":"additional","affiliation":[{"name":"Medical Image Optimisation and Perception Group (MIOPeG) Discipline of Medical Radiation Sciences (C42) University of Sydney Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2015,4]]},"reference":[{"key":"e_1_2_6_2_1","doi-asserted-by":"publisher","DOI":"10.3322\/caac.20006"},{"key":"e_1_2_6_3_1","unstructured":"Australian Institute of Health and Welfare (AIHW) Cancer Australia Australasian Association of Cancer Registries.Cancer survival and prevalence in Australia: cancers diagnosed from 1982 to 2004. Cancer Series no. 42. Cat. no. CAN 38. Canberra: AIHW;2008."},{"key":"e_1_2_6_4_1","unstructured":"Australian Institute of Health and Welfare.BreastScreen Australia monitoring report 2010\u20132011.2013. [Cited 4 Jun 2014.] Available from URL:http:\/\/www.aihw.gov.au\/WorkArea\/DownloadAsset.aspx?id=60129544880."},{"key":"e_1_2_6_5_1","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/djh333"},{"key":"e_1_2_6_6_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2243011482"},{"key":"e_1_2_6_7_1","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.1996.00440020119016"},{"key":"e_1_2_6_8_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM199412013312206"},{"key":"e_1_2_6_9_1","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/94.18.1346"},{"key":"e_1_2_6_10_1","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/94.18.1373"},{"key":"e_1_2_6_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.crad.2012.02.007"},{"key":"e_1_2_6_12_1","volume-title":"BreastScreen Reader Assessment Strategy (BREAST)","author":"Brennan PC","year":"2013"},{"key":"e_1_2_6_13_1","doi-asserted-by":"publisher","DOI":"10.1053\/j.sembd.2004.03.006"},{"key":"e_1_2_6_14_1","doi-asserted-by":"publisher","DOI":"10.1259\/bjr\/25049149"},{"key":"e_1_2_6_15_1","first-page":"72631E\u20101","article-title":"The relationship between real life breast screening and an annual self assessment scheme","volume":"7263","author":"Scott HJ","year":"2009","journal-title":"Proc SPIE"},{"key":"e_1_2_6_16_1","first-page":"762702\u20101","article-title":"Maintaining quality in the UK breast screening program","volume":"7627","author":"Gale AG","year":"2010","journal-title":"Proc SPIE"},{"key":"e_1_2_6_17_1","first-page":"260","article-title":"Optimum ambient lighting conditions for the viewing of softcopy radiological images","volume":"6146","author":"McEntee M","year":"2006","journal-title":"Proc SPIE"},{"key":"e_1_2_6_18_1","doi-asserted-by":"publisher","DOI":"10.2214\/AJR.05.2048"},{"key":"e_1_2_6_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-013-9571-1"},{"key":"e_1_2_6_20_1","volume-title":"Elementary Statistics in Social Research","author":"Levin J","year":"1994"},{"key":"e_1_2_6_21_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.13122399"},{"key":"e_1_2_6_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-4356(99)00218-8"},{"key":"e_1_2_6_23_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2491072025"},{"key":"e_1_2_6_24_1","unstructured":"BreastScreen Australia National Accreditation Standards.BreastScreen Australia quality improvement program.2008. [Cited 15 Dec 2014.] Available from URL:http:\/\/www.cancerscreening.gov.au\/internet\/screening\/publishing.nsf\/Content\/br\u2010accreditation\/$File\/standards.pdf."},{"key":"e_1_2_6_25_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1996.03540210060035"}],"container-title":["Journal of Medical Imaging and Radiation Oncology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2F1754-9485.12301","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2F1754-9485.12301","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/1754-9485.12301","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/1754-9485.12301","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/1754-9485.12301","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,6]],"date-time":"2023-09-06T21:52:50Z","timestamp":1694037170000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1754-9485.12301"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4]]},"references-count":24,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,8]]}},"alternative-id":["10.1111\/1754-9485.12301"],"URL":"https:\/\/doi.org\/10.1111\/1754-9485.12301","archive":["Portico"],"relation":{},"ISSN":["1754-9477","1754-9485"],"issn-type":[{"value":"1754-9477","type":"print"},{"value":"1754-9485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,4]]},"assertion":[{"value":"2014-09-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-02-08","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-04-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}