{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,17]],"date-time":"2026-05-17T06:39:04Z","timestamp":1778999944860,"version":"3.51.4"},"reference-count":34,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2019,1,4]],"date-time":"2019-01-04T00:00:00Z","timestamp":1546560000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100000925","name":"National Health and Medical Research Council","doi-asserted-by":"publisher","award":["1077788"],"award-info":[{"award-number":["1077788"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Med Imag Rad Onc"],"published-print":{"date-parts":[[2019,4]]},"abstract":"Abstract<\/jats:title>Introduction<\/jats:title>This study quantified inter\u2010observer contouring variations for multiple male pelvic structures, many of which are of emerging relevance for prostate cancer radiotherapy progression and toxicity response studies.<\/jats:p><\/jats:sec>Methods<\/jats:title>Five prostate cancer patient datasets (CT<\/jats:styled-content> and T2\u2010weighted MR<\/jats:styled-content>) were distributed to 13 observers for contouring. CT<\/jats:styled-content> structures contoured included the clinical target volume (CTV<\/jats:styled-content>), seminal vesicles, rectum, colon, bowel bag, bladder and peri\u2010rectal space (PRS<\/jats:styled-content>). MR<\/jats:styled-content> contours included CTV<\/jats:styled-content>, trigone, membranous urethra, penile bulb, neurovascular bundle and multiple pelvic floor muscles. Contouring variations were assessed using the intraclass correlation coefficient (ICC<\/jats:styled-content>), Dice similarity coefficient (DSC<\/jats:styled-content>), and multiple additional metrics.<\/jats:p><\/jats:sec>Results<\/jats:title>Clinical target volume (CT<\/jats:styled-content> and MR<\/jats:styled-content>), bladder, rectum and PRS<\/jats:styled-content> contours showed excellent inter\u2010observer agreement (median ICC<\/jats:styled-content>\u00a0=\u00a00.97; 0.99; 1.00; 0.95; 0.90, DSC<\/jats:styled-content>\u00a0=\u00a00.83\u00a0\u00b1\u00a00.05; 0.88\u00a0\u00b1\u00a00.05; 0.93\u00a0\u00b1\u00a00.03; 0.81\u00a0\u00b1\u00a00.07; 0.80\u00a0\u00b1\u00a00.06, respectively). Seminal vesicle contours were more variable (ICC<\/jats:styled-content>\u00a0=\u00a00.75, DSC<\/jats:styled-content>\u00a0=\u00a00.73\u00a0\u00b1\u00a00.14), while colon and bowel bag contoured volumes were consistent (ICC<\/jats:styled-content>\u00a0=\u00a00.97; 0.97), but displayed poor overlap (DSC<\/jats:styled-content>\u00a0=\u00a00.58\u00a0\u00b1\u00a00.22; 0.67\u00a0\u00b1\u00a00.21). Smaller MR<\/jats:styled-content> structures showed significant inter\u2010observer variations, with poor overlap for trigone, membranous urethra, penile bulb, and left and right neurovascular bundles (DSC<\/jats:styled-content>\u00a0=\u00a00.44\u00a0\u00b1\u00a00.22; 0.41\u00a0\u00b1\u00a00.21; 0.66\u00a0\u00b1\u00a00.21; 0.16\u00a0\u00b1\u00a00.17; 0.15\u00a0\u00b1\u00a00.15). Pelvic floor muscles recorded moderate to strong inter\u2010observer agreement (ICC<\/jats:styled-content>\u00a0=\u00a00.50\u20130.97), although large outlier variations were observed.<\/jats:p><\/jats:sec>Conclusions<\/jats:title>Inter\u2010observer contouring variation was significant for multiple pelvic structures contoured on MR<\/jats:styled-content>.<\/jats:p><\/jats:sec>","DOI":"10.1111\/1754-9485.12844","type":"journal-article","created":{"date-parts":[[2019,1,4]],"date-time":"2019-01-04T19:07:58Z","timestamp":1546628878000},"page":"264-271","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Multi\u2010observer contouring of male pelvic anatomy: Highly variable agreement across conventional and emerging structures of interest"],"prefix":"10.1111","volume":"63","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5541-5217","authenticated-orcid":false,"given":"Dale","family":"Roach","sequence":"first","affiliation":[{"name":"Faculty of Medicine University of New South Wales Sydney New South Wales Australia"},{"name":"Ingham Institute for Applied Medical Research Sydney New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4337-2165","authenticated-orcid":false,"given":"Lois C","family":"Holloway","sequence":"additional","affiliation":[{"name":"Faculty of Medicine University of New South Wales Sydney New South Wales Australia"},{"name":"Ingham Institute for Applied Medical Research Sydney New South Wales Australia"},{"name":"Centre for Medical Radiation Physics University of Wollongong Wollongong New South Wales Australia"},{"name":"Department of Radiation Oncology Liverpool and Macarthur Cancer Therapy Centres New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4867-7670","authenticated-orcid":false,"given":"Michael G","family":"Jameson","sequence":"additional","affiliation":[{"name":"Faculty of Medicine University of New South Wales Sydney New South Wales Australia"},{"name":"Ingham Institute for Applied Medical Research Sydney New South Wales Australia"},{"name":"Centre for Medical Radiation Physics University of Wollongong Wollongong New South Wales Australia"},{"name":"Department of Radiation Oncology Liverpool and Macarthur Cancer Therapy Centres New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9349-2275","authenticated-orcid":false,"given":"Jason A","family":"Dowling","sequence":"additional","affiliation":[{"name":"Faculty of Medicine University of New South Wales Sydney New South Wales Australia"},{"name":"Centre for Medical Radiation Physics University of Wollongong Wollongong New South Wales Australia"},{"name":"Australian e\u2010Health Research Centre CSIRO, Royal Brisbane Hospital Brisbane Queensland Australia"},{"name":"School of Mathematical and Physical Sciences University of Newcastle Newcastle New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1467-2361","authenticated-orcid":false,"given":"Angel","family":"Kennedy","sequence":"additional","affiliation":[{"name":"Radiation Oncology Sir Charles Gairdner Hospital Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7494-4029","authenticated-orcid":false,"given":"Peter B","family":"Greer","sequence":"additional","affiliation":[{"name":"School of Mathematical and Physical Sciences University of Newcastle Newcastle New South Wales Australia"},{"name":"Calvary Mater Newcastle Hospital Newcastle New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michele","family":"Krawiec","sequence":"additional","affiliation":[{"name":"Radiation Oncology Sir Charles Gairdner Hospital Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0626-6438","authenticated-orcid":false,"given":"Robba","family":"Rai","sequence":"additional","affiliation":[{"name":"Faculty of Medicine University of New South Wales Sydney New South Wales Australia"},{"name":"Ingham Institute for Applied Medical Research Sydney New South Wales Australia"},{"name":"Department of Radiation Oncology Liverpool and Macarthur Cancer Therapy Centres New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4177-9503","authenticated-orcid":false,"given":"Jim","family":"Denham","sequence":"additional","affiliation":[{"name":"School of Medicine and Population Health University of Newcastle Newcastle New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6521-0805","authenticated-orcid":false,"given":"Jeremiah","family":"De Leon","sequence":"additional","affiliation":[{"name":"Illawarra Cancer Care Centre Wollongong New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4861-2108","authenticated-orcid":false,"given":"Karen","family":"Lim","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology Liverpool and Macarthur Cancer Therapy Centres New South Wales Australia"},{"name":"South Western Sydney Clinical School University of New South Wales Sydney New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Megan E","family":"Berry","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology Liverpool and Macarthur Cancer Therapy Centres New South Wales Australia"},{"name":"South Western Sydney Clinical School University of New South Wales Sydney New South Wales Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rohen T","family":"White","sequence":"additional","affiliation":[{"name":"Radiation Oncology Sir Charles Gairdner Hospital Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sean A","family":"Bydder","sequence":"additional","affiliation":[{"name":"Radiation Oncology Sir Charles Gairdner Hospital Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hendrick T","family":"Tan","sequence":"additional","affiliation":[{"name":"Radiation Oncology Sir Charles Gairdner Hospital Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4425-4614","authenticated-orcid":false,"given":"Jeremy D","family":"Croker","sequence":"additional","affiliation":[{"name":"Fiona Stanley Hospital Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alycea","family":"McGrath","sequence":"additional","affiliation":[{"name":"Radiation Oncology Sir Charles Gairdner Hospital Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Matthews","sequence":"additional","affiliation":[{"name":"Radiation Oncology Auckland City Hospital Auckland New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert J","family":"Smeenk","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology Radboud University Medical Centre Nijmegen The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6875-0719","authenticated-orcid":false,"given":"Martin A","family":"Ebert","sequence":"additional","affiliation":[{"name":"Centre for Medical Radiation Physics University of Wollongong Wollongong New South Wales Australia"},{"name":"Radiation Oncology Sir Charles Gairdner Hospital Perth Western Australia Australia"},{"name":"School of Physics and Astrophysics Faculty of Science University of Western Australia Perth Western Australia Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2019,1,4]]},"reference":[{"key":"e_1_2_6_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00066-003-0976-5"},{"key":"e_1_2_6_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2012.09.023"},{"key":"e_1_2_6_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2012.04.002"},{"key":"e_1_2_6_5_1","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2009.27.4498"},{"key":"e_1_2_6_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2010.11.039"},{"key":"e_1_2_6_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2016.09.009"},{"key":"e_1_2_6_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/1754-9485.12462"},{"key":"e_1_2_6_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2011.02.050"},{"key":"e_1_2_6_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2008.12.042"},{"key":"e_1_2_6_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-3016(99)00288-6"},{"key":"e_1_2_6_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-3016(98)00351-4"},{"key":"e_1_2_6_13_1","doi-asserted-by":"publisher","DOI":"10.1118\/1.4871620"},{"key":"e_1_2_6_14_1","doi-asserted-by":"publisher","DOI":"10.2307\/1932409"},{"key":"e_1_2_6_15_1","article-title":"Comparing photon and proton based hypofractioned sbrt for prostate cancer accounting for robustness and realistic treatment deliverability","volume":"91","author":"Goddard L","year":"2018","journal-title":"Brit J Radiol"},{"key":"e_1_2_6_16_1","doi-asserted-by":"publisher","DOI":"10.1097\/COC.0b013e318173a563"},{"key":"e_1_2_6_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2007.07.018"},{"key":"e_1_2_6_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2013.10.042"},{"key":"e_1_2_6_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ctro.2017.10.002"},{"key":"e_1_2_6_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2011.08.007"},{"key":"e_1_2_6_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2012.01.023"},{"key":"e_1_2_6_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2015.08.045"},{"key":"e_1_2_6_23_1","unstructured":"KennedyAM DowlingJA GhoseS Rivest\u2010H\u00e9naultD EbertMA.Cluster Based selection of CT exemplars from a clinical dataset for inter\u2010patient registration and dose mapping. International Conference on the use of Computers in Radiation Therapy. London 2016."},{"key":"e_1_2_6_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(14)70328-6"},{"key":"e_1_2_6_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2011.11.056"},{"key":"e_1_2_6_26_1","first-page":"177","volume-title":"MILXView: A Medical Imaging, Analysis and Visualization Platform","author":"Burdett N","year":"2010"},{"key":"e_1_2_6_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00066-011-0027-6"},{"key":"e_1_2_6_28_1","doi-asserted-by":"publisher","DOI":"10.2466\/pr0.1966.19.1.3"},{"key":"e_1_2_6_29_1","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6560\/aaa50c"},{"key":"e_1_2_6_30_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-319-18305-3_1","volume-title":"What is Machine Learning? Machine Learning in Radiation Oncology","author":"El Naqa I","year":"2015"},{"key":"e_1_2_6_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/117693510600200030"},{"key":"e_1_2_6_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2014.03.019"},{"key":"e_1_2_6_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.prro.2017.08.001"},{"key":"e_1_2_6_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2011.12.057"},{"key":"e_1_2_6_35_1","doi-asserted-by":"publisher","DOI":"10.1093\/jjco\/hyh078"}],"container-title":["Journal of Medical Imaging and Radiation Oncology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2F1754-9485.12844","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/1754-9485.12844","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/1754-9485.12844","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/1754-9485.12844","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,10]],"date-time":"2023-09-10T09:16:49Z","timestamp":1694337409000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/1754-9485.12844"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,4]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,4]]}},"alternative-id":["10.1111\/1754-9485.12844"],"URL":"https:\/\/doi.org\/10.1111\/1754-9485.12844","archive":["Portico"],"relation":{},"ISSN":["1754-9477","1754-9485"],"issn-type":[{"value":"1754-9477","type":"print"},{"value":"1754-9485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,4]]},"assertion":[{"value":"2018-06-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-27","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}