{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T00:14:47Z","timestamp":1784160887668,"version":"3.55.0"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,5,23]],"date-time":"2021-05-23T00:00:00Z","timestamp":1621728000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,23]],"date-time":"2021-05-23T00:00:00Z","timestamp":1621728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Swiss Cancer League","award":["BIL KLS-4300-08-2017"],"award-info":[{"award-number":["BIL KLS-4300-08-2017"]}]},{"DOI":"10.13039\/100000072","name":"National Institute of Dental and Craniofacial Research","doi-asserted-by":"publisher","award":["1R01DE025248"],"award-info":[{"award-number":["1R01DE025248"]}],"id":[{"id":"10.13039\/100000072","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000072","name":"National Institute of Dental and Craniofacial Research","doi-asserted-by":"publisher","award":["R56DE025248"],"award-info":[{"award-number":["R56DE025248"]}],"id":[{"id":"10.13039\/100000072","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["1R01CA218148"],"award-info":[{"award-number":["1R01CA218148"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P30CA016672"],"award-info":[{"award-number":["P30CA016672"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P50CA097007"],"award-info":[{"award-number":["P50CA097007"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["1R01CA214825"],"award-info":[{"award-number":["1R01CA214825"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000121","name":"Division of Mathematical Sciences","doi-asserted-by":"publisher","award":["NSF 1557679"],"award-info":[{"award-number":["NSF 1557679"]}],"id":[{"id":"10.13039\/100000121","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000147","name":"Division of Civil, Mechanical and Manufacturing Innovation","doi-asserted-by":"publisher","award":["NSF 1933369"],"award-info":[{"award-number":["NSF 1933369"]}],"id":[{"id":"10.13039\/100000147","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"publisher","award":["R25EB025787-01"],"award-info":[{"award-number":["R25EB025787-01"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["UL1TR003167"],"award-info":[{"award-number":["UL1TR003167"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004917","name":"Cancer Prevention and Research Institute of Texas","doi-asserted-by":"publisher","award":["RP 170668"],"award-info":[{"award-number":["RP 170668"]}],"id":[{"id":"10.13039\/100004917","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Digit Imaging"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Automated segmentation templates can save clinicians time compared to de novo segmentation but may still take substantial time to review and correct. It has not been thoroughly investigated which automated segmentation-corrected segmentation similarity metrics best predict clinician correction time. Bilateral thoracic cavity volumes in 329 CT scans were segmented by a UNet-inspired deep learning segmentation tool and subsequently corrected by a fourth-year medical student. Eight spatial similarity metrics were calculated between the automated and corrected segmentations and associated with correction times using Spearman\u2019s rank correlation coefficients. Nine clinical variables were also associated with metrics and correction times using Spearman\u2019s rank correlation coefficients or Mann\u2013Whitney\n                    <jats:italic>U<\/jats:italic>\n                    tests. The added path length, false negative path length, and surface Dice similarity coefficient correlated better with correction time than traditional metrics, including the popular volumetric Dice similarity coefficient (respectively\n                    <jats:italic>\u03c1<\/jats:italic>\n                    \u2009=\u20090.69,\n                    <jats:italic>\u03c1<\/jats:italic>\n                    \u2009=\u20090.65,\n                    <jats:italic>\u03c1<\/jats:italic>\n                    \u2009=\u2009\u2009\u2212\u20090.48 versus\n                    <jats:italic>\u03c1<\/jats:italic>\n                    \u2009=\u2009\u2009\u2212\u20090.25; correlation\n                    <jats:italic>p<\/jats:italic>\n                    values\u2009&lt;\u20090.001). Clinical variables poorly represented in the autosegmentation tool\u2019s training data were often associated with decreased accuracy but not necessarily with prolonged correction time. Metrics used to develop and evaluate autosegmentation tools should correlate with clinical time saved. To our knowledge, this is only the second investigation of which metrics correlate with time saved. Validation of our findings is indicated in other anatomic sites and clinical workflows. Novel spatial similarity metrics may be preferable to traditional metrics for developing and evaluating autosegmentation tools that are intended to save clinicians time.\n                  <\/jats:p>","DOI":"10.1007\/s10278-021-00460-3","type":"journal-article","created":{"date-parts":[[2021,5,23]],"date-time":"2021-05-23T16:02:40Z","timestamp":1621785760000},"page":"541-553","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Novel Autosegmentation Spatial Similarity Metrics Capture the Time Required to Correct Segmentations Better Than Traditional Metrics in a Thoracic Cavity Segmentation Workflow"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7457-5534","authenticated-orcid":false,"given":"Kendall J.","family":"Kiser","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arko","family":"Barman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sonja","family":"Stieb","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clifton D.","family":"Fuller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luca","family":"Giancardo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,23]]},"reference":[{"issue":"11","key":"460_CR1","doi-asserted-by":"publisher","first-page":"3093","DOI":"10.1161\/STROKEAHA.119.026189","volume":"50","author":"SA Sheth","year":"2019","unstructured":"Sheth SA, Lopez-Rivera V, Barman A, et al: Machine Learning-Enabled Automated Determination of Acute Ischemic Core From Computed Tomography Angiography. Stroke. 2019;50(11):3093-3100. https:\/\/doi.org\/10.1161\/STROKEAHA.119.026189","journal-title":"Stroke."},{"key":"460_CR2","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1016\/j.nicl.2014.03.009","volume":"4","author":"CR Gillebert","year":"2014","unstructured":"Gillebert CR, Humphreys GW, Mantini D: Automated delineation of stroke lesions using brain CT images. Neuroimage Clin. 2014;4:540-548.\u00a0https:\/\/doi.org\/10.1016\/j.nicl.2014.03.009","journal-title":"Neuroimage Clin."},{"key":"460_CR3","doi-asserted-by":"publisher","first-page":"967","DOI":"10.3389\/fnins.2018.00967","volume":"12","author":"O Pena-Nogales","year":"2018","unstructured":"Pena-Nogales O, Ellmore TM, de Luis-Garcia R, Suescun J, Schiess MC, Giancardo L: Longitudinal Connectomes as a Candidate Progression Marker for Prodromal Parkinson's Disease. Front Neurosci. 2018;12:967. https:\/\/doi.org\/10.3389\/fnins.2018.00967","journal-title":"Front Neurosci."},{"issue":"5","key":"460_CR4","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1007\/s11517-018-1936-7","volume":"57","author":"H Chen","year":"2018","unstructured":"Chen H, Sprengers AMJ, Kang Y, Verdonschot N: Automated segmentation of trabecular and cortical bone from proton density weighted MRI of the knee. Medical & Biological Engineering & Computing. 2018;57(5):1015-1027. https:\/\/doi.org\/10.1007\/s11517-018-1936-7","journal-title":"Medical & Biological Engineering & Computing."},{"key":"460_CR5","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1016\/j.medengphy.2017.10.008","volume":"51","author":"M van Eijnatten","year":"2018","unstructured":"van Eijnatten M, van Dijk R, Dobbe J, Streekstra G, Koivisto J, Wolff J: CT image segmentation methods for bone used in medical additive manufacturing. Med Eng Phys. 2018;51:6-16. https:\/\/doi.org\/10.1016\/j.medengphy.2017.10.008","journal-title":"Med Eng Phys."},{"key":"460_CR6","doi-asserted-by":"publisher","unstructured":"Rao TJN, Girish GN, Kothari AR, Rajan J: Deep Learning Based Sub-Retinal Fluid Segmentation in Central Serous Chorioretinopathy Optical Coherence Tomography Scans. Paper presented at: 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); 23\u201327 July, 2019. https:\/\/doi.org\/10.1109\/EMBC.2019.8857105","DOI":"10.1109\/EMBC.2019.8857105"},{"issue":"2","key":"460_CR7","doi-asserted-by":"publisher","first-page":"187","DOI":"10.22608\/APO.201904","volume":"8","author":"R Kapoor","year":"2019","unstructured":"Kapoor R, Whigham BT, Al-Aswad LA: Artificial Intelligence and Optical Coherence Tomography Imaging. Asia Pac J Ophthalmol (Phila). 2019;8(2):187-194. https:\/\/doi.org\/10.22608\/APO.201904","journal-title":"Asia Pac J Ophthalmol (Phila)."},{"issue":"8","key":"460_CR8","doi-asserted-by":"publisher","first-page":"1731","DOI":"10.1016\/j.ophtha.2016.04.005","volume":"123","author":"U Chakravarthy","year":"2016","unstructured":"Chakravarthy U, Goldenberg D, Young G, et al: Automated Identification of Lesion Activity in Neovascular Age-Related Macular Degeneration. Ophthalmology. 2016;123(8):1731-1736. https:\/\/doi.org\/10.1016\/j.ophtha.2016.04.005","journal-title":"Ophthalmology."},{"issue":"10","key":"460_CR9","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.1007\/s10439-018-2091-x","volume":"46","author":"S Moccia","year":"2018","unstructured":"Moccia S, Foti S, Routray A, et al: Toward Improving Safety in Neurosurgery with an Active Handheld Instrument. Ann Biomed Eng. 2018;46(10):1450-1464. https:\/\/doi.org\/10.1007\/s10439-018-2091-x","journal-title":"Ann Biomed Eng."},{"issue":"16","key":"460_CR10","doi-asserted-by":"publisher","first-page":"165008","DOI":"10.1088\/1361-6560\/ab2f47","volume":"64","author":"P Zaffino","year":"2019","unstructured":"Zaffino P, Pernelle G, Mastmeyer A, et al: Fully automatic catheter segmentation in MRI with 3D convolutional neural networks: application to MRI-guided gynecologic brachytherapy. Phys Med Biol. 2019;64(16):165008. https:\/\/doi.org\/10.1088\/1361-6560\/ab2f47","journal-title":"Phys Med Biol."},{"issue":"2","key":"460_CR11","doi-asserted-by":"publisher","first-page":"e0227791","DOI":"10.1371\/journal.pone.0227791","volume":"15","author":"MK Fehling","year":"2020","unstructured":"Fehling MK, Grosch F, Schuster ME, Schick B, Lohscheller J: Fully automatic segmentation of glottis and vocal folds in endoscopic laryngeal high-speed videos using a deep Convolutional LSTM Network. PLoS One. 2020;15(2):e0227791. https:\/\/doi.org\/10.1371\/journal.pone.0227791","journal-title":"PLoS One."},{"key":"460_CR12","doi-asserted-by":"publisher","first-page":"4006","DOI":"10.1038\/ncomms5006","volume":"5","author":"HJ Aerts","year":"2014","unstructured":"Aerts HJ, Velazquez ER, Leijenaar RT, et al: Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006. https:\/\/doi.org\/10.1038\/ncomms5006","journal-title":"Nat Commun."},{"issue":"2","key":"460_CR13","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1148\/radiol.2020191145","volume":"295","author":"A Zwanenburg","year":"2020","unstructured":"Zwanenburg A, Vallieres M, Abdalah MA, et al: The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. Radiology. 2020;295(2):328-338. https:\/\/doi.org\/10.1148\/radiol.2020191145","journal-title":"Radiology."},{"issue":"2","key":"460_CR14","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1148\/radiol.2020200059","volume":"295","author":"CK Kuhl","year":"2020","unstructured":"Kuhl CK, Truhn D: The Long Route to Standardized Radiomics: Unraveling the Knot from the End. Radiology. 2020;295(2):339-341. https:\/\/doi.org\/10.1148\/radiol.2020200059","journal-title":"Radiology."},{"issue":"3","key":"460_CR15","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/j.radonc.2014.08.028","volume":"112","author":"GV Walker","year":"2014","unstructured":"Walker GV, Awan M, Tao R, et al: Prospective randomized double-blind study of atlas-based organ-at-risk autosegmentation-assisted radiation planning in head and neck cancer. Radiother Oncol. 2014;112(3):321-325. https:\/\/doi.org\/10.1016\/j.radonc.2014.08.028","journal-title":"Radiother Oncol."},{"issue":"4","key":"460_CR16","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1016\/j.ijrobp.2015.12.017","volume":"94","author":"MM van Heeswijk","year":"2016","unstructured":"van Heeswijk MM, Lambregts DM, van Griethuysen JJ, et al: Automated and Semiautomated Segmentation of Rectal Tumor Volumes on Diffusion-Weighted MRI: Can It Replace Manual Volumetry? Int J Radiat Oncol Biol Phys. 2016;94(4):824-831. https:\/\/doi.org\/10.1016\/j.ijrobp.2015.12.017","journal-title":"Int J Radiat Oncol Biol Phys."},{"issue":"3","key":"460_CR17","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/j.radonc.2005.10.011","volume":"77","author":"EA Miles","year":"2005","unstructured":"Miles EA, Clark CH, Urbano MT, et al: The impact of introducing intensity modulated radiotherapy into routine clinical practice. Radiother Oncol. 2005;77(3):241-246. https:\/\/doi.org\/10.1016\/j.radonc.2005.10.011","journal-title":"Radiother Oncol."},{"issue":"4","key":"460_CR18","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1002\/jmri.21292","volume":"27","author":"F Sardanelli","year":"2008","unstructured":"Sardanelli F, Quarenghi M, Di Leo G, Boccaccini L, Schiavi A: Segmentation of cardiac cine MR images of left and right ventricles: interactive semiautomated methods and manual contouring by two readers with different education and experience. J Magn Reson Imaging. 2008;27(4):785-792. https:\/\/doi.org\/10.1002\/jmri.21292","journal-title":"J Magn Reson Imaging."},{"issue":"13","key":"460_CR19","doi-asserted-by":"publisher","first-page":"5199","DOI":"10.1088\/0031-9155\/60\/13\/5199","volume":"60","author":"MB Altman","year":"2015","unstructured":"Altman MB, Kavanaugh JA, Wooten HO, et al: A framework for automated contour quality assurance in radiation therapy including adaptive techniques. Phys Med Biol. 2015;60(13):5199-5209. https:\/\/doi.org\/10.1088\/0031-9155\/60\/13\/5199","journal-title":"Phys Med Biol."},{"issue":"2","key":"460_CR20","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.radonc.2016.09.009","volume":"121","author":"SK Vinod","year":"2016","unstructured":"Vinod SK, Jameson MG, Min M, Holloway LC: Uncertainties in volume delineation in radiation oncology: A systematic review and recommendations for future studies. Radiother Oncol. 2016;121(2):169-179. https:\/\/doi.org\/10.1016\/j.radonc.2016.09.009","journal-title":"Radiother Oncol."},{"issue":"3","key":"460_CR21","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1111\/1754-9485.12462","volume":"60","author":"SK Vinod","year":"2016","unstructured":"Vinod SK, Min M, Jameson MG, Holloway LC: A review of interventions to reduce inter-observer variability in volume delineation in radiation oncology. J Med Imaging Radiat Oncol. 2016;60(3):393-406. https:\/\/doi.org\/10.1111\/1754-9485.12462","journal-title":"J Med Imaging Radiat Oncol."},{"key":"460_CR22","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.radonc.2019.04.006","volume":"137","author":"J van der Veen","year":"2019","unstructured":"van der Veen J, Gulyban A, Nuyts S: Interobserver variability in delineation of target volumes in head and neck cancer. Radiother Oncol. 2019;137:9-15. https:\/\/doi.org\/10.1016\/j.radonc.2019.04.006","journal-title":"Radiother Oncol."},{"key":"460_CR23","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.media.2018.08.006","volume":"50","author":"L Joskowicz","year":"2018","unstructured":"Joskowicz L, Cohen D, Caplan N, Sosna J: Automatic segmentation variability estimation with segmentation priors. Med Image Anal. 2018;50:54-64. https:\/\/doi.org\/10.1016\/j.media.2018.08.006","journal-title":"Med Image Anal."},{"key":"460_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.radonc.2019.11.021","volume":"145","author":"J Schreier","year":"2019","unstructured":"Schreier J, Genghi A, Laaksonen H, Morgas T, Haas B: Clinical evaluation of a full-image deep segmentation algorithm for the male pelvis on cone-beam CT and CT. Radiother Oncol. 2019;145:1-6. https:\/\/doi.org\/10.1016\/j.radonc.2019.11.021","journal-title":"Radiother Oncol."},{"issue":"27","key":"460_CR25","doi-asserted-by":"publisher","first-page":"42579","DOI":"10.18632\/oncotarget.9938","volume":"7","author":"MA Gambacorta","year":"2016","unstructured":"Gambacorta MA, Boldrini L, Valentini C, et al: Automatic segmentation software in locally advanced rectal cancer: READY (REsearch program in Auto Delineation sYstem)-RECTAL 02: prospective study. Oncotarget. 2016;7(27):42579-42584. https:\/\/doi.org\/10.18632\/oncotarget.9938","journal-title":"Oncotarget."},{"key":"460_CR26","doi-asserted-by":"publisher","first-page":"1192","DOI":"10.3389\/fonc.2019.01192","volume":"9","author":"N Bi","year":"2019","unstructured":"Bi N, Wang J, Zhang T, et al: Deep Learning Improved Clinical Target Volume Contouring Quality and Efficiency for Postoperative Radiation Therapy in Non-small Cell Lung Cancer. Front Oncol. 2019;9:1192. https:\/\/doi.org\/10.3389\/fonc.2019.01192","journal-title":"Front Oncol."},{"issue":"11","key":"460_CR27","doi-asserted-by":"publisher","first-page":"5129","DOI":"10.1002\/mp.13221","volume":"45","author":"Y Fu","year":"2018","unstructured":"Fu Y, Mazur TR, Wu X, et al: A novel MRI segmentation method using CNN \u2010based correction network for MRI \u2010guided adaptive radiotherapy. Med Phys. 2018;45(11):5129-5137. https:\/\/doi.org\/10.1002\/mp.13221","journal-title":"Med Phys."},{"key":"460_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.phro.2019.12.001","volume":"13","author":"F Vaassen","year":"2020","unstructured":"Vaassen F, Hazelaar C, Vaniqui A, et al: Evaluation of measures for assessing time-saving of automatic organ-at-risk segmentation in radiotherapy. Physics and Imaging in Radiation Oncology. 2020;13:1-6. https:\/\/doi.org\/10.1016\/j.phro.2019.12.001","journal-title":"Physics and Imaging in Radiation Oncology."},{"key":"460_CR29","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1016\/j.radonc.2019.05.010","volume":"138","author":"J van der Veen","year":"2019","unstructured":"van der Veen J, Willems S, Deschuymer S, et al: Benefits of deep learning for delineation of organs at risk in head and neck cancer. Radiother Oncol. 2019;138:68-74. https:\/\/doi.org\/10.1016\/j.radonc.2019.05.010","journal-title":"Radiother Oncol."},{"issue":"1","key":"460_CR30","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1016\/j.adro.2018.10.003","volume":"4","author":"LE Henke","year":"2019","unstructured":"Henke LE, Olsen JR, Contreras JA, et al: Stereotactic MR-Guided Online Adaptive Radiation Therapy (SMART) for Ultracentral Thorax Malignancies: Results of a Phase 1 Trial. Adv Radiat Oncol. 2019;4(1):201-209. https:\/\/doi.org\/10.1016\/j.adro.2018.10.003","journal-title":"Adv Radiat Oncol."},{"issue":"5","key":"460_CR31","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1001\/jamafacial.2018.0238","volume":"20","author":"P Sinha","year":"2018","unstructured":"Sinha P, Skolnick G, Patel KB, Branham GH, Chi JJ: A 3-Dimensional-Printed Short-Segment Template Prototype for Mandibular Fracture Repair. JAMA Facial Plast Surg. 2018;20(5):373-380. https:\/\/doi.org\/10.1001\/jamafacial.2018.0238","journal-title":"JAMA Facial Plast Surg."},{"issue":"2","key":"460_CR32","doi-asserted-by":"publisher","first-page":"134","DOI":"10.3857\/roj.2019.00038","volume":"37","author":"A Ayyalusamy","year":"2019","unstructured":"Ayyalusamy A, Vellaiyan S, Subramanian S, et al: Auto-segmentation of head and neck organs at risk in radiotherapy and its dependence on anatomic similarity. Radiat Oncol J. 2019;37(2):134-142. https:\/\/doi.org\/10.3857\/roj.2019.00038","journal-title":"Radiat Oncol J."},{"issue":"1","key":"460_CR33","doi-asserted-by":"publisher","first-page":"9802","DOI":"10.1038\/s41598-018-28100-x","volume":"8","author":"PM Gordaliza","year":"2018","unstructured":"Gordaliza PM, Munoz-Barrutia A, Abella M, Desco M, Sharpe S, Vaquero JJ: Unsupervised CT Lung Image Segmentation of a Mycobacterium Tuberculosis Infection Model. Sci Rep. 2018;8(1):9802. https:\/\/doi.org\/10.1038\/s41598-018-28100-x","journal-title":"Sci Rep."},{"key":"460_CR34","doi-asserted-by":"crossref","unstructured":"Lambert Z, Petitjean C, Dubray B, Ruan S: SegTHOR: Segmentation of Thoracic Organs at Risk in CT images. arXiv:1912.05950. Published 12 Dec 2019. Accessed 01 May 2020.","DOI":"10.1109\/IPTA50016.2020.9286453"},{"key":"460_CR35","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.ejmp.2018.05.006","volume":"50","author":"K Men","year":"2018","unstructured":"Men K, Zhang T, Chen X, et al: Fully automatic and robust segmentation of the clinical target volume for radiotherapy of breast cancer using big data and deep learning. Phys Med. 2018;50:13-19. https:\/\/doi.org\/10.1016\/j.ejmp.2018.05.006","journal-title":"Phys Med."},{"issue":"12","key":"460_CR36","doi-asserted-by":"publisher","first-page":"6377","DOI":"10.1002\/mp.12602","volume":"44","author":"K Men","year":"2017","unstructured":"Men K, Dai J, Li Y: Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks. Med Phys. 2017;44(12):6377-6389. https:\/\/doi.org\/10.1002\/mp.12602","journal-title":"Med Phys."},{"issue":"11","key":"460_CR37","doi-asserted-by":"publisher","first-page":"5086","DOI":"10.1002\/mp.13814","volume":"46","author":"DJ Rhee","year":"2019","unstructured":"Rhee DJ, Cardenas CE, Elhalawani H, et al: Automatic detection of contouring errors using convolutional neural networks. Med Phys. 2019;46(11):5086-5097. https:\/\/doi.org\/10.1002\/mp.13814","journal-title":"Med Phys."},{"key":"460_CR38","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1016\/j.media.2018.01.006","volume":"45","author":"HR Roth","year":"2018","unstructured":"Roth HR, Lu L, Lay N, et al: Spatial aggregation of holistically-nested convolutional neural networks for automated pancreas localization and segmentation. Med Image Anal. 2018;45:94-107. https:\/\/doi.org\/10.1016\/j.media.2018.01.006","journal-title":"Med Image Anal."},{"issue":"3","key":"460_CR39","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1016\/j.radonc.2015.05.012","volume":"115","author":"CJ Tao","year":"2015","unstructured":"Tao CJ, Yi JL, Chen NY, et al: Multi-subject atlas-based auto-segmentation reduces interobserver variation and improves dosimetric parameter consistency for organs at risk in nasopharyngeal carcinoma: A multi-institution clinical study. Radiother Oncol. 2015;115(3):407-411. https:\/\/doi.org\/10.1016\/j.radonc.2015.05.012","journal-title":"Radiother Oncol."},{"key":"460_CR40","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1186\/1748-717X-9-173","volume":"9","author":"D Thomson","year":"2014","unstructured":"Thomson D, Boylan C, Liptrot T, et al: Evaluation of an automatic segmentation algorithm for definition of head and neck organs at risk. Radiat Oncol. 2014;9:173. https:\/\/doi.org\/10.1186\/1748-717X-9-173","journal-title":"Radiat Oncol."},{"issue":"9","key":"460_CR41","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1007\/s00066-012-0117-0","volume":"188","author":"I Simmat","year":"2012","unstructured":"Simmat I, Georg P, Georg D, Birkfellner W, Goldner G, Stock M: Assessment of accuracy and efficiency of atlas-based autosegmentation for prostate radiotherapy in a variety of clinical conditions. Strahlenther Onkol. 2012;188(9):807-815. https:\/\/doi.org\/10.1007\/s00066-012-0117-0","journal-title":"Strahlenther Onkol."},{"key":"460_CR42","doi-asserted-by":"publisher","unstructured":"Vandewinckele L, Willems S, Robben D, et al: Segmentation of head-and-neck organs-at-risk in longitudinal CT scans combining deformable registrations and convolutional neural networks. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 2019:1\u201310. https:\/\/doi.org\/10.1080\/21681163.2019.1673824","DOI":"10.1080\/21681163.2019.1673824"},{"issue":"10","key":"460_CR43","doi-asserted-by":"publisher","first-page":"4558","DOI":"10.1002\/mp.13147","volume":"45","author":"N Tong","year":"2018","unstructured":"Tong N, Gou S, Yang S, Ruan D, Sheng K: Fully automatic multi-organ segmentation for head and neck cancer radiotherapy using shape representation model constrained fully convolutional neural networks. Med Phys. 2018;45(10):4558-4567. https:\/\/doi.org\/10.1002\/mp.13147","journal-title":"Med Phys."},{"issue":"1","key":"460_CR44","doi-asserted-by":"publisher","first-page":"5301","DOI":"10.1038\/s41598-017-05728-9","volume":"7","author":"S Trebeschi","year":"2017","unstructured":"Trebeschi S, van Griethuysen JJM, Lambregts DMJ, et al: Deep Learning for Fully-Automated Localization and Segmentation of Rectal Cancer on Multiparametric MR. Sci Rep. 2017;7(1):5301. https:\/\/doi.org\/10.1038\/s41598-017-05728-9","journal-title":"Sci Rep."},{"issue":"3","key":"460_CR45","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/j.radonc.2010.11.017","volume":"98","author":"PW Voet","year":"2011","unstructured":"Voet PW, Dirkx ML, Teguh DN, Hoogeman MS, Levendag PC, Heijmen BJ: Does atlas-based autosegmentation of neck levels require subsequent manual contour editing to avoid risk of severe target underdosage? A dosimetric analysis. Radiother Oncol. 2011;98(3):373-377. https:\/\/doi.org\/10.1016\/j.radonc.2010.11.017","journal-title":"A dosimetric analysis. Radiother Oncol."},{"issue":"4","key":"460_CR46","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1120\/jacmp.v17i4.6051","volume":"17","author":"K Wardman","year":"2016","unstructured":"Wardman K, Prestwich RJ, Gooding MJ, Speight RJ: The feasibility of atlas-based automatic segmentation of MRI for H&N radiotherapy planning. J Appl Clin Med Phys. 2016;17(4):146-154. https:\/\/doi.org\/10.1120\/jacmp.v17i4.6051","journal-title":"J Appl Clin Med Phys."},{"issue":"10","key":"460_CR47","doi-asserted-by":"publisher","first-page":"4568","DOI":"10.1002\/mp.13141","volume":"45","author":"J Yang","year":"2018","unstructured":"Yang J, Veeraraghavan H, Armato SG, et al: Autosegmentation for thoracic radiation treatment planning: A grand challenge at AAPM 2017. Med Phys. 2018;45(10):4568-4581. https:\/\/doi.org\/10.1002\/mp.13141","journal-title":"Med Phys."},{"issue":"3","key":"460_CR48","doi-asserted-by":"publisher","first-page":"297","DOI":"10.2307\/1932409","volume":"26","author":"LR Dice","year":"1945","unstructured":"Dice LR: Measures of the Amount of Ecologic Association Between Species. Ecology. 1945;26(3):297. https:\/\/doi.org\/10.2307\/1932409","journal-title":"Ecology."},{"key":"460_CR49","volume-title":"Wets RJ-B","author":"RT Rockafellar","year":"1998","unstructured":"Rockafellar RT, Wets RJB: Variational Analysis. Springer-Verlag Berlin Heidelberg; 1998."},{"issue":"11","key":"460_CR50","doi-asserted-by":"publisher","first-page":"5105","DOI":"10.1002\/mp.13200","volume":"45","author":"MJ Gooding","year":"2018","unstructured":"Gooding MJ, Smith AJ, Tariq M, et al: Comparative evaluation of autocontouring in clinical practice: A practical method using the Turing test. Med Phys. 2018;45(11):5105-5115. https:\/\/doi.org\/10.1002\/mp.13200","journal-title":"Med Phys."},{"key":"460_CR51","unstructured":"Nikolov S, Blackwell S, Mendes R, et al: Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy. arXiv:1809.04430. Published 12 Sep 2018. Accessed 07 Mar 2019."},{"key":"460_CR52","doi-asserted-by":"publisher","unstructured":"Kiser KJ, Ahmed S, Stieb S, et al. PleThora: Pleural effusion and thoracic cavity segmentations in diseased lungs for benchmarking chest CT processing pipelines. Med Phys. 2020;47(11):5941-5952. https:\/\/doi.org\/10.1002\/mp.14424","DOI":"10.1002\/mp.14424"},{"key":"460_CR53","doi-asserted-by":"publisher","unstructured":"Aerts HJWL, Wee L, Rios Velazquez E, et al: Data from NSCLC-Radiomics . In: The Cancer Imaging Archive. 2019. https:\/\/doi.org\/10.7937\/K9\/TCIA.2015.PF0M9REI","DOI":"10.7937\/K9\/TCIA.2015.PF0M9REI"},{"key":"460_CR54","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.jneumeth.2016.03.001","volume":"264","author":"X Li","year":"2016","unstructured":"Li X, Morgan PS, Ashburner J, Smith J, Rorden C: The first step for neuroimaging data analysis: DICOM to NIfTI conversion. J Neurosci Methods. 2016;264:47-56. https:\/\/doi.org\/10.1016\/j.jneumeth.2016.03.001","journal-title":"J Neurosci Methods."},{"key":"460_CR55","unstructured":"Li X, Morgan PS, Ashburner J, Smith J, Rorden C: dcm2niix.exe [computer program]. Version v1.0.201811142020. Accessed January 23, 2019. Available from: https:\/\/www.nitrc.org\/plugins\/mwiki\/index.php\/dcm2nii:MainPage"},{"key":"460_CR56","unstructured":"Pesiuk V: Lung Segmentation (3D) [computer program]. GitHub 2017. Accessed December 15, 2018. Available from: https:\/\/github.com\/imlab-uiip\/lung-segmentation-3d"},{"issue":"3","key":"460_CR57","doi-asserted-by":"publisher","first-page":"1116","DOI":"10.1016\/j.neuroimage.2006.01.015","volume":"31","author":"PA Yushkevich","year":"2006","unstructured":"Yushkevich PA, Piven J, Hazlett HC, et al: User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage. 2006;31(3):1116-1128. https:\/\/doi.org\/10.1016\/j.neuroimage.2006.01.015","journal-title":"Neuroimage."},{"key":"460_CR58","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1186\/s12880-015-0068-x","volume":"15","author":"AA Taha","year":"2015","unstructured":"Taha AA, Hanbury A: Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med Imaging. 2015;15:29. https:\/\/doi.org\/10.1186\/s12880-015-0068-x","journal-title":"BMC Med Imaging."},{"issue":"3","key":"460_CR59","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1109\/MCSE.2007.58","volume":"9","author":"TE Oliphant","year":"2007","unstructured":"Oliphant TE: Python for Scientific Computing. Computing in Science & Engineering. 2007;9(3):10-20. https:\/\/doi.org\/10.1109\/MCSE.2007.58","journal-title":"Computing in Science & Engineering."},{"key":"460_CR60","doi-asserted-by":"publisher","first-page":"14","DOI":"10.3389\/fninf.2014.00014","volume":"8","author":"A Abraham","year":"2014","unstructured":"Abraham A, Pedregosa F, Eickenberg M, et al: Machine learning for neuroimaging with scikit-learn. Front Neuroinform. 2014;8:14. https:\/\/doi.org\/10.3389\/fninf.2014.00014","journal-title":"Front Neuroinform."},{"key":"460_CR61","doi-asserted-by":"crossref","unstructured":"McKinney W: Data structures for statistical computing in Python. Proceedings of the 9th Python in Science Conference (SCIPY 2010). 2010;445:51\u201356.","DOI":"10.25080\/Majora-92bf1922-00a"},{"issue":"1","key":"460_CR62","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1186\/s13014-016-0732-5","volume":"11","author":"J Roesch","year":"2016","unstructured":"Roesch J, Panje C, Sterzing F, et al: SBRT for centrally localized NSCLC - What is too central? Radiat Oncol. 2016;11(1):157. https:\/\/doi.org\/10.1186\/s13014-016-0732-5","journal-title":"Radiat Oncol."},{"issue":"4","key":"460_CR63","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1097\/JTO.0000000000000453","volume":"10","author":"JY Chang","year":"2015","unstructured":"Chang JY, Bezjak A, Mornex F, Committee IART: Stereotactic ablative radiotherapy for centrally located early stage non-small-cell lung cancer: what we have learned. J Thorac Oncol. 2015;10(4):577-585. https:\/\/doi.org\/10.1097\/JTO.0000000000000453","journal-title":"J Thorac Oncol."},{"issue":"3\u20134","key":"460_CR64","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1093\/biomet\/52.3-4.591","volume":"52","author":"MB Wilk","year":"1965","unstructured":"Wilk MB, Shapiro SS: An analysis of variance test for normality (complete samples). Biometrika. 1965;52(3-4):591-611. https:\/\/doi.org\/10.1093\/biomet\/52.3-4.591","journal-title":"Biometrika."},{"key":"460_CR65","unstructured":"Spearman Rank Correlation Coefficient: In: The Concise Encyclopedia of Statistics. New York, NY: Springer New York; 2008:502\u2013505."},{"issue":"1","key":"460_CR66","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1214\/aoms\/1177730491","volume":"18","author":"HB Mann","year":"1947","unstructured":"Mann HB, Whitney DR: On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other. The Annals of Mathematical Statistics. 1947;18(1):50-60. https:\/\/doi.org\/10.1214\/aoms\/1177730491","journal-title":"The Annals of Mathematical Statistics."},{"key":"460_CR67","unstructured":"Kruskal-Wallis Test: In: The Concise Encyclopedia of Statistics. New York, NY: Springer New York; 2008:288\u2013290."},{"issue":"293","key":"460_CR68","doi-asserted-by":"publisher","first-page":"52","DOI":"10.2307\/2282330","volume":"56","author":"OJ Dunn","year":"1961","unstructured":"Dunn OJ: Multiple comparisons among means. Journal of the American Statistical Association. 1961;56(293):52. https:\/\/doi.org\/10.2307\/2282330","journal-title":"Journal of the American Statistical Association."},{"key":"460_CR69","doi-asserted-by":"publisher","DOI":"10.1002\/mp.13300","author":"W Zhu","year":"2018","unstructured":"Zhu W, Huang Y, Zeng L, et al: AnatomyNet: Deep learning for fast and fully automated whole-volume segmentation of head and neck anatomy. Med Phys. 2018. https:\/\/doi.org\/10.1002\/mp.13300","journal-title":"Med Phys."},{"issue":"2","key":"460_CR70","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1016\/j.ijrobp.2018.01.114","volume":"101","author":"CE Cardenas","year":"2018","unstructured":"Cardenas CE, McCarroll RE, Court LE, et al: Deep Learning Algorithm for Auto-Delineation of High-Risk Oropharyngeal Clinical Target Volumes With Built-In Dice Similarity Coefficient Parameter Optimization Function. Int J Radiat Oncol Biol Phys. 2018;101(2):468-478. https:\/\/doi.org\/10.1016\/j.ijrobp.2018.01.114","journal-title":"Int J Radiat Oncol Biol Phys."},{"key":"460_CR71","doi-asserted-by":"publisher","first-page":"983","DOI":"10.3389\/fonc.2019.00983","volume":"9","author":"KJ Kiser","year":"2019","unstructured":"Kiser KJ, Smith BD, Wang J, Fuller CD: \"Apres Mois, Le Deluge\": Preparing for the Coming Data Flood in the MRI-Guided Radiotherapy Era. Front Oncol. 2019;9:983. https:\/\/doi.org\/10.3389\/fonc.2019.00983","journal-title":"Front Oncol."},{"issue":"11","key":"460_CR72","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1016\/j.clon.2018.08.001","volume":"30","author":"A Hunt","year":"2018","unstructured":"Hunt A, Hansen VN, Oelfke U, Nill S, Hafeez S. Adaptive Radiotherapy Enabled by MRI Guidance. Clin Oncol (R Coll Radiol). 2018;30(11):711-719. https:\/\/doi.org\/10.1016\/j.clon.2018.08.001","journal-title":"Clin Oncol (R Coll Radiol)."},{"issue":"3","key":"460_CR73","doi-asserted-by":"publisher","first-page":"781","DOI":"10.1148\/radiol.2019190613","volume":"291","author":"CP Langlotz","year":"2019","unstructured":"Langlotz CP, Allen B, Erickson BJ, et al. A Roadmap for Foundational Research on Artificial Intelligence in Medical Imaging: From the 2018 NIH\/RSNA\/ACR\/The Academy Workshop. Radiology. 2019;291(3):781-791.\u00a0https:\/\/doi.org\/10.1148\/radiol.2019190613","journal-title":"Radiology."},{"issue":"5","key":"460_CR74","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1053\/j.semnuclmed.2019.06.005","volume":"49","author":"A Ibrahim","year":"2019","unstructured":"Ibrahim A, Vallieres M, Woodruff H, et al. Radiomics Analysis for Clinical Decision Support in Nuclear Medicine. Semin Nucl Med. 2019;49(5):438-449.\u00a0https:\/\/doi.org\/10.1053\/j.semnuclmed.2019.06.005","journal-title":"Semin Nucl Med."},{"issue":"2","key":"460_CR75","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1002\/mp.12045","volume":"44","author":"B Ibragimov","year":"2017","unstructured":"Ibragimov B, Xing L. Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys. 2017;44(2):547-557.\u00a0https:\/\/doi.org\/10.1002\/mp.12045","journal-title":"Med Phys."},{"issue":"7553","key":"460_CR76","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y Lecun","year":"2015","unstructured":"Lecun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436-444. https:\/\/doi.org\/10.1038\/nature14539","journal-title":"Nature."},{"issue":"6","key":"460_CR77","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Communications of the ACM. 2017;60(6):84-90. https:\/\/doi.org\/10.1145\/3065386","journal-title":"Communications of the ACM."}],"container-title":["Journal of Digital Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-021-00460-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10278-021-00460-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-021-00460-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,2]],"date-time":"2021-08-02T13:11:14Z","timestamp":1627909874000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10278-021-00460-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,23]]},"references-count":77,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["460"],"URL":"https:\/\/doi.org\/10.1007\/s10278-021-00460-3","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.05.14.20102103","asserted-by":"object"}]},"ISSN":["0897-1889","1618-727X"],"issn-type":[{"value":"0897-1889","type":"print"},{"value":"1618-727X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,23]]},"assertion":[{"value":"19 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 March 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 May 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 May 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}]}}