{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T16:00:23Z","timestamp":1790352023593,"version":"4.1.0"},"reference-count":31,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,4,28]],"date-time":"2023-04-28T00:00:00Z","timestamp":1682640000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008005","name":"Yonsei University College of Medicine","doi-asserted-by":"publisher","award":["C-2019-0025"],"award-info":[{"award-number":["C-2019-0025"]}],"id":[{"id":"10.13039\/501100008005","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002619","name":"Ajou University","doi-asserted-by":"publisher","award":["M-2021-C0460-00086"],"award-info":[{"award-number":["M-2021-C0460-00086"]}],"id":[{"id":"10.13039\/501100002619","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Oncol."],"abstract":"<jats:sec><jats:title>Background and purpose<\/jats:title><jats:p>Deep learning-based models have been actively investigated for various aspects of radiotherapy. However, for cervical cancer, only a few studies dealing with the auto-segmentation of organs-at-risk (OARs) and clinical target volumes (CTVs) exist. This study aimed to train a deep learning-based auto-segmentation model for OAR\/CTVs for patients with cervical cancer undergoing radiotherapy and to evaluate the model\u2019s feasibility and efficacy with not only geometric indices but also comprehensive clinical evaluation.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>A total of 180 abdominopelvic computed tomography images were included (training set, 165; validation set, 15). Geometric indices such as the Dice similarity coefficient (DSC) and the 95% Hausdorff distance (HD) were analyzed. A Turing test was performed and physicians from other institutions were asked to delineate contours with and without using auto-segmented contours to assess inter-physician heterogeneity and contouring time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The correlation between the manual and auto-segmented contours was acceptable for the anorectum, bladder, spinal cord, cauda equina, right and left femoral heads, bowel bag, uterocervix, liver, and left and right kidneys (DSC greater than 0.80). The stomach and duodenum showed DSCs of 0.67 and 0.73, respectively. CTVs showed DSCs between 0.75 and 0.80. Turing test results were favorable for most OARs and CTVs. No auto-segmented contours had large, obvious errors. The median overall satisfaction score of the participating physicians was 7 out of 10. Auto-segmentation reduced heterogeneity and shortened contouring time by 30 min among radiation oncologists from different institutions. Most participants favored the auto-contouring system.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The proposed deep learning-based auto-segmentation model may be an efficient tool for patients with cervical cancer undergoing radiotherapy. Although the current model may not completely replace humans, it can serve as a useful and efficient tool in real-world clinics.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fonc.2023.1119008","type":"journal-article","created":{"date-parts":[[2023,4,28]],"date-time":"2023-04-28T05:58:53Z","timestamp":1682661533000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Comprehensive clinical evaluation of deep learning-based auto-segmentation for radiotherapy in patients with cervical cancer"],"prefix":"10.3389","volume":"13","author":[{"given":"Seung Yeun","family":"Chung","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jee Suk","family":"Chang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong Bae","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,4,28]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1093\/annonc\/mdx220","article-title":"Cervical cancer: ESMO clinical practice guidelines for diagnosis, treatment and follow-up","volume":"28","author":"Marth","year":"2017","journal-title":"Ann Oncol"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2009.10.075","article-title":"Consensus guidelines for delineation of clinical target volume for intensity-modulated pelvic radiotherapy for the definitive treatment of cervix cancer","volume":"79","author":"Lim","year":"2011","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2018.02.013","article-title":"An atlas to aid delineation of para-aortic lymph node region in cervical cancer: design and validation of contouring guidelines","volume":"127","author":"Keenan","year":"2018","journal-title":"Radiother Oncol"},{"key":"B4","doi-asserted-by":"publisher","first-page":"2538","DOI":"10.1200\/JCO.2017.77.4273","article-title":"Patient-reported toxicity during pelvic intensity-modulated radiation therapy: NRG oncology\u2013RTOG 1203","volume":"36","author":"Klopp","year":"2018","journal-title":"J Clin Oncol"},{"key":"B5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13014-021-01771-z","article-title":"Clinical feasibility of deep learning-based auto-segmentation of target volumes and organs-at-risk in breast cancer patients after breast-conserving surgery","volume":"16","author":"Chung","year":"2021","journal-title":"Radiat Oncol"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/j.prro.2020.06.007","article-title":"Quality of regional nodal irradiation plans in breast cancer patients across a Large network\u2013can we translate results from randomized trials into the clinic","volume":"11","author":"Ling","year":"2021","journal-title":"Pract Radiat Oncol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1109\/RBME.2018.2864254","article-title":"Learning for personalized medicine: a comprehensive review from a deep learning perspective","volume":"12","author":"Zhang","year":"2018","journal-title":"IEEE Rev Biomed Eng"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra1814259","article-title":"Machine learning in medicine","volume":"380","author":"Rajkomar","year":"2019","journal-title":"New Engl J Med"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1016\/j.ccell.2021.04.002","article-title":"Artificial intelligence for clinical oncology","volume":"39","author":"Kann","year":"2021","journal-title":"Cancer Cell"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2018.00416","article-title":"Machine learning with radiation oncology big data","volume":"416","author":"Deng","year":"2018","journal-title":"Front Oncol"},{"key":"B11","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.phro.2020.06.006","article-title":"External validation of deep learning-based contouring of head and neck organs at risk","volume":"15","author":"Brunenberg","year":"2020","journal-title":"Phys Imaging Radiat Oncol"},{"key":"B12","doi-asserted-by":"publisher","first-page":"959","DOI":"10.3390\/diagnostics10110959","article-title":"A deep learning-based automated CT segmentation of prostate cancer anatomy for radiation therapy planning-a retrospective multicenter study","volume":"10","author":"Kiljunen","year":"2020","journal-title":"Diagnostics"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1080\/0284186X.2017.1285499","article-title":"Autodelineation of cervical cancers using multiparametric magnetic resonance imaging and machine learning","volume":"56","author":"Torheim","year":"2017","journal-title":"Acta Oncol"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1093\/jrr\/rrab070","article-title":"Automatic contour segmentation of cervical cancer using artificial intelligence","volume":"62","author":"Kano","year":"2021","journal-title":"J Radiat Res"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1002\/mp.14467","article-title":"Automatic contouring system for cervical cancer using convolutional neural networks","volume":"47","author":"Rhee","year":"2020","journal-title":"Med Phys"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2012.01.023","article-title":"Pelvic normal tissue contouring guidelines for radiation therapy: a radiation therapy oncology group consensus panel atlas","volume":"83","author":"Gay","year":"2012","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2005.05.062","article-title":"Mapping pelvic lymph nodes: guidelines for delineation in intensity-modulated radiotherapy","volume":"63","author":"Taylor","year":"2005","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1093\/jjco\/hyr096","article-title":"A consensus-based guideline defining clinical target volume for primary disease in external beam radiotherapy for intact uterine cervical cancer","volume":"41","author":"Toita","year":"2011","journal-title":"Japanese J Clin Oncol"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1016\/j.prro.2016.01.006","article-title":"Improving target volume delineation in intact cervical carcinoma: literature review and step-by-step pictorial atlas to aid contouring","volume":"6","author":"Eminowicz","year":"2016","journal-title":"Pract Radiat Oncol"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1093\/jjco\/hyp191","article-title":"A consensus-based guideline defining the clinical target volume for pelvic lymph nodes in external beam radiotherapy for uterine cervical cancer","volume":"40","author":"Toita","year":"2010","journal-title":"Japanese J Clin Oncol"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1002\/mp.13200","article-title":"Comparative evaluation of autocontouring in clinical practice: a practical method using the Turing test","volume":"45","author":"Gooding","year":"2018","journal-title":"Med Phys"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2021.05.003","article-title":"Metrics to evaluate the performance of auto-segmentation for radiation treatment planning: a critical review","volume":"160","author":"Sherer","year":"2021","journal-title":"Radiother Oncol"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2020.09.060","article-title":"Development and validation of a deep learning algorithm for auto-delineation of clinical target volume and organs at risk in cervical cancer radiotherapy","volume":"153","author":"Liu","year":"2020","journal-title":"Radiother Oncol"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1002\/acm2.13097","article-title":"Evaluation of deep learning-based auto-segmentation algorithms for delineating clinical target volume and organs at risk involving data for 125 cervical cancer patients","volume":"21","author":"Wang","year":"2020","journal-title":"J Appl Clin Med Phys"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13014-022-02157-5","article-title":"A dual deep neural network for auto-delineation in cervical cancer radiotherapy with clinical validation","volume":"17","author":"Nie","year":"2022","journal-title":"Radiat Oncol"},{"key":"B26","doi-asserted-by":"publisher","first-page":"13650","DOI":"10.1038\/s41598-022-18084-0","article-title":"Evaluation of auto-segmentation for EBRT planning structures using deep learning-based workflow on cervical cancer","volume":"12","author":"Wang","year":"2022","journal-title":"Sci Rep"},{"key":"B27","doi-asserted-by":"publisher","first-page":"667","DOI":"10.3390\/diagnostics13040667","article-title":"Automated contouring and planning in radiation therapy: what is \u2018Clinically acceptable\u2019","volume":"13","author":"Baroudi","year":"2023","journal-title":"Diagnostics"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1002\/acm2.13647","article-title":"Automatic contouring QA method using a deep learning\u2013based autocontouring system","volume":"23","author":"Rhee","year":"2022","journal-title":"J Appl Clin Med Phys"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.phro.2019.12.001","article-title":"Evaluation of measures for assessing time-saving of automatic organ-at-risk segmentation in radiotherapy","volume":"13","author":"Vaassen","year":"2020","journal-title":"Phys Imaging Radiat Oncol"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-021-00460-3","article-title":"Novel autosegmentation spatial similarity metrics capture the time required to correct segmentations better than traditional metrics in a thoracic cavity segmentation workflow","volume":"34","author":"Kiser","year":"2021","journal-title":"J Digital Imaging"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1016\/S0959-8049(03)00455-6","article-title":"Quality assurance of EORTC trial 22922\/10925 investigating the role of internal mammary\u2013medial supraclavicular irradiation in stage I-III breast cancer: the individual case review","volume":"39","author":"Poortmans","year":"2003","journal-title":"Eur J Cancer"}],"container-title":["Frontiers in Oncology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fonc.2023.1119008\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,28]],"date-time":"2023-04-28T05:58:57Z","timestamp":1682661537000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fonc.2023.1119008\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,28]]},"references-count":31,"alternative-id":["10.3389\/fonc.2023.1119008"],"URL":"https:\/\/doi.org\/10.3389\/fonc.2023.1119008","relation":{},"ISSN":["2234-943X"],"issn-type":[{"value":"2234-943X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,28]]},"article-number":"1119008"}}