{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T20:21:14Z","timestamp":1791577274704,"version":"4.3.4"},"reference-count":29,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T00:00:00Z","timestamp":1670889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Life"],"abstract":"<jats:p>Proper delineation of both target volumes and organs at risk is a crucial step in the radiation therapy workflow. This process is normally carried out manually by medical doctors, hence demanding timewise. To improve efficiency, auto-contouring methods have been proposed. We assessed a specific commercial software to investigate its impact on the radiotherapy workflow on four specific disease sites: head and neck, prostate, breast, and rectum. For the present study, we used a commercial deep learning-based auto-segmentation software, namely Limbus Contour (LC), Version 1.5.0 (Limbus AI Inc., Regina, SK, Canada). The software uses deep convolutional neural network models based on a U-net architecture, specific for each structure. Manual and automatic segmentation were compared on disease-specific organs at risk. Contouring time, geometrical performance (volume variation, Dice Similarity Coefficient\u2014DSC, and center of mass shift), and dosimetric impact (DVH differences) were evaluated. With respect to time savings, the maximum advantage was seen in the setting of head and neck cancer with a 65%-time reduction. The average DSC was 0.72. The best agreement was found for lungs. Good results were highlighted for bladder, heart, and femoral heads. The most relevant dosimetric difference was in the rectal cancer case, where the mean volume covered by the 45 Gy isodose was 10.4 cm3 for manual contouring and 289.4 cm3 for automatic segmentation. Automatic contouring was able to significantly reduce the time required in the procedure, simplifying the workflow, and reducing interobserver variability. Its implementation was able to improve the radiation therapy workflow in our department.<\/jats:p>","DOI":"10.3390\/life12122088","type":"journal-article","created":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T02:59:01Z","timestamp":1670900341000},"page":"2088","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":41,"title":["Implementation of a Commercial Deep Learning-Based Auto Segmentation Software in Radiotherapy: Evaluation of Effectiveness and Impact on Workflow"],"prefix":"10.3390","volume":"12","author":[{"given":"Lorenzo","family":"Radici","sequence":"first","affiliation":[{"name":"Department of Medical Physics, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Silvia","family":"Ferrario","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valeria Casanova","family":"Borca","sequence":"additional","affiliation":[{"name":"Department of Medical Physics, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8155-6865","authenticated-orcid":false,"given":"Domenico","family":"Cante","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marina","family":"Paolini","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cristina","family":"Piva","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Baratto","sequence":"additional","affiliation":[{"name":"Department of Medical Physics, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2276-0687","authenticated-orcid":false,"given":"Pierfrancesco","family":"Franco","sequence":"additional","affiliation":[{"name":"Department of Translational Medicine (DIMET), \u2018Maggiore della Carit\u00e0\u2019 University Hospital, University of Eastern Piedmont, 28100 Novara, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria Rosa","family":"La Porta","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, ASL TO4, Ivrea Community Hospital, 10015 Ivrea, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.radonc.2019.10.019","article-title":"Comparing deep learning-based auto-segmentation of organs at risk and clinical target volumes to expert inter-observer variability in radiotherapy planning","volume":"144","author":"Wong","year":"2020","journal-title":"Radiother. Oncol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.radonc.2017.11.012","article-title":"Clinical evaluation of atlas and deep learning based automatic contouring for lung cancer","volume":"126","author":"Lustberg","year":"2018","journal-title":"Radiother. Oncol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2654","DOI":"10.1109\/TMI.2019.2907072","article-title":"An Evaluation of Atlas Selection Methods for Atlas-Based Automatic Segmentation in Radiotherapy Treatment Planning","volume":"38","author":"Schipaanboord","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1002\/mp.12045","article-title":"Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks","volume":"44","author":"Ibragimov","year":"2017","journal-title":"Med. Phys."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6377","DOI":"10.1002\/mp.12602","article-title":"Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks","volume":"44","author":"Men","year":"2017","journal-title":"Med. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","article-title":"The Cancer Imaging Archive (TCIA): Maintaining and operating a public information repository","volume":"26","author":"Clark","year":"2013","journal-title":"J. Digit. Imaging"},{"key":"ref_7","unstructured":"Zuley, M.L., Jarosz, R., Kirk, S., Lee, Y., Colen, R., Garcia, K., Delbeke, D., Pham, M., Nagy, P., and Sevinc, G. (2016). Radiology data from the cancer genome atlas head-neck squamous cell carcinoma [TCGA-HNSC] collection. Cancer Imaging Arch., 10."},{"key":"ref_8","first-page":"K9","article-title":"Data from head and neck cancer CT atlas","volume":"10","author":"Grossberg","year":"2017","journal-title":"Cancer Imaging Arch."},{"key":"ref_9","unstructured":"Zuley, M.L., Jarosz, R., Drake, B.F., Rancilio, D., Klim, A., Rieger-Christ, K., and Lemmerman, J. (2016). Radiology data from the cancer genome atlas prostate adenocarcinoma [tcga-prad] collection. Cancer Imaging Arch., 9."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.dib.2017.06.002","article-title":"CT images and radiotherapy treatment planning of patients with breast cancer: A dataset","volume":"13","author":"Rezaei","year":"2017","journal-title":"Data Brief"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1186\/1748-717X-7-32","article-title":"3D Variation in delineation of head and neck organs at risk","volume":"7","author":"Brouwer","year":"2012","journal-title":"Radiat. Oncol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.radonc.2013.10.010","article-title":"Delineation of the neck node levels for head and neck tumors: A 2013 update. DAHANCA, EORTC, HKNPCSG, NCIC CTG, NCRI, RTOG, TROG consensus guidelines","volume":"110","author":"Ang","year":"2014","journal-title":"Radiother. Oncol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.radonc.2013.10.035","article-title":"Recommendation for a contouring method and atlas of organs at risk in nasopharyngeal carcinoma patients receiving intensity-modulated radiotherapy","volume":"110","author":"Sun","year":"2014","journal-title":"Radiother. Oncol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e353","DOI":"10.1016\/j.ijrobp.2012.01.023","article-title":"Pelvic normal tissue contouring guidelines for radiation therapy: A Radiation Therapy Oncology Group consensus panel atlas","volume":"83","author":"Gay","year":"2012","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.radonc.2015.07.041","article-title":"CT-based delineation of organs at risk in the head and neck region: DAHANCA, EORTC, GORTEC, HKNPCSG, NCIC CTG, NCRI, NRG Oncology and TROG consensus guidelines","volume":"117","author":"Brouwer","year":"2015","journal-title":"Radiother. Oncol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"626499","DOI":"10.3389\/fonc.2021.626499","article-title":"Training and Validation of Deep Learning-Based Auto-Segmentation Models for Lung Stereotactic Ablative Radiotherapy Using Retrospective Radiotherapy Planning Contours","volume":"11","author":"Wong","year":"2021","journal-title":"Front. Oncol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1186\/s13014-021-01831-4","article-title":"Implementation of deep learning-based auto-segmentation for radiotherapy planning structures: A workflow study at two cancer centers","volume":"16","author":"Wong","year":"2021","journal-title":"Radiat. Oncol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e80","DOI":"10.1016\/j.prro.2020.05.013","article-title":"Clinical Evaluation of Deep Learning and Atlas-Based Auto-Contouring of Bladder and Rectum for Prostate Radiation Therapy","volume":"11","author":"Zabel","year":"2021","journal-title":"Pract. Radiat. Oncol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cefaro, G.A., Genovesi, D., and Perez, C.A. (2013). Delineating Organs at Risk in Radiation Therapy, Springer.","DOI":"10.1007\/978-88-470-5257-4"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"703","DOI":"10.3109\/0284186X.2013.765064","article-title":"Delineation of target volumes and organs at risk in adjuvant radiotherapy of early breast cancer: National guidelines and contouring atlas by the Danish Breast Cancer Cooperative Group","volume":"52","author":"Nielsen","year":"2013","journal-title":"Acta Oncol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gambacorta, M.A., Chiloiro, G., and Valentini, V. (2018). Should We Tailor the Delineation of Pelvic Structures According to Tumor Presentation?. Multidisciplinary Management of Rectal Cancer, Springer.","DOI":"10.1007\/978-3-319-43217-5_21"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1186\/s13014-014-0264-9","article-title":"Technical guidelines for head and neck cancer IMRT on behalf of the Italian association of radiation oncology\u2014Head and neck working group","volume":"9","author":"Merlotti","year":"2014","journal-title":"Radiat. Oncol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","article-title":"Measures of the amount of ecologic association between species","volume":"26","author":"Dice","year":"1945","journal-title":"Ecology"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"D\u2019Aviero, A., Re, A., Catucci, F., Piccari, D., Votta, C., Piro, D., Piras, A., Di Dio, C., Iezzi, M., and Preziosi, F. (2022). Clinical Validation of a Deep-Learning Segmentation Software in Head and Neck: An Early Analysis in a Developing Radiation Oncology Center. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19159057"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1016\/j.ijrobp.2012.09.036","article-title":"Small bowel dose parameters predicting grade \u2265 3 acute toxicity in rectal cancer patients treated with neoadjuvant chemoradiation: An independent validation study comparing peritoneal space versus small bowel loop contouring techniques","volume":"85","author":"Banerjee","year":"2013","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1186\/s13014-020-01650-z","article-title":"Evaluation of small bowel motion and feasibility of using the peritoneal space to replace bowel loops for dose constraints during intensity-modulated radiotherapy for rectal cancer","volume":"15","author":"Li","year":"2020","journal-title":"Radiat. Oncol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"638197","DOI":"10.3389\/fonc.2021.638197","article-title":"A Preliminary Experience of Implementing Deep-Learning Based Auto-Segmentation in Head and Neck Cancer: A Study on Real-World Clinical Cases","volume":"11","author":"Zhong","year":"2021","journal-title":"Front. Oncol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1016\/j.ijrobp.2008.03.004","article-title":"Development and validation of a standardized method for contouring the brachial plexus: Preliminary dosimetric analysis among patients treated with IMRT for head-and-neck cancer","volume":"72","author":"Hall","year":"2008","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.ijrobp.2010.10.019","article-title":"Variations in the contouring of organs at risk: Test case from a patient with oropharyngeal cancer","volume":"82","author":"Nelms","year":"2012","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."}],"container-title":["Life"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-1729\/12\/12\/2088\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:40:15Z","timestamp":1760146815000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-1729\/12\/12\/2088"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,13]]},"references-count":29,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["life12122088"],"URL":"https:\/\/doi.org\/10.3390\/life12122088","relation":{},"ISSN":["2075-1729"],"issn-type":[{"value":"2075-1729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,13]]}}}