{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T15:15:38Z","timestamp":1788016538846,"version":"build-2784847793"},"reference-count":40,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2023,12,7]],"date-time":"2023-12-07T00:00:00Z","timestamp":1701907200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Italian Ministry of Health (Ricerca Corrente)"},{"name":"ACC reti 2021\u2014RCR WP12"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>Purpose: When autocontouring based on artificial intelligence (AI) is used in the radiotherapy (RT) workflow, the contours are reviewed and eventually adjusted by a radiation oncologist before an RT treatment plan is generated, with the purpose of improving dosimetry and reducing both interobserver variability and time for contouring. The purpose of this study was to evaluate the results of application of a commercial AI-based autocontouring for RT, assessing both geometric accuracies and the influence on optimized dose from automatically generated contours after review by human operator. Materials and Methods: A commercial autocontouring system was applied to a retrospective database of 40 patients, of which 20 were treated with radiotherapy for prostate cancer (PCa) and 20 for head and neck cancer (HNC). Contours resulting from AI were compared against AI contours reviewed by human operator and human-only contours using Dice similarity coefficient (DSC), Hausdorff distance (HD), and relative volume difference (RVD). Dosimetric indices such as Dmean, D0.03cc, and normalized plan quality metrics were used to compare dose distributions from RT plans generated from structure sets contoured by humans assisted by AI against plans from manual contours. The reduction in contouring time obtained by using automated tools was also assessed. A Wilcoxon rank sum test was computed to assess the significance of differences. Interobserver variability of the comparison of manual vs. AI-assisted contours was also assessed among two radiation oncologists for PCa. Results: For PCa, AI-assisted segmentation showed good agreement with expert radiation oncologist structures with average DSC among patients \u2265 0.7 for all structures, and minimal radiation oncology adjustment of structures (DSC of adjusted versus AI structures \u2265 0.91). For HNC, results of comparison between manual and AI contouring varied considerably e.g., 0.77 for oral cavity and 0.11\u20130.13 for brachial plexus, but again, adjustment was generally minimal (DSC of adjusted against AI contours 0.97 for oral cavity, 0.92\u20130.93 for brachial plexus). The difference in dose for the target and organs at risk were not statistically significant between human and AI-assisted, with the only exceptions of D0.03cc to the anal canal and Dmean to the brachial plexus. The observed average differences in plan quality for PCa and HNC cases were 8% and 6.7%, respectively. The dose parameter changes due to interobserver variability in PCa were small, with the exception of the anal canal, where large dose variations were observed. The reduction in time required for contouring was 72% for PCa and 84% for HNC. Conclusions: When an autocontouring system is used in combination with human review, the time of the RT workflow is significantly reduced without affecting dose distribution and plan quality.<\/jats:p>","DOI":"10.3390\/cancers15245735","type":"journal-article","created":{"date-parts":[[2023,12,7]],"date-time":"2023-12-07T03:35:31Z","timestamp":1701920131000},"page":"5735","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Clinical Use of a Commercial Artificial Intelligence-Based Software for Autocontouring in Radiation Therapy: Geometric Performance and Dosimetric Impact"],"prefix":"10.3390","volume":"15","author":[{"given":"S M Hasibul","family":"Hoque","sequence":"first","affiliation":[{"name":"Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6113-6644","authenticated-orcid":false,"given":"Giovanni","family":"Pirrone","sequence":"additional","affiliation":[{"name":"Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2292-0444","authenticated-orcid":false,"given":"Fabio","family":"Matrone","sequence":"additional","affiliation":[{"name":"Radiation Oncology Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alessandra","family":"Donofrio","sequence":"additional","affiliation":[{"name":"Radiation Oncology Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9677-3176","authenticated-orcid":false,"given":"Giuseppe","family":"Fanetti","sequence":"additional","affiliation":[{"name":"Radiation Oncology Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9968-7679","authenticated-orcid":false,"given":"Angela","family":"Caroli","sequence":"additional","affiliation":[{"name":"Radiation Oncology Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rahnuma Shahrin","family":"Rista","sequence":"additional","affiliation":[{"name":"Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roberto","family":"Bortolus","sequence":"additional","affiliation":[{"name":"Radiation Oncology Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1711-4242","authenticated-orcid":false,"given":"Michele","family":"Avanzo","sequence":"additional","affiliation":[{"name":"Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Annalisa","family":"Drigo","sequence":"additional","affiliation":[{"name":"Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1802-0627","authenticated-orcid":false,"given":"Paola","family":"Chiovati","sequence":"additional","affiliation":[{"name":"Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.radonc.2014.03.024","article-title":"Estimating the demand for radiotherapy from the evidence: A review of changes from 2003 to 2012","volume":"112","author":"Barton","year":"2014","journal-title":"Radiother. Oncol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1016\/S1470-2045(06)70759-8","article-title":"Role of radiotherapy in cancer control in low-income and middle-income countries","volume":"7","author":"Barton","year":"2006","journal-title":"Lancet Oncol."},{"key":"ref_3","unstructured":"(2022, November 05). Cancer Today. Available online: http:\/\/gco.iarc.fr\/today\/home."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1762","DOI":"10.3389\/fonc.2020.01762","article-title":"Analysis of Geometric Performance and Dosimetric Impact of Using Automatic Contour Segmentation for Radiotherapy Planning","volume":"10","author":"Cao","year":"2020","journal-title":"Front. Oncol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1111\/j.1754-9485.2010.02192.x","article-title":"A review of methods of analysis in contouring studies for radiation oncology","volume":"54","author":"Jameson","year":"2010","journal-title":"J. Med. Imaging Radiat. Oncol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1186\/s13014-020-01562-y","article-title":"Atlas-based auto-segmentation for postoperative radiotherapy planning in endometrial and cervical cancers","volume":"15","author":"Kim","year":"2020","journal-title":"Radiat. Oncol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2669","DOI":"10.1002\/mp.13553","article-title":"Shape constrained fully convolutional DenseNet with adversarial training for multiorgan segmentation on head and neck CT and low-field MR images","volume":"46","author":"Tong","year":"2019","journal-title":"Med. Phys."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1002\/jmrs.365","article-title":"A future of automated image contouring with machine learning in radiation therapy","volume":"66","author":"Jackson","year":"2019","journal-title":"J. Med. Radiat. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1186\/s13014-021-01831-4","article-title":"Implementation of deep learning-based auto-segmentation for radiotherapy planning structures: A workflow study at two cancer centers","volume":"16","author":"Wong","year":"2021","journal-title":"Radiat. Oncol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.phro.2020.11.002","article-title":"Machine learning applications in radiation oncology: Current use and needs to support clinical implementation","volume":"16","author":"Brouwer","year":"2020","journal-title":"Phys. Imaging Radiat. Oncol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e13507","DOI":"10.1002\/acm2.13507","article-title":"Clinical validation of an automatic atlas-based segmentation tool for male pelvis CT images","volume":"23","author":"Casati","year":"2022","journal-title":"J. Appl. Clin. Med. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"D\u2019aviero, A., Re, A., Catucci, F., Piccari, D., Votta, C., Piro, D., Piras, A., Di Dio, C., Iezzi, M., and Preziosi, F. (2022). Clinical Validation of a Deep-Learning Segmentation Software in Head and Neck: An Early Analysis in a Developing Radiation Oncology Center. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19159057"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e80","DOI":"10.1016\/j.prro.2020.05.013","article-title":"Clinical Evaluation of Deep Learning and Atlas-Based Auto-Contouring of Bladder and Rectum for Prostate Radiation Therapy","volume":"11","author":"Zabel","year":"2021","journal-title":"Pract. Radiat. Oncol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Taha, A.A., and Hanbury, A. (2015). Metrics for evaluating 3D medical image segmentation: Analysis, selection, and tool. BMC Med. Imaging, 15.","DOI":"10.1186\/s12880-015-0068-x"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.radonc.2010.11.017","article-title":"Does atlas-based autosegmentation of neck levels require subsequent manual contour editing to avoid risk of severe target underdosage? A dosimetric analysis","volume":"98","author":"Voet","year":"2011","journal-title":"Radiother. Oncol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.radonc.2016.09.009","article-title":"Uncertainties in volume delineation in radiation oncology: A systematic review and recommendations for future studies","volume":"121","author":"Vinod","year":"2016","journal-title":"Radiother. Oncol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"050902","DOI":"10.1118\/1.4871620","article-title":"Vision 20\/20: Perspectives on automated image segmentation for radiotherapy","volume":"41","author":"Sharp","year":"2014","journal-title":"Med. Phys."},{"key":"ref_18","unstructured":"(2022, November 12). Eclipse|Varian. Available online: https:\/\/www.varian.com\/products\/radiotherapy\/treatment-planning\/eclipse."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.radonc.2014.11.030","article-title":"ESTRO consensus guideline on target volume delineation for elective radiation therapy of early stage breast cancer","volume":"114","author":"Offersen","year":"2015","journal-title":"Radiother. Oncol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.radonc.2018.01.014","article-title":"ESTRO ACROP consensus guideline on CT- and MRI-based target volume delineation for primary radiation therapy of localized prostate cancer","volume":"127","author":"Salembier","year":"2018","journal-title":"Radiother. Oncol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.radonc.2017.10.016","article-title":"Delineation of the primary tumour Clinical Target Volumes (CTV-P) in laryngeal, hypopharyngeal, oropharyngeal and oral cavity squamous cell carcinoma: AIRO, CACA, DAHANCA, EORTC, GEORCC, GORTEC, HKNPCSG, HNCIG, IAG-KHT, LPRHHT, NCIC CTG, NCRI, NRG Oncology, PHNS, SBRT, SOMERA, SRO, SSHNO, TROG consensus guidelines","volume":"126","author":"Evans","year":"2018","journal-title":"Radiother. Oncol."},{"key":"ref_22","unstructured":"(2022, November 12). Limbus AI-Automatic Contouring for Radiation Therapy, Limbus AI. Available online: https:\/\/limbus.ai\/."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.radonc.2019.10.019","article-title":"Comparing deep learning-based auto-segmentation of organs at risk and clinical target volumes to expert inter-observer variability in radiotherapy planning","volume":"144","author":"Wong","year":"2020","journal-title":"Radiother. Oncol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","article-title":"The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository","volume":"26","author":"Clark","year":"2013","journal-title":"J. Digit. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"490","DOI":"10.3389\/fonc.2020.00490","article-title":"Electron Density and Biologically Effective Dose (BED) Radiomics-Based Machine Learning Models to Predict Late Radiation-Induced Subcutaneous Fibrosis","volume":"10","author":"Avanzo","year":"2020","journal-title":"Front. Oncol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.ejmp.2015.11.003","article-title":"Image-guided volumetric arc radiotherapy of pancreatic cancer with simultaneous integrated boost: Optimization strategies and dosimetric results","volume":"32","author":"Avanzo","year":"2016","journal-title":"Phys. Medica"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Baroudi, H., Brock, K.K., Cao, W., Chen, X., Chung, C., Court, L.E., El Basha, M.D., Farhat, M., Gay, S., and Gronberg, M.P. (2023). Automated Contouring and Planning in Radiation Therapy: What Is \u2018Clinically Acceptable\u2019?. Diagnostics, 13.","DOI":"10.3390\/diagnostics13040667"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5105","DOI":"10.1002\/mp.13200","article-title":"Comparative evaluation of autocontouring in clinical practice: A practical method using the Turing test","volume":"45","author":"Gooding","year":"2018","journal-title":"Med. Phys."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"015006","DOI":"10.1117\/1.JMI.5.1.015006","article-title":"Family of boundary overlap metrics for the evaluation of medical image segmentation","volume":"5","author":"Yeghiazaryan","year":"2018","journal-title":"J. Med. Imaging"},{"key":"ref_30","unstructured":"(2022, November 30). StructSeg2019-Grand Challenge, Grand-Challenge.org. Available online: https:\/\/structseg2019.grand-challenge.org\/Evaluation\/."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1016\/j.ijrobp.2017.12.013","article-title":"American Association of Physicists in Medicine Task Group 263: Standardizing Nomenclatures in Radiation Oncology","volume":"100","author":"Mayo","year":"2017","journal-title":"Int. J. Radiat. Oncol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1093\/jicru\/ndq008","article-title":"3. Special Considerations Regarding Absorbed-Dose and Dose\u2013Volume Prescribing and Reporting in IMRT","volume":"10","author":"Doses","year":"2010","journal-title":"J. ICRU"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.ijrobp.2005.09.028","article-title":"Conformity index: A review","volume":"64","author":"Feuvret","year":"2006","journal-title":"Int. J. Radiat. Oncol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1016\/j.prro.2011.11.012","article-title":"Variation in external beam treatment plan quality: An inter-institutional study of planners and planning systems","volume":"2","author":"Nelms","year":"2012","journal-title":"Pract. Radiat. Oncol."},{"key":"ref_35","unstructured":"(2022, November 30). MATLAB-MathWorks. Available online: https:\/\/ww2.mathworks.cn\/en\/products\/matlab.html."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Avanzo, M., Trianni, A., Botta, F., Talamonti, C., Stasi, M., and Iori, M. (2021). Artificial Intelligence and the Medical Physicist: Welcome to the Machine. Appl. Sci., 11.","DOI":"10.3390\/app11041691"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1016\/j.semradonc.2022.06.012","article-title":"Regulatory Aspects of the Use of Artificial Intelligence Medical Software","volume":"32","author":"Zanca","year":"2022","journal-title":"Semin. Radiat. Oncol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.clon.2023.01.016","article-title":"A Review of the Metrics Used to Assess Auto-Contouring Systems in Radiotherapy","volume":"35","author":"Mackay","year":"2023","journal-title":"Clin. Oncol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2543","DOI":"10.1118\/1.1785454","article-title":"Dose uncertainty due to computed tomography (CT) slice thickness in CT-based high dose rate brachytherapy of the prostate cancer","volume":"31","author":"Kim","year":"2004","journal-title":"Med. Phys."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1120\/jacmp.v4i4.2511","article-title":"CT slice index and thickness: Impact on organ contouring in radiation treatment planning for prostate cancer","volume":"4","author":"Berthelet","year":"2003","journal-title":"J. Appl. Clin. Med. Phys."}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/15\/24\/5735\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:34:35Z","timestamp":1760132075000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/15\/24\/5735"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,7]]},"references-count":40,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["cancers15245735"],"URL":"https:\/\/doi.org\/10.3390\/cancers15245735","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,7]]}}}