{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,15]],"date-time":"2026-11-15T11:05:32Z","timestamp":1794740732495,"version":"4.9.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T00:00:00Z","timestamp":1766448000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T00:00:00Z","timestamp":1769472000000},"content-version":"vor","delay-in-days":35,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Contour delineation is crucial for ensuring the efficacy and side effects of radiotherapy (RT), but it inevitably involves inter-observer variability (IOV). Deep learning (DL) models have been used to assist in contour delineation, but further evaluation is needed to guide healthcare professionals in the judicious application of DL models. The contours of 22 anatomical structures and the gross tumor volume (GTV) for 30 patients with nasopharyngeal carcinoma were delineated using four DL models: AccuContour, RT-Viewer-contour, RT-Mind, and PVmed Contouring. The overall kappa values and generalized conformity indices of these contours were calculated to assess consistency. The Dice similarity coefficient (DSC), Relative Volume Difference (RVD), 95th percentile Hausdorff Distance (HD95), and Average Symmetric Surface Distance (ASSD) were calculated to evaluate the accuracy of the contours. Additionally, two innovative model frameworks were introduced to improve the fidelity and reliability of patient contour delineation. The consistency of the contours generated by the four DL models was poor for GTV, pituitary gland, temporal lobes, and temporomandibular joints. Marked differences were still observed between the contours generated by the models and the manual delineations by oncologists for the GTV, lens, optic nerves, pituitary glands temporomandibular joints, temporal lobes, and trachea. The model frameworks we proposed can effectively optimize the contours of GTV, brainstem, eyes, lens, and temporomandibular joints. The contours generated by DL models still have deficiencies in the application of nasopharyngeal carcinoma radiotherapy. To address this, two model frameworks were proposed to increase the robustness of automatic contouring.<\/jats:p>","DOI":"10.1038\/s41598-025-33567-6","type":"journal-article","created":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T21:23:50Z","timestamp":1766525030000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Consistency evaluation and performance optimization of deep learning-based auto-contouring for nasopharyngeal carcinoma"],"prefix":"10.1038","volume":"16","author":[{"given":"Linghui","family":"Yan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuhao","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zirong","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liuling","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoting","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianming","family":"Ding","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zixuan","family":"Leng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qichao","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chuanben","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaodong","family":"Fei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,12,23]]},"reference":[{"key":"33567_CR1","doi-asserted-by":"publisher","first-page":"950","DOI":"10.1016\/j.ijrobp.2009.09.062","volume":"77","author":"PM Harari","year":"2010","unstructured":"Harari, P. M., Song, S. & Tom\u00e9, W. A. Emphasizing conformal avoidance versus target definition for IMRT planning in head-and-neck cancer. Int. J. Radiat. Oncol. Biol. Phys. 77, 950\u2013958 (2010).","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"33567_CR2","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.radonc.2005.04.010","volume":"77","author":"X Geets","year":"2005","unstructured":"Geets, X. et al. Inter-observer variability in the delineation of pharyngo-laryngeal tumor, Parotid glands and cervical spinal cord: comparison between CT-scan and MRI. Radiother Oncol. 77, 25\u201331 (2005).","journal-title":"Radiother Oncol."},{"key":"33567_CR3","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1016\/j.radonc.2009.09.008","volume":"93","author":"TA van de Water","year":"2009","unstructured":"van de Water, T. A., Bijl, H. P., Westerlaan, H. E. & Langendijk, J. A. Delineation guidelines for organs at risk involved in radiation-induced salivary dysfunction and Xerostomia. Radiother Oncol. 93, 545\u2013552 (2009).","journal-title":"Radiother Oncol."},{"key":"33567_CR4","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1016\/j.prro.2016.04.005","volume":"6","author":"SL Berry","year":"2016","unstructured":"Berry, S. L., Boczkowski, A., Ma, R., Mechalakos, J. & Hunt, M. Interobserver variability in radiation therapy plan output: results of a single-institution study. Pract. Radiat. Oncol. 6, 442\u2013449 (2016).","journal-title":"Pract. Radiat. Oncol."},{"key":"33567_CR5","first-page":"e834","volume":"45","author":"I El Naqa","year":"2018","unstructured":"El Naqa, I. et al. Machine learning and modeling: Data, validation, communication challenges. Med. Phys. 45, e834\u2013e840 (2018).","journal-title":"Med. Phys."},{"key":"33567_CR6","doi-asserted-by":"publisher","first-page":"221","DOI":"10.3389\/fonc.2017.00221","volume":"7","author":"ATY Chang","year":"2017","unstructured":"Chang, A. T. Y., Tan, L. T., Duke, S. & Ng, W. T. Challenges for quality assurance of target volume delineation in clinical trials. Front. Oncol. 7, 221 (2017).","journal-title":"Front. Oncol."},{"key":"33567_CR7","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1016\/j.canrad.2021.08.020","volume":"26","author":"M Chen","year":"2022","unstructured":"Chen, M. et al. Application of deep learning to auto-delineation of target volumes and organs at risk in radiotherapy. Cancer Radiother. 26, 494\u2013501 (2022).","journal-title":"Cancer Radiother"},{"key":"33567_CR8","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.radonc.2020.09.008","volume":"153","author":"L Vandewinckele","year":"2020","unstructured":"Vandewinckele, L. et al. Overview of artificial intelligence-based applications in radiotherapy: recommendations for implementation and quality assurance. Radiother Oncol. 153, 55\u201366 (2020).","journal-title":"Radiother Oncol."},{"key":"33567_CR9","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1016\/j.clon.2021.12.003","volume":"34","author":"K Harrison","year":"2022","unstructured":"Harrison, K. et al. Machine learning for Auto-Segmentation in radiotherapy planning. Clin. Oncol. (R Coll. Radiol). 34, 74\u201388 (2022).","journal-title":"Clin. Oncol. (R Coll. Radiol)"},{"key":"33567_CR10","doi-asserted-by":"publisher","first-page":"100654","DOI":"10.1016\/j.phro.2024.100654","volume":"32","author":"AT L\u00ea","year":"2024","unstructured":"L\u00ea, A. T. et al. Head and neck automatic multi-organ segmentation on Dual-Energy computed tomography. Phys. Imaging Radiat. Oncol. 32, 100654 (2024).","journal-title":"Phys. Imaging Radiat. Oncol."},{"key":"33567_CR11","doi-asserted-by":"crossref","unstructured":"Dai, X. et al. Multi-organ auto-delineation in head-and-neck MRI for radiation therapy using regional convolutional neural network. Phys. Med. Biol. 67, (2022).","DOI":"10.1088\/1361-6560\/ac3b34"},{"key":"33567_CR12","doi-asserted-by":"publisher","first-page":"5862","DOI":"10.1002\/mp.15146","volume":"48","author":"X Dai","year":"2021","unstructured":"Dai, X. et al. Automated delineation of head and neck organs at risk using synthetic MRI-aided mask scoring regional convolutional neural network. Med. Phys. 48, 5862\u20135873 (2021).","journal-title":"Med. Phys."},{"key":"33567_CR13","doi-asserted-by":"publisher","first-page":"e14248","DOI":"10.1002\/acm2.14248","volume":"25","author":"S Luan","year":"2024","unstructured":"Luan, S. et al. Accurate and robust auto-segmentation of head and neck organ-at-risks based on a novel CNN fine-tuning workflow. J. Appl. Clin. Med. Phys. 25, e14248 (2024).","journal-title":"J. Appl. Clin. Med. Phys."},{"key":"33567_CR14","doi-asserted-by":"publisher","first-page":"e13647","DOI":"10.1002\/acm2.13647","volume":"23","author":"DJ Rhee","year":"2022","unstructured":"Rhee, D. J. et al. Automatic contouring QA method using a deep learning-based autocontouring system. J. Appl. Clin. Med. Phys. 23, e13647 (2022).","journal-title":"J. Appl. Clin. Med. Phys."},{"key":"33567_CR15","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/j.radonc.2015.07.041","volume":"117","author":"CL Brouwer","year":"2015","unstructured":"Brouwer, C. L. et al. CT-based delineation of organs at risk in the head and neck region: DAHANCA, EORTC, GORTEC, HKNPCSG, NCIC CTG, NCRI, NRG oncology and TROG consensus guidelines. Radiother Oncol. 117, 83\u201390 (2015).","journal-title":"Radiother Oncol."},{"key":"33567_CR16","doi-asserted-by":"publisher","first-page":"979","DOI":"10.1118\/1.1568978","volume":"30","author":"JO Deasy","year":"2003","unstructured":"Deasy, J. O., Blanco, A. I. & Clark, V. H. CERR: a computational environment for radiotherapy research. Med. Phys. 30, 979\u2013985 (2003).","journal-title":"Med. Phys."},{"key":"33567_CR17","doi-asserted-by":"publisher","first-page":"572","DOI":"10.1016\/j.radonc.2010.06.009","volume":"97","author":"R Allozi","year":"2010","unstructured":"Allozi, R. et al. Tools for consensus analysis of experts\u2019 contours for radiotherapy structure definitions. Radiother Oncol. 97, 572\u2013578 (2010).","journal-title":"Radiother Oncol."},{"key":"33567_CR18","doi-asserted-by":"publisher","first-page":"2863","DOI":"10.1088\/0031-9155\/54\/9\/018","volume":"54","author":"E Kouwenhoven","year":"2009","unstructured":"Kouwenhoven, E., Giezen, M. & Struikmans, H. Measuring the similarity of target volume delineations independent of the number of observers. Phys. Med. Biol. 54, 2863\u20132873 (2009).","journal-title":"Phys. Med. Biol."},{"key":"33567_CR19","doi-asserted-by":"publisher","first-page":"297","DOI":"10.2307\/1932409","volume":"26","author":"LR Dice","year":"1945","unstructured":"Dice, L. R. Measures of the amount of Ecologic association between species. Ecology 26, 297\u2013302 (1945).","journal-title":"Ecology"},{"key":"33567_CR20","doi-asserted-by":"publisher","first-page":"850","DOI":"10.1109\/34.232073","volume":"15","author":"DP Huttenlocher","year":"1993","unstructured":"Huttenlocher, D. P., Klanderman, G. A. & Rucklidge, W. J. Comparing images using the hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. 15, 850\u2013863 (1993).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"33567_CR21","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1007\/s00066-011-0027-6","volume":"188","author":"I Fotina","year":"2012","unstructured":"Fotina, I., L\u00fctgendorf-Caucig, C., Stock, M., P\u00f6tter, R. & Georg, D. Critical discussion of evaluation parameters for inter-observer variability in target definition for radiation therapy. Strahlenther Onkol. 188, 160\u2013167 (2012).","journal-title":"Strahlenther Onkol"},{"key":"33567_CR22","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1111\/j.1754-9485.2010.02192.x","volume":"54","author":"MG Jameson","year":"2010","unstructured":"Jameson, M. G., Holloway, L. C., Vial, P. J., Vinod, S. K. & Metcalfe, P. E. A review of methods of analysis in contouring studies for radiation oncology. J. Med. Imaging Radiat. Oncol. 54, 401\u2013410 (2010).","journal-title":"J. Med. Imaging Radiat. Oncol."},{"key":"33567_CR23","doi-asserted-by":"crossref","unstructured":"Taha, A. A. & Hanbury, A. Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med.  Imaging 15 (1), 15. (2015).","DOI":"10.1186\/s12880-015-0068-x"},{"key":"33567_CR24","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1016\/j.ijrobp.2024.09.020","volume":"121","author":"L Yang","year":"2025","unstructured":"Yang, L. et al. Multimodal image confidence: A novel method for tumor and organ boundary representation. Int. J. Radiat. Oncol. Biol. Phys. 121, 558\u2013569 (2025).","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"33567_CR25","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1016\/j.radonc.2006.03.006","volume":"78","author":"M Suzuki","year":"2006","unstructured":"Suzuki, M. et al. Analysis of interfractional set-up errors and intrafractional organ motions during IMRT for head and neck tumors to define an appropriate planning target volume (PTV)- and planning organs at risk volume (PRV)-margins. Radiother Oncol. 78, 283\u2013290 (2006).","journal-title":"Radiother Oncol."},{"key":"33567_CR26","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.ijrobp.2006.05.009","volume":"66","author":"JC Stroom","year":"2006","unstructured":"Stroom, J. C. & Heijmen, B. J. M. Limitations of the planning organ at risk volume (PRV) concept. Int. J. Radiat. Oncol. Biol. Phys. 66, 279\u2013286 (2006).","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"33567_CR27","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1016\/j.radonc.2010.10.006","volume":"98","author":"M Wanet","year":"2011","unstructured":"Wanet, M. et al. Gradient-based delineation of the primary GTV on FDG-PET in non-small cell lung cancer: a comparison with threshold-based approaches, CT and surgical specimens. Radiother Oncol. 98, 117\u2013125 (2011).","journal-title":"Radiother Oncol."},{"key":"33567_CR28","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1016\/j.ijrobp.2010.09.001","volume":"82","author":"J van Loon","year":"2012","unstructured":"van Loon, J. et al. Microscopic disease extension in three dimensions for non-small-cell lung cancer: development of a prediction model using pathology-validated positron emission tomography and computed tomography features. Int. J. Radiat. Oncol. Biol. Phys. 82, 448\u2013456 (2012).","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"33567_CR29","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1016\/j.radonc.2014.03.019","volume":"112","author":"MG Jameson","year":"2014","unstructured":"Jameson, M. G., Kumar, S., Vinod, S. K., Metcalfe, P. E. & Holloway, L. C. Correlation of contouring variation with modeled outcome for conformal non-small cell lung cancer radiotherapy. Radiother Oncol. 112, 332\u2013336 (2014).","journal-title":"Radiother Oncol."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-33567-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-33567-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-33567-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T10:27:27Z","timestamp":1769509647000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-33567-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,23]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["33567"],"URL":"https:\/\/doi.org\/10.1038\/s41598-025-33567-6","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,23]]},"assertion":[{"value":"3 October 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that Zirong Li, Zixuan Leng, and Qichao Zhou are affiliated with Manteia Technologies Co. Ltd. and contributed to this research. Manteia Technologies Co. Ltd. also provided the product used in this study. However the results of the research are reliable. All other authors have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"This study was approved by the Ethics Committee of Fujian Cancer Hospital (Ethics Approval Number: YKT2020-011-01).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"The informed consent was obtained from all the participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}],"article-number":"3564"}}