{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T09:40:49Z","timestamp":1792402849452,"version":"4.4.0"},"reference-count":20,"publisher":"Wiley","issue":"10","license":[{"start":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T00:00:00Z","timestamp":1790121600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T00:00:00Z","timestamp":1790121600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["P30016672"],"award-info":[{"award-number":["P30016672"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["aapm.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J Applied Clin Med Phys"],"published-print":{"date-parts":[[2026,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Commercial deep\u2010learning segmentation (DLS) tools are increasingly used in clinical practice. Software updates may alter segmentation performance, highlighting the need for systematic clinical evaluation before implementation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>This study presents our experience in clinically evaluating and regression\u2010testing a RayStation DLS model with the aim of guiding commissioning and routine quality assurance of commercial DLS tools in clinical environments.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      U\u2010Net DLS model for normal\u2010tissue structures, originally commissioned in RayStation version 11B, was regression\u2010tested after upgrading to 2024A. Previously commissioned CT datasets for head and neck (\n                      <jats:italic>n<\/jats:italic>\n                      \u00a0=\u00a018), thorax (\n                      <jats:italic>n<\/jats:italic>\n                      \u00a0=\u00a018), male pelvis (\n                      <jats:italic>n<\/jats:italic>\n                      \u00a0=\u00a018), and breast (\n                      <jats:italic>n<\/jats:italic>\n                      \u00a0=\u00a021) were re\u2010evaluated in RayStation 2024A for regression testing following the software upgrade, while 20 new abdominal cases were included for initial commissioning. Clinical segmentations served as the reference standard. Geometric performance was evaluated using Dice Similarity Coefficient (DSC), 95% Hausdorff Distance (HD95), and Mean Surface Distance (MSD). Dosimetric evaluation used the original clinical treatment plans to compare Dmean and Dmax between DLS and clinical contours, normalized to prescription dose; breast was excluded from dosimetric analysis because its DLS model was not commissioned for clinical use.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Regression testing showed that, in comparison with the previously commissioned data, mean\u00a0[\u00b1\u00a0standard deviation (SD)] DSC values were 0.81\u00a0\u00b1\u00a00.09 for the head and neck, 0.84\u00a0\u00b1\u00a00.13 for the thorax, and 0.89\u00a0\u00b1\u00a00.06 for male pelvis. Corresponding MSD values were 0.83\u00a0\u00b1\u00a00.34\u00a0mm, 2.47\u00a0\u00b1\u00a01.81\u00a0mm, and 1.76\u00a0\u00b1\u00a00.68\u00a0mm; and HD95 values were 4.75\u00a0\u00b1\u00a02.38\u00a0mm, 8.45\u00a0\u00b1\u00a03.38\u00a0mm, and 13.21\u00a0\u00b1\u00a07.05\u00a0mm. Significant paired differences between versions were limited to selected structures, including the mandible, cochlea, and eye in head and neck; lungs and esophagus in thorax; and prostate in the male pelvis (\n                      <jats:italic>p<\/jats:italic>\n                      \u00a0&lt;\u00a00.05). Breast segmentation results showed low performance (DSC 0.66\u00a0\u00b1\u00a00.15, MSD 4.8\u00a0\u00b1\u00a01.93\u00a0mm, and HD95 22.2\u00a0\u00b1\u00a09.6\u00a0mm) compared to clinical reference, so the breast structure models are not recommended for clinical use. Abdominal structures (RayStation 2024A vs clinical) had DSC 0.95\u00a0\u00b1\u00a00.014; MSD 0.82\u00a0\u00b1\u00a00.32\u00a0mm; and HD95 5.4\u00a0\u00b1\u00a02.9\u00a0mm. The mean dose differences between DLS and clinical segmentations were 0.03\u00a0Gy for the head and neck, \u20130.92\u00a0Gy for the thorax, 0.27\u00a0Gy for the male pelvis, and 0.02\u00a0Gy for the abdominal sites, and the corresponding maximum dose differences were 10.96\u00a0Gy, 13.23\u00a0Gy, 3.39\u00a0Gy, and 6.31\u00a0Gy.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We described a procedure for practical quality assurance of auto\u2010segmentation tools for clinical use after periodic software upgrades. Regression testing of head and neck, thorax, and male pelvis sites showed consistent performance after the software upgrade and the DLS models for abdominal site were commissioned in this study for clinical use; while the DLS models for breast site were not recommended.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/acm2.70824","type":"journal-article","created":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T05:30:01Z","timestamp":1790227801000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Clinical evaluation and regression test of a commercial deep\u2010learning auto\u2010segmentation model"],"prefix":"10.1002","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-6079-0836","authenticated-orcid":false,"given":"Roya","family":"Barati","sequence":"first","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingwei","family":"Duan","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0741-7063","authenticated-orcid":false,"given":"Song","family":"Gao","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yao","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinru","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"},{"name":"Department of Radiation Oncology Baylor College of Medicine  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cenji","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"},{"name":"Mayo Clinic  Rochester Minnesota USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhan","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Moghadaseh","family":"Khaleghibizaki","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"},{"name":"Graduate School of Biomedical Sciences The University of Texas MD Anderson Cancer Center UTHealth Houston  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fredrik","family":"Lofman","sequence":"additional","affiliation":[{"name":"RaySearch Laboratories AB  Stockholm Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2383-8311","authenticated-orcid":false,"given":"Jared","family":"Ohrt","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laurence","family":"Court","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"},{"name":"Graduate School of Biomedical Sciences The University of Texas MD Anderson Cancer Center UTHealth Houston  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Balter","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"},{"name":"Graduate School of Biomedical Sciences The University of Texas MD Anderson Cancer Center UTHealth Houston  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9254-4501","authenticated-orcid":false,"given":"Jinzhong","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Radiation Physics University of Texas MD Anderson Cancer Center  Houston Texas USA"},{"name":"Graduate School of Biomedical Sciences The University of Texas MD Anderson Cancer Center UTHealth Houston  Houston Texas USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,23]]},"reference":[{"key":"e_1_2_11_2_1","doi-asserted-by":"publisher","DOI":"10.1259\/bjr.20110718"},{"key":"e_1_2_11_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/15330338251345376"},{"key":"e_1_2_11_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.clon.2025.103796"},{"key":"e_1_2_11_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2021.01.024"},{"key":"e_1_2_11_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00066\u2010014\u20100634\u20100"},{"key":"e_1_2_11_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2019.10.019"},{"key":"e_1_2_11_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12032\u2010020\u201001374\u2010w"},{"key":"e_1_2_11_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/1533033819873922"},{"key":"e_1_2_11_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2023.100826"},{"key":"e_1_2_11_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_2_11_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994\u2010021\u201005946\u20103"},{"key":"e_1_2_11_13_1","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics14242851"},{"key":"e_1_2_11_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2021.05.003"},{"key":"e_1_2_11_15_1","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics13040667"},{"key":"e_1_2_11_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.radonc.2024.110345"},{"key":"e_1_2_11_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.phro.2024.100647"},{"key":"e_1_2_11_18_1","doi-asserted-by":"crossref","unstructured":"\u00c7i\u00e7ek\u00d6 AbdulkadirA LienkampSS BroxT RonnebergerO.3D U\u2010Net: learning dense volumetric segmentation from sparse annotation.Medical Image Computing and Computer\u2010Assisted Intervention \u2010 MICCAI 2016.2016;9901:424\u2010432. doi:10.1007\/978-3-319-46723-8_49","DOI":"10.1007\/978-3-319-46723-8_49"},{"key":"e_1_2_11_19_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.1412.6980"},{"key":"e_1_2_11_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/mp.13141"},{"key":"e_1_2_11_21_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12880-015-0068-x"}],"container-title":["Journal of Applied Clinical Medical Physics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/aapm.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/acm2.70824","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/aapm.onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/acm2.70824","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/aapm.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/acm2.70824","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T08:54:23Z","timestamp":1792400063000},"score":1,"resource":{"primary":{"URL":"https:\/\/aapm.onlinelibrary.wiley.com\/doi\/10.1002\/acm2.70824"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,23]]},"references-count":20,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2026,10]]}},"alternative-id":["10.1002\/acm2.70824"],"URL":"https:\/\/doi.org\/10.1002\/acm2.70824","archive":["Portico"],"relation":{},"ISSN":["1526-9914","1526-9914"],"issn-type":[{"value":"1526-9914","type":"print"},{"value":"1526-9914","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,23]]},"assertion":[{"value":"2026-07-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70824"}}