{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T21:02:33Z","timestamp":1786741353742,"version":"build-2736575974"},"reference-count":30,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2025,6,3]],"date-time":"2025-06-03T00:00:00Z","timestamp":1748908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Belgian Scientific Research Fund","doi-asserted-by":"publisher","award":["FC 57373, 7.4556.23"],"award-info":[{"award-number":["FC 57373, 7.4556.23"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002661","name":"Belgian Scientific Research Fund","doi-asserted-by":"publisher","award":["2010149"],"award-info":[{"award-number":["2010149"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"name":"UCLouvain","award":["FC 57373, 7.4556.23"],"award-info":[{"award-number":["FC 57373, 7.4556.23"]}]},{"name":"UCLouvain","award":["2010149"],"award-info":[{"award-number":["2010149"]}]},{"name":"FEDER","award":["FC 57373, 7.4556.23"],"award-info":[{"award-number":["FC 57373, 7.4556.23"]}]},{"name":"FEDER","award":["2010149"],"award-info":[{"award-number":["2010149"]}]},{"name":"Walloon Region","award":["FC 57373, 7.4556.23"],"award-info":[{"award-number":["FC 57373, 7.4556.23"]}]},{"name":"Walloon Region","award":["2010149"],"award-info":[{"award-number":["2010149"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Biomedicines"],"abstract":"<jats:p>Objective: Radiotherapy is a primary method for cancer treatment, wherein radiation doses are divided into multiple sessions or fractions to effectively target tumors and minimize damage to surrounding tissues. Methods: In this study, we leverage reinforcement learning (RL) to enhance treatment planning with the aim of improving the adaptability and robustness of RL agents given the inherent inaccuracies in tumor growth models. A 2D simulation model of tumor growth is employed, where tabular RL techniques are used to determine the optimal treatment strategies. We emphasize the significance of tissue damage predictions and incorporate the Lyman NTCP model to assess treatment outcomes, analyzing complications across three simulated body sites: the rectum, head and neck and lung. Results: For all the tumor sites, the RL approach significantly reduces healthy tissue damage by 10.7%, 49.1% and 37.5%, respectively, for rectal, head and neck and lung cancers compared with the baseline treatment. Conclusions: The RL-based approach in radiotherapy not only achieves tumor eradication but also significantly reduces healthy tissue damage compared with traditional treatment methods. This study demonstrates the potential of reinforcement learning to optimize treatment planning in radiotherapy, offering a promising path towards more personalized and effective cancer treatments.<\/jats:p>","DOI":"10.3390\/biomedicines13061367","type":"journal-article","created":{"date-parts":[[2025,6,3]],"date-time":"2025-06-03T11:55:52Z","timestamp":1748951752000},"page":"1367","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Optimal Fractionation Scheduling for Radiotherapy Treatments with Reinforcement Learning, Tumor Growth Modeling and Outcome Modeling"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-4295-7267","authenticated-orcid":false,"given":"M\u00e9lanie","family":"Ghislain","sequence":"first","affiliation":[{"name":"Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), UCLouvain, 1348 Louvain-La-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-7250-7509","authenticated-orcid":false,"given":"Florian","family":"Martin","sequence":"additional","affiliation":[{"name":"Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), UCLouvain, 1348 Louvain-La-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manon","family":"Dausort","sequence":"additional","affiliation":[{"name":"Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), UCLouvain, 1348 Louvain-La-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Damien","family":"Dasnoy-Sumell","sequence":"additional","affiliation":[{"name":"Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), UCLouvain, 1348 Louvain-La-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9485-3076","authenticated-orcid":false,"given":"Ana Maria","family":"Barragan Montero","sequence":"additional","affiliation":[{"name":"Molecular Imaging, Radiotherapy and Oncology Institute, UCLouvain, 1200 Woluwe-Saint-Lambert, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7243-4778","authenticated-orcid":false,"given":"Beno\u00eet","family":"Macq","sequence":"additional","affiliation":[{"name":"Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), UCLouvain, 1348 Louvain-La-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.clon.2022.03.002","article-title":"When less is more: The rising tide of hypofractionation","volume":"34","author":"Aitken","year":"2022","journal-title":"Clin. Oncol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"216","DOI":"10.3857\/roj.2022.00577","article-title":"Journey to hypofractionation in radiotherapy for breast cancer: Critical reviews for recent updates","volume":"40","author":"Kim","year":"2022","journal-title":"J. Radiat. Oncol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Shen, J., Yang, D., Chen, M., Jiang, L., Dong, X., Li, D., Yu, R., Yu, H., and Shi, A. (2021). Hypofractionated volumetric-modulated arc radiotherapy for patients with non-small-cell lung cancer not suitable for surgery or conventional chemoradiotherapy or SBRT. Front. Oncol., 16.","DOI":"10.3389\/fonc.2021.644852"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Moreau, G., Fran\u00e7ois-Lavet, V., Desbordes, P., and Macq, B. (2021). Reinforcement learning for radiotherapy dose fractioning automation. Biomedicines, 19.","DOI":"10.3390\/biomedicines9020214"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2234","DOI":"10.1118\/1.4916684","article-title":"The emergence of nonuniform spatiotemporal fractionation schemes within the standard BED model","volume":"42","author":"Unkelbach","year":"2015","journal-title":"Med. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1109\/TMI.2018.2865547","article-title":"Statistical shape model to generate a planning library for cervical adaptive radiotherapy","volume":"38","author":"Rigaud","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1109\/JBHI.2015.2398512","article-title":"Modeling the interplay between tumor volume regression and oxygenation in uterine cervical cancer during radiotherapy treatment","volume":"20","author":"Belfatto","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kunz, L.V., Bosque, J.J., Nikmaneshi, M., Chamseddine, I., Munn, L.L., Schuemann, J., Paganetti, H., and Bertolet, A. (2024). AMBER: A Modular Model for Tumor Growth, Vasculature and Radiation Response. Bull. Math. Biol., 86.","DOI":"10.1007\/s11538-024-01371-4"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kolokotroni, E., Abler, D., Ghosh, A., Tzamali, E., Grogan, J., Georgiadi, E., B\u00fcchler, P., Radhakrishnan, R., Byrne, H., and Sakkalis, V. (2024). A Multidisciplinary Hyper-Modeling Scheme in Personalized In Silico Oncology: Coupling Cell Kinetics with Metabolism, Signaling Networks, and Biomechanics as Plug-In Component Models of a Cancer Digital Twin. J. Pers. Med., 14.","DOI":"10.20944\/preprints202403.0490.v1"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1186\/s13014-025-02626-7","article-title":"Mathematical modeling in radiotherapy for cancer: A comprehensive narrative review","volume":"20","author":"Zheng","year":"2025","journal-title":"Radiat. Oncol."},{"key":"ref_11","unstructured":"Liu, R., Swat, M.H., Glazier, J.A., Lei, Y., Zhou, S., and Higley, K.A. (2025). Developing an Agent-Based Mathematical Model for Simulating Post-Irradiation Cellular Response: A Crucial Component of a Digital Twin Framework for Personalized Radiation Treatment. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2329","DOI":"10.1002\/mp.14114","article-title":"Operating a treatment planning system using a deep-reinforcement learning-based virtual treatment planner for prostate cancer intensity-modulated radiation therapy treatment planning","volume":"47","author":"Shen","year":"2020","journal-title":"Med. Phys."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, H., Bai, X., Wang, Y., Lu, Y., and Wang, B. (2023). An integrated solution of deep reinforcement learning for automatic IMRT treatment planning in non-small-cell lung cancer. Front. Oncol., 13.","DOI":"10.3389\/fonc.2023.1124458"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"102193","DOI":"10.1016\/j.artmed.2021.102193","article-title":"A reinforcement learning approach for finding optimal policy of adaptive radiation therapy considering uncertain tumor biological response","volume":"121","author":"Saba","year":"2021","journal-title":"Artif. Intell. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"13","DOI":"10.2307\/3576626","article-title":"Complication probability as assessed from dose-volume histograms","volume":"8","author":"Lyman","year":"1985","journal-title":"Radiat. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1109\/TBME.2017.2655439","article-title":"Editorial Special Section on Multiscale Cancer Modeling","volume":"64","author":"Wang","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1109\/JBHI.2015.2453437","article-title":"Adaptive mathematical model of tumor response to radiotherapy based on CBCT data","volume":"20","author":"Belfatto","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1109\/TMI.2016.2626443","article-title":"Personalized radiotherapy planning based on a computational tumor growth model","volume":"36","author":"Le","year":"2017","journal-title":"IEEE Trans. Med. Imaging."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2683","DOI":"10.1109\/TBME.2008.913420","article-title":"A Minimal Model of Tumor Growth Inhibition","volume":"55","author":"Magni","year":"2008","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1109\/TMI.2019.2902044","article-title":"Personalized radiotherapy design for glioblastoma: Integrating mathematical tumor models, multimodal scans, and bayesian inference","volume":"38","author":"Lipkova","year":"2019","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_21","unstructured":"O\u2019Neil, N. (2012). An Agent-Based Model of Tumor Growth and Response to Radiotherapy. [Master\u2019s Thesis, Virginia Commonwealth University]."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.matcom.2016.05.008","article-title":"Simulation-based optimization of radiotherapy: Agent-based modeling and reinforcement learning","volume":"133","author":"Jalalimanesh","year":"2017","journal-title":"Math. Comput. Simul."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/0360-3016(91)90171-Y","article-title":"Tolerance of normal tissue to therapeutic irradiation","volume":"21","author":"Emami","year":"1991","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"168","DOI":"10.4103\/0973-1482.19597","article-title":"Analytical approach to estimate normal tissue complication probability using best fit of normal tissue tolerance doses into the NTCP equation of the linear quadratic model","volume":"1","author":"Kehwar","year":"2005","journal-title":"J. Cancer Res. Ther."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.ijrobp.2022.08.039","article-title":"Parameters of the Lyman Model for calculation of normal-tissue complication probability: A systematic literature review","volume":"115","author":"Putora","year":"2023","journal-title":"Int. J. Radiat. Oncol. Biol. Phys."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1186\/s13014-018-1040-z","article-title":"The alfa and beta of tumours: A review of parameters of the linear-quadratic model, derived from clinical radiotherapy studies","volume":"13","author":"Oei","year":"2018","journal-title":"Radiat. Oncol."},{"key":"ref_27","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning, Second Edition: An Introduction, MIT Press."},{"key":"ref_28","unstructured":"Dausort, M., Delinte, N., Dessain, Q., Vanden Bulcke, C., and Macq, B. (2023, January 3\u20138). A multi-compartment fingerprinting model for non-invasive tumor cell characterization via diffusion MRI. Proceedings of the 2023 ISMRM & ISMRT Annual Meeting & Exhibition, Toronto, ON, Canada."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Huang, H., Huang, F., Liang, X., Fu, Y., Cheng, Z., Huang, Y., Chen, Z., Duan, Y., and Chen, Y. (2023). Afatinib Reverses EMT via Inhibiting CD44-Stat3 Axis to Promote Radiosensitivity in Nasopharyngeal Carcinoma. Pharmaceuticals, 16.","DOI":"10.3390\/ph16010037"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"21546","DOI":"10.1021\/acsami.4c00793","article-title":"Oxygen-Independent Radiodynamic Therapy: Radiation-Boosted Chemodynamics for Reprogramming the Tumor Immune Environment and Enhancing Antitumor Immune Response","volume":"16","author":"Chen","year":"2024","journal-title":"ACS Appl. Mater. Interfaces"}],"container-title":["Biomedicines"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9059\/13\/6\/1367\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:46:39Z","timestamp":1760031999000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9059\/13\/6\/1367"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,3]]},"references-count":30,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["biomedicines13061367"],"URL":"https:\/\/doi.org\/10.3390\/biomedicines13061367","relation":{},"ISSN":["2227-9059"],"issn-type":[{"value":"2227-9059","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,3]]}}}