{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T14:02:44Z","timestamp":1784556164492,"version":"3.55.0"},"reference-count":30,"publisher":"AIP Publishing","issue":"7","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62573316"],"award-info":[{"award-number":["62573316"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62503360"],"award-info":[{"award-number":["62503360"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006606","name":"Natural Science Foundation of Tianjin Municipality","doi-asserted-by":"publisher","award":["25JCQNJC00980"],"award-info":[{"award-number":["25JCQNJC00980"]}],"id":[{"id":"10.13039\/501100006606","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,7,1]]},"abstract":"<jats:p>Low Earth orbit (LEO) satellite networks are increasingly critical for global communications but remain vulnerable to cascading failures triggered by uneven traffic distribution and limited onboard capacity. Traditional static routing strategies are difficult to adapt to the highly dynamic topology and spatiotemporal load fluctuations inherent in LEO constellations. To address this challenge, this paper proposes a robust routing strategy based on reinforcement learning. First, we establish a realistic time-varying spatiotemporal load model that incorporates tidal traffic effects and spatial phase differences, alongside a virtual node topology mapping mechanism. Second, the routing decision process is formulated as a Markov decision process. We design a distributed Q-learning algorithm, where satellite nodes autonomously perceive local congestion states and adaptively reconfigure link weights using residual capacity and load-reciprocal priority strategies. Extensive numerical simulations demonstrate that the proposed method significantly outperforms those static baseline approaches. Specifically, it maintains the higher connectivity even under severe node failures, achieving a substantial robustness gain at the critical breakdown threshold. Furthermore, the algorithm exhibits the rapid convergence and superior cost-effectiveness, achieving high reliability at a lower normalized construction cost. Current results are conducive to understanding the robustness of LEO satellite networks, which will help to devise effective routing strategies.<\/jats:p>","DOI":"10.1063\/5.0341038","type":"journal-article","created":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T13:08:18Z","timestamp":1784552898000},"update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":0,"title":["Reinforcement learning-based robust routing strategies against cascading failures in LEO satellite networks"],"prefix":"10.1063","volume":"36","author":[{"given":"Di","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence, Tiangong University , Tianjin 300387,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5393-8107","authenticated-orcid":false,"given":"Yongshuai","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Tiangong University , Tianjin 300387,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6536-4356","authenticated-orcid":false,"given":"Yuying","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Tiangong University , Tianjin 300387,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2686-5072","authenticated-orcid":false,"given":"Chengyi","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Tiangong University , Tianjin 300387,","place":["China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"317","published-online":{"date-parts":[[2026,7,20]]},"reference":[{"key":"2026072009081332500_c1","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1109\/JIOT.2021.3126825","article-title":"Integrated satellite-terrestrial networks toward 6G: Architectures, applications, and challenges","volume":"9","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"2026072009081332500_c2","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1109\/COMST.2020.3028247","article-title":"Satellite communications in the new space era: A survey and future challenges","volume":"23","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"2026072009081332500_c3","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1109\/MWC.011.2200310","article-title":"LEO satellite access network (LEO-SAN) toward 6G: Challenges and approaches","volume":"31","year":"2022","journal-title":"IEEE Wirel. Commun."},{"key":"2026072009081332500_c4","doi-asserted-by":"publisher","first-page":"123104","DOI":"10.1063\/5.0056152","article-title":"Effect of load-capacity heterogeneity on cascading overloads in networks","volume":"31","year":"2021","journal-title":"Chaos"},{"key":"2026072009081332500_c5","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1038\/s42254-023-00676-y","article-title":"Robustness and resilience of complex networks","volume":"6","year":"2024","journal-title":"Nat. Rev. Phys."},{"key":"2026072009081332500_c6","doi-asserted-by":"publisher","first-page":"123149","DOI":"10.1063\/5.0239811","article-title":"Cascading failure dynamics on higher-order networks with load redistribution","volume":"34","year":"2024","journal-title":"Chaos"},{"key":"2026072009081332500_c7","doi-asserted-by":"publisher","first-page":"197","DOI":"10.23919\/JCC.2021.07.016","article-title":"Information-defined networks: A communication network approach for network studies","volume":"18","year":"2021","journal-title":"China Commun."},{"key":"2026072009081332500_c8","doi-asserted-by":"publisher","first-page":"4883","DOI":"10.1109\/TNSE.2025.3645802","article-title":"Routing in hierarchical hybrid satellite networks: A survey","volume":"13","year":"2025","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"2026072009081332500_c9","doi-asserted-by":"publisher","first-page":"3196","DOI":"10.1109\/TVT.2024.3470075","article-title":"Distributed anti-cascading routing scheme based on fuzzy logic in LEO satellite networks","volume":"74","year":"2024","journal-title":"IEEE Trans. Veh. Technol."},{"key":"2026072009081332500_c10","doi-asserted-by":"publisher","first-page":"13383","DOI":"10.1109\/TMC.2025.3593252","article-title":"Ground-assisted LEO satellite federated learning: Dynamic, efficient, distributed learning","volume":"24","year":"2025","journal-title":"IEEE Trans. Mob. Comput."},{"key":"2026072009081332500_c11","doi-asserted-by":"publisher","first-page":"2743","DOI":"10.1109\/TVT.2021.3058126","article-title":"Analysis of inter-satellite link paths for LEO mega-constellation networks","volume":"70","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"2026072009081332500_c12","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/j.comcom.2024.01.025","article-title":"Available energy routing algorithm considering QoS requirements for LEO satellite network","volume":"217","year":"2024","journal-title":"Comput. Commun."},{"key":"2026072009081332500_c13","doi-asserted-by":"publisher","first-page":"123122","DOI":"10.1063\/5.0067479","article-title":"A quantification method of non-failure cascading spreading in a network of networks","volume":"31","year":"2021","journal-title":"Chaos"},{"key":"2026072009081332500_c14","doi-asserted-by":"publisher","first-page":"126320","DOI":"10.1016\/j.physa.2021.126320","article-title":"Robust analysis of cascading failures in complex networks","volume":"583","year":"2021","journal-title":"Phys. A"},{"key":"2026072009081332500_c15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.physrep.2023.03.005","article-title":"Signal propagation in complex networks","volume":"1017","year":"2023","journal-title":"Phys. Rep."},{"key":"2026072009081332500_c16"},{"key":"2026072009081332500_c17","doi-asserted-by":"publisher","first-page":"7415","DOI":"10.1109\/TSMC.2023.3298019","article-title":"Composite effective degree Markov chain for epidemic dynamics on higher-order networks","volume":"53","year":"2023","journal-title":"IEEE Trans. Syst. Man Cybern.: Syst."},{"key":"2026072009081332500_c18","doi-asserted-by":"publisher","first-page":"4885","DOI":"10.1109\/TON.2026.3688173","article-title":"Digital epidemiology with awareness-based event-triggered migration in cyber-physical networked systems","volume":"34","year":"2026","journal-title":"IEEE Trans. Netw."},{"key":"2026072009081332500_c19","doi-asserted-by":"publisher","first-page":"2441","DOI":"10.1038\/s41562-025-02373-5","article-title":"Higher-order interactions shape collective human behaviour","volume":"9","year":"2025","journal-title":"Nat. Hum. Behav."},{"key":"2026072009081332500_c20","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1016\/j.comcom.2023.07.036","article-title":"Robustness of satellite constellation networks","volume":"210","year":"2023","journal-title":"Comput. Commun."},{"key":"2026072009081332500_c21","doi-asserted-by":"publisher","first-page":"109379","DOI":"10.1016\/j.ress.2023.109379","article-title":"Cascading failure model and resilience enhancement scheme of space information networks","volume":"237","year":"2023","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"2026072009081332500_c22","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1109\/TNSE.2023.3308610","article-title":"Modeling and analysis of cascading failures in LEO satellite networks","volume":"11","year":"2023","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"2026072009081332500_c23","doi-asserted-by":"publisher","first-page":"1672","DOI":"10.1109\/TNSM.2023.3343357","article-title":"A dynamic cascading failure model for LEO satellite networks","volume":"21","year":"2024","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"2026072009081332500_c24","doi-asserted-by":"publisher","first-page":"15705","DOI":"10.1109\/TCOMM.2025.3610221","article-title":"Resilience of mega-satellite constellations: How node failures impact inter-satellite networking over time?","volume":"73","year":"2025","journal-title":"IEEE Trans. Commun."},{"key":"2026072009081332500_c25","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1109\/MWC.006.2300048","article-title":"Integrated computing and networking for LEO satellite mega-constellations: Architecture, challenges and open issues","volume":"31","year":"2024","journal-title":"IEEE Wirel. Commun."},{"key":"2026072009081332500_c26","doi-asserted-by":"publisher","first-page":"063128","DOI":"10.1063\/5.0151881","article-title":"Impact of simplicial complexes on epidemic spreading in partially mapping activity-driven multiplex networks","volume":"33","year":"2023","journal-title":"Chaos"},{"key":"2026072009081332500_c27"},{"key":"2026072009081332500_c28","doi-asserted-by":"publisher","first-page":"3225","DOI":"10.1109\/TVT.2024.3471658","article-title":"GRLR: Routing with graph neural network and reinforcement learning for mega LEO satellite constellations","volume":"74","year":"2025","journal-title":"IEEE Trans. Veh. Technol."},{"key":"2026072009081332500_c29","doi-asserted-by":"publisher","first-page":"5311","DOI":"10.1109\/TNSE.2024.3368086","article-title":"Adaptive task offloading with spatiotemporal load awareness in satellite edge computing","volume":"11","year":"2024","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"2026072009081332500_c30","doi-asserted-by":"publisher","first-page":"033123","DOI":"10.1063\/5.0194027","article-title":"Analyzing the robustness of LEO satellite networks based on two different attacks and load distribution methods","volume":"34","year":"2024","journal-title":"Chaos"}],"container-title":["Chaos: An Interdisciplinary Journal of Nonlinear Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/aip\/cha\/article-pdf\/doi\/10.1063\/5.0341038\/21080655\/073130_1_5.0341038.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/aip\/cha\/article-pdf\/doi\/10.1063\/5.0341038\/21080655\/073130_1_5.0341038.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T13:08:19Z","timestamp":1784552899000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/cha\/article\/36\/7\/073130\/3398913\/Reinforcement-learning-based-robust-routing"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,1]]},"references-count":30,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,7,1]]}},"URL":"https:\/\/doi.org\/10.1063\/5.0341038","relation":{},"ISSN":["1054-1500","1089-7682"],"issn-type":[{"value":"1054-1500","type":"print"},{"value":"1089-7682","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,7]]},"published":{"date-parts":[[2026,7,1]]},"article-number":"073130"}}