{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T19:08:31Z","timestamp":1768417711276,"version":"3.49.0"},"reference-count":40,"publisher":"Wiley","license":[{"start":{"date-parts":[[2021,4,21]],"date-time":"2021-04-21T00:00:00Z","timestamp":1618963200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972210"],"award-info":[{"award-number":["61972210"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61873131"],"award-info":[{"award-number":["61873131"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61872191"],"award-info":[{"award-number":["61872191"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61803212"],"award-info":[{"award-number":["61803212"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005374","name":"Nanjing University of Posts and Telecommunications","doi-asserted-by":"publisher","award":["61972210"],"award-info":[{"award-number":["61972210"]}],"id":[{"id":"10.13039\/501100005374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005374","name":"Nanjing University of Posts and Telecommunications","doi-asserted-by":"publisher","award":["61873131"],"award-info":[{"award-number":["61873131"]}],"id":[{"id":"10.13039\/501100005374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005374","name":"Nanjing University of Posts and Telecommunications","doi-asserted-by":"publisher","award":["61872191"],"award-info":[{"award-number":["61872191"]}],"id":[{"id":"10.13039\/501100005374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005374","name":"Nanjing University of Posts and Telecommunications","doi-asserted-by":"publisher","award":["61803212"],"award-info":[{"award-number":["61803212"]}],"id":[{"id":"10.13039\/501100005374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Security and Communication Networks"],"published-print":{"date-parts":[[2021,4,21]]},"abstract":"<jats:p>Satellite Internet of Things (S-IoT), which integrates satellite networks with IoT, is a new mobile Internet to provide services for social networks. However, affected by the dynamic changes of topology structure and node status, the efficient and secure forwarding of data packets in S-IoT is challenging. In view of the abovementioned problem, this paper proposes an adaptive routing strategy based on improved double Q-learning for S-IoT. First, the whole S-IoT is regarded as a reinforcement learning environment, and satellite nodes and ground nodes in S-IoT are both regarded as intelligent agents. Each node in the S-IoT maintains two Q tables, which are used for selecting the forwarding node and for evaluating the forwarding value, respectively. In addition, the next hop node of data packets is determined depending on the mixed Q value. Second, in order to optimize the Q value, this paper makes improvements on the mixed Q value, the reward value, and the discount factor, respectively, based on the congestion degree, the hop count, and the node status. Finally, we perform extensive simulations to evaluate the performance of this adaptive routing strategy in terms of delivery rate, average delay, and overhead ratio. Evaluation results demonstrate that the proposed strategy can achieve more efficient and secure routing in the highly dynamic environment compared with the state-of-the-art strategies.<\/jats:p>","DOI":"10.1155\/2021\/5530023","type":"journal-article","created":{"date-parts":[[2021,4,21]],"date-time":"2021-04-21T22:22:16Z","timestamp":1619043736000},"page":"1-11","source":"Crossref","is-referenced-by-count":8,"title":["Adaptive Routing Strategy Based on Improved Double Q-Learning for Satellite Internet of Things"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1864-3894","authenticated-orcid":true,"given":"Jian","family":"Zhou","sequence":"first","affiliation":[{"name":"College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"},{"name":"Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"},{"name":"Ministry of Education Key Laboratory of Computer Network and Information Integration, Southeast University, Ministry of Education, Nanjing 211189, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaotian","family":"Gong","sequence":"additional","affiliation":[{"name":"College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"},{"name":"Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2873-9803","authenticated-orcid":true,"given":"Lijuan","family":"Sun","sequence":"additional","affiliation":[{"name":"College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"},{"name":"Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Xie","sequence":"additional","affiliation":[{"name":"College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"},{"name":"Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoyong","family":"Yan","sequence":"additional","affiliation":[{"name":"College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"},{"name":"Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing 210023, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"issue":"3","key":"1","first-page":"2062","article-title":"Signal estimation in cognitive satellite networks for satellite-based industrial Internet of Things","volume":"17","author":"M. Liu","year":"2020","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2020.101971"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.011.2000445"},{"issue":"3","key":"4","first-page":"6","article-title":"Development status and challenges of IoT for LEO satellites","volume":"1","author":"G. X. Zhang","year":"2017","journal-title":"Journal of IoT"},{"issue":"1","key":"5","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/MNET.2018.1800172","article-title":"Satellite mobile edge computing: improving QoS of high-speed satellite-terrestrial networks using edge computing techniques","volume":"33","author":"Z. Zhang","year":"2018","journal-title":"IEEE Network"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-019-01421-5"},{"key":"7","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.sysarc.2016.04.011","article-title":"\u201cNoC routing protocols\u2013objective-based classification","volume":"66","author":"A. B. Gabis","year":"2016","journal-title":"Journal of System Architecture"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2017.03.006"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1007\/s12083-019-00753-z"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1145\/1341771.1341791"},{"key":"11","doi-asserted-by":"crossref","article-title":"Spray and Wait: an efficient routing scheme for intermittently connected mobile networks","author":"T. Spyropoulos","DOI":"10.1145\/1080139.1080143"},{"key":"12","doi-asserted-by":"crossref","article-title":"Probabilistic routing in intermittently connected networks","author":"A. Lindgren","DOI":"10.1007\/978-3-540-27767-5_24"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1109\/jsyst.2016.2630923"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1109\/mcom.2015.7060480"},{"key":"15","article-title":"Adaptive routing strategy based on improved Q-learning for satellite internet of things","author":"X. T. Gong"},{"key":"16","article-title":"Double Q-learning","author":"H. V. Hasselt"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1109\/tgrs.2018.2890513"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2020.3026673"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2020.3011506"},{"key":"20","doi-asserted-by":"crossref","article-title":"Routing in LEO-based satellite networks","author":"V. V. Gounder","DOI":"10.1109\/ETWCS.1999.897340"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1109\/35.601743"},{"key":"22","article-title":"Design of ip-based routing in a LEO satellite network","author":"Y. Hashimoto"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2013.07.011"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1109\/90.917071"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1109\/jsac.2016.2611860"},{"key":"26","doi-asserted-by":"crossref","article-title":"Energy-aware routing algorithm for DTN-Nanosatellite networks","author":"M. Marchese","DOI":"10.1109\/GLOCOM.2018.8647491"},{"issue":"4","key":"27","article-title":"A multi-QoS optimization routing for LEO\/MEO satellite IP networks","volume":"9","author":"T. Mao","year":"2014","journal-title":"Journal of Multiple Sclerosis"},{"key":"28","article-title":"A routing algorithm to provide end-to-end delay guarantee in low earth orbit satellite networks","author":"Q. Huang"},{"key":"29","doi-asserted-by":"publisher","DOI":"10.1007\/s11767-006-0040-6"},{"issue":"4","key":"30","first-page":"26","article-title":"Distributed data storage and transmission technology of the space internet of things","volume":"2","author":"Y. Z. Qin","year":"2018","journal-title":"Journal of IoT"},{"key":"31","doi-asserted-by":"publisher","DOI":"10.1007\/bf00992698"},{"key":"32","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2020.101778"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2020.101757"},{"key":"34","doi-asserted-by":"crossref","article-title":"ARBR: Adaptive reinforcement-based routing for DTN","author":"A. Elwhishi","DOI":"10.1109\/WIMOB.2010.5645040"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2014.09.012"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2013.07.017"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-018-0819-y"},{"key":"38","doi-asserted-by":"crossref","article-title":"Human-like autonomous vehicle speed control by deep reinforcement learning with double Q-learning","author":"Y. Zhang","DOI":"10.1109\/IVS.2018.8500630"},{"key":"39","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2020.03.004"},{"issue":"5","key":"40","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1109\/TSC.2018.2867482","article-title":"A double deep Q-learning model for energy-efficient edge scheduling","volume":"12","author":"Q. Zhang","year":"2018","journal-title":"IEEE Transactions on Services Computing"}],"container-title":["Security and Communication Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/scn\/2021\/5530023.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/scn\/2021\/5530023.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/scn\/2021\/5530023.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,21]],"date-time":"2021-04-21T22:22:28Z","timestamp":1619043748000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/scn\/2021\/5530023\/"}},"subtitle":[],"editor":[{"given":"Hao","family":"Peng","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,4,21]]},"references-count":40,"alternative-id":["5530023","5530023"],"URL":"https:\/\/doi.org\/10.1155\/2021\/5530023","relation":{},"ISSN":["1939-0122","1939-0114"],"issn-type":[{"value":"1939-0122","type":"electronic"},{"value":"1939-0114","type":"print"}],"subject":[],"published":{"date-parts":[[2021,4,21]]}}}