{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T02:22:18Z","timestamp":1769739738260,"version":"3.49.0"},"reference-count":35,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T00:00:00Z","timestamp":1728259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Technologies R&amp;D Program of Jiangsu (Prospective and Key Technologies for Industry)","award":["BE2023022"],"award-info":[{"award-number":["BE2023022"]}]},{"name":"Key Technologies R&amp;D Program of Jiangsu (Prospective and Key Technologies for Industry)","award":["BE2023022-2"],"award-info":[{"award-number":["BE2023022-2"]}]},{"name":"Key Technologies R&amp;D Program of Jiangsu (Prospective and Key Technologies for Industry)","award":["62471204"],"award-info":[{"award-number":["62471204"]}]},{"name":"Key Technologies R&amp;D Program of Jiangsu (Prospective and Key Technologies for Industry)","award":["BK2021022532"],"award-info":[{"award-number":["BK2021022532"]}]},{"name":"Key Technologies R&amp;D Program of Jiangsu (Prospective and Key Technologies for Industry)","award":["24KJA510003"],"award-info":[{"award-number":["24KJA510003"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["BE2023022"],"award-info":[{"award-number":["BE2023022"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["BE2023022-2"],"award-info":[{"award-number":["BE2023022-2"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["62471204"],"award-info":[{"award-number":["62471204"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["BK2021022532"],"award-info":[{"award-number":["BK2021022532"]}]},{"name":"National Natural Science Foundation of China (NSFC)","award":["24KJA510003"],"award-info":[{"award-number":["24KJA510003"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["BE2023022"],"award-info":[{"award-number":["BE2023022"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["BE2023022-2"],"award-info":[{"award-number":["BE2023022-2"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["62471204"],"award-info":[{"award-number":["62471204"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["BK2021022532"],"award-info":[{"award-number":["BK2021022532"]}]},{"name":"Natural Science Foundation of Jiangsu Province","award":["24KJA510003"],"award-info":[{"award-number":["24KJA510003"]}]},{"name":"Major Natural Science Foundation of the Higher Education Institutions of Jiangsu Province","award":["BE2023022"],"award-info":[{"award-number":["BE2023022"]}]},{"name":"Major Natural Science Foundation of the Higher Education Institutions of Jiangsu Province","award":["BE2023022-2"],"award-info":[{"award-number":["BE2023022-2"]}]},{"name":"Major Natural Science Foundation of the Higher Education Institutions of Jiangsu Province","award":["62471204"],"award-info":[{"award-number":["62471204"]}]},{"name":"Major Natural Science Foundation of the Higher Education Institutions of Jiangsu Province","award":["BK2021022532"],"award-info":[{"award-number":["BK2021022532"]}]},{"name":"Major Natural Science Foundation of the Higher Education Institutions of Jiangsu Province","award":["24KJA510003"],"award-info":[{"award-number":["24KJA510003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Recently, the Internet of Things (IoT) has witnessed rapid development. However, the scarcity of computing resources on the ground has constrained the application scenarios of IoT. Low Earth Orbit (LEO) satellites have drawn people\u2019s attention due to their broader coverage and shorter transmission delay. They are capable of offloading more IoT computing tasks to mobile edge computing (MEC) servers with lower latency in order to address the issue of scarce computing resources on the ground. Nevertheless, it is highly challenging to share bandwidth and power resources among multiple IoT devices and LEO satellites. In this paper, we explore the efficient data offloading mechanism in the LEO satellite-based IoT (LEO-IoT), where LEO satellites forward data from the terrestrial to the MEC servers. Specifically, by optimally selecting the forwarding LEO satellite for each IoT task and allocating communication resources, we aim to minimize the data offloading latency and energy consumption. Particularly, we employ the state-of-the-art Decision Transformer (DT) to solve this optimization problem. We initially obtain a pre-trained DT through training on a specific task. Subsequently, the pre-trained DT is fine-tuned by acquiring a small quantity of data under the new task, enabling it to converge rapidly, with less training time and superior performance. Numerical simulation results demonstrate that in contrast to the classical reinforcement learning approach (Proximal Policy Optimization), the convergence speed of DT can be increased by up to three times, and the performance can be improved by up to 30%.<\/jats:p>","DOI":"10.3390\/e26100846","type":"journal-article","created":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T08:35:23Z","timestamp":1728290123000},"page":"846","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Decision Transformer-Based Efficient Data Offloading in LEO-IoT"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-8529-4709","authenticated-orcid":false,"given":"Pengcheng","family":"Xia","sequence":"first","affiliation":[{"name":"School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mengfei","family":"Zang","sequence":"additional","affiliation":[{"name":"Qian Xuesen College, Nanjing University of Science and Technology, Nanjing 210094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Engineering, Jiangsu Second Normal University, Nanjing 211200, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changxu","family":"Ni","sequence":"additional","affiliation":[{"name":"School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Li","sequence":"additional","affiliation":[{"name":"School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiyang","family":"Ni","sequence":"additional","affiliation":[{"name":"School of Computer Engineering, Jiangsu Second Normal University, Nanjing 211200, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Naik, S., and Ganesha, P. (2022, January 26). An Architecture for Performance Improvement of IoT Mobile Application Verification Using Statistical Methods. Proceedings of the 2022 IEEE 8th World Forum on Internet of Things (WF-IoT), Yokohama, Japan.","DOI":"10.1109\/WF-IoT54382.2022.10152200"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sharbaf, M.S. (2022, January 26). IoT Driving New Business Model, and IoT Security, Privacy, and Awareness Challenges. Proceedings of the 2022 IEEE 8th World Forum on Internet of Things (WF-IoT), Yokohama, Japan.","DOI":"10.1109\/WF-IoT54382.2022.10152044"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Chen, G., Huang, R., Tang, X., and Huang, Q. (2024, January 19). Research on the 5G MEC Co-Construction and Sharing. Proceedings of the 2024 4th International Conference on Neural Networks, Information and Communication (NNICE), Guangzhou, China.","DOI":"10.1109\/NNICE61279.2024.10499087"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2918","DOI":"10.1109\/TVT.2023.3318151","article-title":"New Insight for Multi-User Hybrid NOMA Offloading Strategies in MEC Networks","volume":"73","author":"Huang","year":"2024","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1109\/JPROC.2023.3306773","article-title":"Trusted AI in Multiagent Systems: An Overview of Privacy and Security for Distributed Learning","volume":"111","author":"Ma","year":"2023","journal-title":"Proc. IEEE"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2545","DOI":"10.1109\/JIOT.2022.3213687","article-title":"Channel Allocation for Mega LEO Satellite Constellations in the MEO\u2013LEO Networked Telemetry System","volume":"10","author":"Zeng","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Shi, L., Yang, F., Wu, W., Sun, A., Sun, Y., and Sun, T. (2022, January 9). Load Balancing and Remaining Visible Time Based Handover Algorithm for LEO Satellite Network. Proceedings of the 2022 IEEE 8th International Conference on Computer and Communications (ICCC), Chengdu, China.","DOI":"10.1109\/ICCC56324.2022.10065821"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2401","DOI":"10.1109\/TPDS.2021.3138848","article-title":"Blockchain Assisted Decentralized Federated Learning (BLADE-FL): Performance Analysis and Resource Allocation","volume":"33","author":"Li","year":"2022","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1109\/TGCN.2022.3186792","article-title":"Optimal Computation Offloading in Collaborative LEO-IoT Enabled MEC: A Multiagent Deep Reinforcement Learning Approach","volume":"7","author":"Lyu","year":"2023","journal-title":"IEEE Trans. Green Commun. Netw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4488","DOI":"10.1109\/TIFS.2023.3293417","article-title":"Personalized Federated Learning With Differential Privacy and Convergence Guarantee","volume":"18","author":"Wei","year":"2023","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3259","DOI":"10.1109\/TITS.2023.3324962","article-title":"Federated Learning in Intelligent Transportation Systems: Recent Applications and Open Problems","volume":"25","author":"Zhang","year":"2024","journal-title":"IEEE Trans. Intell. Transport. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jin, L., Wang, L., Jin, X., Zhu, J., Duan, K., and Li, Z. (2022, January 27). Research on the Application of LEO Satellite in IOT. Proceedings of the 2022 IEEE 2nd International Conference on Electronic Technology, Communication and Information (ICETCI), Changchun, China.","DOI":"10.1109\/ICETCI55101.2022.9832117"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kodheli, O., Andrenacci, S., Maturo, N., Chatzinotas, S., and Zimmer, F. (2018, January 10\u201312). Resource Allocation Approach for Differential Doppler Reduction in NB-IoT over LEO Satellite. Proceedings of the 2018 9th Advanced Satellite Multimedia Systems Conference and the 15th Signal Processing for Space Communications Workshop (ASMS\/SPSC), Berlin, Germany.","DOI":"10.1109\/ASMS-SPSC.2018.8510724"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"9981","DOI":"10.1109\/JIOT.2020.3048818","article-title":"Max Completion Time Optimization for Internet of Things in LEO Satellite-Terrestrial Integrated Networks","volume":"8","author":"Gao","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"14399","DOI":"10.1109\/JIOT.2021.3068596","article-title":"5G Embraces Satellites for 6G Ubiquitous IoT: Basic Models for Integrated Satellite Terrestrial Networks","volume":"8","author":"Fang","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhao, X., Yuan, Y., Wang, A., Zheng, T.-X., and Lei, L. (2023, January 25). Optimality Analysis and Efficient Scheduling for Massive IoT-LEO Satellite Networks. Proceedings of the 2023 IEEE 24th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Shanghai, China.","DOI":"10.1109\/SPAWC53906.2023.10304510"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3270","DOI":"10.1109\/JSEN.2022.3230796","article-title":"Optimal Traffic Load Allocation for Aloha-Based IoT LEO Constellations","volume":"23","author":"Tondo","year":"2023","journal-title":"IEEE Sens. J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5723","DOI":"10.1109\/TVT.2020.2982508","article-title":"Path Planning for UAV-Mounted Mobile Edge Computing with Deep Reinforcement Learning","volume":"69","author":"Liu","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"7783","DOI":"10.1109\/TVT.2023.3238771","article-title":"Joint Multi-Task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT","volume":"72","author":"Chai","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"10131","DOI":"10.1109\/JIOT.2023.3237209","article-title":"Two-Timescale Learning-Based Task Offloading for Remote IoT in Integrated Satellite\u2013Terrestrial Networks","volume":"10","author":"Han","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1109\/JSAC.2022.3227032","article-title":"Edge-Assisted Multi-Layer Offloading Optimization of LEO Satellite-Terrestrial Integrated Networks","volume":"41","author":"Cao","year":"2023","journal-title":"IEEE J. Select. Areas Commun."},{"key":"ref_22","unstructured":"Chen, L., Lu, K., Rajeswaran, A., Lee, K., Grover, A., Laskin, M., Abbeel, P., Srinivas, A., and Mordatch, I. (2021, January 6\u201314). Decision Transformer: Reinforcement Learning via Sequence Modeling. Proceedings of the 35th International Conference on Neural Information Processing Systems (NIPS \u201921), Online."},{"key":"ref_23","unstructured":"Zheng, Q., Zhang, A., and Grover, A. (2022, January 17\u201323). Online Decision Transformer. Proceedings of the 39th International Conference on Machine Learning Research, Baltimore, MA, USA."},{"key":"ref_24","unstructured":"Zhang, J., Li, J., Wang, Z., Shi, L., Jin, S., Chen, W., and Poor, H.V. (2024). Decision Transformer for Wireless Communications: A New Paradigm of Resource Management. IEEE Wirel. Commun., accepted."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5250","DOI":"10.1109\/JIOT.2021.3058236","article-title":"Learning-Based Queue-Aware Task Offloading and Resource Allocation for Space\u2013Air\u2013Ground-Integrated Power IoT","volume":"8","author":"Liao","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"9849","DOI":"10.1109\/TVT.2020.3002983","article-title":"Multi-Agent Deep Reinforcement Learning-Based Flexible Satellite Payload for Mobile Terminals","volume":"69","author":"Hu","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"9164","DOI":"10.1109\/JIOT.2021.3056569","article-title":"Computation Offloading in LEO Satellite Networks With Hybrid Cloud and Edge Computing","volume":"8","author":"Tang","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1109\/JSAC.2018.2832780","article-title":"Cooperative Multigroup Multicast Transmission in Integrated Terrestrial-Satellite Networks","volume":"36","author":"Zhu","year":"2018","journal-title":"IEEE J. Select. Areas Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TWC.2015.2424961","article-title":"Multicast Multigroup Precoding and User Scheduling for Frame-Based Satellite Communications","volume":"14","author":"Christopoulos","year":"2015","journal-title":"IEEE Trans. Wireless Commun."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2367","DOI":"10.1109\/TWC.2020.2964236","article-title":"Energy Efficiency and Traffic Offloading Optimization in Integrated Satellite\/Terrestrial Radio Access Networks","volume":"19","author":"Li","year":"2020","journal-title":"IEEE Trans. Wireless Commun."},{"key":"ref_31","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917), Long Beach, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/s11633-022-1383-7","article-title":"Offline Pre-Trained Multi-Agent Decision Transformer","volume":"20","author":"Meng","year":"2023","journal-title":"Mach. Intell. Res."},{"key":"ref_33","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arxiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4600","DOI":"10.1109\/TSMC.2021.3098451","article-title":"Proximal Policy Optimization With Policy Feedback","volume":"52","author":"Gu","year":"2022","journal-title":"IEEE Trans. Syst. Man Cybern, Syst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liu, C., and Li, D. (2023, January 12). Multi-Agent Proximal Policy Optimization via Non-Fixed Value Clipping. Proceedings of the 2023 IEEE 12th Data Driven Control and Learning Systems Conference (DDCLS), Xiangtan, China.","DOI":"10.1109\/DDCLS58216.2023.10167264"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/10\/846\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:12:05Z","timestamp":1760112725000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/10\/846"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,7]]},"references-count":35,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["e26100846"],"URL":"https:\/\/doi.org\/10.3390\/e26100846","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,7]]}}}