{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T05:17:10Z","timestamp":1788499030127,"version":"build-2803163510"},"reference-count":30,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T00:00:00Z","timestamp":1787961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["RS-2021-NR060120"],"award-info":[{"award-number":["RS-2021-NR060120"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2120251015517"],"award-info":[{"award-number":["2120251015517"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["RS-2022-NR069161"],"award-info":[{"award-number":["RS-2022-NR069161"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"award":["RS-2021-NR060120"],"award-info":[{"award-number":["RS-2021-NR060120"]}],"id":[{"id":"https:\/\/ror.org\/013aysd81","id-type":"ROR","asserted-by":"publisher"}]},{"award":["2120251015517"],"award-info":[{"award-number":["2120251015517"]}],"id":[{"id":"https:\/\/ror.org\/013aysd81","id-type":"ROR","asserted-by":"publisher"}]},{"award":["RS-2022-NR069161"],"award-info":[{"award-number":["RS-2022-NR069161"]}],"id":[{"id":"https:\/\/ror.org\/013aysd81","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Unmanned Aerial Vehicles (UAVs) have emerged as a flexible, cost-effective solution for connecting Internet of Things (IoT) devices where traditional infrastructure falls short. However, managing their limited energy alongside the diverse demands of densely deployed devices makes resource allocation a genuinely hard problem. This paper presents a Deep Reinforcement Learning (DRL) framework that jointly optimizes user scheduling, IoT device transmit power, bandwidth, and UAV movement in a 6G-enabled UAV-relay uplink network, using a deterministic large-scale air-to-ground path-loss channel model. The UAV acts as an aerial decode-and-forward relay between IoT devices and a Base Station (BS), with a Deep Q-Network (DQN) making decisions based on queue backlogs, channel conditions, UAV position, and remaining battery. The reward function balances Energy Efficiency (EE), queue stability, fairness, and battery longevity. We benchmark the DQN against six baselines; Round Robin (RR), Random Allocation (RA), the Single-to-Noise Ratio (Max-SNR), Proportional Fair (PF), a Lyapunov heuristic, and a GreedyEE scheme; across a range of device counts, traffic loads, battery budgets, and flight altitudes. Simulations consistently show that the DQN outperforms all baselines, including a RA baseline with equal access to UAV mobility; in EE, throughput, delay, and fairness, confirming that the gain stems from the learned joint control policy rather than from UAV mobility being available.<\/jats:p>","DOI":"10.3390\/s26175483","type":"journal-article","created":{"date-parts":[[2026,8,31]],"date-time":"2026-08-31T05:55:56Z","timestamp":1788155756000},"page":"5483","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Deep Reinforcement Learning-Based Energy-Efficient Resource Allocation and Scheduling in 6G-Enabled UAV-Assisted IoT Wireless Networks"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2133-5286","authenticated-orcid":false,"given":"Ali","family":"Nauman","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, College of Digital Convergence, Yeungnam University, Gyeongsan 38541, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8454-6980","authenticated-orcid":false,"given":"Sung Won","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, College of Digital Convergence, Yeungnam University, Gyeongsan 38541, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,29]]},"reference":[{"key":"ref_1","unstructured":"IoT Analytics (2026, June 22). Number of Connected IoT Devices Growing 14% to 21.1 Billion. Available online: https:\/\/iot-analytics.com\/number-connected-iot-devices\/."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5482","DOI":"10.1109\/JSEN.2022.3148128","article-title":"Challenges, applications, and future of wireless sensors in Internet of Things: A review","volume":"22","author":"Jamshed","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Aslam, N., Wang, H., Esmaiel, H., Junejo, N.U.R., and Agamy, A. (2026). A Review of Wireless Charging Solutions for FANETs in IoT-Enabled Smart Environments. Sensors, 26.","DOI":"10.3390\/s26030912"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Xu, Y., Tang, X., Huang, L., Ullah, H., and Ning, Q. (2025). Multi-objective optimization for resource allocation in space\u2013air\u2013ground network with diverse IoT devices. Sensors, 25.","DOI":"10.3390\/s25010274"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liu, T., Sun, C., Zhang, Y., and Sun, W. (2025). Energy-Efficient End-to-End Optimization for UAV-Assisted IoT Data Collection and LEO Satellite Offloading in SAGIN. Electronics, 15.","DOI":"10.3390\/electronics15010024"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MCOM.2016.7470933","article-title":"Wireless communications with unmanned aerial vehicles: Opportunities and challenges","volume":"54","author":"Zeng","year":"2016","journal-title":"IEEE Commun. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/MCOM.001.1900411","article-title":"Toward 6G networks: Use cases and technologies","volume":"58","author":"Giordani","year":"2020","journal-title":"IEEE Commun. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MWC.2025.11016258","article-title":"Guest editorial: Unveiling the cosmic connection: Ai\u2019s pivotal role in bridging terrestrial and non-terrestrial networks","volume":"32","author":"Jamshed","year":"2025","journal-title":"IEEE Wirel. Commun."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2329","DOI":"10.1109\/TWC.2019.2902559","article-title":"Energy minimization for wireless communication with rotary-wing UAV","volume":"18","author":"Zeng","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/IOTM.001.2300242","article-title":"Synergizing airborne non-terrestrial networks and reconfigurable intelligent surfaces-aided 6G IoT","volume":"7","author":"Jamshed","year":"2024","journal-title":"IEEE Internet Things Mag."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1426","DOI":"10.1109\/JSAC.2006.879347","article-title":"An introduction to convex optimization for communications and signal processing","volume":"24","author":"Luo","year":"2006","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"100144","DOI":"10.1016\/j.prime.2023.100144","article-title":"Reinforcement learning-based allocation of fog nodes for cloud-based smart grid","volume":"4","author":"Jamshed","year":"2023","journal-title":"E-Prime Electr. Eng. Electron. Energy"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tang, Z., Wei, X., Wei, Z., Tan, F., Tian, C., Tang, Y., and Xiong, X. (2026). Deep Reinforcement-Learning-Optimized Adaptive EKF for Robust Utility Harmonic Impedance Estimation. Electronics, 15.","DOI":"10.3390\/electronics15122557"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.comcom.2021.05.007","article-title":"Reinforcement learning-enabled intelligent device-to-device (I-D2D) communication in narrowband Internet of Things (NB-IoT)","volume":"176","author":"Nauman","year":"2021","journal-title":"Comput. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2109","DOI":"10.1109\/TWC.2017.2789293","article-title":"Joint trajectory and communication design for multi-UAV enabled wireless networks","volume":"17","author":"Wu","year":"2018","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2334","DOI":"10.1109\/COMST.2019.2902862","article-title":"A tutorial on UAVs for wireless networks: Applications, challenges, and open problems","volume":"21","author":"Mozaffari","year":"2019","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1264","DOI":"10.1109\/LCOMM.2018.2822700","article-title":"Power-efficient communication in UAV-aided wireless sensor networks","volume":"22","author":"Hua","year":"2018","journal-title":"IEEE Commun. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Liu, B., and Zhu, H. (2019). Energy-effective data gathering for UAV-aided wireless sensor networks. Sensors, 19.","DOI":"10.3390\/s19112506"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"393","DOI":"10.23919\/JCIN.2020.9306013","article-title":"Deep Q-network based dynamic trajectory design for UAV-aided emergency communications","volume":"5","author":"Wang","year":"2020","journal-title":"J. Commun. Inf. Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1109\/TCCN.2020.3027695","article-title":"Multi-agent deep reinforcement learning-based trajectory planning for multi-UAV assisted mobile edge computing","volume":"7","author":"Wang","year":"2020","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"111681","DOI":"10.1016\/j.comnet.2025.111681","article-title":"Joint trajectory and offloading optimization in UAV-assisted MEC via federated multi-agent reinforcement learning and potential fields","volume":"272","author":"Wang","year":"2025","journal-title":"Comput. Netw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3133","DOI":"10.1109\/COMST.2019.2916583","article-title":"Applications of deep reinforcement learning in communications and networking: A survey","volume":"21","author":"Luong","year":"2019","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Choudhury, B., Shah, V.K., Ferdowsi, A., Reed, J.H., and Hou, Y.T. (2021, January 4\u20137). AoI-minimizing scheduling in UAV-relayed IoT networks. Proceedings of the 2021 IEEE 18th International Conference on Mobile Ad Hoc and Smart Systems (MASS), Virtual Event.","DOI":"10.1109\/MASS52906.2021.00023"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yan, J., Wang, Z., Liu, S., Liu, H., Zhang, C., Wang, B., Sun, F., Shen, Z., Liu, Q., and Xu, J. (2026). Energy-Constrained UAV-UGV Coordination for Online Task Discovery in Known Environments with Obstacles. Drones, 10.","DOI":"10.3390\/drones10050343"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gao, S., Qiao, Y., Fu, K., Hui, K., and Huang, R. (IEEE Trans. Veh. Technol., 2026). Energy-Fairness-Aware Multi-UAV Trajectory Planning Algorithm for AoI-Constrained Data Collection, IEEE Trans. Veh. Technol., Early Access.","DOI":"10.1109\/TVT.2026.3684042"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"19645","DOI":"10.1109\/TITS.2025.3615998","article-title":"Learning-Based AoI Minimization Through UAV-Assisted Data Distribution in Vehicular Networks","volume":"26","author":"Qu","year":"2025","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"17494","DOI":"10.1109\/TVT.2026.3678290","article-title":"Few-shot recognition and classification framework for jamming signal: A CGAN-based fusion CNN approach","volume":"75","author":"Ding","year":"2026","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jamshed, M.A., Ayaz, F., Kaushik, A., Fischione, C., and Ur-Rehman, M. (2024, January 2\u20135). Green uav-enabled internet-of-things network with ai-assisted noma for disaster management. Proceedings of the 2024 IEEE 35th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Valencia, Spain.","DOI":"10.1109\/PIMRC59610.2024.10817434"},{"key":"ref_29","unstructured":"Mohsin, M.A., Umer, M., Bilal, A., Jamshed, M.A., and Cioffi, J.M. (2025). Continual learning for wireless channel prediction. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1109\/TGCN.2023.3330018","article-title":"Energy-aware resource optimization for improved urllc in multi-hop integrated aerial terrestrial networks","volume":"8","author":"Awais","year":"2023","journal-title":"IEEE Trans. Green Commun. Netw."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/17\/5483\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T04:29:57Z","timestamp":1788496197000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/17\/5483"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,29]]},"references-count":30,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["s26175483"],"URL":"https:\/\/doi.org\/10.3390\/s26175483","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,29]]}}}