{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T17:41:08Z","timestamp":1779903668301,"version":"3.53.1"},"reference-count":45,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T00:00:00Z","timestamp":1678406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Science Foundation of Guangxi Province","award":["2022GXNSFDA035070"],"award-info":[{"award-number":["2022GXNSFDA035070"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In an unmanned aerial vehicles ad hoc network (UANET), UAVs communicate with each other to accomplish intricate tasks collaboratively and cooperatively. However, the high mobility of UAVs, the variable link quality, and heavy traffic loads can lead to difficulties in finding an optimal communication path. We proposed a delay-aware and link-quality-aware geographical routing protocol for a UANET via the dueling deep Q-network (DLGR-2DQ) to address these problems. Firstly, the link quality was not only related to the physical layer metric, the signal-to-noise ratio, which was influenced by path loss and Doppler shifts, but also the expected transmission count of the data link layer. In addition, we also considered the total waiting time of packets in the candidate forwarding node in order to decrease the end-to-end delay. Then, we modeled the packet-forwarding process as a Markov decision process. We crafted an appropriate reward function that utilized the penalty value for each additional hop, total waiting time, and link quality to accelerate the learning of the dueling DQN algorithm. Finally, the simulation results illustrated that our proposed routing protocol outperformed others in terms of the packet delivery ratio and the average end-to-end delay.<\/jats:p>","DOI":"10.3390\/s23063024","type":"journal-article","created":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T03:28:33Z","timestamp":1678678113000},"page":"3024","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Delay-Aware and Link-Quality-Aware Geographical Routing Protocol for UANET via Dueling Deep Q-Network"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9865-5555","authenticated-orcid":false,"given":"Yanan","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Information and Communications, Guilin University of Electronic Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongbing","family":"Qiu","sequence":"additional","affiliation":[{"name":"School of Information and Communications, Guilin University of Electronic Technology, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/MWC.2018.1800160","article-title":"UAV-Assisted Emergency Networks in Disasters","volume":"26","author":"Zhao","year":"2019","journal-title":"IEEE Wirel. Commun."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"100859","DOI":"10.1016\/j.paerosci.2022.100859","article-title":"Review of using small UAV based meteorological measurements for road weather management","volume":"134","author":"Sziroczak","year":"2022","journal-title":"Prog. Aerosp. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Adao, T., Hru\u0161ka, J., P\u00e1dua, L., Bessa, J., Peres, E., Morais, R., and Sousa, J.J. (2017). Hyperspectral imaging: A review on UAV-based sensors, data processing and applications for agriculture and forestry. Remote Sens., 9.","DOI":"10.3390\/rs9111110"},{"key":"ref_4","first-page":"1","article-title":"Hyperspectral imaging with UAVs for mineral exploration","volume":"2021","author":"Booysen","year":"2021","journal-title":"Uropean Assoc. Geosci. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bai, J., Zeng, Z., Wang, T., Zhang, S., Xiong, N.N., and Liu, A. (2022). TANTO: An Effective Trust based Unmanned Aerial Vehicle Computing System for the Internet-of-Things. IEEE Internet Things J.","DOI":"10.1109\/JIOT.2022.3150765"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6","DOI":"10.11648\/j.ajnc.20211001.12","article-title":"An Optimized Routing OLSR Protocol with Low Control Overhead for UAV Ad Hoc Networks","volume":"10","author":"Zhu","year":"2021","journal-title":"Am. J. Networks Commun."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Perkins, C.E., and Royer, E.M. (1999, January 25-26). Ad-hoc on-demand distance vector routing. Proceedings of the Second IEEE Workshop, New Orleans, LA, USA.","DOI":"10.1109\/MCSA.1999.749281"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s11390-018-1818-3","article-title":"A flocking-based on demand routing protocol for unmanned aerial vehicles","volume":"33","author":"Bahloul","year":"2018","journal-title":"J. Comput. Sci. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Karp, B., and Kung, H.-T. (2000, January 6\u201311). GPSR: Greedy perimeter stateless routing for wireless networks. Proceedings of the 6th Annual International Conference on Mobile Computing and Networking, Boston, MA, USA.","DOI":"10.1145\/345910.345953"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"686809","DOI":"10.1155\/2015\/686809","article-title":"An efficient bypassing void routing algorithm for wireless sensor network","volume":"2015","author":"Fan","year":"2015","journal-title":"J. Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.comcom.2019.11.010","article-title":"An reactive void handling algorithm in sensor networks and iot emergency management","volume":"150","author":"Qian","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e4690","DOI":"10.1002\/dac.4690","article-title":"Geographic routing with hybrid firefly algorithm and galactic swarm optimization for efficient `void\u2019 handling in mobile ad hoc networks","volume":"34","author":"Kaliyamurthi","year":"2021","journal-title":"Int. J. Commun. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"107660","DOI":"10.1016\/j.knosys.2021.107660","article-title":"A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems","volume":"235","author":"Chen","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2422","DOI":"10.1109\/TITS.2021.3114295","article-title":"A Deep Reinforcement Learning-Based Resource Management Game in Vehicular Edge Computing","volume":"23","author":"Zhu","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"302","DOI":"10.23919\/JCC.2022.05.005","article-title":"Adaptive 3D routing protocol for flying ad hoc networks based on prediction-driven Q-learning","volume":"19","author":"Zhang","year":"2022","journal-title":"China Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"012048","DOI":"10.1088\/1755-1315\/234\/1\/012048","article-title":"Dynamic Routing Algorithm with Q-learning for Internet of things with Delayed Estimator","volume":"234","author":"Wang","year":"2019","journal-title":"IOP Conf. Series Earth Environ. Sci."},{"key":"ref_17","first-page":"4244","article-title":"OLGR: A Q-learning-based geographic FANET routing algorithm based on multi-agent reinforcement learning","volume":"15","author":"Qiu","year":"2021","journal-title":"Ksii Internet. Inf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1985","DOI":"10.1109\/JIOT.2021.3089759","article-title":"A Q-Learning-Based Topology-Aware Routing Protocol for Flying Ad Hoc Networks","volume":"9","author":"Arafat","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lyu, N., Song, G., Yang, B., and Cheng, Y. (2018, January 27\u201330). QNGPSR: A Q-network enhanced geographic Ad-Hoc routing protocol based on GPSR. Proceedings of the 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall), Chicago, IL, USA.","DOI":"10.1109\/VTCFall.2018.8690651"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1308","DOI":"10.1631\/FITEE.1900401","article-title":"A traffic-aware Q-network enhanced routing protocol based on GPSR for unmanned aerial vehicle Ad-Hoc networks","volume":"21","author":"Chen","year":"2020","journal-title":"Front Inform. Tech."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Qiu, H. (2022). DDQN with prioritized experience replay-based optimized geographical routing protocol of considering link stability and energy prediction for UANET. Sensors, 22.","DOI":"10.3390\/s22135020"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1109\/COMST.2015.2495297","article-title":"Survey of important issues in UAV communication networks","volume":"18","author":"Gupta","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1109\/COMST.2020.2982452","article-title":"Routing in Flying Ad Hoc Networks: A Comprehensive Survey","volume":"22","author":"Lakew","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"102790","DOI":"10.1016\/j.adhoc.2022.102790","article-title":"A review of AI-enabled routing protocols for UAV networks: Trends, challenges, and future outlook","volume":"130","author":"Razi","year":"2022","journal-title":"Ad Hoc Netw."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wu, J., Shi, S., Liu, Z., and Gu, X. (2019, January 25\u201326). Optimization of AODV routing protocol in UAV Ad-Hoc network. Proceedings of the International Conference on Artificial Intelligence for Communications and Networks, Harbin, China.","DOI":"10.1007\/978-3-030-22968-9_43"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mansour, H.S., Mutar, M.H., Aziz, I.A., Mostafa, S.A., Mahdin, H., Abbas, A.H., Hassan, M.H., Abdulsattar, N.F., and Jubair, M.A. (2022). Cross-Layer and Energy-Aware AODV Routing Protocol for Flying Ad-Hoc Networks. Sustainability, 14.","DOI":"10.3390\/su14158980"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Adikari, A.A.C.D., and Kathiravelu, T. (2022, January 23\u201324). A hop-count and neighbor-count based routing protocol for flying Ad-Hoc networks. Proceedings of the 2022 2nd International Conference on Advanced Research in Computing (ICARC), Belihuloya, Sri Lanka.","DOI":"10.1109\/ICARC54489.2022.9753801"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tuli, E.A., Golam, M., Kim, D.-S., and Lee, J.-M. (2022). Performance Enhancement of Optimized Link State Routing Protocol by Parameter Configuration for UANET. Drones, 6.","DOI":"10.3390\/drones6010022"},{"key":"ref_29","first-page":"100489","article-title":"OLSR+: A new routing method based on fuzzy logic in flying ad-hoc networks (FANETs)","volume":"36","author":"Rahmani","year":"2022","journal-title":"Veh. Commun."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"102116","DOI":"10.1016\/j.adhoc.2020.102116","article-title":"Enhanced OLSR routing for airborne networks with multi-beam directional antennas","volume":"102","author":"Zhang","year":"2020","journal-title":"Ad Hoc Netw."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Biomo, J.-D.M.M., Kunz, T., and St-Hilaire, M. (2014, January 6\u20139). Routing in unmanned aerial ad hoc networks: A recovery strategy for Greedy geographic forwarding failure. Proceedings of the 2014 IEEE Wireless Communications and Networking Conference (WCNC), Istanbul, Turkey.","DOI":"10.1109\/WCNC.2014.6952677"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mahmud, I., and Cho, Y.-Z. (2021). LECAR: Location Estimation-Based Congestion-Aware Routing Protocol for Sparsely Deployed Energy-Efficient UAVs. Sensors, 21.","DOI":"10.3390\/s21217192"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zheng, B., Zhuo, K., Zhang, H., and Wu, H.-X. (2022). A novel airborne greedy geographic routing protocol for flying Ad hoc networks. Wirel. Netw., 1\u201315.","DOI":"10.1007\/s11276-022-03030-9"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lansky, J., Ali, S., Rahmani, A.M., Yousefpoor, M.S., Yousefpoor, E., Khan, F., and Hosseinzadeh, M. (2022). Reinforcement Learning-Based Routing Protocols in Flying Ad Hoc Networks (FANET): A Review. Mathematics, 10.","DOI":"10.3390\/math10163017"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s11277-020-07181-w","article-title":"Q-Learning-Based Fuzzy Logic for Multi-objective Routing Algorithm in Flying Ad Hoc Networks","volume":"113","author":"Yang","year":"2020","journal-title":"Wirel. Pers. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shilova, Y., Kavalerov, M., and Bezukladnikov, I. (2016, January 2\u20133). Full echo Q-routing with adaptive learning rates: A reinforcement learning approach to network routing. Proceedings of the 2016 IEEE NW Russia Young Researchers in Electrical and Electronic Engineering Conference (EIConRusNW), St. Petersburg, Russia.","DOI":"10.1109\/EIConRusNW.2016.7448188"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kavalerov, M.V., Shilova, Y.A., and Bezukladnikov, I.I. (2017, January 1\u20133). Preventing instability in full echo Q-routing with adaptive learning rates. Proceedings of the 2017 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus), St. Petersburg and Moscow, Russia.","DOI":"10.1109\/EIConRus.2017.7910517"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2223","DOI":"10.1109\/TNSE.2021.3085514","article-title":"Fully-Echoed Q-Routing With Simulated Annealing Inference for Flying Adhoc Networks","volume":"8","author":"Afghah","year":"2021","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1016\/j.comcom.2019.11.011","article-title":"QMR:Q-learning based Multi-objective optimization Routing protocol for Flying Ad Hoc Networks","volume":"150","author":"Liu","year":"2019","journal-title":"Comput. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5166","DOI":"10.1109\/TVT.2021.3074015","article-title":"Deep Reinforcement Learning Aided Packet-Routing for Aeronautical Ad-Hoc Networks Formed by Passenger Planes","volume":"70","author":"Liu","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1109\/TCCN.2019.2907520","article-title":"Deep Q -Learning-Based Node Positioning for Throughput-Optimal Communications in Dynamic UAV Swarm Network","volume":"5","author":"Koushik","year":"2019","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_42","unstructured":"Jianmin, L., Qi, W., Chentao, H., and Yongjun, X. (2020, January 16\u201319). Ardeep: Adaptive and reliable routing protocol for mobile robotic networks with deep reinforcement learning. Proceedings of the 2020 IEEE 45th Conference on Local Computer Networks (LCN), Sydney, NSW, Australia."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Khan, M.F., Yau, K.-L.A., Ling, M.H., Imran, M.A., and Chong, Y.-W. (2022). An Intelligent Cluster-Based Routing Scheme in 5G Flying Ad Hoc Networks. Appl. Sci., 12.","DOI":"10.3390\/app12073665"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1109\/MCOM.2016.7470935","article-title":"On the importance of link characterization for aerial wireless sensor networks","volume":"54","author":"Ahmed","year":"2016","journal-title":"IEEE Commun. Mag."},{"key":"ref_45","unstructured":"Wang, Z., Schaul, T., Hessel, M., Hasselt, H., Lanctot, M., and Freitas, N. (2016, January 19\u2013214). Dueling network architectures for deep reinforcement learning. Proceedings of the International Conference on Machine Learning, New York, NY, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/3024\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:52:19Z","timestamp":1760122339000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/3024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,10]]},"references-count":45,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23063024"],"URL":"https:\/\/doi.org\/10.3390\/s23063024","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,10]]}}}