{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T17:36:06Z","timestamp":1782408966562,"version":"3.54.5"},"reference-count":38,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,12,2]],"date-time":"2022-12-02T00:00:00Z","timestamp":1669939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Zhejiang Key Research and Development Project","award":["2022C01048"],"award-info":[{"award-number":["2022C01048"]}]},{"name":"Zhejiang Key Research and Development Project","award":["LGG22F010012"],"award-info":[{"award-number":["LGG22F010012"]}]},{"name":"Zhejiang Province Public Welfare Project","award":["2022C01048"],"award-info":[{"award-number":["2022C01048"]}]},{"name":"Zhejiang Province Public Welfare Project","award":["LGG22F010012"],"award-info":[{"award-number":["LGG22F010012"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Aiming at the path planning problem of unmanned aerial vehicle (UAV) base stations when performing search tasks, this paper proposes a Double DQN-state splitting Q network (DDQN-SSQN) algorithm that combines state splitting and optimal state to complete the optimal path planning of UAV based on the Deep Reinforcement Learning DDQN algorithm. The method stores multidimensional state information in categories and uses targeted training to obtain optimal path information. The method also references the received signal strength indicator (RSSI) to influence the reward received by the agent, and in this way reduces the decision difficulty of the UAV. In order to simulate the scenarios of UAVs in real work, this paper uses the Open AI Gym simulation platform to construct a mission system model. The simulation results show that the proposed scheme can plan the optimal path faster than other traditional algorithmic schemes and has a greater advantage in the stability and convergence speed of the algorithm.<\/jats:p>","DOI":"10.3390\/e24121767","type":"journal-article","created":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T02:56:26Z","timestamp":1670208986000},"page":"1767","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Path Planning Research of a UAV Base Station Searching for Disaster Victims\u2019 Location Information Based on Deep Reinforcement Learning"],"prefix":"10.3390","volume":"24","author":[{"given":"Jinduo","family":"Zhao","sequence":"first","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhigao","family":"Gan","sequence":"additional","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5003-7325","authenticated-orcid":false,"given":"Jiakai","family":"Liang","sequence":"additional","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Wang","sequence":"additional","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0880-9798","authenticated-orcid":false,"given":"Keqiang","family":"Yue","sequence":"additional","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenjun","family":"Li","sequence":"additional","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yilin","family":"Li","sequence":"additional","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8047-0672","authenticated-orcid":false,"given":"Ruixue","family":"Li","sequence":"additional","affiliation":[{"name":"Zhejiang Integrated Circuits and Intelligent Hardware Collaborative Innovation Center, Hangzhou Dianzi University, Hangzhou 310018, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"139","DOI":"10.23919\/JCN.2021.000044","article-title":"Robust secure UAV relay-assisted cognitive communications with resource allocation and cooperative jamming","volume":"24","author":"Wang","year":"2022","journal-title":"J. Commun. Netw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"17275","DOI":"10.1109\/JIOT.2021.3078701","article-title":"AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Rein-forcement Learning Method","volume":"8","author":"Sun","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4015","DOI":"10.1109\/JIOT.2021.3118949","article-title":"Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment","volume":"9","author":"Ouahouah","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1109\/LWC.2022.3171602","article-title":"Attention-Based Communication and Control for Multi-UAV Path Planning","volume":"11","author":"Shiri","year":"2022","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sun, R., Zhao, D., Ding, L., Zhang, J., and Ma, H. (2022). UAV-Net+: Effective and Energy-Efficient UAV Network Deployment for Extending Cell Tower Coverage with Dynamic Demands. IEEE Trans. Veh. Technol., 1\u201313.","DOI":"10.1109\/TVT.2022.3202141"},{"key":"ref_6","first-page":"1129","article-title":"An Improved Artificial Potential Field Method for Path Planning and For-mation Control of the Multi-UAV Systems","volume":"69","author":"Pan","year":"2022","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"154679","DOI":"10.1109\/ACCESS.2021.3128295","article-title":"UAV Dynamic Path Planning Based on Obstacle Position Prediction in an Unknown Environment","volume":"9","author":"Feng","year":"2021","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"12505","DOI":"10.1109\/JIOT.2021.3137331","article-title":"Autonomous UAV Path-Planning Optimization Using Metaheuristic Approach for Predisaster Assessment","volume":"9","author":"Qadir","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/TAI.2021.3103143","article-title":"Bipartite Cooperative Coevolution for Energy-Aware Coverage Path Planning of UAVs","volume":"3","author":"Shao","year":"2022","journal-title":"IEEE Trans. Artif. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1109\/JSTARS.2021.3134948","article-title":"VPP: Visibility-Based Path Planning Heuristic for Moni-toring Large Regions of Complex Terrain Using a UAV Onboard Camera","volume":"15","author":"Romero","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_11","unstructured":"Chen, J., Du, C., Zhang, Y., Han, P., and Wei, W. (2021). A Clustering-Based Coverage Path Planning Method for Autonomous Het-erogeneous UAVs. IEEE Trans. Intell. Transp. Syst., 1\u201311."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1463","DOI":"10.23919\/JSEE.2021.000124","article-title":"Self-organized search-attack mission planning for UAV swarm based on wolf pack hunting behavior","volume":"32","author":"Jinqiang","year":"2021","journal-title":"J. Syst. Eng. Electron."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"20100","DOI":"10.1109\/ACCESS.2021.3054179","article-title":"Improved Bat Algorithm for UAV Path Planning in Three-Dimensional Space","volume":"9","author":"Zhou","year":"2021","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"227629","DOI":"10.1109\/ACCESS.2020.3045934","article-title":"Mission-Oriented 3D Path Planning for High-Altitude Long-Endurance So-lar-Powered UAVs with Optimal Energy Management","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"124670","DOI":"10.1109\/ACCESS.2021.3109879","article-title":"Multi-UAV Path Planning Based on Fusion of Sparrow Search Algo-rithm and Improved Bioinspired Neural Network","volume":"9","author":"Liu","year":"2021","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"45695","DOI":"10.1109\/ACCESS.2022.3170583","article-title":"Decentralized Multi-UAV Path Planning Based on Two-Layer Coordinative Framework for Formation Rendezvous","volume":"10","author":"Cheng","year":"2022","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6993","DOI":"10.1109\/JIOT.2020.2979521","article-title":"Multiobjective UAV Path Planning for Emergency Information Collection and Transmis-sion","volume":"7","author":"Huang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"37572","DOI":"10.1109\/ACCESS.2022.3164505","article-title":"Online Path Planning Framework for UAV in Rural Areas","volume":"10","author":"Airlangga","year":"2022","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wu, X., Lei, Y., Tong, X., Zhang, Y., Li, H., Qiu, C., Guo, C., Sun, Y., and Lai, G. (2022). A Non-rigid Hierarchical Discrete Grid Structure and its Application to UAVs Conflict Detection and Path Planning. IEEE Trans. Aerosp. Electron. Syst.","DOI":"10.1109\/TAES.2022.3170323"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"146264","DOI":"10.1109\/ACCESS.2019.2943253","article-title":"Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement Learning","volume":"7","author":"Qie","year":"2019","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"29064","DOI":"10.1109\/ACCESS.2020.2971780","article-title":"Path Planning for UAV Ground Target Tracking via Deep Reinforcement Learning","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"18487","DOI":"10.1109\/JIOT.2022.3160887","article-title":"High-Performance UAV Crowdsensing: A Deep Reinforcement Learning Approach","volume":"9","author":"Wei","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"12071","DOI":"10.1109\/JIOT.2021.3133278","article-title":"Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning with Sequential Model","volume":"9","author":"Zhu","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1109\/JIOT.2019.2947718","article-title":"Joint Design of Access Point Selection and Path Planning for UAV-Assisted Cellular Networks","volume":"7","author":"Zhu","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"59486","DOI":"10.1109\/ACCESS.2021.3073704","article-title":"UAV Path Planning Based on Multi-Layer Reinforcement Learning Technique","volume":"9","author":"Cui","year":"2021","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3659","DOI":"10.1109\/TNSE.2022.3188670","article-title":"A Load-Balanced and Energy-Efficient Navigation Scheme for UAV-Mounted Mobile Edge Computing","volume":"9","author":"Wang","year":"2022","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhang, L., Jabbari, B., and Ansari, N. (2022). Deep Reinforcement Learning Driven UAV-assisted Edge Computing. IEEE Internet Things J.","DOI":"10.1109\/WCNC51071.2022.9771769"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/TETCI.2021.3083410","article-title":"Multi-UAV Mobile Edge Computing and Path Planning Platform Based on Reinforcement Learning","volume":"6","author":"Chang","year":"2021","journal-title":"IEEE Trans. Emerg. Top. Comput. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, R., Qu, Z., Huang, G., Dong, M., Wang, T., Zhang, S., and Liu, A. (2022). DRL-UTPS: DRL-based Trajectory Planning for Unmanned Aerial Vehicles for Data Collection in Dynamic IoT Network. IEEE Trans. Intell. Veh., 1\u201314.","DOI":"10.1109\/TIV.2022.3213703"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1109\/TMC.2020.3003639","article-title":"Reinforcement Learning-Based Collision Avoidance and Optimal Trajectory Planning in UAV Communication Networks","volume":"21","author":"Hsu","year":"2022","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"87715","DOI":"10.1109\/ACCESS.2022.3199004","article-title":"Energy-Optimized Trajectory Planning for Solar-Powered Aircraft in a Wind Field Using Reinforcement Learning","volume":"10","author":"Xi","year":"2022","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1487","DOI":"10.1109\/OJCOMS.2022.3201292","article-title":"Fairness-Based Energy-Efficient 3-D Path Planning of a Portable Access Point: A Deep Reinforcement Learning Approach","volume":"3","author":"Babu","year":"2022","journal-title":"IEEE Open J. Commun. Soc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"13022","DOI":"10.1109\/TVT.2021.3121747","article-title":"Connectivity-Aware 3D UAV Path Design with Deep Reinforcement Learning","volume":"70","author":"Xie","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1109\/OJCOMS.2021.3081996","article-title":"Multi-UAV Path Planning for Wireless Data Harvesting with Deep Reinforcement Learning","volume":"2","author":"Bayerlein","year":"2021","journal-title":"IEEE Open J. Commun. Soc."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7897","DOI":"10.1109\/TWC.2022.3162749","article-title":"Path Planning for Cellular-Connected UAV: A DRL Solution with Quantum-Inspired Experience Replay","volume":"21","author":"Li","year":"2022","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"13901","DOI":"10.1109\/JIOT.2022.3145008","article-title":"Reinforcement Learning-aided Safe Planning for Aerial Robots to Collect Data in Dynamic Environments","volume":"9","author":"Khamidehi","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"16663","DOI":"10.1109\/JIOT.2022.3153585","article-title":"Learning-Based UAV Path Planning for Data Collection with Inte-grated Collision Avoidance","volume":"9","author":"Wang","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"7664","DOI":"10.1109\/ACCESS.2021.3139534","article-title":"Quality-Oriented Hybrid Path Planning Based on A* and Q-Learning for Unmanned Aerial Vehicle","volume":"10","author":"Li","year":"2021","journal-title":"IEEE Access"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/12\/1767\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:33:04Z","timestamp":1760146384000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/12\/1767"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,2]]},"references-count":38,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["e24121767"],"URL":"https:\/\/doi.org\/10.3390\/e24121767","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,2]]}}}