{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T17:45:35Z","timestamp":1784137535703,"version":"3.55.0"},"reference-count":34,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T00:00:00Z","timestamp":1678406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Beijing Hongdahechuang Defense Technology Research Institute Co., Ltd.","award":["XM2101"],"award-info":[{"award-number":["XM2101"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes a feature fusion algorithm for solving the path planning problem of multiple unmanned aerial vehicles (UAVs) using GPS and communication denial conditions. Due to the blockage of GPS and communication, UAVs cannot obtain the precise position of a target, which leads to the failure of path planning algorithms. This paper proposes a feature fusion proximal policy optimization (FF-PPO) algorithm based on deep reinforcement learning (DRL); the algorithm can fuse image recognition information with the original image, realizing the multi-UAV path planning algorithm without an accurate target location. In addition, the FF-PPO algorithm adopts an independent policy for multi-UAV communication denial environments, which enables the distributed control of UAVs such that multi-UAVs can realize the cooperative path planning task without communication. The success rate of our proposed algorithm can reach more than 90% in the multi-UAV cooperative path planning task. Finally, the feasibility of the algorithm is verified by simulations and hardware.<\/jats:p>","DOI":"10.3390\/s23062997","type":"journal-article","created":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T02:05:54Z","timestamp":1678413954000},"page":"2997","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Multi-UAV Path Planning in GPS and Communication Denial Environment"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2979-5797","authenticated-orcid":false,"given":"Yahao","family":"Xu","sequence":"first","affiliation":[{"name":"School of Mechatronical Engineering, Beijing Institute of Technology, 5th South Zhongguancun Street, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiran","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Mechatronical Engineering, Beijing Institute of Technology, 5th South Zhongguancun Street, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Di","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechatronical Engineering, Beijing Institute of Technology, 5th South Zhongguancun Street, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4607-641X","authenticated-orcid":false,"given":"Keyang","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Mechatronical Engineering, Beijing Institute of Technology, 5th South Zhongguancun Street, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongbin","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Mechatronical Engineering, Beijing Institute of Technology, 5th South Zhongguancun Street, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/s00521-021-06569-4","article-title":"A review of artificial intelligence applied to path planning in UAV swarms","volume":"34","author":"Rivero","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_2","first-page":"100469","article-title":"Task assignment algorithms for unmanned aerial vehicle networks: A comprehensive survey","volume":"35","author":"Poudel","year":"2022","journal-title":"Veh. Commun."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1177\/027836498600500106","article-title":"Real-time bstacle avoidance for manipulators and mobile robots","volume":"5","author":"Khatib","year":"1986","journal-title":"Int. J. Robot. Res."},{"key":"ref_4","first-page":"1129","article-title":"An improved artificial potential field method for path planning and formation control of the multi-UAV systems","volume":"69","author":"Pan","year":"2022","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"ref_5","first-page":"577","article-title":"Self-optimization A-star algorithm for UAV path planning based on Laguerre diagram","volume":"37","author":"Wei","year":"2015","journal-title":"Syst. Eng. Electron"},{"key":"ref_6","unstructured":"Holland, J.H. (1975). Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence, MIT Press."},{"key":"ref_7","first-page":"12","article-title":"A multilayer graph for multi-agent formation and trajectory tracking control based on MPC algorithm","volume":"50","author":"Zhenhua","year":"2021","journal-title":"IEEE Trans. Cybern."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"0036850419879024","DOI":"10.1177\/0036850419879024","article-title":"Heuristic Q-learning based on experience replay for three-dimensional path planning of the unmanned aerial vehicle","volume":"103","author":"Xie","year":"2020","journal-title":"Sci. Prog."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"59486","DOI":"10.1109\/ACCESS.2021.3073704","article-title":"UAV Path Planning Based on Multi-Layer Reinforcement Learning Technique","volume":"9","author":"Cui","year":"2021","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"105671","DOI":"10.1016\/j.ast.2019.105671","article-title":"Reinforcement learning based two-level control framework of UAV swarm for cooperative persistent surveillance in an unknown urban area","volume":"98","author":"Liu","year":"2020","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Fevgas, G., Lagkas, T., Argyriou, V., and Sarigiannidis, P. (2022). Coverage Path Planning Methods Focusing on Energy Efficient and Cooperative Strategies for Unmanned Aerial Vehicles. Sensors, 22.","DOI":"10.3390\/s22031235"},{"key":"ref_12","unstructured":"Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., and Mordatch, I. (2017). Multi-agent actor-critic for mixed cooperative-competitive environments. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Krichen, M., Adoni, W.Y.H., Mihoub, A., Alzahrani, M.Y., and Nahhal, T. (2022, January 9\u201311). Security Challenges for Drone Communications: Possible Threats, Attacks and Countermeasures. Proceedings of the 2022 2nd International Conference of Smart Systems and Emerging Technologies (SMARTTECH), Riyadh, Saudi Arabia.","DOI":"10.1109\/SMARTTECH54121.2022.00048"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bunse, C., and Plotz, S. (2018, January 26\u201327). Security analysis of drone communication protocols. Proceedings of the Engineering Secure Software and Systems: 10th International Symposium (ESSoS 2018), Paris, France.","DOI":"10.1007\/978-3-319-94496-8_7"},{"key":"ref_15","unstructured":"(2022, December 03). Yolov5. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_16","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning, MIT Press. [2nd ed.]. An Introduction."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Michels, J., Saxena, A., and Ng, A.Y. (2005, January 7\u201311). High speed obstacle avoidance using monocular vision and reinforcement learning. Proceedings of the 22nd International Conference on Machine Learning, Bonn, Germany.","DOI":"10.1145\/1102351.1102426"},{"key":"ref_18","unstructured":"Xie, L., Wang, S., Markham, A., and Trigoni, N. (2017). Towards monocular vision based obstacle avoidance through deep reinforcement learning. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2686","DOI":"10.1002\/rnc.3018","article-title":"Online adaptive algorithm for optimal control with integral reinforcement learning","volume":"24","author":"Vamvoudakis","year":"2014","journal-title":"Int. J. Robust Nonlinear Control"},{"key":"ref_20","unstructured":"Kulkarni, T.D., Narasimhan, K.R., Saeedi, A., and Tenenbaum, J.B. (2016). Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. Adv. Neural Inf. Process. Syst., 29."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Mottaghi, R., Kolve, E., Lim, J.J., Gupta, A., Fei-Fei, L., and Farhadi, A. (June, January 29). Target-driven visual navigation in indoor scenes using deep reinforcement learning. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989381"},{"key":"ref_22","unstructured":"Chen, L., Moorthy, M., Sharma, P., and Kawthekar, P. (2017). Imitating shortest paths for visual navigation with trajectory-aware deep reinforcement learning. Comput. Sci."},{"key":"ref_23","unstructured":"Siriwardhana, S., Weerasakera, R., Matthies, D.J.C., and Nanayakkara, S. (2019). Vusfa: Variational universal successor features approximator to improve transfer drl for target driven visual navigation. arXiv."},{"key":"ref_24","unstructured":"Siriwardhana, S., Weerasekera, R., and Nanayakkara, R. (2018). Target driven visual navigation with hybrid asynchronous universal successor representations. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"146264","DOI":"10.1109\/ACCESS.2019.2943253","article-title":"Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement Learning","volume":"7","author":"Qie","year":"2019","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_28","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst., 2\u20138."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_30","unstructured":"Schulman, J., Wolski, F., Dhariwal, R., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv."},{"key":"ref_31","unstructured":"Shah, S., Dey, D., Lovett, C., and Kapoor, A. (2018). Field and Service Robotics: Results of the 11th International Conference, Springer International Publishing."},{"key":"ref_32","unstructured":"Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., and Zaremba, W. (2016). Openai gym. arXiv."},{"key":"ref_33","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). Advances in Neural Information Processing Systems 32 (NIPS 2019), Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada, 8\u201314 December 2019, Association for Computing Machinery."},{"key":"ref_34","unstructured":"Moritz, P., Nishihara, R., Wang, S., Tumanov, A., Liaw, R., Liang, E., Elibol, M., Yang, Z., Paul, W., and Jordan, M.I. (2018, January 8\u201310). Ray: A Distributed Framework for Emerging AI Applications. Proceedings of the 13th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 18), Carlsbad, CA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2997\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:51:45Z","timestamp":1760122305000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2997"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,10]]},"references-count":34,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23062997"],"URL":"https:\/\/doi.org\/10.3390\/s23062997","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,10]]}}}