{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T16:09:52Z","timestamp":1781107792567,"version":"3.54.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,14]],"date-time":"2024-03-14T00:00:00Z","timestamp":1710374400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,14]],"date-time":"2024-03-14T00:00:00Z","timestamp":1710374400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"the National Natural Science Foundation of China under Grant","award":["No. 62271250"],"award-info":[{"award-number":["No. 62271250"]}]},{"name":"the Key Technologies R&D Program of Jiangsu (Prospective and Key Technologies for Industry) under Grants","award":["No.BE2022067\uff0cBE2022067-1\uff0cBE2022067-2"],"award-info":[{"award-number":["No.BE2022067\uff0cBE2022067-1\uff0cBE2022067-2"]}]},{"name":"the Key Technologies R&D Program of Jiangsu (Prospective and Key Technologies for Industry) under Grants","award":["BE2022067-3"],"award-info":[{"award-number":["BE2022067-3"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["EURASIP J. Adv. Signal Process."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Cellular-connected unmanned aerial vehicles (UAVs), which have the potential to extend cellular services from the ground into the airspace, represent a promising technological advancement. However, the presence of communication coverage black holes among base stations and various obstacles within the aerial domain pose significant challenges to ensuring the safe operation of UAVs. This paper introduces a novel trajectory planning scheme, namely the double-map assisted UAV approach, which leverages deep reinforcement learning to address these challenges. The mission execution time, wireless connectivity, and obstacle avoidance are comprehensively modeled and analyzed in this approach, leading to the derivation of a novel joint optimization function. By utilizing an advanced technique known as dueling double deep Q network (D3QN), the objective function is optimized, while employing a mechanism of prioritized experience replay strengthens the training of effective samples. Furthermore, the connectivity and obstacle information collected by the UAV during flight are utilized to generate a map of radio and environmental data for simulating the flying process, thereby significantly reducing operational costs. The numerical results demonstrate that the proposed method effectively circumvents obstacles and areas with weak connections during flight, while also considering mission completion time.<\/jats:p>","DOI":"10.1186\/s13634-024-01130-6","type":"journal-article","created":{"date-parts":[[2024,3,14]],"date-time":"2024-03-14T04:45:07Z","timestamp":1710391507000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Joint optimization of UAV communication connectivity and obstacle avoidance in urban environments using a double-map approach"],"prefix":"10.1186","volume":"2024","author":[{"given":"Weizhi","family":"Zhong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiang","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhipeng","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Farman","family":"Ali","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,14]]},"reference":[{"key":"1130_CR1","unstructured":"Statista drones: Estimated size of the global commercial drone market in 2021 with a forecast for 2026. Accessed 18 Aug 2011. [Online]. Available: https:\/\/www.statista.com\/statistics\/878018\/global-commercial-drone-market-size"},{"issue":"4","key":"1130_CR2","doi-asserted-by":"publisher","first-page":"7048","DOI":"10.1109\/JIOT.2019.2913887","volume":"6","author":"J Lyu","year":"2019","unstructured":"J. Lyu, R. Zhang, Network-connected UAV: 3-D system modeling and coverage performance analysis. IEEE Internet Things J. 6(4), 7048\u20137060 (2019)","journal-title":"IEEE Internet Things J."},{"issue":"10","key":"1130_CR3","doi-asserted-by":"publisher","first-page":"19569","DOI":"10.1109\/TITS.2022.3161698","volume":"23","author":"X Liu","year":"2022","unstructured":"X. Liu, Y. Yu, F. Li, T.S. Durrani, Throughput maximization for RIS-UAV relaying communications. IEEE Trans. Intell. Transp. Syst. 23(10), 19569\u201319574 (2022)","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"1130_CR4","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2022.3231376","author":"X Liu","year":"2022","unstructured":"X. Liu, Y. Yu, B. Peng, X.B. Zhai, Q. Zhu, V.C.M. Leung, RIS-UAV enabled worst-case downlink secrecy rate maximization for mobile vehicles. IEEE Trans. Veh. Technol. (2022). https:\/\/doi.org\/10.1109\/TVT.2022.3231376","journal-title":"IEEE Trans. Veh. Technol."},{"issue":"3","key":"1130_CR5","doi-asserted-by":"publisher","first-page":"3962","DOI":"10.1109\/TVT.2022.3219613","volume":"72","author":"X Liu","year":"2023","unstructured":"X. Liu, Z. Liu, B. Lai, B. Peng, T.S. Durrani, Fair energy-efficient resource optimization for multi-UAV enabled Internet of Things. IEEE Trans. Veh. Technol. 72(3), 3962\u20133972 (2023)","journal-title":"IEEE Trans. Veh. Technol."},{"key":"1130_CR6","unstructured":"3GPP TR 36.873 Study on 3D channel model for LTE. V12.7.0 (2017)"},{"key":"1130_CR7","doi-asserted-by":"crossref","unstructured":"J. Qiu, J. Lyu and L. Fu, Placement optimization of aerial base stations with deep reinforcement learning, in Proceedings of the IEEE International Conference on Communications (ICC) (2020), pp. 1\u20136","DOI":"10.1109\/ICC40277.2020.9149258"},{"key":"1130_CR8","doi-asserted-by":"crossref","unstructured":"M. M. U. Chowdhury, W. Saad and I. G\u00fcven\u00e7, Mobility management for cellular-connected UAVs: a learning-based approach, in Proceedings of the IEEE International Conference on Communications Workshops (2020), pp. 1\u20136","DOI":"10.1109\/ICCWorkshops49005.2020.9145089"},{"issue":"4","key":"1130_CR9","doi-asserted-by":"publisher","first-page":"2473","DOI":"10.1109\/TCOMM.2021.3049387","volume":"69","author":"C Zhang","year":"2021","unstructured":"C. Zhang, L. Zhang, L. Zhu, T. Zhang, Z. Xiao, X.G. Xia, 3D deployment of multiple UAV -mounted base stations for UAV communications. IEEE Trans. Commun. 69(4), 2473\u20132488 (2021)","journal-title":"IEEE Trans. Commun."},{"issue":"10","key":"1130_CR10","doi-asserted-by":"publisher","first-page":"4679","DOI":"10.1109\/TWC.2019.2926981","volume":"18","author":"L Liu","year":"2019","unstructured":"L. Liu, S. Zhang, R. Zhang, Multi-beam UAV communication in cellular uplink: cooperative interference cancellation and sum-rate maximization. IEEE Trans. Wirel. Commun. 18(10), 4679\u20134691 (2019)","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"1130_CR11","doi-asserted-by":"crossref","unstructured":"L. Liu, S. Zhang and R. Zhang, Exploiting NOMA for multi-beam UAV communication in cellular uplink, in Proceedings of the IEEE International Conference on Communications (ICC) (2019), pp. 1\u20136","DOI":"10.1109\/ICC.2019.8761670"},{"issue":"3","key":"1130_CR12","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1109\/JSTSP.2019.2899208","volume":"13","author":"W Mei","year":"2019","unstructured":"W. Mei, R. Zhang, Uplink cooperative NOMA for cellular-connected UAV. IEEE J. Sel. Topics Signal Process. 13(3), 644\u2013656 (2019)","journal-title":"IEEE J. Sel. Topics Signal Process."},{"key":"1130_CR13","doi-asserted-by":"crossref","unstructured":"S. Zhang and R. Zhang, Radio map based path planning for cellular-connected UAV, in Proceedings of the IEEE Global Communications Conference (2019), pp. 1\u20136","DOI":"10.1109\/GLOBECOM38437.2019.9013177"},{"key":"1130_CR14","doi-asserted-by":"publisher","first-page":"29205","DOI":"10.1109\/ACCESS.2020.2971772","volume":"8","author":"Y-J Chen","year":"2020","unstructured":"Y.-J. Chen, D.-Y. Huang, Trajectory optimization for cellular-enabled UAV with connectivity outage constraint. IEEE Access 8, 29205\u201329218 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2020.2971772","journal-title":"IEEE Access"},{"issue":"3","key":"1130_CR15","doi-asserted-by":"publisher","first-page":"2580","DOI":"10.1109\/TCOMM.2018.2880468","volume":"67","author":"S Zhang","year":"2019","unstructured":"S. Zhang, Y. Zeng, R. Zhang, Cellular-enabled UAV communication: a connectivity-constrained trajectory optimization perspective. IEEE Trans. Commun. 67(3), 2580\u20132604 (2019)","journal-title":"IEEE Trans. Commun."},{"key":"1130_CR16","doi-asserted-by":"crossref","unstructured":"S. Zhang and R. Zhang, Trajectory design for cellular-connected UA V under outage duration constraint, in Proceedings of the IEEE International Conference on Communications (ICC) (2019), pp. 1\u20136","DOI":"10.1109\/ICC.2019.8761259"},{"key":"1130_CR17","doi-asserted-by":"crossref","unstructured":"E. Bulut and I. Guevenc, Trajectory optimization for cellular-connected UA Vs with disconnectivity constraint, in Proceedings of the IEEE International Conference on Communications Workshops (ICC Workshops) (2018), pp. 1\u20136","DOI":"10.1109\/ICCW.2018.8403623"},{"issue":"9","key":"1130_CR18","doi-asserted-by":"publisher","first-page":"15354","DOI":"10.1109\/TITS.2022.3140357","volume":"23","author":"X Liu","year":"2022","unstructured":"X. Liu, B. Lai, B. Lin, V.C. Leung, Joint communication and trajectory optimization for multi-UAV enabled mobile internet of vehicles. IEEE Trans. Intell. Transp. Syst. 23(9), 15354\u201315366 (2022)","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"issue":"6","key":"1130_CR19","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1109\/LWC.2014.2342736","volume":"3","author":"A Al-Hourani","year":"2014","unstructured":"A. Al-Hourani, S. Kandeepan, S. Lardner, Optimal LAP altitude for maximum coverage. IEEE Wirel. Commun. Lett. 3(6), 569\u2013572 (2014)","journal-title":"IEEE Wirel. Commun. Lett."},{"issue":"1","key":"1130_CR20","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1109\/TCOMM.2017.2746105","volume":"66","author":"MM Azari","year":"2018","unstructured":"M.M. Azari, F. Rosas, K.-C. Chen, S. Pollin, Ultra reliable UAV communication using altitude and cooperation diversity. IEEE Trans. Commun. 66(1), 330\u2013344 (2018)","journal-title":"IEEE Trans. Commun."},{"issue":"6","key":"1130_CR21","doi-asserted-by":"publisher","first-page":"3192","DOI":"10.1109\/TWC.2019.2911939","volume":"18","author":"C You","year":"2019","unstructured":"C. You, R. Zhang, 3D trajectory optimization in Rician fading for UA V-enabled data harvesting. IEEE Trans. Wirel. Commun. 18(6), 3192\u20133207 (2019)","journal-title":"IEEE Trans. Wirel. Commun."},{"issue":"7","key":"1130_CR22","doi-asserted-by":"publisher","first-page":"4205","DOI":"10.1109\/TWC.2021.3056573","volume":"20","author":"Y Zeng","year":"2021","unstructured":"Y. Zeng, X. Xu, S. Jin, R. Zhang, Simultaneous navigation and radio mapping for cellular-connected UAV with deep reinforcement learning. IEEE Trans. Wirel. Commun. 20(7), 4205\u20134220 (2021)","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"1130_CR23","doi-asserted-by":"crossref","unstructured":"J. Chen, U. Yatnalli and D. Gesbert, Learning radio maps for UAV-aided wireless networks: a segmented regression approach, in Proceedings of the IEEE International Conference on Communications (ICC) (2017)","DOI":"10.1109\/ICC.2017.7997333"},{"issue":"4","key":"1130_CR24","doi-asserted-by":"publisher","first-page":"2125","DOI":"10.1109\/TWC.2019.2900035","volume":"18","author":"U Challita","year":"2019","unstructured":"U. Challita, W. Saad, C. Bettstetter, Interference management for cellular-connected UA Vs: a deep reinforcement learning approach. IEEE Trans. Wirel. Commun. 18(4), 2125\u20132140 (2019)","journal-title":"IEEE Trans. Wirel. Commun."},{"issue":"3","key":"1130_CR25","doi-asserted-by":"publisher","first-page":"1975","DOI":"10.1109\/TWC.2020.3037916","volume":"20","author":"S Zhang","year":"2021","unstructured":"S. Zhang, R. Zhang, Radio map-based 3D path planning for cellular-connected UAV. IEEE Trans. Wirel. Commun. 20(3), 1975\u20131989 (2021)","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"1130_CR26","unstructured":"X. Wang and M.C. Gursoy, Learning-based UAV trajectory optimization with collision avoidance and connectivity constraints. Available https:\/\/arxiv.org\/abs\/2104.06256"},{"issue":"12","key":"1130_CR27","doi-asserted-by":"publisher","first-page":"13022","DOI":"10.1109\/TVT.2021.3121747","volume":"70","author":"H Xie","year":"2021","unstructured":"H. Xie, D. Yang, L. Xiao et al., Connectivity-aware 3D UAV Path design with deep reinforcement learning. IEEE Trans. Veh. Technol. 70(12), 13022\u201313034 (2021)","journal-title":"IEEE Trans. Veh. Technol."},{"key":"1130_CR28","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385018400022","author":"M Radmanesh","year":"2018","unstructured":"M. Radmanesh, M. Kumar, P.H. Guentert et al., Overview of path planning and obstacle avoidance algorithms for UAVs: a comparative study. Unmanned Syst. (2018). https:\/\/doi.org\/10.1142\/S2301385018400022","journal-title":"Unmanned Syst."},{"key":"1130_CR29","doi-asserted-by":"publisher","unstructured":"Y. Huang and Y. Zeng, Simultaneous environment sensing and channel knowledge mapping for cellular-connected UAV, in 2021 IEEE Globecom Workshops (GC Wkshps), Madrid, Spain (2021), pp. 1\u20136. https:\/\/doi.org\/10.1109\/GCWkshps52748.2021.9682178.","DOI":"10.1109\/GCWkshps52748.2021.9682178"},{"key":"1130_CR30","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2023.3240463","author":"J Liu","year":"2023","unstructured":"J. Liu, J. Yu, D. Niyato, R. Zhang, X. Gao, J. An, Covert ambient backscatter communications with multi-antenna tag. IEEE Trans. Wirel. Commun. (2023). https:\/\/doi.org\/10.1109\/TWC.2023.3240463","journal-title":"IEEE Trans. Wirel. Commun."},{"issue":"5","key":"1130_CR31","doi-asserted-by":"publisher","first-page":"3103","DOI":"10.1109\/TCOMM.2023.3255900","volume":"71","author":"B Hua","year":"2023","unstructured":"B. Hua, H. Ni, Q. Zhu, C.X. Wang, T. Zhou, K. Mao et al., Channel modeling for UAV-to-ground communications with posture variation and fuselage scattering effect. IEEE Trans. Commun. 71(5), 3103\u20133116 (2023)","journal-title":"IEEE Trans. Commun."},{"issue":"18","key":"1130_CR32","doi-asserted-by":"publisher","first-page":"17592","DOI":"10.1109\/JIOT.2022.3155773","volume":"9","author":"K Mao","year":"2022","unstructured":"K. Mao, Q. Zhu, M. Song, H. Li, B. Ning, G.F. Pedersen et al., Machine learning-based 3D channel modeling for U2V mmwave communications. IEEE Internet Things J. 9(18), 17592\u201317607 (2022)","journal-title":"IEEE Internet Things J."},{"issue":"2","key":"1130_CR33","doi-asserted-by":"publisher","first-page":"1193","DOI":"10.1109\/TCOMM.2022.3233064","volume":"71","author":"M Shi","year":"2023","unstructured":"M. Shi, K. Yang, D. Niyato, H. Yuan, H. Zhou, Z. Xu, The meta distribution of SINR in UAV-assisted cellular networks. IEEE Trans. Commun. 71(2), 1193\u20131206 (2023). https:\/\/doi.org\/10.1109\/TCOMM.2022.3233064","journal-title":"IEEE Trans. Commun."},{"issue":"8","key":"1130_CR34","doi-asserted-by":"publisher","first-page":"6033","DOI":"10.1109\/TWC.2022.3145399","volume":"21","author":"J Pan","year":"2022","unstructured":"J. Pan, N. Ye et al., AI-driven blind signature classification for IoT connectivity: a deep learning approach. IEEE Trans. Wirel. Commun. 21(8), 6033\u20136047 (2022)","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"1130_CR35","doi-asserted-by":"publisher","unstructured":"K. Yu, K. Jin and X. Deng, Review of deep reinforcement learning, in 2022 IEEE 5th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Chongqing, China (2022), pp. 41\u201348. https:\/\/doi.org\/10.1109\/IMCEC55388.2022.10020015","DOI":"10.1109\/IMCEC55388.2022.10020015"},{"key":"1130_CR36","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"V. Mnih et al., Human-level control through deep reinforcement learning. Nature 518, 529\u2013533 (2015)","journal-title":"Nature"}],"container-title":["EURASIP Journal on Advances in Signal Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13634-024-01130-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13634-024-01130-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13634-024-01130-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,14]],"date-time":"2024-03-14T04:55:06Z","timestamp":1710392106000},"score":1,"resource":{"primary":{"URL":"https:\/\/asp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13634-024-01130-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,14]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["1130"],"URL":"https:\/\/doi.org\/10.1186\/s13634-024-01130-6","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-3823266\/v1","asserted-by":"object"}]},"ISSN":["1687-6180"],"issn-type":[{"value":"1687-6180","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,14]]},"assertion":[{"value":"30 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"No conflict of interest exits in the submission of this manuscript.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"35"}}