{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T00:46:04Z","timestamp":1768265164653,"version":"3.49.0"},"reference-count":68,"publisher":"World Scientific Pub Co Pte Ltd","issue":"03","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Un. Sys."],"published-print":{"date-parts":[[2024,5]]},"abstract":"<jats:p> Unmanned aerial vehicles (UAVs) are experiencing a rapid expansion in their applications across various domains, including goods delivery, video capturing, and traffic control. The crucial aspect for UAVs to execute successful target tracking and obstacle avoidance maneuvers lies in the accuracy of their path planning operations. This research paper aims to contribute to the existing body of knowledge by presenting a novel model that incorporates acceleration control, accounting for changing variables such as UAV velocity and altitude, while also incorporating vehicle dynamics. To enhance the realism of the model, we include drag force as a factor. In this study, we focus on exploring the potential of deep reinforcement learning (DRL), specifically the deep deterministic policy gradient (DDPG) algorithm, for modeling a 3D continuous environment with a continuous set of actions. In order to improve the UAV\u2019s performance in executing target tracking and obstacle avoidance maneuvers, we propose an innovative reward function based on the inner product. The training results show that the UAV successfully learns to perform the aforementioned tasks. Also, simulation results demonstrate the superior performance of the proposed UAV modeling and reward function compared to existing works. <\/jats:p>","DOI":"10.1142\/s2301385024420044","type":"journal-article","created":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T15:17:57Z","timestamp":1697037477000},"page":"477-498","source":"Crossref","is-referenced-by-count":19,"title":["A Deep Reinforcement Learning Approach for UAV Path Planning Incorporating Vehicle Dynamics with Acceleration Control"],"prefix":"10.1142","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8368-2307","authenticated-orcid":false,"given":"Sina","family":"Sabzekar","sequence":"first","affiliation":[{"name":"School of Civil Engineering, College of Engineering, University of Tehran, Tehran, Iran"},{"name":"Department of Civil Engineering, Sharif University of Technology, Tehran, Iran"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0190-3530","authenticated-orcid":false,"given":"Mahdi","family":"Samadzad","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, College of Engineering, University of Tehran, Tehran, Iran"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2875-4579","authenticated-orcid":false,"given":"Asal","family":"Mehditabrizi","sequence":"additional","affiliation":[{"name":"School of Civil Engineering, College of Engineering, University of Tehran, Tehran, Iran"},{"name":"Maryland Transportation Institute, University of Maryland, College Park, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6735-7571","authenticated-orcid":false,"given":"Ala Nekouvaght","family":"Tak","sequence":"additional","affiliation":[{"name":"Sonny Astani Department of Civil and Environmental Engineering, University of Southern California, Los Angeles, CA, USA"}]}],"member":"219","published-online":{"date-parts":[[2023,11,16]]},"reference":[{"key":"S2301385024420044BIB001","first-page":"102857","volume":"111","author":"Han B.","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"S2301385024420044BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3157626"},{"key":"S2301385024420044BIB003","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-021-01548-2"},{"key":"S2301385024420044BIB004","doi-asserted-by":"publisher","DOI":"10.1142\/S2737480721500059"},{"key":"S2301385024420044BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2023.3249900"},{"key":"S2301385024420044BIB006","doi-asserted-by":"publisher","DOI":"10.1142\/S230138502450016X"},{"key":"S2301385024420044BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/ICAR53236.2021.9659413"},{"key":"S2301385024420044BIB008","doi-asserted-by":"publisher","DOI":"10.1007\/s11831-022-09742-7"},{"key":"S2301385024420044BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s11075-021-01167-w"},{"key":"S2301385024420044BIB010","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385021500011"},{"key":"S2301385024420044BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/ISCAS45731.2020.9181245"},{"key":"S2301385024420044BIB012","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.119910"},{"key":"S2301385024420044BIB013","doi-asserted-by":"publisher","DOI":"10.3390\/robotics10020073"},{"key":"S2301385024420044BIB014","doi-asserted-by":"publisher","DOI":"10.1109\/ICUMT.2016.7765223"},{"key":"S2301385024420044BIB015","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-023-01819-0"},{"key":"S2301385024420044BIB016","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-021-09997-9"},{"key":"S2301385024420044BIB017","doi-asserted-by":"publisher","DOI":"10.1145\/3301273"},{"key":"S2301385024420044BIB018","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385021500023"},{"key":"S2301385024420044BIB019","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-018-0891-8"},{"key":"S2301385024420044BIB020","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"S2301385024420044BIB022","doi-asserted-by":"publisher","DOI":"10.1007\/s13198-021-01186-9"},{"key":"S2301385024420044BIB024","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2019.2922849"},{"key":"S2301385024420044BIB025","doi-asserted-by":"publisher","DOI":"10.23919\/ChiCC.2017.8027884"},{"key":"S2301385024420044BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/ICRAS.2018.8443226"},{"key":"S2301385024420044BIB027","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-022-07293-4"},{"key":"S2301385024420044BIB028","doi-asserted-by":"publisher","DOI":"10.3390\/app8112169"},{"key":"S2301385024420044BIB029","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-019-01073-3"},{"key":"S2301385024420044BIB030","doi-asserted-by":"publisher","DOI":"10.1007\/s11370-021-00387-2"},{"key":"S2301385024420044BIB031","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-020-09951-8"},{"key":"S2301385024420044BIB032","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-8155-7_432"},{"key":"S2301385024420044BIB033","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2020.3039617"},{"key":"S2301385024420044BIB034","doi-asserted-by":"publisher","DOI":"10.1109\/PLANS46316.2020.9110163"},{"key":"S2301385024420044BIB035","doi-asserted-by":"publisher","DOI":"10.23919\/ECC51009.2020.9143591"},{"key":"S2301385024420044BIB036","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2971780"},{"key":"S2301385024420044BIB037","doi-asserted-by":"publisher","DOI":"10.1109\/CCDC.2017.7978637"},{"key":"S2301385024420044BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/CGNCC.2016.7829099"},{"key":"S2301385024420044BIB039","doi-asserted-by":"publisher","DOI":"10.1109\/ICCT.2017.8359869"},{"key":"S2301385024420044BIB040","doi-asserted-by":"publisher","DOI":"10.1109\/CCDC.2019.8833455"},{"key":"S2301385024420044BIB041","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-018-1384-y"},{"key":"S2301385024420044BIB042","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/2851964"},{"key":"S2301385024420044BIB043","doi-asserted-by":"publisher","DOI":"10.1007\/s11277-021-08947-6"},{"key":"S2301385024420044BIB044","doi-asserted-by":"publisher","DOI":"10.3390\/drones6060147"},{"key":"S2301385024420044BIB045","first-page":"1","volume":"11","author":"Liu H.","year":"2022","journal-title":"Unmanned Syst."},{"key":"S2301385024420044BIB046","doi-asserted-by":"publisher","DOI":"10.1109\/ICIEAM.2019.8742915"},{"key":"S2301385024420044BIB047","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/7854173"},{"key":"S2301385024420044BIB048","doi-asserted-by":"publisher","DOI":"10.1109\/ICInfA.2015.7279322"},{"key":"S2301385024420044BIB049","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"S2301385024420044BIB050","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11796"},{"key":"S2301385024420044BIB052","doi-asserted-by":"publisher","DOI":"10.1109\/ICInfA.2018.8812452"},{"key":"S2301385024420044BIB053","doi-asserted-by":"publisher","DOI":"10.1109\/CAC.2018.8623434"},{"key":"S2301385024420044BIB054","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2019.2954952"},{"key":"S2301385024420044BIB055","doi-asserted-by":"publisher","DOI":"10.1007\/s12555-021-0642-7"},{"key":"S2301385024420044BIB056","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-021-01367-5"},{"key":"S2301385024420044BIB057","first-page":"1","volume":"9","author":"Gu Y.","year":"2022","journal-title":"Complex Intell. Syst."},{"key":"S2301385024420044BIB058","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-021-01568-y"},{"key":"S2301385024420044BIB059","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10846-021-01445-8","volume":"103","author":"Rub B.","year":"2021","journal-title":"J. Intell. Rob. Syst."},{"key":"S2301385024420044BIB060","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2018.2890773"},{"key":"S2301385024420044BIB061","doi-asserted-by":"publisher","DOI":"10.1109\/ICCA.2018.8444355"},{"key":"S2301385024420044BIB062","doi-asserted-by":"publisher","DOI":"10.3390\/rs12040640"},{"key":"S2301385024420044BIB063","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989381"},{"key":"S2301385024420044BIB064","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8202134"},{"key":"S2301385024420044BIB065","doi-asserted-by":"publisher","DOI":"10.3390\/drones6010016"},{"key":"S2301385024420044BIB067","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385021500187"},{"key":"S2301385024420044BIB068","doi-asserted-by":"publisher","DOI":"10.1016\/j.cja.2022.09.008"},{"key":"S2301385024420044BIB069","first-page":"8026","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Paszke A.","year":"2019"},{"key":"S2301385024420044BIB070","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRev.36.823"},{"key":"S2301385024420044BIB071","doi-asserted-by":"publisher","DOI":"10.1145\/3508546.3508598"},{"key":"S2301385024420044BIB072","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385023410029"}],"container-title":["Unmanned Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S2301385024420044","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T02:36:52Z","timestamp":1717382212000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S2301385024420044"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,16]]},"references-count":68,"journal-issue":{"issue":"03","published-print":{"date-parts":[[2024,5]]}},"alternative-id":["10.1142\/S2301385024420044"],"URL":"https:\/\/doi.org\/10.1142\/s2301385024420044","relation":{},"ISSN":["2301-3850","2301-3869"],"issn-type":[{"value":"2301-3850","type":"print"},{"value":"2301-3869","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,16]]}}}