{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T07:20:40Z","timestamp":1781508040405,"version":"3.54.1"},"reference-count":35,"publisher":"World Scientific Pub Co Pte Ltd","issue":"03","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61673327"],"award-info":[{"award-number":["61673327"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Basic Research Programs of Taicang","award":["TC2021JC28"],"award-info":[{"award-number":["TC2021JC28"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["G2021KY05116"],"award-info":[{"award-number":["G2021KY05116"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Yangtze River Delta Research Institute of NPU, Taicang China","award":["215400"],"award-info":[{"award-number":["215400"]}]},{"name":"Industrial Development and Foster Project of Yangtze River Delta Research Institute of NPU, Taicang","award":["CY20210202"],"award-info":[{"award-number":["CY20210202"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Un. Sys."],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:p> Focusing on the problem of multi-UAV cooperative air combat decision-making, a multi-UAV cooperative maneuvering decision-making approach is proposed based on multi-agent deep reinforcement learning (MARL) theory. First, the multi-UAV cooperative short-range air combat environment is established. Then, by combining the value-decomposition networks (VDNs) deep reinforcement learning theory with the embedded expert collaborative air combat experience reward function, an air combat cooperative strategy framework is proposed based on the networked decentralized partially observable Markov decision process (NDec-POMDP). The air combat maneuvering strategy is then optimized to improve the cooperative degree between UAVs in cooperative combat scenarios. Finally, multi-UAV cooperative air combat simulations are carried out and the results show the feasibility and effectiveness of the proposed cooperative air combat decision-making framework and method. <\/jats:p>","DOI":"10.1142\/s2301385023410029","type":"journal-article","created":{"date-parts":[[2022,6,20]],"date-time":"2022-06-20T15:39:09Z","timestamp":1655739549000},"page":"273-286","source":"Crossref","is-referenced-by-count":39,"title":["UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning"],"prefix":"10.1142","volume":"11","author":[{"given":"Zihao","family":"Gong","sequence":"first","affiliation":[{"name":"School of Aerospace Engineering, Xiamen University, Xiamen 361102, P.\u00a0R.\u00a0China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Civil Aviation, Northwestern Polytechnical University, Xian 710072, P.\u00a0R.\u00a0China"},{"name":"Yangtze River Delta Research Institute of NPU, Taicang 215400, P.\u00a0R.\u00a0China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8670-3190","authenticated-orcid":false,"given":"Delin","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Aerospace Engineering, Xiamen University, Xiamen 361102, P.\u00a0R.\u00a0China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2022,6,17]]},"reference":[{"issue":"1","key":"S2301385023410029BIB001","first-page":"1","volume":"10","author":"Yang R.-H.","year":"2021","journal-title":"Unmanned Syst."},{"key":"S2301385023410029BIB002","doi-asserted-by":"publisher","DOI":"10.1109\/ICUS50048.2020.9274902"},{"key":"S2301385023410029BIB003","first-page":"60","volume-title":"Differential Games, Control and Optimization","author":"Rufus I.","year":"1999"},{"key":"S2301385023410029BIB004","doi-asserted-by":"publisher","DOI":"10.2514\/1.26024"},{"key":"S2301385023410029BIB005","doi-asserted-by":"publisher","DOI":"10.1177\/0954410014539654"},{"key":"S2301385023410029BIB006","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2015.11.018"},{"key":"S2301385023410029BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2015.2503285"},{"key":"S2301385023410029BIB008","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2018.04.008"},{"key":"S2301385023410029BIB009","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385018500048"},{"key":"S2301385023410029BIB010","doi-asserted-by":"publisher","DOI":"10.1142\/S2737480721400045"},{"key":"S2301385023410029BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/ICCA.2014.6871018"},{"key":"S2301385023410029BIB012","doi-asserted-by":"publisher","DOI":"10.2514\/1.17168"},{"key":"S2301385023410029BIB013","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.E97.D.89"},{"key":"S2301385023410029BIB014","doi-asserted-by":"publisher","DOI":"10.1016\/j.ast.2019.105534"},{"key":"S2301385023410029BIB015","doi-asserted-by":"publisher","DOI":"10.2514\/1.G002937"},{"key":"S2301385023410029BIB016","doi-asserted-by":"publisher","DOI":"10.5139\/IJASS.2016.17.2.204"},{"key":"S2301385023410029BIB017","doi-asserted-by":"publisher","DOI":"10.2514\/3.46586"},{"key":"S2301385023410029BIB018","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385020500132"},{"key":"S2301385023410029BIB019","doi-asserted-by":"publisher","DOI":"10.2514\/1.46815"},{"key":"S2301385023410029BIB020","first-page":"117637A","volume-title":"Seventh Symp. Novel Photoelectronic Detection Technology and Applications","author":"Gong Z.","year":"2020"},{"key":"S2301385023410029BIB021","doi-asserted-by":"publisher","DOI":"10.1109\/JAS.2015.7032901"},{"key":"S2301385023410029BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/CAC51589.2020.9327173"},{"key":"S2301385023410029BIB023","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2021.107491"},{"key":"S2301385023410029BIB024","first-page":"3699","volume-title":"Advances in Guidance, Navigation and Control","author":"Kang Y.-M.","year":"2021"},{"key":"S2301385023410029BIB025","doi-asserted-by":"publisher","DOI":"10.1007\/s12559-019-09683-7"},{"key":"S2301385023410029BIB026","doi-asserted-by":"publisher","DOI":"10.1016\/S1004-4132(06)60059-5"},{"key":"S2301385023410029BIB027","doi-asserted-by":"publisher","DOI":"10.21629\/JSEE.2018.01.09"},{"key":"S2301385023410029BIB028","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2020.106490"},{"key":"S2301385023410029BIB029","doi-asserted-by":"publisher","DOI":"10.1142\/S1793962317500520"},{"key":"S2301385023410029BIB030","doi-asserted-by":"publisher","DOI":"10.1016\/j.ast.2020.105996"},{"key":"S2301385023410029BIB031","doi-asserted-by":"publisher","DOI":"10.23919\/JSEE.2020.000048"},{"issue":"6","key":"S2301385023410029BIB032","first-page":"224","volume":"16","author":"Shalumov V.","year":"2019","journal-title":"J. Aerosp. Inf. Syst."},{"key":"S2301385023410029BIB033","doi-asserted-by":"publisher","DOI":"10.1142\/S2737480721500059"},{"key":"S2301385023410029BIB034","doi-asserted-by":"publisher","DOI":"10.1142\/S2301385021500187"},{"key":"S2301385023410029BIB035","first-page":"2085","volume-title":"Proc. 17th Int. Conf. Autonomous Agents and MultiAgent Systems","author":"Sunehag P.","year":"2018"}],"container-title":["Unmanned Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S2301385023410029","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,13]],"date-time":"2023-02-13T08:37:59Z","timestamp":1676277479000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S2301385023410029"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,17]]},"references-count":35,"journal-issue":{"issue":"03","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1142\/S2301385023410029"],"URL":"https:\/\/doi.org\/10.1142\/s2301385023410029","relation":{},"ISSN":["2301-3850","2301-3869"],"issn-type":[{"value":"2301-3850","type":"print"},{"value":"2301-3869","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,17]]}}}