{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T21:51:55Z","timestamp":1781819515293,"version":"3.54.5"},"reference-count":48,"publisher":"Wiley","issue":"10","license":[{"start":{"date-parts":[[2024,4,21]],"date-time":"2024-04-21T00:00:00Z","timestamp":1713657600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,4,21]],"date-time":"2024-04-21T00:00:00Z","timestamp":1713657600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["61932012"],"award-info":[{"award-number":["61932012"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100017596","name":"Natural Science Basic Research Program of Shaanxi Province","doi-asserted-by":"publisher","award":["2022JQ\u2010061"],"award-info":[{"award-number":["2022JQ\u2010061"]}],"id":[{"id":"10.13039\/501100017596","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2025,10]]},"abstract":"<jats:p>Decision\u2010making in unmanned combat aerial vehicles (UCAVs) presents a multifaceted challenge because of the complexity and dynamics of the flight environment, which leads to hurdles in training convergence, low decision validity, and the dimensionality catastrophe for decision\u2010making neural networks. A novel framework is proposed to address breaking down the complicated decision issues, which combines the strengths of graph convolutional networks in relation extraction with the ability of hierarchical reinforcement learning. To solve the problem of decision validity under high\u2010dimensional inputs, the joint framework is applied to the Maneuver Intent's decision, and a maneuver library\u2010based state space design method is suggested. The joint framework executes adaptable strategies and flight maneuvers to address the issue of training non\u2010convergence or task failure due to difficult\u2010to\u2010obtain reward signals across various scenarios. Then, the recurrent curriculum training and cross\u2010entropy rewards are designed to train decisions on different sub\u2010strategies. The experimental evaluation demonstrated more flexibility and adaptability in decision\u2010making problems under complex tasks compared to rule\u2010based and reinforcement learning baseline methods. The method proposed in this article provides a novel approach to resolving intricate decision problems, and which has certain theoretical significance and reference value for engineering applications.<\/jats:p>","DOI":"10.1002\/aisy.202300574","type":"journal-article","created":{"date-parts":[[2024,4,21]],"date-time":"2024-04-21T15:09:11Z","timestamp":1713712151000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Joint Situational Assessment\u2010Hierarchical Decision\u2010Making Framework for Maneuver Intent Decisions"],"prefix":"10.1002","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7565-6595","authenticated-orcid":false,"given":"Ruihai","family":"Chen","sequence":"first","affiliation":[{"name":"School of Aeronautics Northwestern Polytechnical University  Xi'an 710072 P. R. China"},{"name":"Chengdu Aircraft Design and Research Institute  Cheng du 610041 P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Li","sequence":"additional","affiliation":[{"name":"Chengdu Aircraft Design and Research Institute  Cheng du 610041 P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanwei","family":"Yan","sequence":"additional","affiliation":[{"name":"Chengdu Aircraft Design and Research Institute  Cheng du 610041 P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7001-4747","authenticated-orcid":false,"given":"Haojie","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Aeronautics Northwestern Polytechnical University  Xi'an 710072 P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2833-3387","authenticated-orcid":false,"given":"Qian","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Aeronautics Northwestern Polytechnical University  Xi'an 710072 P. R. China"},{"name":"Chengdu Aircraft Design and Research Institute  Cheng du 610041 P. R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,4,21]]},"reference":[{"key":"e_1_2_13_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3060426"},{"key":"e_1_2_13_3_1","doi-asserted-by":"publisher","DOI":"10.3390\/aerospace9110658"},{"key":"e_1_2_13_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ast.2022.108031"},{"key":"e_1_2_13_5_1","doi-asserted-by":"publisher","DOI":"10.1049\/cth2.12413"},{"key":"e_1_2_13_6_1","doi-asserted-by":"crossref","unstructured":"H.Piao Z.Sun G.Meng H.Chen B.Qu K.Lang Y.Sun S.Yang X.Peng in2020 Inter. Joint Conf. on Neural Networks (IJCNN) IEEE Glasgow United Kingdom2020 pp.1\u20138 https:\/\/doi.org\/10.1109\/IJCNN48605.2020.9207088.","DOI":"10.1109\/IJCNN48605.2020.9207088"},{"key":"e_1_2_13_7_1","doi-asserted-by":"crossref","unstructured":"C.Qian X.Zhang L.Li M.Zhao Y.Fang H3e: Learning Air Combat with a Three\u2010Level Hierarchical Framework Embedding Expert Knowledge; preprint; SSRN 2023.https:\/\/doi.org\/10.2139\/ssrn.4454247.","DOI":"10.2139\/ssrn.4454247"},{"key":"e_1_2_13_8_1","first-page":"118","volume":"98","author":"Dietterich T. G.","year":"1998","journal-title":"ICML"},{"key":"e_1_2_13_9_1","doi-asserted-by":"crossref","unstructured":"Y.Han H.Piao Y.Hou Y.Sun Z.Sun D.Zhou S.Yang X.Peng S.Fan in2022 Inter. Joint Conf. on Neural Networks (IJCNN) IEEE Padua Italy2022 pp.1\u20138 https:\/\/doi.org\/10.1109\/IJCNN55064.2022.9892208.","DOI":"10.1109\/IJCNN55064.2022.9892208"},{"key":"e_1_2_13_10_1","unstructured":"a)A. S.Vezhnevets S.Osindero T.Schaul N.Heess M.Jaderberg D.Silver K.Kavukcuoglu in34th I nternational Conference on Machine Learning Sydney NSW AustraliaPMLR2017 pp.3540\u20133549;"},{"key":"e_1_2_13_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.119285"},{"key":"e_1_2_13_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2023.3250819"},{"key":"e_1_2_13_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3070835"},{"key":"e_1_2_13_13_1","unstructured":"T. N.Kipf M.Welling Semi\u2010Supervised Classification with Graph Convolutional Networks. arXiv February 22 2017.http:\/\/arxiv.org\/abs\/1609.02907(accessed: 04 May 2023)."},{"key":"e_1_2_13_14_1","unstructured":"M.Defferrard X.Bresson P.Vandergheynst Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering."},{"key":"e_1_2_13_15_1","unstructured":"P.Zhang N.Chen S.Li K.\u2010K. R.Choo C.Jiang Multi\u2010Domain Virtual Network Embedding Algorithm Based on Horizontal Federated Learning. arXiv May 29 2022.http:\/\/arxiv.org\/abs\/2205.14665(accessed 02 May 2023)."},{"key":"e_1_2_13_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2022.3219407"},{"key":"e_1_2_13_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAI.2022.3222143"},{"key":"e_1_2_13_18_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-21756-6"},{"key":"e_1_2_13_19_1","doi-asserted-by":"publisher","DOI":"10.1155\/2023\/3657814"},{"key":"e_1_2_13_20_1","unstructured":"K.Frans J.Ho X.Chen P.Abbeel J.Schulman Meta Learning Shared Hierarchies. arXiv October 26 2017.http:\/\/arxiv.org\/abs\/1710.09767(accessed: 20 February 2023)."},{"key":"e_1_2_13_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(98)00023-X"},{"key":"e_1_2_13_22_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics11030467"},{"key":"e_1_2_13_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/1687814020936790"},{"key":"e_1_2_13_24_1","doi-asserted-by":"crossref","unstructured":"L.Li Z.Zhou J.Chai Z.Liu Y.Zhu J.Yi in2022 IEEE Conf. Games (CoG) IEEE Beijing China2022 pp.616\u2013619.https:\/\/doi.org\/10.1109\/CoG51982.2022.9893690.","DOI":"10.1109\/CoG51982.2022.9893690"},{"key":"e_1_2_13_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dt.2022.08.010"},{"key":"e_1_2_13_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2010.2044997"},{"key":"e_1_2_13_27_1","doi-asserted-by":"publisher","DOI":"10.5139\/IJASS.2016.17.2.204"},{"key":"e_1_2_13_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dt.2021.01.005"},{"key":"e_1_2_13_29_1","doi-asserted-by":"crossref","unstructured":"J.\u2010S.Ha H.\u2010J.Chae H.\u2010L.Choi in2015 American Control Conf. (ACC) IEEE Chicago IL USA2015 pp.3728\u20133733 https:\/\/doi.org\/10.1109\/ACC.2015.7171909.","DOI":"10.1109\/ACC.2015.7171909"},{"key":"e_1_2_13_30_1","doi-asserted-by":"crossref","unstructured":"M.Revay M.Liska in2017 Communication and Information Technologies (KIT) IEEE Vysoke Tatry2017 pp.1\u20134 https:\/\/doi.org\/10.23919\/KIT.2017.8109463.","DOI":"10.23919\/KIT.2017.8109463"},{"key":"e_1_2_13_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.08.020"},{"key":"e_1_2_13_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2009.01.005"},{"key":"e_1_2_13_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/JAS.2021.1004311"},{"key":"e_1_2_13_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.2978386"},{"key":"e_1_2_13_35_1","doi-asserted-by":"crossref","unstructured":"Q.Li W.Jiang C.Liu J.He in2020 12th Inter. Conf. on Intelligent Human\u2010Machine Systems and Cybernetics (IHMSC) IEEE Hangzhou China2020 pp.122\u2013125 https:\/\/doi.org\/10.1109\/IHMSC49165.2020.10106.","DOI":"10.1109\/IHMSC49165.2020.10106"},{"key":"e_1_2_13_36_1","doi-asserted-by":"crossref","unstructured":"G.Comanici D.Precup inProc. of the 9th Inter. Conf. on Autonomous Agents and Multiagent Systems: AAMAS\u2010Volume 2 Toronto Canada2010 pp.709\u2013714.","DOI":"10.65109\/VUYE5463"},{"key":"e_1_2_13_37_1","first-page":"6708","volume":"33","author":"Wen Z.","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"e_1_2_13_38_1","doi-asserted-by":"publisher","DOI":"10.3390\/drones6070166"},{"key":"e_1_2_13_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(99)00052-1"},{"key":"e_1_2_13_40_1","unstructured":"Y.Duan X.Chen R.Houthooft J.Schulman P.Abbeel Benchmarking Deep Reinforcement Learning for Continuous Control."},{"key":"e_1_2_13_41_1","unstructured":"M.Fey J. E.Lenssen Fast Graph Representation Learning with PyTorch Geometric. arXiv April 25 2019 http:\/\/arxiv.org\/abs\/1903.02428(accessed: 16 April 2023)."},{"key":"e_1_2_13_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dt.2021.04.009"},{"key":"e_1_2_13_43_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"e_1_2_13_44_1","doi-asserted-by":"crossref","unstructured":"A.Wang S.Zhao Z.Shi J.Wang in2022 4th Inter. Conf. on Data\u2010driven Optimization of Complex Systems (DOCS) IEEE Chengdu China2022 pp.1\u20136 https:\/\/doi.org\/10.1109\/DOCS55193.2022.9967482.","DOI":"10.1109\/DOCS55193.2022.9967482"},{"key":"e_1_2_13_45_1","doi-asserted-by":"crossref","unstructured":"S.Narvekar J.Sinapov P.Stone inProc. of the Twenty\u2010Sixth Inter. Joint Conf. on Artificial Intelligence International Joint Conference on Artificial Intelligence Organization Melbourne Australia2017 pp.2536\u20132542 https:\/\/doi.org\/10.24963\/ijcai.2017\/353.","DOI":"10.24963\/ijcai.2017\/353"},{"key":"e_1_2_13_46_1","unstructured":"H.Zhao O.Stretcu A. J.Smola G. J.Gordon inProc. of 35 Conf. on Uncertainty in Artificial Intelligence PMLR Tel Aviv Israel July2019 pp.777\u2013787."},{"key":"e_1_2_13_47_1","doi-asserted-by":"crossref","unstructured":"Y.Jiang J.Yu Q.Li in2022 37th Youth Academic Annual Conf. of Chinese Association of Automation (YAC) IEEE Beijing China2022 pp.516\u2013521 https:\/\/doi.org\/10.1109\/YAC57282.2022.10023870.","DOI":"10.1109\/YAC57282.2022.10023870"},{"key":"e_1_2_13_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2020.104112"}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202300574","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/aisy.202300574","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202300574","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T20:56:41Z","timestamp":1781816201000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202300574"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,21]]},"references-count":48,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2025,10]]}},"alternative-id":["10.1002\/aisy.202300574"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202300574","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"value":"2640-4567","type":"print"},{"value":"2640-4567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,21]]},"assertion":[{"value":"2023-09-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2300574"}}