{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T07:36:02Z","timestamp":1768030562306,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":19,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T00:00:00Z","timestamp":1687305600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,21]]},"DOI":"10.1145\/3573900.3593631","type":"proceedings-article","created":{"date-parts":[[2023,6,5]],"date-time":"2023-06-05T10:08:54Z","timestamp":1685959734000},"page":"48-49","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Autonomous Agent for Beyond Visual Range Air Combat: A Deep Reinforcement Learning Approach"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0300-8027","authenticated-orcid":false,"given":"Joao P. A.","family":"Dantas","sequence":"first","affiliation":[{"name":"Decision Support Systems Subdivision, Institute for Advanced Studies, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2944-4476","authenticated-orcid":false,"given":"Marcos R. O. A.","family":"Maximo","sequence":"additional","affiliation":[{"name":"Autonomous Computational System Lab, Aeronautics Institute of Technology, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5375-1076","authenticated-orcid":false,"given":"Takashi","family":"Yoneyama","sequence":"additional","affiliation":[{"name":"Electronic Engineering Division, Aeronautics Institute of Technology, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,6,21]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Machine Learning. PMLR, 449\u2013458","author":"Bellemare G","year":"2017","unstructured":"Marc\u00a0 G Bellemare , Will Dabney , and R\u00e9mi Munos . 2017 . A distributional perspective on reinforcement learning . In International Conference on Machine Learning. PMLR, 449\u2013458 . Marc\u00a0G Bellemare, Will Dabney, and R\u00e9mi Munos. 2017. A distributional perspective on reinforcement learning. In International Conference on Machine Learning. PMLR, 449\u2013458."},{"key":"e_1_3_2_1_2_1","unstructured":"Joao P.\u00a0A. Dantas. 2018. Apoio \u00e0 Decis\u00e3o para o Combate A\u00e9reo Al\u00e9m do Alcance Visual: Uma Abordagem por Redes Neurais Artificiais. Master\u2019s Thesis. Instituto Tecnol\u00f3gico de Aeron\u00e1utica S\u00e3o Jos\u00e9 dos Campos SP Brazil.  Joao P.\u00a0A. Dantas. 2018. Apoio \u00e0 Decis\u00e3o para o Combate A\u00e9reo Al\u00e9m do Alcance Visual: Uma Abordagem por Redes Neurais Artificiais. Master\u2019s Thesis. Instituto Tecnol\u00f3gico de Aeron\u00e1utica S\u00e3o Jos\u00e9 dos Campos SP Brazil."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/LARS\/SBR\/WRE54079.2021.9605380"},{"key":"e_1_3_2_1_4_1","volume-title":"Weapon Engagement Zone Maximum Launch Range Estimation Using a Deep Neural Network","author":"Dantas Joao","unstructured":"Joao P.\u00a0A. Dantas , Andre\u00a0 N. Costa , Diego Geraldo , Marcos R. O.\u00a0A. Maximo , and Takashi Yoneyama . 2021. Weapon Engagement Zone Maximum Launch Range Estimation Using a Deep Neural Network . In Intelligent Systems, Andr\u00e9 Britto and Karina Valdivia\u00a0Delgado (Eds.). Springer , Cham , 193\u2013207. Joao P.\u00a0A. Dantas, Andre\u00a0N. Costa, Diego Geraldo, Marcos R. O.\u00a0A. Maximo, and Takashi Yoneyama. 2021. Weapon Engagement Zone Maximum Launch Range Estimation Using a Deep Neural Network. In Intelligent Systems, Andr\u00e9 Britto and Karina Valdivia\u00a0Delgado (Eds.). Springer, Cham, 193\u2013207."},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 20th International Conference on Scientific Computing. 25th\u201328th","author":"Dantas Joao","year":"2022","unstructured":"Joao P.\u00a0A Dantas , Andre\u00a0 N. Costa , Vitor C.\u00a0F. Gomes , Andre\u00a0 R. Kuroswiski , Felipe L.\u00a0L. Medeiros , and Diego Geraldo . 2022 . ASA: A Simulation Environment for Evaluating Military Operational Scenarios . In Proceedings of the 20th International Conference on Scientific Computing. 25th\u201328th , Las Vegas, NV, USA. Joao P.\u00a0A Dantas, Andre\u00a0N. Costa, Vitor C.\u00a0F. Gomes, Andre\u00a0R. Kuroswiski, Felipe L.\u00a0L. Medeiros, and Diego Geraldo. 2022. ASA: A Simulation Environment for Evaluating Military Operational Scenarios. In Proceedings of the 20th International Conference on Scientific Computing. 25th\u201328th, Las Vegas, NV, USA."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/3586210.3586376"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TLA.2022.9853232"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3390\/machines10111033"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11796"},{"key":"e_1_3_2_1_10_1","volume-title":"Promise and reality: Beyond visual range (BVR) air-to-air combat","author":"Higby Col\u00a0Patrick","year":"1945","unstructured":"Lt\u00a0 Col\u00a0Patrick Higby and USAF Col . 2005. Promise and reality: Beyond visual range (BVR) air-to-air combat . Air War College (AWC) Electives Program : Air Power Theory, Doctrine, and Strategy: 1945 \u2013Present 30 (2005). Lt\u00a0Col\u00a0Patrick Higby and USAF Col. 2005. Promise and reality: Beyond visual range (BVR) air-to-air combat. Air War College (AWC) Electives Program: Air Power Theory, Doctrine, and Strategy: 1945\u2013Present 30 (2005)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3060426"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics11030467"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.3390\/aerospace9100563"},{"key":"e_1_3_2_1_14_1","volume-title":"Human-level control through deep reinforcement learning. Nature 518, 7540","author":"Mnih Volodymyr","year":"2015","unstructured":"Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Andrei\u00a0 A Rusu , Joel Veness , Marc\u00a0 G Bellemare , Alex Graves , Martin Riedmiller , Andreas\u00a0 K Fidjeland , Georg Ostrovski , 2015. Human-level control through deep reinforcement learning. Nature 518, 7540 ( 2015 ), 529\u2013533. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei\u00a0A Rusu, Joel Veness, Marc\u00a0G Bellemare, Alex Graves, Martin Riedmiller, Andreas\u00a0K Fidjeland, Georg Ostrovski, 2015. Human-level control through deep reinforcement learning. Nature 518, 7540 (2015), 529\u2013533."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN48605.2020.9207088"},{"key":"e_1_3_2_1_16_1","volume-title":"Prioritized Experience Replay. arXiv preprint arXiv:1511.05952","author":"Schaul Tom","year":"2015","unstructured":"Tom Schaul , John Quan , Ioannis Antonoglou , and David Silver . 2015. Prioritized Experience Replay. arXiv preprint arXiv:1511.05952 ( 2015 ). Tom Schaul, John Quan, Ioannis Antonoglou, and David Silver. 2015. Prioritized Experience Replay. arXiv preprint arXiv:1511.05952 (2015)."},{"key":"e_1_3_2_1_17_1","volume-title":"International Conference on Machine Learning. PMLR","author":"Wang Ziyu","year":"2015","unstructured":"Ziyu Wang , Tom Schaul , Matteo Hessel , Hado van Hasselt , Marc Lanctot , and Nando de Freitas . 2015 . Dueling network architectures for deep reinforcement learning . In International Conference on Machine Learning. PMLR , 1995\u20132003. Ziyu Wang, Tom Schaul, Matteo Hessel, Hado van Hasselt, Marc Lanctot, and Nando de Freitas. 2015. Dueling network architectures for deep reinforcement learning. In International Conference on Machine Learning. PMLR, 1995\u20132003."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/app122010230"},{"key":"e_1_3_2_1_19_1","volume-title":"Autonomous maneuver decision-making method based on reinforcement learning and Monte Carlo tree search. Frontiers in Neurorobotics","author":"Zhang Hongpeng","year":"2022","unstructured":"Hongpeng Zhang , Huan Zhou , Yujie Wei , and Changqiang Huang . 2022. Autonomous maneuver decision-making method based on reinforcement learning and Monte Carlo tree search. Frontiers in Neurorobotics ( 2022 ). Hongpeng Zhang, Huan Zhou, Yujie Wei, and Changqiang Huang. 2022. Autonomous maneuver decision-making method based on reinforcement learning and Monte Carlo tree search. Frontiers in Neurorobotics (2022)."}],"event":{"name":"SIGSIM-PADS '23: SIGSIM Conference on Principles of Advanced Discrete Simulation","location":"Orlando FL USA","acronym":"SIGSIM-PADS '23","sponsor":["SIGSIM ACM Special Interest Group on Simulation and Modeling"]},"container-title":["ACM SIGSIM Conference on Principles of Advanced Discrete Simulation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3573900.3593631","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:21Z","timestamp":1750182561000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3573900.3593631"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,21]]},"references-count":19,"alternative-id":["10.1145\/3573900.3593631","10.1145\/3573900"],"URL":"https:\/\/doi.org\/10.1145\/3573900.3593631","relation":{},"subject":[],"published":{"date-parts":[[2023,6,21]]},"assertion":[{"value":"2023-06-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}