{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T15:04:00Z","timestamp":1784300640986,"version":"3.55.0"},"reference-count":20,"publisher":"American Institute of Aeronautics and Astronautics (AIAA)","issue":"8","content-domain":{"domain":["arc.aiaa.org"],"crossmark-restriction":true},"short-container-title":["Journal of Aerospace Information Systems"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:p> This paper aims to examine the potential of using the emerging deep reinforcement learning techniques in missile guidance applications. To this end, a Markovian decision process that enables the application of reinforcement learning theory to solve the guidance problem is formulated. A heuristic way is used to shape a proper reward function that has tradeoff between guidance accuracy, energy consumption, and interception time. The state-of-the-art deep deterministic policy gradient algorithm is used to learn an action policy that maps the observed engagements states to a guidance command. Extensive empirical numerical simulations are performed to validate the proposed computational guidance algorithm. <\/jats:p>","DOI":"10.2514\/1.i010970","type":"journal-article","created":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T09:13:24Z","timestamp":1624871604000},"page":"571-582","update-policy":"https:\/\/doi.org\/10.2514\/aiaa_crossmarkpolicy","source":"Crossref","is-referenced-by-count":63,"title":["Computational Missile Guidance: A Deep Reinforcement Learning Approach"],"prefix":"10.2514","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6432-5187","authenticated-orcid":false,"given":"Shaoming","family":"He","sequence":"first","affiliation":[{"name":"Beijing Institute of Technology, 100081 Beijing, People\u2019s Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9938-0370","authenticated-orcid":false,"given":"Hyo-Sang","family":"Shin","sequence":"additional","affiliation":[{"name":"Cranfield University, Cranfield, England MK43 0AL, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonios","family":"Tsourdos","sequence":"additional","affiliation":[{"name":"Cranfield University, Cranfield, England MK43 0AL, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1387","reference":[{"key":"r1","doi-asserted-by":"publisher","DOI":"10.2514\/4.868948"},{"key":"r2","doi-asserted-by":"publisher","DOI":"10.2514\/1.G003343"},{"issue":"8","key":"r3","first-page":"1887","volume":"39","author":"Jeon I. S.","year":"2019","journal-title":"Journal of Guidance, Control, and Dynamics"},{"key":"r4","doi-asserted-by":"publisher","DOI":"10.1109\/7.640285"},{"key":"r6","doi-asserted-by":"publisher","DOI":"10.2322\/tjsass.56.205"},{"key":"r7","doi-asserted-by":"publisher","DOI":"10.2514\/1.G002745"},{"key":"r8","doi-asserted-by":"publisher","DOI":"10.2514\/6.2020-3093"},{"key":"r9","doi-asserted-by":"publisher","DOI":"10.2514\/1.50821"},{"issue":"2","key":"r10","first-page":"399","volume":"5","author":"Padhi R.","year":"2009","journal-title":"International Journal of Innovative Computing, Information and Control"},{"key":"r11","doi-asserted-by":"publisher","DOI":"10.2514\/1.53647"},{"key":"r12","doi-asserted-by":"publisher","DOI":"10.2514\/1.61615"},{"key":"r13","doi-asserted-by":"publisher","DOI":"10.2514\/1.G003931"},{"key":"r15","doi-asserted-by":"publisher","DOI":"10.2514\/1.I010754"},{"key":"r16","doi-asserted-by":"publisher","DOI":"10.2514\/1.I010304"},{"key":"r17","doi-asserted-by":"publisher","DOI":"10.2514\/6.2012-4470"},{"key":"r18","doi-asserted-by":"publisher","DOI":"10.1016\/j.asr.2019.12.030"},{"key":"r21","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"r23","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2012.2218667"},{"key":"r25","doi-asserted-by":"publisher","DOI":"10.2514\/3.29539"},{"key":"r26","doi-asserted-by":"publisher","DOI":"10.2514\/1.G002201"}],"container-title":["Journal of Aerospace Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I010970","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T17:20:45Z","timestamp":1689355245000},"score":1,"resource":{"primary":{"URL":"https:\/\/arc.aiaa.org\/doi\/10.2514\/1.I010970"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8]]},"references-count":20,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2021,8]]}},"alternative-id":["10.2514\/1.I010970"],"URL":"https:\/\/doi.org\/10.2514\/1.i010970","relation":{},"ISSN":["1940-3151","2327-3097"],"issn-type":[{"value":"1940-3151","type":"print"},{"value":"2327-3097","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8]]},"assertion":[{"value":"2021-01-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-29","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-06-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}