{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,15]],"date-time":"2026-08-15T08:39:58Z","timestamp":1786783198021,"version":"3.56.0"},"reference-count":36,"publisher":"American Institute of Aeronautics and Astronautics (AIAA)","issue":"8","content-domain":{"domain":["arc.aiaa.org"],"crossmark-restriction":true},"short-container-title":["Journal of Aerospace Information Systems"],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:p> The development of remote sensing satellite constellations has created an increasing need for periodic observations of ground targets. At present, the research on periodic observation is not sufficient, and the multisatellite scheduling algorithm based on deep reinforcement learning (DRL) is still relatively few and is trained inefficiently. In this paper, a periodic observation mission planning (POMP) algorithm is proposed for the periodic Earth observation scheduling problem. The POMP is based on the encoder\/decoder architecture. First, static and dynamic attributes of the observation task and satellite are encoded using three convolutional networks in the encoder and decoder. Second, an additive attention mechanism is employed to calculate the probability of each observation task being selected. Third, the model is trained with the REINFORCE with rollout baseline algorithm. Experimental results in various scenarios show that both training with the REINFORCE with rollout baseline algorithm and encoding dynamic attributes of the satellite as part of the step context vector are effective. The proposed POMP can maintain the gap with the ant colony optimization (ACO) algorithm in weight degree of timeout (WDT) and total timeout within 0.7% and 1.5\u00a0h, respectively, while having a tens of seconds advantage over ACO in terms of computational time. <\/jats:p>","DOI":"10.2514\/1.i011209","type":"journal-article","created":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T11:49:53Z","timestamp":1683719393000},"page":"508-519","update-policy":"https:\/\/doi.org\/10.2514\/aiaa_crossmarkpolicy","source":"Crossref","is-referenced-by-count":11,"title":["Deep Reinforcement Learning-Based Periodic Earth Observation Scheduling for Agile Satellite Constellation"],"prefix":"10.2514","volume":"20","author":[{"given":"Xin","family":"Wang","sequence":"first","affiliation":[{"name":"Zhejiang University, 310027 Hangzhou, People\u2019s Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fanyu","family":"Zhao","sequence":"additional","affiliation":[{"name":"Zhejiang University, 310027 Hangzhou, People\u2019s Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhong","family":"Shi","sequence":"additional","affiliation":[{"name":"Zhejiang University, 310027 Hangzhou, People\u2019s Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhonghe","family":"Jin","sequence":"additional","affiliation":[{"name":"Zhejiang University, 310027 Hangzhou, People\u2019s Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1387","reference":[{"key":"r1","first-page":"1","volume-title":"Proceedings of the International Symposium on AI","author":"Lema\u00eetre M.","year":"2000"},{"key":"r2","doi-asserted-by":"publisher","DOI":"10.1016\/S1270-9638(02)01173-2"},{"key":"r3","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2009.11.012"},{"key":"r4","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2017.04.006"},{"key":"r5","doi-asserted-by":"publisher","DOI":"10.1109\/TAES.2020.2966902"},{"key":"r6","first-page":"2692","volume-title":"Advances in Neural Information Processing Systems","volume":"2015","author":"Vinyals O.","year":"2015"},{"key":"r11","unstructured":"ManchandaS.MittalA.DhawanA.MedyaS.RanuS.SinghA. K. \u201cLearning Heuristics over Large Graphs via Deep Reinforcement Learning,\u201d arXiv preprint arXiv:1903.03332, 2019, https:\/\/arxiv.org\/abs\/1903.03332."},{"key":"r14","doi-asserted-by":"publisher","DOI":"10.2514\/1.I010754"},{"key":"r15","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2020.3020732"},{"issue":"2","key":"r16","first-page":"395","volume":"55","author":"Ma Y.","year":"2021","journal-title":"Journal of Zhejiang University (Engineering Science)"},{"issue":"6","key":"r17","first-page":"1215","volume":"55","author":"Ma Y.","year":"2021","journal-title":"Journal of Zhejiang University (Engineering Science)"},{"key":"r18","doi-asserted-by":"publisher","DOI":"10.3390\/rs13122377"},{"key":"r19","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2021.107607"},{"key":"r20","doi-asserted-by":"publisher","DOI":"10.1016\/j.ast.2008.01.001"},{"key":"r22","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2011.02.015"},{"key":"r23","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2013.02.009"},{"key":"r24","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.12.039"},{"key":"r25","doi-asserted-by":"publisher","DOI":"10.1016\/j.asr.2017.11.010"},{"key":"r26","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2005.12.026"},{"key":"r27","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2018.06.020"},{"key":"r28","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2019.2934148"},{"key":"r29","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(02)00382-X"},{"issue":"1","key":"r30","first-page":"24","volume":"179","author":"Bonnet G.","year":"2008","journal-title":"Frontiers in Artificial Intelligence and Applications"},{"key":"r32","doi-asserted-by":"publisher","DOI":"10.1016\/j.actaastro.2018.11.001"},{"key":"r33","doi-asserted-by":"publisher","DOI":"10.1016\/j.asr.2021.09.003"},{"key":"r35","doi-asserted-by":"publisher","DOI":"10.1016\/j.ast.2021.107047"},{"key":"r36","doi-asserted-by":"publisher","DOI":"10.1016\/j.asr.2022.08.016"},{"key":"r37","unstructured":"GuoY., The Study on Key Technologies of Multiple Types of Earth Observating Satellites United Scheduling, National Univ. of Defense Technology, Changsha, 2009, pp. 84\u2013103."},{"key":"r38","unstructured":"PangZ., Research on Collaborative Mission Scheduling Methods of High-Orbit and Low-Orbit Earth Observation Satellites, Harbin Inst. of Technology, Harbin, 2013, pp. 41\u201347."},{"key":"r39","unstructured":"WangL., Model and Method of Periodic Observation Task Scheduling for Networked Satellites, National Univ. of Defense Technology, Changsha, 2017, pp. 17\u201329."},{"key":"r40","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2007.892759"},{"issue":"11","key":"r41","first-page":"2521","volume":"47","author":"Kai-Wen L.","year":"2021","journal-title":"Acta Automatica Sinica"},{"key":"r42","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21428"},{"key":"r43","doi-asserted-by":"publisher","DOI":"10.2514\/1.12923"},{"key":"r45","doi-asserted-by":"publisher","DOI":"10.1016\/j.asr.2020.02.018"},{"key":"r46","unstructured":"SuttonR. S.BartoA. G., Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 2018, pp. 326\u2013329."}],"container-title":["Journal of Aerospace Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I011209","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T00:34:56Z","timestamp":1694651696000},"score":1,"resource":{"primary":{"URL":"https:\/\/arc.aiaa.org\/doi\/10.2514\/1.I011209"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":36,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["10.2514\/1.I011209"],"URL":"https:\/\/doi.org\/10.2514\/1.i011209","relation":{},"ISSN":["1940-3151","2327-3097"],"issn-type":[{"value":"1940-3151","type":"print"},{"value":"2327-3097","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8]]},"assertion":[{"value":"2022-10-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-18","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}