{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T12:15:32Z","timestamp":1792412132896,"version":"4.4.0"},"reference-count":23,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T00:00:00Z","timestamp":1721692800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Traditional spacecraft attitude control often relies heavily on the dimension and mass information of the spacecraft. In active debris removal scenarios, these characteristics cannot be known beforehand because the debris can take any shape or mass. Additionally, it is not possible to measure the mass of the combined system of satellite and debris object in orbit. Therefore, it is crucial to develop an adaptive satellite attitude control that can extract mass information about the satellite system from other measurements. The authors propose using deep reinforcement learning (DRL) algorithms, employing stacked observations to handle widely varying masses. The satellite is simulated in Basilisk software, and the control performance is assessed using Monte Carlo simulations. The results demonstrate the benefits of DRL with stacked observations compared to a classical proportional\u2013integral\u2013derivative (PID) controller for the spacecraft attitude control. The algorithm is able to adapt, especially in scenarios with changing physical properties.<\/jats:p>","DOI":"10.3389\/frobt.2024.1402846","type":"journal-article","created":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T01:10:22Z","timestamp":1721697022000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Adaptive satellite attitude control for varying masses using deep reinforcement learning"],"prefix":"10.3389","volume":"11","author":[{"given":"Wiebke","family":"Retagne","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonas","family":"Dauer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G\u00fcnther","family":"Waxenegger-Wilfing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,7,23]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1380","DOI":"10.2514\/1.G003277","article-title":"Fully coupled reaction wheel static and dynamic imbalance for spacecraft jitter modeling","volume":"41","author":"Alcorn","year":"2018","journal-title":"J. Guid. Control, Dyn."},{"key":"B2","volume-title":"Reinforcement learning for spacecraft attitude control (70th International Astronautical Congress)","author":"Allison","year":"2019"},{"key":"B3","unstructured":"Autonomous vehicle systems\n          \n          \n          2023"},{"key":"B4","unstructured":"Basilisk\n          \n          \n          2024"},{"key":"B5","volume-title":"Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor","author":"Haarnoja","year":"2018"},{"key":"B6","unstructured":"Hr16 datasheet\n          \n          \n          2023"},{"key":"B7","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1016\/j.actaastro.2022.07.024","article-title":"A model predictive control for attitude stabilization and spin control of a spacecraft with a flexible rotating payload","volume":"199","author":"Iannelli","year":"2022","journal-title":"Acta Astronaut."},{"key":"B8","doi-asserted-by":"publisher","first-page":"0086","DOI":"10.34133\/space.0086","article-title":"Orbital interception pursuit strategy for random evasion using deep reinforcement learning","volume":"3","author":"Jiang","year":"2023","journal-title":"Space Sci. Technol."},{"key":"B9","unstructured":"Laboratory for atmospheric and space physics\n          \n          \n          2023"},{"key":"B10","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1093\/comjnl\/7.4.308","article-title":"A simplex method for function minimization","volume":"7","author":"Nelder","year":"1965","journal-title":"Comput. J."},{"key":"B11","unstructured":"Proximal policy optimization"},{"key":"B12","unstructured":"Soft actor-critic"},{"key":"B13","unstructured":"Algorithm\n          \n          \n          2023"},{"key":"B14","unstructured":"Algorithm\n          \n          \n          2023"},{"key":"B15","unstructured":"Algorithm\n          \n          \n          2023"},{"key":"B16","unstructured":"Reaction wheel scenario\n          \n          \n            \n              Schaub\n              H.\n            \n          \n          \n          2023"},{"key":"B17","volume-title":"Analytical mechanics of space systems","author":"Schaub","year":"2018"},{"key":"B18","volume-title":"Proximal policy optimization","author":"Schulman","year":"2017"},{"key":"B19","doi-asserted-by":"crossref","first-page":"1360","DOI":"10.1109\/ACC.2002.1023210","article-title":"Spacecraft robust attitude tracking design: pid control approach","volume-title":"Proceedings of the 2002 American control conference (IEEE cat. No.CH37301) 2","author":"Show","year":"2002"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.arcontrol.2022.07.004","article-title":"Reinforcement learning in spacecraft control applications: advances, prospects, and challenges","volume":"54","author":"Tipaldi","year":"2022","journal-title":"Annu. Rev. Control"},{"key":"B21","volume-title":"Fundamentals of astrodynamics and applications","author":"Vallado","year":"2001"},{"key":"B22","unstructured":"Vizard\n          \n          \n          2023"},{"key":"B23","doi-asserted-by":"publisher","first-page":"0047","DOI":"10.34133\/space.0047","article-title":"Optimal multi-impulse linear rendezvous via reinforcement learning","volume":"3","author":"Xu","year":"2023","journal-title":"Space Sci. Technol."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1402846\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T01:10:30Z","timestamp":1721697030000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1402846\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,23]]},"references-count":23,"alternative-id":["10.3389\/frobt.2024.1402846"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1402846","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,23]]},"article-number":"1402846"}}