{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T19:16:16Z","timestamp":1781118976837,"version":"3.54.1"},"reference-count":10,"publisher":"American Institute of Aeronautics and Astronautics (AIAA)","issue":"7","license":[{"start":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T00:00:00Z","timestamp":1648512000000},"content-version":"am","delay-in-days":271,"URL":"https:\/\/www.aiaa.org\/userlicenses\/1.0\/#CompEndUserLicense"}],"funder":[{"DOI":"10.13039\/100006196","name":"Jet Propulsion Laboratory","doi-asserted-by":"publisher","award":["RSA No.\u00a01640005"],"award-info":[{"award-number":["RSA No.\u00a01640005"]}],"id":[{"id":"10.13039\/100006196","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["arc.aiaa.org"],"crossmark-restriction":true},"short-container-title":["Journal of Aerospace Information Systems"],"published-print":{"date-parts":[[2021,7]]},"abstract":"<jats:p> Delay tolerant networks (DTNs) offer a set of standardized protocols to enable Internet-like connectivity across the solar system. Unlike other protocols such as the Transmission Control Protocol (TCP) and the Internet Protocol (IP), DTN protocols are robust to end-to-end connection disruptions and long delays. Although the behavior of DTN core protocols is well understood, management of DTNs is still an area of active research. This paper uses reinforcement learning (RL) to automate the management of a DTN node consisting of an orbital relay between the moon and Earth. More specifically, the RL agent is in charge of deciding when to drop packets, when to change the data rate of the neighbor node links, when to reroute bundles to crosslinks, or when not to change any network parameter. The agent\u2019s goal is to maximize the bits received by the Deep Space Network while minimizing the capacity allocated to all controlled links, and control the buffer utilization to avoid memory overflows. To assess the potential of using RL in DTN management, the performance of the trained RL agent is benchmarked against other non-RL-based policies in a realistic lunar scenario. Results show that the RL agent provides the highest reward, outperforming all non-RL policies in this scenario. <\/jats:p>","DOI":"10.2514\/1.i010920","type":"journal-article","created":{"date-parts":[[2021,3,29]],"date-time":"2021-03-29T11:37:30Z","timestamp":1617017850000},"page":"404-416","update-policy":"https:\/\/doi.org\/10.2514\/aiaa_crossmarkpolicy","source":"Crossref","is-referenced-by-count":5,"title":["Autonomous Delay Tolerant Network Management Using Reinforcement Learning"],"prefix":"10.2514","volume":"18","author":[{"given":"Pau Garcia","family":"Buzzi","sequence":"first","affiliation":[{"name":"Texas A&M University, College Station, Texas 77840"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Selva","sequence":"additional","affiliation":[{"name":"Texas A&M University, College Station, Texas 77840"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc Sanchez","family":"Net","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, California 91109"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1387","reference":[{"key":"r1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2019.2916583"},{"key":"r3","doi-asserted-by":"publisher","DOI":"10.1109\/MAES.2014.130123"},{"key":"r8","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25959-3_37"},{"key":"r9","doi-asserted-by":"publisher","DOI":"10.1109\/LCOMM.2012.120312.122262"},{"key":"r10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-79995-2"},{"key":"r11","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"2018"},{"key":"r13","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"r20","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2828859"},{"key":"r22","doi-asserted-by":"publisher","DOI":"10.1109\/TCC.2015.2474406"},{"key":"r25","doi-asserted-by":"publisher","DOI":"10.2514\/6.2020-4007"}],"container-title":["Journal of Aerospace Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/arc.aiaa.org\/doi\/am-pdf\/10.2514\/1.I010920","content-type":"application\/pdf","content-version":"am","intended-application":"unspecified"},{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I010920","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I010920","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T17:19:22Z","timestamp":1689355162000},"score":1,"resource":{"primary":{"URL":"https:\/\/arc.aiaa.org\/doi\/10.2514\/1.I010920"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7]]},"references-count":10,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["10.2514\/1.I010920"],"URL":"https:\/\/doi.org\/10.2514\/1.i010920","relation":{},"ISSN":["1940-3151","2327-3097"],"issn-type":[{"value":"1940-3151","type":"print"},{"value":"2327-3097","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7]]},"assertion":[{"value":"2020-10-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-02-02","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-02-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}