{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T13:44:17Z","timestamp":1765547057971,"version":"3.41.2"},"reference-count":37,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005014","name":"Northrop Grumman","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005014","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Many real-world robotic applications such as search and rescue, disaster relief, and inspection operations are often set in unstructured environments with a restricted or unreliable communication infrastructure. In such environments, a multi-robot system must either be deployed to i) remain constantly connected, hence sacrificing operational efficiency or ii) allow disconnections considering when and how to regroup. In communication-restricted environments, we insist that the latter approach is desired to achieve a robust and predictable method for cooperative planning. One of the main challenges in achieving this goal is that optimal planning in partially unknown environments without communication requires an intractable sequence of possibilities. To solve this problem, we propose a novel epistemic planning approach for propagating beliefs about the system\u2019s states during communication loss to ensure cooperative operations. Typically used for discrete multi-player games or natural language processing, epistemic planning is a powerful representation of reasoning through events, actions, and belief revisions, given new information. Most robot applications use traditional planning to interact with their immediate environment and only consider knowledge of their own state. By including an epistemic notion in planning, a robot may enact depth-of-reasoning about the system\u2019s state, analyzing its beliefs about each robot in the system. In this method, a set of possible beliefs about other robots in the system are propagated using a Frontier-based planner to accomplish the coverage objective. As disconnections occur, each robot tracks beliefs about the system state and reasons about multiple objectives: i) coverage of the environment, ii) dissemination of new observations, and iii) possible information sharing from other robots. A task allocation optimization algorithm with gossip protocol is used in conjunction with the epistemic planning mechanism to locally optimize all three objectives, considering that in a partially unknown environment, the belief propagation may not be safe or possible to follow and that another robot may be attempting an information relay using the belief state. Results indicate that our framework performs better than the standard solution for communication restrictions and even shows similar performance to simulations with no communication limitations. Extensive experiments provide evidence of the framework\u2019s performance in real-world scenarios.<\/jats:p>","DOI":"10.3389\/frobt.2023.1149439","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T14:52:00Z","timestamp":1684853520000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Epistemic planning for multi-robot systems in communication-restricted environments"],"prefix":"10.3389","volume":"10","author":[{"given":"Lauren","family":"Bramblett","sequence":"first","affiliation":[]},{"given":"Nicola","family":"Bezzo","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,5,23]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ICRA48506.2021.9561711","article-title":"Active bayesian multi-class mapping from range and semantic segmentation observations","volume-title":"2021 IEEE international conference on robotics and automation (ICRA)","author":"Asgharivaskasi","year":"2021"},{"key":"B2","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/0010-0277(85)90022-8","article-title":"Does the autistic child have a \u201ctheory of mind\u201d","volume":"21","author":"Baron-Cohen","year":"1985","journal-title":"Cognition"},{"key":"B3","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA.2018.8460617","article-title":"Planning-aware communication for decentralised multi-robot coordination","author":"Best","year":"2018"},{"key":"B4","first-page":"120","article-title":"Del-based epistemic planning for human-robot collaboration: Theory and implementation","author":"Bolander","year":"2021"},{"key":"B5","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA48891.2023.10161553","article-title":"Epistemic prediction and planning with implicit coordination for multi-robot teams in communication restricted environment","author":"Bramblett","year":"2023"},{"key":"B6","doi-asserted-by":"crossref","DOI":"10.1109\/IROS47612.2022.9981898","article-title":"Coordinated multi-agent exploration, rendezvous, & task allocation in unknown environments with limited connectivity","author":"Bramblett","year":"2022"},{"key":"B7","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA40945.2020.9197109","article-title":"Connectivity maintenance: Global and optimized approach through control barrier functions","author":"Capelli","year":"2020"},{"key":"B8","doi-asserted-by":"crossref","DOI":"10.23919\/ECC.2019.8796034","article-title":"Ant-based multi-robot exploration in non-convex space without global-connectivity constraints","author":"Cardona","year":"2019"},{"key":"B9","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA.2015.7139494","article-title":"Multi-uav exploration with limited communication and battery","author":"Cesare","year":"2015"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1712","DOI":"10.1007\/s11227-021-03940-z","article-title":"Consensus-based bundle algorithm with local replanning for heterogeneous multi-uav system in the time-sensitive and dynamic environment","volume":"78","author":"Chen","year":"2022","journal-title":"J. Supercomput."},{"key":"B11","first-page":"268","article-title":"The next frontier: Combining information gain and distance cost for decentralized multi-robot exploration","author":"Colares","year":"2016"},{"key":"B12","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1109\/tra.2004.824698","article-title":"Coverage control for mobile sensing networks","volume":"20","author":"Cortes","year":"2004","journal-title":"IEEE Trans. robotics Automation"},{"key":"B13","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1007\/s11633-019-1187-6","article-title":"Hdec-posmdps mrs exploration and fire searching based on iot cloud robotics","volume":"17","author":"El Shenawy","year":"2020","journal-title":"Int. J. Automation Comput."},{"key":"B14","doi-asserted-by":"publisher","first-page":"1325","DOI":"10.1109\/jproc.2006.876927","article-title":"Distributed multirobot exploration and mapping","volume":"94","author":"Fox","year":"2006","journal-title":"Proc. IEEE"},{"key":"B15","doi-asserted-by":"publisher","first-page":"14413","DOI":"10.1109\/tvt.2020.3034800","article-title":"Voronoi-based multi-robot autonomous exploration in unknown environments via deep reinforcement learning","volume":"69","author":"Hu","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"B16","first-page":"052006","article-title":"Multi-robot task allocation for search and rescue missions","volume-title":"Journal of physics: Conference series","author":"Hussein","year":"2014"},{"key":"B17","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1007\/978-1-4613-8997-2_29","article-title":"Real-time obstacle avoidance for manipulators and mobile robots","volume-title":"Autonomous robot vehicles","author":"Khatib","year":"1986"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1813","DOI":"10.3390\/electronics9111813","article-title":"A multiplicatively weighted voronoi-based workspace partition for heterogeneous seeding robots","volume":"9","author":"Kim","year":"2020","journal-title":"Electronics"},{"key":"B19","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1145\/355588.365140","article-title":"Backus normal form vs. backus naur form","volume":"7","author":"Knuth","year":"1964","journal-title":"Commun. ACM"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1495","DOI":"10.1177\/0278364913496484","article-title":"A comprehensive taxonomy for multi-robot task allocation","volume":"32","author":"Korsah","year":"2013","journal-title":"Int. J. Robotics Res."},{"key":"B21","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1126\/science.aaf8110","article-title":"Great apes anticipate that other individuals will act according to false beliefs","volume":"354","author":"Krupenye","year":"2016","journal-title":"Science"},{"key":"B22","doi-asserted-by":"crossref","DOI":"10.1109\/CISCE50729.2020.00086","article-title":"Simulation research on pipeline map system based on multi-robot queue cooperation","author":"Kuang-wei","year":"2020"},{"key":"B23","doi-asserted-by":"publisher","first-page":"771520","DOI":"10.3389\/frobt.2021.771520","article-title":"Balancing collective exploration and exploitation in multi-agent and multi-robot systems: A review","volume":"8","author":"Kwa","year":"2022","journal-title":"Front. Robotics AI"},{"article-title":"An auction-based coordination strategy for task-constrained multi-agent stochastic planning with submodular rewards","year":"2022","author":"Liu","key":"B24"},{"key":"B25","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA.2018.8460759","article-title":"Heterogeneous multi-robot system for exploration and strategic water sampling","author":"Manjanna","year":"2018"},{"key":"B26","article-title":"Coordinated multi-robot exploration under communication constraints using decentralized markov decision processes","volume-title":"Twenty-sixth AAAI conference on artificial intelligence","author":"Matignon","year":"2012"},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.24963\/ijcai.2019\/71","article-title":"Reachability games in dynamic epistemic logic","author":"Maubert","year":"2019"},{"article-title":"Concurrent games in dynamic epistemic logic","year":"2021","author":"Maubert","key":"B28"},{"key":"B29","doi-asserted-by":"crossref","DOI":"10.1109\/SSRR.2014.7017662","article-title":"Aerial-guided navigation of a ground robot among movable obstacles","author":"Mueggler","year":"2014"},{"key":"B30","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v29i1.9440","article-title":"Multi-robot auctions for allocation of tasks with temporal constraints","author":"Nunes","year":"2015"},{"key":"B31","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1007\/s10514-019-09828-5","article-title":"Auctions for multi-robot task allocation in communication limited environments","volume":"44","author":"Otte","year":"2020","journal-title":"Aut. Robots"},{"key":"B32","doi-asserted-by":"publisher","first-page":"100469","DOI":"10.1016\/j.vehcom.2022.100469","article-title":"Task assignment algorithms for unmanned aerial vehicle networks: A comprehensive survey","volume":"35","author":"Poudel","year":"2022","journal-title":"Veh. Commun."},{"article-title":"Epistemic logic","year":"2019","author":"Rendsvig","key":"B33"},{"key":"B34","first-page":"506","article-title":"Evaluating sequential single-item auctions for dynamic task allocation","volume-title":"Australasian joint conference on artificial intelligence","author":"Schoenig","year":"2010"},{"volume-title":"Dynamic epistemic logic","year":"2007","author":"Van Ditmarsch","key":"B35"},{"key":"B36","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1609\/aimag.v35i4.2556","article-title":"Multirobot coordination for space exploration","volume":"35","author":"Yliniemi","year":"2014","journal-title":"AI Mag."},{"key":"B37","doi-asserted-by":"publisher","first-page":"11691","DOI":"10.1109\/tvt.2019.2948953","article-title":"Bayesian reinforcement learning for multi-robot decentralized patrolling in uncertain environments","volume":"68","author":"Zhou","year":"2019","journal-title":"IEEE Trans. Veh. Technol."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1149439\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,13]],"date-time":"2023-12-13T20:23:13Z","timestamp":1702498993000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1149439\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,23]]},"references-count":37,"alternative-id":["10.3389\/frobt.2023.1149439"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1149439","relation":{},"ISSN":["2296-9144"],"issn-type":[{"type":"electronic","value":"2296-9144"}],"subject":[],"published":{"date-parts":[[2023,5,23]]},"article-number":"1149439"}}