{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T07:00:23Z","timestamp":1780470023654,"version":"3.54.1"},"reference-count":70,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T00:00:00Z","timestamp":1780444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>\n                    This paper focuses on\n                    <jats:italic>ad hoc teamwork<\/jats:italic>\n                    , the problem of enabling an AI agent to collaborate with other agents without prior coordination. Methods considered state of the art for\n                    <jats:italic>ad hoc<\/jats:italic>\n                    teamwork formulate it primarily as a learning problem, using a large labeled dataset of different situations to model the action choices of other agents (or agent\n                    <jats:italic>types<\/jats:italic>\n                    ) and determine the actions of the\n                    <jats:italic>ad hoc<\/jats:italic>\n                    agent. Such datasets are not readily available in practical domains, and these methods lack transparency and make it difficult to rapidly revise existing knowledge (or models) in response to changes in the domain, team composition, or agents' capabilities. Our architecture for\n                    <jats:italic>ad hoc<\/jats:italic>\n                    teamwork embeds the principles of refinement, ecological rationality, interactive learning, and explainable agency, leveraging the complementary strengths of knowledge-based and data-driven methods for reasoning and learning. Specifically, for any given goal, our architecture enables an\n                    <jats:italic>ad hoc<\/jats:italic>\n                    AI agent to determine its actions through non-monotonic logical reasoning with: (a) prior domain-specific commonsense knowledge; (b) models learned and revised rapidly to predict the behavior of other agents; and (c) anticipated abstract future goals based on generic knowledge of similar situations in a pretrained Large Language Model. In addition, the\n                    <jats:italic>ad hoc<\/jats:italic>\n                    agent processes natural language descriptions and observations of other agents' behavior, using a combination of a pretrained Large Language Model and decision-tree induction to incrementally acquire and revise knowledge in the form of objects, actions, and axioms that govern domain dynamics. Furthermore, the\n                    <jats:italic>ad hoc<\/jats:italic>\n                    agent generates relational descriptions as on-demand explanations of its decisions and beliefs, and those of other agents, in response to various types of questions. We ground and experimentally evaluate the capabilities of our architecture in\n                    <jats:italic>VirtualHome<\/jats:italic>\n                    , a realistic, physics-based 3D simulation environment. We demonstrate reliable, efficient, transparent, and scalable performance, providing a substantial improvement in performance compared with a purely knowledge-based baseline, and comparable or better performance than a purely data-driven baseline while using orders of magnitude fewer resources.\n                  <\/jats:p>","DOI":"10.3389\/frai.2026.1765191","type":"journal-article","created":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T06:00:55Z","timestamp":1780466455000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Collaborate and explain on-the-fly: knowledge-based reasoning and learning in ad hoc teamwork"],"prefix":"10.3389","volume":"9","author":[{"given":"Hasra","family":"Dodampegama","sequence":"first","affiliation":[{"name":"Institute of Perception","place":["Action and Behavior, School of Informatics, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohan","family":"Sridharan","sequence":"additional","affiliation":[{"name":"Institute of Perception","place":["Action and Behavior, School of Informatics, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,6,3]]},"reference":[{"key":"B1","article-title":"\u201cE-HBA: using action policies for expert advice and agent typification,\u201d","author":"Albrecht","year":"2015","journal-title":"Workshop on Multiagent Interaction without Prior Coordination at AAAI"},{"key":"B2","doi-asserted-by":"crossref","DOI":"10.65109\/BHXM6519","article-title":"\u201cA game-theoretic model and best-response learning method for ad hoc coordination in multiagent systems,\u201d","volume-title":"International Conference on Autonomous Agents and Multiagent Systems","author":"Albrecht","year":"2013"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.65109\/GDSI1069","article-title":"\u201cReasoning about hypothetical agent behaviors and their parameters,\u201d","author":"Albrecht","year":"2017","journal-title":"International Conference on Autonomous Agents and Multiagent Systems (AAMAS)"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.65109\/KCZB5817","article-title":"\u201cExplainable agents and robots: Results from a systematic literature review,\u201d","author":"Anjomshoae","year":"2019","journal-title":"International Conference on Autonomous Agents and Multiagent Systems, Montreal, Canada"},{"key":"B5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1146\/annurev-psych-120710-100422","article-title":"Working memory: theories, models, and controversies","volume":"63","author":"Baddeley","year":"2012","journal-title":"Ann. Rev. Psychol"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40564-8_14","article-title":"\u201cTowards answer set programming with sorts,\u201d","author":"Balai","year":"2013","journal-title":"Conference on Logic Programming and Nonmonotonic Reasoning"},{"key":"B7","article-title":"\u201cLogic programs with consistency-restoring rules,\u201d","author":"Balduccini","year":"2003","journal-title":"AAAI Spring Symposium on Logical Formalization of Commonsense Reasoning"},{"key":"B8","doi-asserted-by":"publisher","first-page":"103601","DOI":"10.1016\/j.artint.2021.103601","article-title":"An action language for multi-agent domains","volume":"302","author":"Baral","year":"2022","journal-title":"Artif. Intell"},{"key":"B9","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.artint.2016.10.005","article-title":"Making friends on the fly: cooperating with new teammates","volume":"242","author":"Barrett","year":"2017","journal-title":"Artif. Intell"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v27i1.8659","article-title":"\u201cTeamwork with limited knowledge of teammates,\u201d","author":"Barrett","year":"2013","journal-title":"AAAI Conference on Artificial Intelligence"},{"key":"B11","first-page":"53","article-title":"\u201cCoordination and adaptation in impromptu teams,\u201d","author":"Bowling","year":"2005","journal-title":"National Conference on Artificial Intelligence"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6196","article-title":"\u201cAATEAM: Achieving the ad hoc teamwork by employing the attention mechanism,\u201d","author":"Chen","year":"2020","journal-title":"AAAI"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v37i1.25070","article-title":"\u201cBack to the future: toward a hybrid architecture for ad hoc teamwork,\u201d","author":"Dodampegama","year":"","journal-title":"AAAI Conference on Artificial Intelligence"},{"key":"B14","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1007\/978-3-031-52038-9_12","article-title":"\u201cExplanation and knowledge acquisition in ad hoc teamwork,\u201d","author":"Dodampegama","year":"","journal-title":"Practical Aspects of Declarative Languages"},{"key":"B15","doi-asserted-by":"publisher","first-page":"696","DOI":"10.1017\/S1471068423000091","article-title":"Knowledge-based reasoning and learning under partial observability in ad hoc teamwork","volume":"23","author":"Dodampegama","year":"","journal-title":"Theory Pract. Logic Progr"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-74209-5_26","article-title":"\u201cReasoning and explanation generation in ad hoc collaboration between humans and embodied AI,\u201d","author":"Dodampegama","year":"2024","journal-title":"International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR), Dallas, USA"},{"key":"B17","doi-asserted-by":"crossref","DOI":"10.1145\/3772429.3772444","article-title":"\u201cReasoning with commonsense knowledge and decision heuristics for scalable ad hoc human-agent collaboration,\u201d","volume-title":"Distributed AI Conference (DAI)","author":"Dodampegama","year":""},{"key":"B18","article-title":"\u201cThinking together, apart: reasoning and learning in ad hoc teamwork,\u201d","author":"Dodampegama","year":"","journal-title":"Advances in Cognitive Systems Conference, Atlanta, USA"},{"key":"B19","unstructured":"Dodampegama\n              H.\n            \n            \n              Sridharan\n              M.\n            \n          \n          KAT-VH. GitHub Repository.\n          \n          2026"},{"key":"B20","doi-asserted-by":"publisher","author":"Ehsan","year":"2024","DOI":"10.1145\/3613904.3642474"},{"key":"B21","doi-asserted-by":"publisher","first-page":"3208","DOI":"10.3390\/app14083209","article-title":"Learning ad hoc cooperation policies from limited priors via meta-reinforcement learning","volume":"14","author":"Fang","year":"2024","journal-title":"Appl. Sci"},{"key":"B22","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1007\/978-3-030-87626-5_7","article-title":"\u201cExplanation as a process: user-centric construction of multi-level and multi-modal explanations,\u201d","author":"Finzel","year":"2021","journal-title":"KI 2021: Advances in Artificial Intelligence"},{"key":"B23","article-title":"\u201cExplainable planning,\u201d","author":"Fox","year":"2017","journal-title":"IJCAI Workshop on Explainable AI"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1080\/11663081.2013.798954","article-title":"\u201cSome properties of system descriptions of AL_d,\u201d","author":"Gelfond","year":"2013","journal-title":"Applied Non-Classical Logics, Special Issue on Equilibrium Logic and ASP"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139342124","author":"Gelfond","year":"2014","journal-title":"Knowledge Representation, Reasoning and the Design of Intelligent Agents"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1057\/9781137442505_3","author":"Gigerenzer","year":"2016","journal-title":"Towards a Rational Theory of Heuristics"},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.4324\/9781315658353-2","article-title":"\u201cWhat is bounded rationality?,\u201d","volume-title":"Routledge Handbook of Bounded Rationality","author":"Gigerenzer","year":"2020"},{"key":"B28","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1146\/annurev-psych-120709-145346","article-title":"Heuristic decision making","volume":"62","author":"Gigerenzer","year":"2011","journal-title":"Annu. Rev. Psychol"},{"key":"B29","doi-asserted-by":"publisher","first-page":"79081","DOI":"10.52202\/075280-3459","article-title":"\u201cLeveraging pre-trained large language models to construct and utilize world models for model-based task planning,\u201d","author":"Guan","year":"2023","journal-title":"Advances in Neural Information Processing Systems"},{"key":"B30","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1093\/bjps\/axi147","article-title":"Causes and explanations: a structural-model approach. Part i: Causes","volume":"56","author":"Halpern","year":"2005","journal-title":"Br. J. Philos. Sci"},{"key":"B31","article-title":"\u201cPosition: LLMs Can't plan, but can help planning in LLM-modulo frameworks,\u201d","author":"Kambhampati","year":"2024","journal-title":"International Conference on Machine Learning"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11790.001.0001","author":"Katsikopoulos","year":"2021","journal-title":"Classification in the Wild: The Science and Art of Transparent Decision Making"},{"key":"B33","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1109\/MIS.2017.3121552","article-title":"Interactive task learning","volume":"32","author":"Laird","year":"2017","journal-title":"IEEE Intell. Syst"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33019775","article-title":"\u201cExplainable, normative, and justified agency,\u201d","author":"Langley","year":"2019","journal-title":"AAAI Conference on Artificial Intelligence"},{"key":"B35","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v31i2.19108","article-title":"\u201cExplainable agency for intelligent autonomous systems,\u201d","volume-title":"Innovative Applications of Artificial Intelligence","author":"Langley","year":"2017"},{"key":"B36","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1016\/j.artint.2018.03.005","article-title":"The complexity and generality of learning answer set programs","volume":"259","author":"Law","year":"2018","journal-title":"Artif. Intell"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2024.XX.033","article-title":"\u201cLeveraging large language model for heterogeneous ad hoc teamwork collaboration,\u201d","author":"Liu","year":"2024","journal-title":"Robotics: Science and Systems, Delft, The Netherlands"},{"key":"B38","doi-asserted-by":"publisher","first-page":"5098","DOI":"10.18653\/v1\/2024.acl-long.279","article-title":"\u201cAre emergent abilities in large language models just in-context learning?,\u201d","author":"Lu","year":"2024","journal-title":"Annual Meeting of the Association for Computational Linguistics"},{"key":"B39","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1145\/219717.219748","article-title":"Wordnet: a lexical database for English","volume":"38","author":"Miller","year":"1995","journal-title":"Commun. ACM"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","article-title":"Explanations in artificial intelligence: insights from the social sciences","volume":"267","author":"Miller","year":"2019","journal-title":"Artif. Intell"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20614-6_16","article-title":"\u201cA survey of ad hoc teamwork: definitions, methods, and open problems,\u201d","author":"Mirsky","year":"2022","journal-title":"European Conference on Multiagent Systems"},{"key":"B42","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1007\/s42979-021-00573-0","article-title":"Integrated commonsense reasoning and deep learning for transparent decision making in robotics","volume":"2","author":"Mota","year":"2021","journal-title":"SN Comput. Sci"},{"key":"B43","article-title":"GPT-4 Technical Report","year":"2024","journal-title":"arXiv:2303.08774"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511803161","author":"Pearl","year":"2009","journal-title":"Causality"},{"key":"B45","author":"Pearl","year":"2018","journal-title":"The Book of Why"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00886","article-title":"\u201cVirtualhome: Simulating household activities via programs,\u201d","author":"Puig","year":"2018","journal-title":"International Conference on Computer Vision and Pattern Recognition"},{"key":"B47","year":""},{"key":"B48","first-page":"8776","article-title":"\u201cTowards open ad hoc teamwork using graph-based policy learning,\u201d","author":"Rahman","year":"2021","journal-title":"International Conference on Machine Learning"},{"key":"B49","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/0004-3702(87)90062-2","article-title":"A theory of diagnosis from first principles","volume":"32","author":"Reiter","year":"1987","journal-title":"Artif. Intell"},{"key":"B50","doi-asserted-by":"publisher","first-page":"104013","DOI":"10.1016\/j.artint.2023.104013","article-title":"Teamster: model-based reinforcement learning for ad hoc teamwork","volume":"324","author":"Ribeiro","year":"2023","journal-title":"Artif. Intell"},{"key":"B51","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nat. Mach. Intell"},{"key":"B52","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/21-SS133","article-title":"Interpretable machine learning: fundamental principles and 10 grand challenges","volume":"16","author":"Rudin","year":"2022","journal-title":"Stat. Surv"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-86230-5_51","article-title":"\u201cad hoc teamwork in the presence of non-stationary teammates,\u201d","author":"Santos","year":"2021","journal-title":"Progress in Artificial Intelligence"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00943","article-title":"\u201cHabitat: a platform for embodied ai research,\u201d","author":"Savva","year":"2019","journal-title":"IEEE\/CVF International Conference on Computer Vision (ICCV)"},{"key":"B55","author":"Shi","year":"2023"},{"key":"B56","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1037\/h0042769","article-title":"Rational choice and the structure of the environment","volume":"63","author":"Simon","year":"1956","journal-title":"Psychol. Rev"},{"key":"B57","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1007\/978-3-642-11355-0_13","article-title":"\u201cReasoning and planning with cooperative actions or multiagents using answer set programming,\u201d","author":"Son","year":"2010","journal-title":"Declarative Agent Languages and Technologies VII"},{"key":"B58","article-title":"\u201cIntegrated knowledge-based reasoning and data-driven learning for explainable agency in robotics,\u201d","volume-title":"Explainable Agency in Artificial Intelligence: Research and Practice","author":"Sridharan","year":"2024"},{"key":"B59","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v39i27.35085","article-title":"\u201cBack to the future of integrated robot systems,\u201d","volume-title":"AAAI Conference on Artificial Intelligence","author":"Sridharan","year":"2025"},{"key":"B60","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1613\/jair.1.11524","article-title":"REBA: a refinement-based architecture for knowledge representation and reasoning in robotics","volume":"65","author":"Sridharan","year":"2019","journal-title":"J. Artif. Intell. Res"},{"key":"B61","unstructured":"Knowledge representation and interactive learning of domain knowledge for human-robot collaboration\n          \n          77\n          96\n          \n            \n              Sridharan\n              M.\n            \n            \n              Meadows\n              B.\n            \n          \n          Adv. Cogn. Syst\n          7\n          2018"},{"key":"B62","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s13218-019-00616-y","article-title":"Towards a theory of explanations for human\u2013robot collaboration","volume":"33","author":"Sridharan","year":"2019","journal-title":"KI"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1609\/icaps.v27i1.13852","article-title":"\u201cWhat can i not do? Towards an architecture for reasoning about and learning affordances,\u201d","author":"Sridharan","year":"2017","journal-title":"International Conference on Automated Planning and Scheduling"},{"key":"B64","doi-asserted-by":"publisher","first-page":"1272","DOI":"10.1038\/nature04286","article-title":"Sleep-dependent memory consolidation","volume":"437","author":"Stickgold","year":"2005","journal-title":"Nature"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v24i1.7529","article-title":"\u201cad hoc autonomous agent teams: collaboration without pre-coordination,\u201d","author":"Stone","year":"2010","journal-title":"AAAI Conference on Artificial Intelligence"},{"key":"B66","first-page":"439","article-title":"\u201cOnline planning for ad hoc autonomous agent teams,\u201d","author":"Wu","year":"2011","journal-title":"International Joint Conference on Artificial Intelligence"},{"key":"B67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/aerospace12070635","article-title":"\u201cDETEAMSK: a model-based reinforcement learning approach to intelligent top-level planning and decisions for multi-drone ad hoc teamwork by decoupling the identification of teammate and task","volume":"12","author":"Xu","year":"2025","journal-title":"Aerospace"},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.1109\/AGENTS.2018.8460136","article-title":"\u201cTowards large scale ad-hoc teamwork,\u201d","author":"Yourdshahi","year":"2018","journal-title":"IEEE International Conference on Agents"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.65109\/MLIU4603","article-title":"\u201cOn-the-fly strategy adaptation for ad-hoc agent coordination,\u201d","author":"Zand","year":"2022","journal-title":"International Conference on Autonomous Agents and Multiagent Systems"},{"key":"B70","doi-asserted-by":"publisher","author":"Zintgraf","year":"2021","DOI":"10.65109\/XFZI5041"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2026.1765191\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T06:00:58Z","timestamp":1780466458000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2026.1765191\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,3]]},"references-count":70,"alternative-id":["10.3389\/frai.2026.1765191"],"URL":"https:\/\/doi.org\/10.3389\/frai.2026.1765191","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,3]]},"article-number":"1765191"}}