{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T05:55:53Z","timestamp":1777528553142,"version":"3.51.4"},"reference-count":134,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T00:00:00Z","timestamp":1682294400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique\u2014FNRS","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["681872"],"award-info":[{"award-number":["681872"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002910","name":"F\u00e9d\u00e9ration Wallonie-Bruxelles","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002910","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Swarm robotics is a promising approach to control large groups of robots. However, designing the individual behavior of the robots so that a desired collective behavior emerges is still a major challenge. In recent years, many advances in the automatic design of control software for robot swarms have been made, thus making automatic design a promising tool to address this challenge. In this article, I highlight and discuss recent advances and trends in offline robot evolution, embodied evolution, and offline robot learning for swarm robotics. For each approach, I describe recent design methods of interest, and commonly encountered challenges. In addition to the review, I provide a perspective on recent trends and discuss how they might influence future research to help address the remaining challenges of designing robot swarms.<\/jats:p>","DOI":"10.3389\/frobt.2023.1134841","type":"journal-article","created":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T04:32:29Z","timestamp":1682310749000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Recent trends in robot learning and evolution for swarm robotics"],"prefix":"10.3389","volume":"10","author":[{"given":"Jonas","family":"Kuckling","sequence":"first","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,4,24]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","DOI":"10.1145\/1015330.1015430","article-title":"Apprenticeship learning via inverse reinforcement learning","volume-title":"Icml 2004","author":"Abbeel","year":"2004"},{"key":"B2","first-page":"41","article-title":"Understandable controller extraction from video observations of swarms","author":"Alharthi","year":"2022"},{"key":"B3","first-page":"436","article-title":"Organizing the aggregate: Languages for spatial computing","volume-title":"Formal and practical aspects of domain-specific languages: Recent developments","author":"Beal","year":"2012"},{"key":"B4","first-page":"181","article-title":"From local actions to global tasks: Stigmergy and collective robotics","author":"Beckers","year":"1994"},{"key":"B5","first-page":"41","article-title":"Curriculum learning","author":"Bengio","year":"2009"},{"key":"B6","first-page":"1","article-title":"From swarm intelligence to swarm robotics","author":"Beni","year":"2005"},{"key":"B7","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1109\/TRO.2009.2024997","article-title":"Optimized stochastic policies for task allocation in swarms of robots","volume":"25","author":"Berman","year":"2009","journal-title":"IEEE Trans. Robotics"},{"key":"B8","first-page":"378","article-title":"Design of control policies for spatially inhomogeneous robot swarms with application to commercial pollination","author":"Berman","year":"2011"},{"key":"B9","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1080\/09540090412331314759","article-title":"Toward open-ended evolutionary robotics: Evolving elementary robotic units able to self-assemble and self-reproduce","volume":"16","author":"Bianco","year":"2004","journal-title":"Connect. Sci."},{"key":"B10","doi-asserted-by":"publisher","first-page":"59","DOI":"10.3389\/frobt.2019.00059","article-title":"Automatic off-line design of robot swarms: A manifesto","volume":"6","author":"Birattari","year":"2019","journal-title":"Front. Robotics AI"},{"key":"B11","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/978-3-030-72069-8_5","article-title":"AutoMoDe: A modular approach to the automatic off-line design and fine-tuning of control software for robot swarms","volume-title":"Automated design of machine learning and search algorithms","author":"Birattari","year":"2021"},{"key":"B12","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1038\/s42256-020-0215-0","article-title":"Disentangling automatic and semi-automatic approaches to the optimization-based design of control software for robot swarms","volume":"2","author":"Birattari","year":"2020","journal-title":"Nat. Mach. Intell."},{"key":"B13","unstructured":"A study of reinforcement learning algorithms for aggregates of minimalistic robots BloomJ. MukherjeeA. PinciroliC. 2022"},{"key":"B14","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1145\/2493883","article-title":"Evolutionary robotics","volume":"56","author":"Bongard","year":"2013","journal-title":"Commun. ACM"},{"key":"B15","first-page":"57","article-title":"Once more unto the breach: Co-evolving a robot and its simulator","author":"Bongard","year":"2004"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2700318","article-title":"Property-driven design for swarm robotics: A design method based on prescriptive modeling and model checking","volume":"9","author":"Brambilla","year":"2014","journal-title":"ACM Trans. Aut. Adapt. Syst."},{"key":"B17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11721-012-0075-2","article-title":"Swarm robotics: A review from the swarm engineering perspective","volume":"7","author":"Brambilla","year":"2013","journal-title":"Swarm Intell."},{"key":"B18","doi-asserted-by":"publisher","first-page":"20200309","DOI":"10.1098\/rstb.2020.0309","article-title":"Social learning in swarm robotics","volume":"377","author":"Bredeche","year":"2021","journal-title":"Philosophical Trans. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"B19","doi-asserted-by":"publisher","first-page":"12","DOI":"10.3389\/frobt.2018.00012","article-title":"Embodied evolution in collective robotics: A review","volume":"5","author":"Bredeche","year":"2018","journal-title":"Front. Robotics AI"},{"key":"B20","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1080\/13873954.2011.601425","article-title":"Environment-driven distributed evolutionary adaptation in a population of autonomous robotic agents","volume":"18","author":"Bredeche","year":"2012","journal-title":"Math. Comput. Model. Dyn. Syst."},{"key":"B21","first-page":"1877","article-title":"Language models are few-shot learners","author":"Brown","year":"2020"},{"key":"B22","doi-asserted-by":"publisher","first-page":"108010","DOI":"10.1016\/j.asoc.2021.108010","article-title":"Cultural evolution of probabilistic aggregation in synthetic swarms","volume":"113","author":"Cambier","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"B23","first-page":"100","article-title":"AutoMoDe-pomodoro: An evolutionary class of modular designs","author":"Cambier","year":"2022"},{"key":"B24","doi-asserted-by":"publisher","first-page":"53","DOI":"10.3389\/frobt.2020.00053","article-title":"Mutual shaping in swarm robotics: User studies in fire and rescue, storage organization, and bridge inspection","volume":"7","author":"Carrillo-Zapata","year":"2020","journal-title":"Front. Robotics AI"},{"key":"B25","article-title":"Behavior trees in robotics and AI: An introduction","volume-title":"Chapman & Hall\/CRC artificial intelligence and robotics series","author":"Colledanchise","year":"2018"},{"key":"B26","first-page":"153","article-title":"The effect of fitness function design on performance in evolutionary robotics: The influence of a priori knowledge","author":"Divband Soorati","year":"2015"},{"key":"B27","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3389\/frobt.2015.00004","article-title":"Evolutionary robotics: What, why, and where to","volume":"2","author":"Doncieux","year":"2015","journal-title":"Front. Robotics AI"},{"key":"B28","first-page":"1055","article-title":"Evolutionary robotics: Exploring new horizons","author":"Doncieux","year":"2011"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1463","DOI":"10.4249\/scholarpedia.1463","article-title":"Swarm robotics","volume":"9","author":"Dorigo","year":"2014","journal-title":"Scholarpedia"},{"key":"B30","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1109\/MRA.2013.2252996","article-title":"Swarmanoid: A novel concept for the study of heterogeneous robotic swarms","volume":"20","author":"Dorigo","year":"2013","journal-title":"IEEE Robotics Automation Mag."},{"key":"B31","doi-asserted-by":"publisher","first-page":"eabe4385","DOI":"10.1126\/scirobotics.abe4385","article-title":"Reflections on the future of swarm robotics","volume":"5","author":"Dorigo","year":"2020","journal-title":"Sci. Robotics"},{"key":"B32","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1023\/B:AURO.0000033973.24945.f3","article-title":"Evolving self-organizing behaviors for a Swarm-bot","volume":"17","author":"Dorigo","year":"2003","journal-title":"Aut. Robots"},{"key":"B33","first-page":"183","article-title":"Moving mixtures of active and passive elements with robots that do not compute","volume-title":"Ants 2022: Swarm intelligence","author":"Dosieah","year":"2022"},{"key":"B34","doi-asserted-by":"publisher","first-page":"e0151834","DOI":"10.1371\/journal.pone.0151834","article-title":"Evolution of collective behaviors for a real swarm of aquatic surface robots","volume":"11","author":"Duarte","year":"2016","journal-title":"PLOS ONE"},{"key":"B35","first-page":"785","article-title":"Hybrid control for large swarms of aquatic drones","author":"Duarte","year":"2014"},{"key":"B36","doi-asserted-by":"publisher","first-page":"e1004273","DOI":"10.1371\/journal.pcbi.1004273","article-title":"Evolution of self-organized task specialization in robot swarms","volume":"11","author":"Ferrante","year":"2015","journal-title":"PLOS Comput. Biol."},{"key":"B37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/frobt.2016.00029","article-title":"Automatic design of robot swarms: Achievements and challenges","volume":"3","author":"Francesca","year":"2016","journal-title":"Front. Robotics AI"},{"key":"B38","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/s11721-014-0092-4","article-title":"AutoMoDe: A novel approach to the automatic design of control software for robot swarms","volume":"8","author":"Francesca","year":"2014","journal-title":"Swarm Intell."},{"key":"B39","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free-energy principle: A unified brain theory?","volume":"11","author":"Friston","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"B40","doi-asserted-by":"publisher","first-page":"eaat0430","DOI":"10.1126\/scirobotics.aat0430","article-title":"Autonomous task sequencing in a robot swarm","volume":"3","author":"Garattoni","year":"2018","journal-title":"Sci. Robotics"},{"key":"B41","doi-asserted-by":"publisher","first-page":"4654","DOI":"10.3390\/app10134654","article-title":"Automatic design of collective behaviors for robots that can display and perceive colors","volume":"10","author":"Garz\u00f3n Ramos","year":"2020","journal-title":"Appl. Sci."},{"key":"B42","first-page":"355","article-title":"Evolving aggregation behaviors in multi-robot systems with binary sensors","author":"Gauci","year":""},{"key":"B43","first-page":"421","article-title":"Clustering objects with robots that do not compute","author":"Gauci","year":""},{"key":"B44","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA48891.2023.10160947","article-title":"Show me what you want: Inverse reinforcement learning to automatically design robot swarms by demonstration","author":"Gharbi","year":"2023"},{"key":"B45","first-page":"393","article-title":"Exponential natural evolution strategies","author":"Glasmachers","year":"2010"},{"key":"B46","first-page":"225","article-title":"Task-agnostic evolution of diverse repertoires of swarm behaviours","author":"Gomes","year":"2018"},{"key":"B47","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1007\/s11047-016-9582-1","article-title":"Challenges in cooperative coevolution of physically heterogeneous robot teams","volume":"18","author":"Gomes","year":"2019","journal-title":"Nat. Comput."},{"key":"B48","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1162\/EVCO_a_00173","article-title":"Novelty-driven cooperative coevolution","volume":"25","author":"Gomes","year":"2017","journal-title":"Evol. Comput."},{"key":"B49","first-page":"212","article-title":"Systematic derivation of behaviour characterisations in evolutionary robotics","author":"Gomes","year":"2014"},{"key":"B50","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/s11721-013-0081-z","article-title":"Evolution of swarm robotics systems with novelty search","volume":"7","author":"Gomes","year":"2013","journal-title":"Swarm Intell."},{"key":"B51","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1177\/105971239700500305","article-title":"Incremental evolution of complex general behavior","volume":"5","author":"Gomez","year":"1997","journal-title":"Adapt. Behav."},{"key":"B52","doi-asserted-by":"publisher","first-page":"1155","DOI":"10.1126\/science.1144259","article-title":"Social integration of robots into groups of cockroaches to control self-organized choices","volume":"318","author":"Halloy","year":"2007","journal-title":"Science"},{"key":"B53","first-page":"344","article-title":"Evolution of collective behaviors by minimizing surprise","author":"Hamann","year":"2014"},{"key":"B54","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-74528-2","volume-title":"Swarm robotics: A formal approach","author":"Hamann","year":"2018"},{"key":"B55","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1007\/s11721-008-0015-3","article-title":"A framework of space\u2013time continuous models for algorithm design in swarm robotics","volume":"2","author":"Hamann","year":"2008","journal-title":"Swarm Intell."},{"key":"B56","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1162\/106365601750190398","article-title":"Completely derandomized self-adaptation in evolution strategies","volume":"9","author":"Hansen","year":"2001","journal-title":"Evol. Comput."},{"key":"B57","doi-asserted-by":"publisher","first-page":"e291","DOI":"10.7717\/peerj-cs.291","article-title":"Modular automatic design of collective behaviors for robots endowed with local communication capabilities","volume":"6","author":"Hasselmann","year":"2020","journal-title":"PeerJ Comput. Sci."},{"key":"B58","article-title":"Towards the automatic design of automatic methods for the design of robot swarms","author":"Hasselmann","year":"2023"},{"key":"B59","doi-asserted-by":"publisher","first-page":"4345","DOI":"10.1038\/s41467-021-24642-3","article-title":"Empirical assessment and comparison of neuro-evolutionary methods for the automatic off-line design of robot swarms","volume":"12","author":"Hasselmann","year":"2021","journal-title":"Nat. Commun."},{"key":"B60","first-page":"252","article-title":"Formica ex machina: Ant swarm foraging from physical to virtual and back again","author":"Hecker","year":"2012"},{"key":"B61","first-page":"1055","article-title":"Evolution, individual learning, and social learning in a swarm of real robots","author":"Heinerman","year":"2015"},{"key":"B62","first-page":"139","article-title":"Evolution versus design: Controlling autonomous robots","author":"Husbands","year":"1992"},{"key":"B63","first-page":"1","article-title":"Deep reinforcement learning for swarm systems","volume":"20","author":"H\u00fcttenrauch","year":"2019","journal-title":"J. Mach. Learn. Res."},{"key":"B64","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1177\/105971239700600205","article-title":"Evolutionary robotics and the radical envelope-of-noise hypothesis","volume":"6","author":"Jakobi","year":"1997","journal-title":"Adapt. Behav."},{"key":"B65","first-page":"487","article-title":"Evolving behaviour trees for swarm robotics","author":"Jones","year":"2018"},{"key":"B66","doi-asserted-by":"publisher","first-page":"1900031","DOI":"10.1002\/aisy.201900031","article-title":"Onboard evolution of understandable swarm behaviors","volume":"1","author":"Jones","year":"2019","journal-title":"Adv. Intell. Syst."},{"key":"B67","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1613\/jair.301","article-title":"Reinforcement learning: A survey","volume":"4","author":"Kaelbling","year":"1996","journal-title":"J. Artif. Intell. Res."},{"key":"B68","doi-asserted-by":"publisher","first-page":"103293","DOI":"10.1016\/j.robot.2019.103293","article-title":"Engineered self-organization for resilient robot self-assembly with minimal surprise","volume":"122","author":"Kaiser","year":"2019","journal-title":"Robotics Aut. Syst."},{"key":"B69","doi-asserted-by":"publisher","first-page":"672","DOI":"10.1108\/17563780911005836","article-title":"Model independence in swarm robotics","volume":"2","author":"Kazadi","year":"2009","journal-title":"Int. J. Intelligent Comput. Cybern."},{"key":"B70","doi-asserted-by":"publisher","first-page":"1238","DOI":"10.1177\/0278364913495721","article-title":"Reinforcement learning in robotics: A survey","volume":"32","author":"Kober","year":"2013","journal-title":"Int. J. Robotics Res."},{"key":"B71","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/TEVC.2012.2185849","article-title":"The transferability approach: Crossing the reality gap in evolutionary robotics","volume":"17","author":"Koos","year":"2013","journal-title":"IEEE Trans. Evol. Comput."},{"key":"B72","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1177\/0278364918784350","article-title":"Swirl: A sequential windowed inverse reinforcement learning algorithm for robot tasks with delayed rewards","volume":"38","author":"Krishnan","year":"2019","journal-title":"Int. J. Robot. Res."},{"key":"B73","first-page":"30","article-title":"Behavior trees as a control architecture in the automatic modular design of robot swarms","author":"Kuckling","year":"2018"},{"key":"B74","doi-asserted-by":"publisher","first-page":"e322","DOI":"10.7717\/peerj-cs.322","article-title":"Iterative improvement in the automatic modular design of robot swarms","volume":"6","author":"Kuckling","year":"","journal-title":"PeerJ Comput. Sci."},{"key":"B75","first-page":"3","article-title":"AutoMoDe-IcePop: Automatic modular design of control software for robot swarms using simulated annealing","volume-title":"Artificial intelligence and machine learning: Bnaic 2019, benelearn 2019","author":"Kuckling","year":""},{"key":"B76","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1007\/s42979-021-00988-9","article-title":"AutoMoDe-cedrata: Automatic design of behavior trees for controlling a swarm of robots with communication capabilities","volume":"3","author":"Kuckling","year":"2022","journal-title":"SN Comput. Sci."},{"key":"B77","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1162\/EVCO_a_00025","article-title":"Abandoning objectives: Evolution through the search for novelty alone","volume":"19","author":"Lehman","year":"2011","journal-title":"Evol. Comput."},{"key":"B78","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1038\/s41586-019-1022-9","article-title":"Particle robotics based on statistical mechanics of loosely coupled components","volume":"567","author":"Li","year":"2019","journal-title":"Nature"},{"key":"B79","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11721-016-0126-1","article-title":"Turing learning: A metric-free approach to inferring behavior and its application to swarms","volume":"10","author":"Li","year":"2016","journal-title":"Swarm Intell."},{"key":"B80","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11721-019-00175-w","article-title":"Simulation-only experiments to mimic the effects of the reality gap in the automatic design of robot swarms","volume":"14","author":"Ligot","year":"2020","journal-title":"Swarm Intell."},{"key":"B81","first-page":"109","article-title":"AutoMoDe-arlequin: Neural networks as behavioral modules for the automatic design of probabilistic finite state machines","author":"Ligot","year":""},{"key":"B82","doi-asserted-by":"publisher","first-page":"e314","DOI":"10.7717\/peerj-cs.314","article-title":"Automatic modular design of robot swarms using behavior trees as a control architecture","volume":"6","author":"Ligot","year":"","journal-title":"PeerJ Comput. Sci."},{"key":"B83","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1007\/s11721-016-0119-0","article-title":"Supervisory control theory applied to swarm robotics","volume":"10","author":"Lopes","year":"2016","journal-title":"Swarm Intell."},{"key":"B84","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1023\/A:1008819414322","article-title":"Reinforcement learning in the multi-robot domain","volume":"4","author":"Matari\u0107","year":"1997","journal-title":"Aut. Robots"},{"key":"B85","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1080\/095281398146806","article-title":"Using communication to reduce locality in distributed multi-agent learning","volume":"10","author":"Matari\u0107","year":"1998","journal-title":"J. Exp. Theor. Artif. Intell."},{"key":"B86","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1038\/s41467-017-00109-2","article-title":"Mergeable nervous systems for robots","volume":"8","author":"Mathews","year":"2017","journal-title":"Nat. Commun."},{"key":"B87","doi-asserted-by":"publisher","first-page":"101118","DOI":"10.1016\/j.swevo.2022.101118","article-title":"AutoMoDe-mate: Automatic off-line design of spatially-organizing behaviors for robot swarms","volume":"74","author":"Mendiburu","year":"2022","journal-title":"Swarm Evol. Comput."},{"key":"B88","first-page":"59","article-title":"The e-puck, a robot designed for education in engineering","author":"Mondada","year":"2009"},{"key":"B89","unstructured":"Illuminating search spaces by mapping elites MouretJ.-B. CluneJ. 2015"},{"key":"B90","first-page":"513","article-title":"Learning swarm behaviors using grammatical evolution and behavior trees","author":"Neupane","year":"2019"},{"key":"B91","volume-title":"Behavioral and cognitive robotics: An adaptive perspective","author":"Nolfi","year":"2021"},{"key":"B92","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2889.001.0001","volume-title":"Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines","author":"Nolfi","year":"2000"},{"key":"B93","first-page":"22","article-title":"How co-evolution can enhance the adaptive power of artificial evolution: Implications for evolutionary robotics","volume-title":"EvoRobots 1998: Evolutionary robotics","author":"Nolfi","year":"1998"},{"key":"B94","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2300000053","article-title":"An algorithmic perspective on imitation learning","volume":"7","author":"Osa","year":"2018","journal-title":"Found. Trends\u00ae Robot"},{"key":"B95","doi-asserted-by":"publisher","first-page":"1346","DOI":"10.1109\/LRA.2018.2795640","article-title":"Finding consensus without computation","volume":"3","author":"\u00d6zdemir","year":"2018","journal-title":"IEEE Robotics Automation Lett."},{"key":"B96","doi-asserted-by":"crossref","DOI":"10.7551\/ecal_a_056","article-title":"Shepherding with robots that do not compute","author":"\u00d6zdemir","year":"2017"},{"key":"B97","first-page":"9674","article-title":"Spatial coverage without computation","author":"\u00d6zdemir","year":"2019"},{"key":"B98","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1162\/artl_a_00291","article-title":"An overview of open-ended evolution: Editorial introduction to the open-ended evolution ii special issue","volume":"25","author":"Packard","year":"2019","journal-title":"Artif. Life"},{"key":"B99","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1109\/MS.2016.95","article-title":"Buzz: A programming language for robot swarms","volume":"33","author":"Pinciroli","year":"2016","journal-title":"IEEE Softw."},{"key":"B100","doi-asserted-by":"publisher","first-page":"1282","DOI":"10.1016\/j.robot.2010.08.004","article-title":"Open-ended evolution as a means to self-organize heterogeneous multi-robot systems in real time","volume":"58","author":"Prieto","year":"2010","journal-title":"Robotics Aut. Syst."},{"key":"B101","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1109\/TRO.2016.2631593","article-title":"The impact of diversity on optimal control policies for heterogeneous robot swarms","volume":"33","author":"Prorok","year":"2009","journal-title":"IEEE Trans. Robotics"},{"key":"B102","doi-asserted-by":"publisher","first-page":"40","DOI":"10.3389\/frobt.2016.00040","article-title":"Quality diversity: A new frontier for evolutionary computation","volume":"3","author":"Pugh","year":"2016","journal-title":"Front. Robotics AI"},{"key":"B103","doi-asserted-by":"publisher","first-page":"2321","DOI":"10.1098\/rsta.2003.1258","article-title":"Evolving controllers for a homogeneous system of physical robots: Structured cooperation with minimal sensors","volume":"361","author":"Quinn","year":"2003","journal-title":"Philos. Trans. A Math. Phys. Eng. Sci."},{"key":"B104","unstructured":"Language models are unsupervised multitask learners RadfordA. WuJ. ChildR. LuanD. AmodeiD. SutskeverI. 2019"},{"key":"B105","doi-asserted-by":"publisher","first-page":"e0140950","DOI":"10.1371\/journal.pone.0140950","article-title":"A design pattern for decentralised decision making","volume":"10","author":"Reina","year":"2015","journal-title":"PLOS ONE"},{"key":"B106","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1126\/science.1254295","article-title":"Programmable self-assembly in a thousand-robot swarm","volume":"345","author":"Rubenstein","year":"2014","journal-title":"Science"},{"key":"B107","first-page":"10","article-title":"Swarm robotics: From sources of inspiration to domains of application","author":"\u015eahin","year":"2005"},{"key":"B108","doi-asserted-by":"publisher","first-page":"e221","DOI":"10.7717\/peerj-cs.221","article-title":"Concurrent design of control software and configuration of hardware for robot swarms under economic constraints","volume":"5","author":"Salman","year":"2019","journal-title":"PeerJ Comput. Sci."},{"key":"B109","doi-asserted-by":"publisher","first-page":"100762","DOI":"10.1016\/j.swevo.2020.100762","article-title":"Swarm intelligence and cyber-physical systems: Concepts, challenges and future trends","volume":"60","author":"Schranz","year":"2021","journal-title":"Swarm Evol. Comput."},{"key":"B110","doi-asserted-by":"publisher","first-page":"36","DOI":"10.3389\/frobt.2020.00036","article-title":"Swarm robotic behaviors and current applications","volume":"7","author":"Schranz","year":"2020","journal-title":"Front. Robotics AI"},{"key":"B111","doi-asserted-by":"publisher","first-page":"160938","DOI":"10.1098\/rsos.160938","article-title":"Evolutionary online behaviour learning and adaptation in real robots","volume":"4","author":"Silva","year":"2017","journal-title":"R. Soc. Open Sci."},{"key":"B112","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1162\/EVCO_a_00172","article-title":"Open issues in evolutionary robotics","volume":"24","author":"Silva","year":"2016","journal-title":"Evol. Comput."},{"key":"B113","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1162\/EVCO_a_00141","article-title":"odNEAT: an algorithm for decentralised online evolution of robotic controllers","volume":"23","author":"Silva","year":"2015","journal-title":"Evol. Comput."},{"key":"B114","doi-asserted-by":"publisher","first-page":"eaau9178","DOI":"10.1126\/scirobotics.aau9178","article-title":"Morphogenesis in robot swarms","volume":"3","author":"Slavkov","year":"2018","journal-title":"Sci. Robotics"},{"key":"B115","first-page":"1413","article-title":"Inverse reinforcement learning in swarm systems","author":"\u0160o\u0161i\u0107","year":"2017"},{"key":"B116","first-page":"27","article-title":"A macroscopic model for self-organized aggregation in swarm robotic systems","author":"Soysal","year":"2007"},{"key":"B117","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1007\/978-3-030-65154-1_2","article-title":"Evaluation of alternative exploration schemes in the automatic modular design of robot swarms","volume-title":"Artificial intelligence and machine learning: Bnaic 2019, benelearn 2019","author":"Spaey","year":"2020"},{"key":"B118","unstructured":"Open-endedness: The last grand challenge you\u2019ve never heard of StanleyK. O. LehmanJ. SorosL. 2017"},{"key":"B119","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1162\/106365602320169811","article-title":"Evolving neural networks through augmenting topologies","volume":"10","author":"Stanley","year":"2002","journal-title":"Evol. Comput."},{"key":"B120","doi-asserted-by":"publisher","first-page":"13","DOI":"10.3389\/frobt.2014.00013","article-title":"Evolutionary robotics: Model or design?","volume":"1","author":"Trianni","year":"2014","journal-title":"Front. Robotics AI"},{"key":"B121","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-77612-3","volume-title":"Evolutionary swarm robotics","author":"Trianni","year":"2008"},{"key":"B122","first-page":"865","article-title":"Evolving aggregation behaviors in a swarm of robots","author":"Trianni","year":"2003"},{"key":"B123","doi-asserted-by":"publisher","first-page":"e0136406","DOI":"10.1371\/journal.pone.0136406","article-title":"Advantages of task-specific multi-objective optimisation in evolutionary robotics","volume":"10","author":"Trianni","year":"2015","journal-title":"PLOS ONE"},{"key":"B124","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1162\/artl_a_00031","article-title":"Engineering the evolution of self-organizing behaviors in swarm robotics: A case study","volume":"17","author":"Trianni","year":"2011","journal-title":"Artif. Life"},{"key":"B125","doi-asserted-by":"crossref","first-page":"153","DOI":"10.7551\/mitpress\/8493.003.0008","article-title":"Evolutionary swarm robotics: A theoretical and methodological itinerary from individual neuro-controllers to collective behaviours","volume-title":"The horizons of evolutionary robotics","author":"Trianni","year":"2014"},{"key":"B126","first-page":"31","article-title":"Environment induced emergence of collective behavior in evolving swarms with limited sensing","author":"van Diggelen","year":"2022"},{"key":"B127","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S0921-8890(02)00170-7","article-title":"Embodied evolution: Distributing an evolutionary algorithm in a population of robots","volume":"39","author":"Watson","year":"2002","journal-title":"Robotics Aut. Syst."},{"key":"B128","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1126\/science.1245842","article-title":"Designing collective behavior in a termite-inspired robot construction team","volume":"343","author":"Werfel","year":"2014","journal-title":"Science"},{"key":"B129","first-page":"126","article-title":"Towards dependable swarms and a new discipline of swarm engineering","author":"Winfield","year":"2005"},{"key":"B130","doi-asserted-by":"publisher","first-page":"eaav8006","DOI":"10.1126\/scirobotics.aav8006","article-title":"Reconfigurable magnetic microrobot swarm: Multimode transformation, locomotion, and manipulation","volume":"4","author":"Xie","year":"2019","journal-title":"Sci. Robotics"},{"key":"B131","first-page":"615","article-title":"Automated global-to-local programming in 1-D spatial multi-agent systems","author":"Yamins","year":"2008"},{"key":"B132","doi-asserted-by":"publisher","first-page":"eaar7650","DOI":"10.1126\/scirobotics.aar7650","article-title":"The grand challenges of Science Robotics","volume":"3","author":"Yang","year":"2018","journal-title":"Sci. Robotics"},{"key":"B133","doi-asserted-by":"publisher","first-page":"3260","DOI":"10.1038\/s41467-018-05749-6","article-title":"Ultra-extensible ribbon-like magnetic microswarm","volume":"9","author":"Yu","year":"2018","journal-title":"Nat. Commun."},{"key":"B134","first-page":"737","article-title":"Sim-to-real transfer in deep reinforcement learning for robotics: A survey","author":"Zhao","year":"2020"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1134841\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,19]],"date-time":"2024-10-19T01:46:28Z","timestamp":1729302388000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1134841\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,24]]},"references-count":134,"alternative-id":["10.3389\/frobt.2023.1134841"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1134841","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,24]]},"article-number":"1134841"}}