{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:28:34Z","timestamp":1770917314416,"version":"3.50.1"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T00:00:00Z","timestamp":1678924800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>This paper proposes an iterative transfer learning approach to achieve swarming collective motion in groups of mobile robots. By applying transfer learning, a deep learner capable of recognizing swarming collective motion can use its knowledge to tune stable collective motion behaviors across multiple robot platforms. The transfer learner requires only a small set of initial training data from each robot platform, and this data can be collected from random movements. The transfer learner then progressively updates its own knowledge base with an iterative approach. This transfer learning eliminates the cost of extensive training data collection and the risk of trial-and-error learning on robot hardware. We test this approach on two robot platforms: simulated Pioneer 3DX robots and real Sphero BOLT robots. The transfer learning approach enables both platforms to automatically tune stable collective behaviors. Using the knowledge-base library the tuning procedure is fast and accurate. We demonstrate that these tuned behaviors can be used for typical multi-robot tasks such as coverage, even though they are not specifically designed for coverage tasks.<\/jats:p>","DOI":"10.3389\/fnbot.2023.1113991","type":"journal-article","created":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T05:30:48Z","timestamp":1678944648000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Iterative transfer learning for automatic collective motion tuning on multiple robot platforms"],"prefix":"10.3389","volume":"17","author":[{"given":"Shadi","family":"Abpeikar","sequence":"first","affiliation":[]},{"given":"Kathryn","family":"Kasmarik","sequence":"additional","affiliation":[]},{"given":"Matt","family":"Garratt","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,3,16]]},"reference":[{"key":"B1","volume-title":"Replication Data for: Automatic Collective behavior Recognition","author":"Abpeikar","year":"2022"},{"key":"B2","unstructured":"AbpeikarS. KasmarikK. Human Perception of Swarming2019"},{"key":"B3","doi-asserted-by":"publisher","first-page":"101085","DOI":"10.1016\/j.swevo.2022.101085","article-title":"Automatic collective motion tuning using actor-critic deep reinforcement learning","volume":"72","author":"Abpeikar","year":"","journal-title":"Swarm Evolut. Comput"},{"key":"B4","first-page":"531","article-title":"\u201cTransfer learning for autonomous recognition of swarm behavior in UGVs,\u201d","volume-title":"Australasian Joint Conference on Artificial Intelligence","author":"Abpeikar","year":""},{"key":"B5","first-page":"155","article-title":"\u201cTuning swarm behavior for environmental sensing tasks represented as coverage problems,\u201d","volume-title":"Cognitive Data Science in Sustainable Computing, Artificial Intelligence and Data Science in Environmental Sensing","author":"Abpeikar","year":""},{"key":"B6","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/978-3-319-98446-9_19","article-title":"\u201cBuilding collaboration inmulti-agent systems using reinforcement learning,\u201d","volume-title":"International Conference on Computational Collective Intelligence","author":"Aydin","year":"2018"},{"key":"B7","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s10458-006-9010-5","article-title":"Shaping multi-agent systems with gradient reinforcement learning","volume":"15","author":"Buffet","year":"2007","journal-title":"Auton. Agent Multi. Agent Syst"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2629528","article-title":"Transfer learning across feature-rich heterogeneous feature spaces via feature-space remapping (FSR)","volume":"6","author":"Feuz","year":"2015","journal-title":"ACM Trans. Intell. Syst. Technol"},{"key":"B9","doi-asserted-by":"publisher","first-page":"13825","DOI":"10.1007\/s00521-020-04791-0","article-title":"On self-organised aggregation dynamics in swarms of robots with informed robots","volume":"32","author":"Firat","year":"2020","journal-title":"Neural Comput. Appl"},{"key":"B10","doi-asserted-by":"publisher","first-page":"29","DOI":"10.3389\/frobt.2016.00029","article-title":"Automatic design of robot swarms: achievements and challenges","volume":"3","author":"Francesca","year":"2016","journal-title":"Front. Robot. AI"},{"key":"B11","doi-asserted-by":"publisher","first-page":"13","DOI":"10.3389\/frobt.2018.00013","article-title":"Assessing human judgment of computationally generated swarming behavior","volume":"5","author":"Harvey","year":"2018","journal-title":"Front. Robot. AI"},{"key":"B12","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1109\/ICMECH.2019.8722887","article-title":"\u201cExploration in extreme environments with swarm robotic system,\u201d","volume-title":"2019 IEEE international conference on mechatronics (ICM), volume 1","author":"Huang","year":"2019"},{"key":"B13","first-page":"281","article-title":"\u201cAutonomous recognition of collective behavior in robot swarms,\u201d","volume-title":"Australasian Joint Conference on Artificial Intelligence","author":"Kasmarik","year":"2020"},{"key":"B14","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1016\/j.biosystems.2018.01.005","article-title":"Self-organization in aggregating robot swarms: a DW-KNN topological approach","volume":"165","author":"Khaldi","year":"2018","journal-title":"Biosystems"},{"key":"B15","doi-asserted-by":"publisher","first-page":"100715","DOI":"10.1016\/j.swevo.2020.100715","article-title":"Autonomous detection of collective behaviors in swarms","volume":"57","author":"Khan","year":"2020","journal-title":"Swarm Evolut. Comput"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2023.3239815","article-title":"Federated reinforcement learning for collective navigation of robotic swarms","author":"Na","year":"2022","journal-title":"arXiv preprint"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5402\/2013\/608164","article-title":"An introduction to swarm robotics","volume":"2013","author":"Navarro","year":"2013","journal-title":"Isrn Robot"},{"key":"B18","first-page":"012001","article-title":"\u201cAutomatic robotic scanning and inspection mechanism for mines using IoT,\u201d","volume-title":"IOP conference series: Materials science and engineering, volume 1045","author":"Qadri","year":"2021"},{"key":"B19","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1145\/37401.37406","article-title":"\u201cFlocks, herds and schools: a distributed behavioral model,\u201d","volume-title":"Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques","author":"Reynolds","year":"1987"},{"key":"B20","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1109\/TAC.2004.829621","article-title":"Coordinated collective motion of groups of autonomous mobile robots: analysis of Vicsek's model","volume":"49","author":"Savkin","year":"2004","journal-title":"IEEE Trans. Automat. Contr"},{"key":"B21","doi-asserted-by":"publisher","first-page":"36","DOI":"10.3389\/frobt.2020.00036","article-title":"Swarm robotic behaviors and current applications","volume":"7","author":"Schranz","year":"2020","journal-title":"Front. Robot. AI"},{"key":"B22","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1007\/s11721-011-0055-y","article-title":"Self-organised path formation in a swarm of robots","volume":"5","author":"Sperati","year":"2011","journal-title":"Swarm Intell"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2201.00248","article-title":"Transfer RL across observation feature spaces via model-based regularization","author":"Sun","year":"2022","journal-title":"arXiv preprint"},{"key":"B24","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton","year":"2018"},{"key":"B25","doi-asserted-by":"crossref","first-page":"242","DOI":"10.4018\/978-1-60566-766-9.ch011","article-title":"\u201cTransfer learning,\u201d","volume-title":"Handbook of Research on machine Learning Applications and Trends: Algorithms, Methods, and Techniques","author":"Torrey","year":"2010"},{"key":"B26","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1007\/s10015-016-0331-4","article-title":"Adaptive role assignment for self-organized flocking of a real robotic swarm","volume":"21","author":"Toshiyuki","year":"2016","journal-title":"Artif. Life Robot"},{"key":"B27","doi-asserted-by":"publisher","first-page":"101171","DOI":"10.1016\/j.swevo.2022.101171","article-title":"Frontier-led swarming: robust multi-robot coverage of unknown environments","volume":"75","author":"Tran","year":"2022","journal-title":"Swarm Evolut. Comput"},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-77612-3","volume-title":"Evolutionary Swarm Robotics: Evolving Self-Organising behaviours in Groups of Autonomous Robots, volume 108","author":"Trianni","year":"2008"},{"key":"B29","doi-asserted-by":"publisher","first-page":"35551","DOI":"10.1109\/ACCESS.2018.2843773","article-title":"Feature-based transfer learning based on distribution similarity","volume":"6","author":"Zhong","year":"2018","journal-title":"IEEE Access"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1113991\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,9]],"date-time":"2023-12-09T01:26:44Z","timestamp":1702085204000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1113991\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,16]]},"references-count":29,"alternative-id":["10.3389\/fnbot.2023.1113991"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2023.1113991","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,16]]},"article-number":"1113991"}}