{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T09:56:19Z","timestamp":1777715779267,"version":"3.51.4"},"reference-count":55,"publisher":"SAGE Publications","issue":"3-4","license":[{"start":{"date-parts":[[2008,3,1]],"date-time":"2008-03-01T00:00:00Z","timestamp":1204329600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2008,3]]},"abstract":"<jats:p>This article addresses the problem of how modular robotics systems, i.e. systems composed of multiple modules that can be configured into different robotic structures, can learn to locomote. In particular, we tackle the problems of online learning, that is, learning while moving, and the problem of dealing with unknown arbitrary robotic structures. We propose a framework for learning locomotion controllers based on two components: a central pattern generator (CPG) and a gradient-free optimization algorithm referred to as Powell's method. The CPG is implemented as a system of coupled nonlinear oscillators in our YaMoR modular robotic system, with one oscillator per module. The nonlinear oscillators are coupled together across modules using Bluetooth communication to obtain specific gaits, i.e. synchronized patterns of oscillations among modules. Online learning involves running the Powell optimization algorithm in parallel with the CPG model, with the speed of locomotion being the criterion to be optimized. Interesting aspects of the optimization include the fact that it is carried out online, the robots do not require stopping or resetting and it is fast. We present results showing the interesting properties of this framework for a modular robotic system. In particular, our CPG model can readily be implemented in a distributed system, it is computationally cheap, it exhibits limit cycle behavior (temporary perturbations are rapidly forgotten), it produces smooth trajectories even when control parameters are abruptly changed and it is robust against imperfect communication among modules. We also present results of learning to move with three different robot structures. Interesting locomotion modes are obtained after running the optimization for less than 60 minutes.<\/jats:p>","DOI":"10.1177\/0278364907088401","type":"journal-article","created":{"date-parts":[[2008,3,28]],"date-time":"2008-03-28T12:58:02Z","timestamp":1206709082000},"page":"423-443","source":"Crossref","is-referenced-by-count":101,"title":["Learning to Move in Modular Robots using Central Pattern Generators and Online Optimization"],"prefix":"10.1177","volume":"27","author":[{"given":"Alexander","family":"Sproewitz","sequence":"first","affiliation":[{"name":"School of Computer and Communication Science Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne Station 14, CH-1015 Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rico","family":"Moeckel","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Science Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne Station 14, CH-1015 Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J\u00e9r\u00f4me","family":"Maye","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Science Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne Station 14, CH-1015 Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Auke Jan","family":"Ijspeert","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Science Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne Station 14, CH-1015 Lausanne, Switzerland,"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2008,3,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2006.870671"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2004.828593"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1177\/105971239200100105"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1126\/science.1133687"},{"key":"atypb5","volume-title":"Algorithms for Minimization without Derivatives. NJ","author":"Brent, R.","year":"1973"},{"key":"atypb6","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS2006)","author":"Buchli, J."},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-006-0128-y"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1007\/BF00276069"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1126\/science.1107799"},{"key":"atypb10","volume-title":"International Conference on Artificial Neural Networks (ICANN 2003)","author":"Conradt, J."},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1126\/science.7423199"},{"key":"atypb12","volume-title":"Proceedings of the Harmonic Drive International Symposium, Nagano, Japan, and Proceedings of COE\/Super-Mechano-Systems Workshop","author":"Duff, D."},{"key":"atypb13","volume-title":"Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA2005)","author":"Endo, G."},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1177\/0278364906063822"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-011-7084-0_3"},{"key":"atypb16","volume-title":"Proceedings of the Fourth European Conference on Artificial Life, ECAL97","author":"Gruau, F."},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1007\/s004220000211"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2008.03.014"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1162\/106454699568773"},{"key":"atypb20","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2007)","author":"Ijspeert, A.J."},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1126\/science.1138353"},{"key":"atypb22","volume-title":"IEEE International Conference on Robotics and Automation (ICRA2003)","author":"Kamimura, A."},{"key":"atypb23","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS2004)","author":"Kamimura, A."},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008924521542"},{"key":"atypb25","volume-title":"Proceedings of the 2004 IEEE International Conference on Robotics & Automation","author":"Kohl, N."},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1137\/0151070"},{"key":"atypb27","volume-title":"Proceedings of the first IEEE\/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob 2006)","author":"Lachat, D."},{"key":"atypb28","volume-title":"Genetic algorithms for gait synthesis in a hexapod robot","author":"Lewis, M.A.","year":"1993"},{"key":"atypb29","volume-title":"Proceedings of the IEEE International Conference on Mechatronics and Automation (ICMA 2005)","author":"Marbach, D."},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2006.05.012"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1108\/01439910610667908"},{"key":"atypb32","volume-title":"Proceedings of the 2007 IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Moeckel, R."},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1109\/TMECH.2002.806220"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2007.01.002"},{"key":"atypb35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/BF00206233","volume":"72","author":"Nishii, J.","year":"1994","journal-title":"Biological Cybernetics"},{"key":"atypb36","volume-title":"Proceedings of CIRA'03, IEEE International Symposium on Computational Intelligence in Robotics and Automation","author":"Ostergaard, E.H."},{"key":"atypb37","volume-title":"Proceedings of The IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS2001)","author":"Paul, C."},{"key":"atypb38","volume-title":"Numerical recipes in C: the art of scientific computing","author":"Press, W.","year":"1994","edition":"2"},{"key":"atypb39","volume-title":"Proceedings of the 2006 IEEE International Conference on Robotics and Automation (ICRA2006)","author":"Righetti, L."},{"key":"atypb40","volume-title":"Proceedings of the 2008 IEEE International Conference on Robotics and Automation","author":"Righetti, L."},{"key":"atypb41","volume-title":"Proceedings of the IEEE Conference on Robotics and Automation (ICRA 2004)","author":"Salemi, B."},{"issue":"5","key":"atypb42","first-page":"1","volume":"18","author":"Shen, W.","year":"2002","journal-title":"IEEE Transactions on Robotics and Automation"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1023\/B:AURO.0000032940.08116.f1"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1996.76.6.4094"},{"key":"atypb45","volume-title":"Proceedings, Artificial Life IV","author":"Sims, K."},{"key":"atypb46","volume-title":"Proceedings of the IEEE International conference on Robotics and Automation (ICRA2003)","author":"Stoy, K."},{"key":"atypb47","volume-title":"Reinforcement learning: an introduction","author":"Sutton, R.","year":"1998"},{"key":"atypb48","volume-title":"Workshop Procedings of the 18th International Conference on Architecture of Computing Systems 2005 (ARCS'05)","author":"Upegui, A."},{"key":"atypb49","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2002)","author":"Vassilvitskii, S."},{"key":"atypb50","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2000)","author":"Vona, M."},{"key":"atypb51","volume-title":"Proceedings of the 2004 IEEE International Conference on Robotics & Automation","author":"Weingarten, J.D."},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1990.64.3.862"},{"key":"atypb53","volume-title":"Yamor lifelong learning. Master's thesis","author":"Yerly, M.","year":"2007"},{"key":"atypb54","volume-title":"Locomotion with a Unit Modular Reconfigurable Robot. Ph. D. thesis","author":"Yim, M.","year":"1994"},{"key":"atypb55","volume-title":"IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS2002)","author":"Zhang, Y."}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364907088401","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364907088401","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:16:20Z","timestamp":1777457780000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364907088401"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,3]]},"references-count":55,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2008,3]]}},"alternative-id":["10.1177\/0278364907088401"],"URL":"https:\/\/doi.org\/10.1177\/0278364907088401","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,3]]}}}