{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T09:56:00Z","timestamp":1777715760851,"version":"3.51.4"},"reference-count":34,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2008,2,1]],"date-time":"2008-02-01T00:00:00Z","timestamp":1201824000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2008,2]]},"abstract":"<jats:p>In this paper we describe a learning framework for a central pattern generator (CPG)-based biped locomotion controller using a policy gradient method. Our goals in this study are to achieve CPG-based biped walking with a 3D hardware humanoid and to develop an efficient learning algorithm with CPG by reducing the dimensionality of the state space used for learning. We demonstrate that an appropriate feedback controller can be acquired within a few thousand trials by numerical simulations and the controller obtained in numerical simulation achieves stable walking with a physical robot in the real world. Numerical simulations and hardware experiments evaluate the walking velocity and stability. The results suggest that the learning algorithm is capable of adapting to environmental changes. Furthermore, we present an online learning scheme with an initial policy for a hardware robot to improve the controller within 200 iterations.<\/jats:p>","DOI":"10.1177\/0278364907084980","type":"journal-article","created":{"date-parts":[[2008,1,25]],"date-time":"2008-01-25T09:44:04Z","timestamp":1201254244000},"page":"213-228","source":"Crossref","is-referenced-by-count":165,"title":["Learning CPG-based Biped Locomotion with a Policy Gradient Method: Application to a Humanoid Robot"],"prefix":"10.1177","volume":"27","author":[{"given":"Gen","family":"Endo","sequence":"first","affiliation":[{"name":"Tokyo Institute of Technology 2-12-1 Ookayama, Meguro-ku Tokyo, 152-8550, Japan,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Morimoto","sequence":"additional","affiliation":[{"name":"ATR Computational Neuroscience Laboratories Computational Brain Project, ICORP Japan Science and Technology Agency 2-2-2 Hikaridai, Seika-cho, Soraku-gun Kyoto, 619-0288, Japan,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takamitsu","family":"Matsubara","sequence":"additional","affiliation":[{"name":"ATR Computational Neuroscience Laboratories 2-2-2 Hikaridai, Seika-cho, Soraku-gun Kyoto, 619-0288, Japan, , Nara Institute of Science and Technology 8916-5 Takayama-cho, Ikoma-shi Nara, 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Nakanishi","sequence":"additional","affiliation":[{"name":"ATR Computational Neuroscience Laboratories Computational Brain Project, ICORP Japan Science and Technology Agency 2-2-2 Hikaridai, Seika-cho, Soraku-gun Kyoto, 619-0288, Japan,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gordon","family":"Cheng","sequence":"additional","affiliation":[{"name":"ATR Computational Neuroscience Laboratories ICORP, Japan Science and Technology Agency 2-2-2 Hikaridai, Seika-cho, Soraku-gun Kyoto, 619-0288, Japan,"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2008,2,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-005-4051-1"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.806"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(97)00043-2"},{"key":"atypb4","volume-title":"Proceedings of the 2nd International Symposium on Adaptive Motion of Animals and Machines (AMAM'03)","author":"Cohen, A.H."},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008920420634"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300015961"},{"key":"atypb7","volume-title":"Proceedings of the 2004 IEEE International Conference on Robotics and Automation (ICRA'04)","author":"Endo, G."},{"key":"atypb8","volume-title":"Proceedings of the 20th National Conference on Artificial Intelligence (AAAI-05)","author":"Endo, G."},{"key":"atypb9","volume-title":"Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA'05)","author":"Endo, G."},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1016\/0166-2236(95)80008-P"},{"key":"atypb11","volume-title":"Proceedings of the 6th International Symposium on Computer Simulation in Biomechanics","author":"Hase, K."},{"issue":"4","key":"atypb12","first-page":"327","volume":"106","author":"Hase, K.","year":"1998","journal-title":"Science"},{"key":"atypb13","volume-title":"Proceedings of the 1998 IEEE International Conference on Robotics and Automation","author":"Hirai, K."},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2004.07.007"},{"issue":"1","key":"atypb15","first-page":"7","volume":"11","author":"Ishiguro, A.","year":"2003","journal-title":"Behavior"},{"key":"atypb16","volume-title":"Proceedings of the 15th International Conference on Machine Learning (ICML-98)","author":"Kimura, H."},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2006.1919"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1137\/S0363012901385691"},{"key":"atypb19","volume-title":"Proceedings of the 2001 IEEE-RAS International Conference on Humanoid Robots (Humanoids2001)","author":"Kuroki, Y."},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2006.05.012"},{"key":"atypb21","first-page":"345","volume":"52","author":"Matsuoka, K.","year":"1985","journal-title":"Cybernetics"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1177\/027836499000900206"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1515\/9780691221540"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.7210\/jrsj.18.87"},{"key":"atypb25","volume-title":"Proceedings of the 19th National Conference on Artificial Intelligence (AAAI'04)","author":"Mori, T."},{"key":"atypb26","volume-title":"Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA'05)","author":"Morimoto, J."},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2000.895195"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198524052.001.0001"},{"key":"atypb29","volume-title":"Proceedings of the 2005 IEEE-RAS International Conference on Humanoid Robots (Humanoids2005)","author":"Park, I."},{"key":"atypb30","volume-title":"Proceedings of the 3rd IEEE International Conference on Humanoid Robots (Humanoids2003)","author":"Peters, J."},{"key":"atypb31","first-page":"1057","volume":"12","author":"Sutton, R.S.","year":"2000","journal-title":"Advances in Neural Information Processing Systems"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1007\/BF00204048"},{"key":"atypb33","volume-title":"Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS'04)","author":"Tedrake, R."},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00048-3"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364907084980","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364907084980","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:16:14Z","timestamp":1777457774000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364907084980"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,2]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2008,2]]}},"alternative-id":["10.1177\/0278364907084980"],"URL":"https:\/\/doi.org\/10.1177\/0278364907084980","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,2]]}}}