{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T14:15:47Z","timestamp":1753884947476,"version":"3.41.2"},"reference-count":31,"publisher":"World Scientific Pub Co Pte Ltd","issue":"05","funder":[{"DOI":"10.13039\/501100004489","name":"Mitacs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004489","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Human. Robot."],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:p> We consider the whole-body humanoid gait control model via reinforcement learning, where an initial predefined parametric gait policy is optimized by employing the augmented random search algorithm realizing most of the experiments in simulation and verifying the results onto the real robot. In our proposal, we take into account the reality gap problem, also known as Sim to real problem, for the development of the experiments and the policy guaranteeing functional results in the real robot employing a simplified custom simulator. We show that our proposed learning algorithm allows the humanoid robot MAX-E2 to walk efficiently in virtual and real environments. <\/jats:p>","DOI":"10.1142\/s0219843622500219","type":"journal-article","created":{"date-parts":[[2022,11,2]],"date-time":"2022-11-02T05:38:20Z","timestamp":1667367500000},"source":"Crossref","is-referenced-by-count":2,"title":["Reinforcement Learning for Bipedal Gait with MAX-E2 Humanoid Robot"],"prefix":"10.1142","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5874-721X","authenticated-orcid":false,"given":"David","family":"Yanguas-Rojas","sequence":"first","affiliation":[{"name":"Department of Mechanical and Mechatronics Engineering, Universidad Nacional de Colombia, Carrera 45 #26-85, Bogot\u00e1 D.C., Colombia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eduardo","family":"Mojica-Nava","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Universidad Nacional de Colombia, Carrera 45 #26-85, Bogot\u00e1 D.C., Colombia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alben","family":"Cardenas","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Universit\u00e9 de Qu\u00e9bec \u00e0 Trois-Rivi\u00e8res, 3351 Bd des Forges, Trois-Rivi\u00e8res, Qu\u00e9bec, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2022,11,23]]},"reference":[{"key":"S0219843622500219BIB001","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-071020-045021"},{"volume-title":"Workshop of Physical Agents","year":"2011","author":"Cristiano J.","key":"S0219843622500219BIB002"},{"key":"S0219843622500219BIB003","doi-asserted-by":"publisher","DOI":"10.1142\/S0219843604000083"},{"key":"S0219843622500219BIB004","first-page":"1955","author":"Chevallereau C.","year":"2014","journal-title":"Automatica"},{"key":"S0219843622500219BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2002.806653"},{"key":"S0219843622500219BIB006","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-015-9479-3"},{"key":"S0219843622500219BIB007","volume-title":"Reinforcement Learning","author":"Sutton R. S.","year":"2008","edition":"2"},{"key":"S0219843622500219BIB008","doi-asserted-by":"publisher","DOI":"10.1038\/nature16961"},{"key":"S0219843622500219BIB009","first-page":"1","volume-title":"Int. Conf. Learning Representations 2020 Conf.","author":"Kaiser Lukasz","year":"2019"},{"key":"S0219843622500219BIB010","doi-asserted-by":"crossref","first-page":"25","DOI":"10.3905\/jfds.2020.1.030","volume":"2","author":"Zhang Z.","year":"2020","journal-title":"J. Financ. Data Sci."},{"key":"S0219843622500219BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2016.2522401"},{"key":"S0219843622500219BIB012","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1049\/iet-its.2019.0317","volume":"14","author":"Duan J.","year":"2020","journal-title":"IET Intell. Transp. Syst."},{"key":"S0219843622500219BIB013","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.trc.2018.12.018","volume":"99","author":"Qi X.","year":"2019","journal-title":"Transp. Res. C, Emerg. Technol."},{"journal-title":"Robot., Sci. Syst.","year":"2019","author":"Singh A.","key":"S0219843622500219BIB014"},{"volume-title":"Proc. Australasian Conf. on Robotics and Automation","year":"2015","author":"Zhang F.","key":"S0219843622500219BIB015"},{"key":"S0219843622500219BIB016","first-page":"23","volume-title":"IEEE Int. Conf. Intelligent Robots and Systems","author":"Tobin J.","year":"2017"},{"volume-title":"3rd Conf. oRobot Learning (CoRL 2019)","year":"2019","author":"Xie Z.","key":"S0219843622500219BIB018"},{"key":"S0219843622500219BIB019","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1177\/0278364908095171","volume":"28","author":"Hemker T.","year":"2009","journal-title":"Int. J. Robot. Res."},{"key":"S0219843622500219BIB020","doi-asserted-by":"crossref","first-page":"2047","DOI":"10.1109\/LRA.2022.3143227","volume":"7","author":"Krishna L.","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"volume-title":"32nd Conf. Neural Information Processing Systems (NeurIPS 2018)","year":"2018","author":"Mania H.","key":"S0219843622500219BIB021"},{"journal-title":"Google Deepmind","year":"2018","author":"Tan J.","key":"S0219843622500219BIB022"},{"key":"S0219843622500219BIB024","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-32552-1"},{"key":"S0219843622500219BIB026","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/s11044-019-09667-3","volume":"46","author":"Arcos-Legarda J.","year":"2019","journal-title":"Multibody Syst. Dyn."},{"key":"S0219843622500219BIB027","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1986.289285"},{"key":"S0219843622500219BIB028","first-page":"213","volume-title":"ACM SIGGRAPH\/Eurographics Symp. Computer Animation, SCA","author":"Xie Z.","year":"2020"},{"key":"S0219843622500219BIB029","first-page":"279","volume-title":"IEEE-RAS Int. Conf. Humanoid Robots","author":"Deits R.","year":"2015"},{"key":"S0219843622500219BIB030","first-page":"726","volume-title":"2019 6th Int. Conf. Control, Decision and Information Technologies","author":"Sanchez-Magos M.","year":"2019"},{"key":"S0219843622500219BIB031","first-page":"136","volume":"8","author":"Bharadwaj D.","year":"2019","journal-title":"Int. J. Innov. Technol. Explor. Eng."},{"key":"S0219843622500219BIB032","series-title":"International Series in Operations Research and Management Science","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-85450-8","volume-title":"Penalty and Barrier Methods","volume":"228","author":"Luenberger D. G.","year":"2021"},{"key":"S0219843622500219BIB034","doi-asserted-by":"crossref","first-page":"4019","DOI":"10.1109\/CEC.2007.4424995","volume-title":"2007 IEEE Congress on Evolutionary Computation","author":"Kulvanit P.","year":"2007"},{"issue":"2","key":"S0219843622500219BIB035","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1152\/japplphysiol.00767.2005","volume":"100","author":"Browning R. C.","year":"2006","journal-title":"J. Appl. Physiol."}],"container-title":["International Journal of Humanoid Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219843622500219","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T07:40:32Z","timestamp":1671522032000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0219843622500219"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10]]},"references-count":31,"journal-issue":{"issue":"05","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["10.1142\/S0219843622500219"],"URL":"https:\/\/doi.org\/10.1142\/s0219843622500219","relation":{},"ISSN":["0219-8436","1793-6942"],"issn-type":[{"type":"print","value":"0219-8436"},{"type":"electronic","value":"1793-6942"}],"subject":[],"published":{"date-parts":[[2022,10]]},"article-number":"2250021"}}