{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,12]],"date-time":"2026-07-12T02:56:17Z","timestamp":1783824977941,"version":"3.55.0"},"reference-count":33,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2023,11,4]],"date-time":"2023-11-04T00:00:00Z","timestamp":1699056000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62201375"],"award-info":[{"award-number":["62201375"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62072291"],"award-info":[{"award-number":["62072291"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972454"],"award-info":[{"award-number":["61972454"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20220635"],"award-info":[{"award-number":["BK20220635"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20201405"],"award-info":[{"award-number":["BK20201405"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>Due to the nonlinearity and underactuation of bipedal robots, developing efficient jumping strategies remains challenging. To address this, a multiobjective collaborative deep reinforcement learning algorithm based on the actor\u2010critic framework is presented. Initially, two deep deterministic policy gradient (DDPG) networks are established for training the jumping motion, each focusing on different objectives and collaboratively learning the optimal jumping policy. Following this, a recovery experience replay mechanism, predicated on dynamic time warping, is integrated into the DDPG to enhance sample utilization efficiency. Concurrently, a timely adjustment unit is incorporated, which works in tandem with the training frequency to improve the convergence accuracy of the algorithm. Additionally, a Markov decision process is designed to manage the complexity and parameter uncertainty in the dynamic model of the bipedal robot. Finally, the proposed method is validated on a PyBullet platform. The results show that the method outperforms baseline methods by improving learning speed and enabling robust jumps with greater height and distance.<\/jats:p>","DOI":"10.1002\/aisy.202300352","type":"journal-article","created":{"date-parts":[[2023,11,4]],"date-time":"2023-11-04T04:26:42Z","timestamp":1699072002000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A Multiobjective Collaborative Deep Reinforcement Learning Algorithm for Jumping Optimization of Bipedal Robot"],"prefix":"10.1002","volume":"6","author":[{"given":"Chongben","family":"Tao","sequence":"first","affiliation":[{"name":"School of Electronic and Information Engineering Suzhou University of Science and Technology  Suzhou 215009 China"},{"name":"Suzhou Automobile Research Institute Tsinghua University  Suzhou 215134 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6236-1138","authenticated-orcid":false,"given":"Mengru","family":"Li","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering Suzhou University of Science and Technology  Suzhou 215009 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5276-0026","authenticated-orcid":false,"given":"Feng","family":"Cao","sequence":"additional","affiliation":[{"name":"School of Computer and Information Technology Shanxi University  Taiyuan 030006 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhen","family":"Gao","sequence":"additional","affiliation":[{"name":"Faculty of Engineering McMaster University  Hamilton ON L8S 0A Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zufeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Automation Tsinghua University  Beijing 100084 China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2023,11,4]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202100038"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2020.3047787"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2019.103362"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aav4282"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3099226"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3076959"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202300072"},{"key":"e_1_2_10_9_1","doi-asserted-by":"crossref","unstructured":"X.Xiong A. D.Ames in2018 IEEE\/RSJ Inter. Conf. on Intelligent Robots and Systems (IROS) IEEE Piscataway NJ2018 pp.3821\u20133828.","DOI":"10.1109\/IROS.2018.8593547"},{"key":"e_1_2_10_10_1","doi-asserted-by":"crossref","unstructured":"T.Sugihara K.Imanishi T.Yamamoto S.Caron in2021 IEEE Inter. Conf. on Robotics and Automation (ICRA) IEEE Piscataway NJ2021 pp.6258\u20136263.","DOI":"10.1109\/ICRA48506.2021.9561503"},{"key":"e_1_2_10_11_1","doi-asserted-by":"crossref","unstructured":"A.Sripada J.Vistapalli R. P.Kumar in2018 IEEE Inter. Conf. on Robotics and Biomimetics (ROBIO) IEEE Piscataway NJ2018 pp.1683\u20131687.","DOI":"10.1109\/ROBIO.2018.8665223"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2016.2614272"},{"key":"e_1_2_10_13_1","doi-asserted-by":"crossref","unstructured":"J.Shen Y.Liu X.Zhang D.Hong in202017th Inter. Conf. on Ubiquitous Robots (UR) IEEE Piscataway NJ2020 pp.205\u2013212.","DOI":"10.1109\/UR49135.2020.9144799"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202200339"},{"key":"e_1_2_10_15_1","doi-asserted-by":"crossref","unstructured":"A. F.Muzio M. R.Maximo T.Yoneyama in2020 Latin American Robotics Symposium (LARS) 2020 Brazilian Symposium on Robotics (SBR) and 2020 Workshop on Robotics in Education (WRE) IEEE Piscataway NJ2020 pp.1\u20136.","DOI":"10.1109\/LARS\/SBR\/WRE51543.2020.9307084"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.abb9764"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSII.2022.3145373"},{"key":"e_1_2_10_18_1","unstructured":"G.Bellegarda Q.Nguyen arXiv preprint arXiv:2011.07089 2020."},{"key":"e_1_2_10_19_1","doi-asserted-by":"crossref","unstructured":"Q.Wei M.Luo J.Zhao F.Guo in2017 IEEE Inter. Conf. on Mechatronics and Automation (ICMA) IEEE Piscataway NJ2017 pp.1608\u20131613.","DOI":"10.1109\/ICMA.2017.8016057"},{"key":"e_1_2_10_20_1","unstructured":"J. A.Eknathet al. Ph.D. Dissertation Indian Institute of Technology Hyderabad 2018."},{"key":"e_1_2_10_21_1","doi-asserted-by":"crossref","unstructured":"W.Liao X.Chen G.Huang H.Qi Q.Li Z.Yu Q.Huang in2019 IEEE Inter. Conf. on Advanced Robotics and its Social Impacts (ARSO) IEEE Piscataway NJ2019 pp.61\u201367.","DOI":"10.1109\/ARSO46408.2019.8948791"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2018.2852785"},{"key":"e_1_2_10_23_1","doi-asserted-by":"crossref","unstructured":"Y.Ding M.Zhang C.Li H. W.Park K.Hauser in2021 IEEE Inter. Conf. on Robotics and Automation (ICRA) IEEE Piscataway NJ2021 pp.2839\u20132845.","DOI":"10.1109\/ICRA48506.2021.9561939"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12541-020-00360-6"},{"key":"e_1_2_10_25_1","doi-asserted-by":"publisher","DOI":"10.3390\/app9030502"},{"key":"e_1_2_10_26_1","doi-asserted-by":"crossref","unstructured":"G.Bellegarda Y.Chen Z.Liu Q.Nguyen in2022IEEE\/RSJ Inter. Conf. on Intelligent Robots and Systems (IROS) Kyoto Japan October2022 pp.10364\u201310370.","DOI":"10.1109\/IROS47612.2022.9982132"},{"key":"e_1_2_10_27_1","doi-asserted-by":"crossref","unstructured":"D.Rodriguez S.Behnke in2021 IEEE Inter. Conf. on Robotics and Automation (ICRA) IEEE Piscataway NJ2021 pp.3033\u20133039.","DOI":"10.1109\/ICRA48506.2021.9561717"},{"key":"e_1_2_10_28_1","doi-asserted-by":"crossref","unstructured":"H.Duan A.Malik J.Dao A.Saxena K.Green J.Siekmann A.Fern J.Hurst in2022 Inter. Conf. on Robotics and Automation (ICRA) IEEE Piscataway NJ2022 pp.10428\u201310434.","DOI":"10.1109\/ICRA46639.2022.9812015"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-022-01619-y"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.abc5986"},{"key":"e_1_2_10_31_1","doi-asserted-by":"crossref","unstructured":"A.Escontrela X. B.Peng W.Yu T.Zhang A.Iscen K.Goldberg P.Abbeel in2022IEEE\/RSJ Inter. Conf. on Intelligent Robots and Systems (IROS) Kyoto Japan October2022 pp.25\u201332.","DOI":"10.1109\/IROS47612.2022.9981973"},{"key":"e_1_2_10_32_1","doi-asserted-by":"crossref","unstructured":"R.Batke F.Yu J.Dao J.Hurst R. L.Hatton A.Fern K.Green in2022IEEE-RAS 21st Inter. Conf. on Humanoid Robots (Humanoids) Ginowan Japan November2022 pp.714\u2013721.","DOI":"10.1109\/Humanoids53995.2022.9999741"},{"key":"e_1_2_10_33_1","unstructured":"G.Novati P.Koumoutsakos inInter. Conf. on Machine Learning PMLR California USA June2019 pp.4851\u20134860."},{"key":"e_1_2_10_34_1","first-page":"1","volume":"37","author":"Zhang H.","year":"2018","journal-title":"ACM Trans. Graph."}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202300352","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T23:11:55Z","timestamp":1759878715000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202300352"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,4]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1002\/aisy.202300352"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202300352","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"value":"2640-4567","type":"print"},{"value":"2640-4567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,4]]},"assertion":[{"value":"2023-06-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2300352"}}