{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,11]],"date-time":"2025-09-11T19:21:18Z","timestamp":1757618478421,"version":"3.44.0"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T00:00:00Z","timestamp":1750982400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T00:00:00Z","timestamp":1750982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach. Intell. Res."],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Reactive planning and control capacity for collaborative robots is essential when the tasks change online in an unstructured environment. This is more difficult for collaborative mobile manipulators (CMM) due to high redundancies. To this end, this paper proposed a reactive whole-body locomotion-integrated manipulation approach based on combined learning and optimization. First, human demonstrations are collected, where the wrist and pelvis movements are treated as whole-body trajectories, mapping to the end-effector (EE) and the mobile base (MB) of CMM, respectively. A time-input kernelized movement primitive (T-KMP) learns the whole-body trajectory, and a multi-dimensional kernelized movement primitive (M-KMP) learns the spatial relationship between the MB and EE pose. According to task changes, the T-KMP adapts the learned trajectories online by inserting the new desired point predicted by M-KMP. Then, the updated reference trajectories are sent to a hierarchical quadratic programming (HQP) controller, where the EE and the MB trajectories tracking are set as the first and second priority tasks, generating the feasible and optimal joint level commands. An ablation simulation experiment with CMM of the HQP is conducted to show the necessity of MB trajectory tracking in mimicking human whole-body motion behavior. Finally, the tasks of the reactive pick-and-place and reactive reaching were undertaken, where the target object was randomly moved, even out of the region of demonstrations. The results showed that the proposed approach can successfully transfer and adapt the human whole-body loco-manipulation skills to CMM online with task changes.<\/jats:p>","DOI":"10.1007\/s11633-024-1538-9","type":"journal-article","created":{"date-parts":[[2025,6,28]],"date-time":"2025-06-28T03:00:08Z","timestamp":1751079608000},"page":"627-640","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reactive Whole-body Locomotion-integrated Manipulation Based on Combined Learning and Optimization"],"prefix":"10.1007","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0860-4768","authenticated-orcid":false,"given":"Jianzhuang","family":"Zhao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4064-1043","authenticated-orcid":false,"given":"Tao","family":"Teng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8819-2734","authenticated-orcid":false,"given":"Elena","family":"De Momi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1261-737X","authenticated-orcid":false,"given":"Arash","family":"Ajoudani","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,6,27]]},"reference":[{"issue":"5","key":"1538_CR1","doi-asserted-by":"publisher","first-page":"957","DOI":"10.1007\/s10514-017-9677-2","volume":"42","author":"A Ajoudani","year":"2018","unstructured":"A. Ajoudani, A. M. Zanchettin, S. Ivaldi, A. Albu-Sch\u00e4ffer, K. Kosuge, O. Khatib. Progress and prospects of the human-robot collaboration. Autonomous Robots, vol. 42, no. 5, pp. 957\u2013975, 2018. DOI: https:\/\/doi.org\/10.1007\/s10514-017-9677-2.","journal-title":"Autonomous Robots"},{"issue":"4","key":"1538_CR2","doi-asserted-by":"publisher","first-page":"3593","DOI":"10.1109\/LRA.2019.2928757","volume":"4","author":"Y Wu","year":"2019","unstructured":"Y. Wu, P. Balatti, M. Lorenzini, F. Zhao, W. Kim, A. Ajoudani. A teleoperation interface for loco-manipulation control of mobile collaborative robotic assistant. IEEE Robotics and Automation Letters, vol. 4, no. 4, pp. 3593\u20133600, 2019. DOI: https:\/\/doi.org\/10.1109\/LRA.2019.2928757.","journal-title":"IEEE Robotics and Automation Letters"},{"key":"1538_CR3","doi-asserted-by":"publisher","first-page":"9128","DOI":"10.1109\/ICRA40945.2020.9196850","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation","author":"E Lamon","year":"2020","unstructured":"E. Lamon, M. Leonori, W. Kim, A. Ajoudani. Towards an intelligent collaborative robotic system for mixed case palletizing. In Proceedings of IEEE International Conference on Robotics and Automation, Paris, France, pp. 9128\u20139134, 2020. DOI: https:\/\/doi.org\/10.1109\/ICRA40945.2020.9196850."},{"key":"1538_CR4","doi-asserted-by":"publisher","unstructured":"T. Teng, X. Wu, Z. Li, D. Caldwell, F. Chen. Robust shared control with stable contact servoing for enhanced object transportation by telerobotic bimanual mobile manipulators. Journal of Field Robotics, published online. DOI: https:\/\/doi.org\/10.1002\/rob.22464.","DOI":"10.1002\/rob.22464"},{"issue":"6","key":"1538_CR5","doi-asserted-by":"publisher","first-page":"2888","DOI":"10.1109\/TMECH.2020.3047919","volume":"26","author":"X Liu","year":"2021","unstructured":"X. Liu, S. S. Ge, F. Zhao, X. Mei. Optimized interaction control for robot manipulator interacting with flexible environment. IEEE\/ASME Transactions on Mechatronics, vol. 26, no. 6, pp. 2888\u20132898, 2021. DOI: https:\/\/doi.org\/10.1109\/TMECH.2020.3047919.","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"issue":"2","key":"1538_CR6","doi-asserted-by":"publisher","first-page":"1050","DOI":"10.1109\/TRO.2022.3226144","volume":"39","author":"C Pezzato","year":"2023","unstructured":"C. Pezzato, C. H. Corbato, S. Bonhof, M. Wisse. Active inference and behavior trees for reactive action planning and execution in robotics. IEEE Transactions on Robotics, vol. 39, no. 2, pp. 1050\u20131069, 2023. DOI: https:\/\/doi.org\/10.1109\/TRO.2022.3226144.","journal-title":"IEEE Transactions on Robotics"},{"key":"1538_CR7","doi-asserted-by":"publisher","unstructured":"L. Zhang, J. Zhao, E. Lamon, Y. Wang, X. Hong. Energy efficient multi-robot task allocation constrained by time window and precedence. IEEE Transactions on Automation Science and Engineering, published online. DOI: https:\/\/doi.org\/10.1109\/TASE.2023.3312214.","DOI":"10.1109\/TASE.2023.3312214"},{"issue":"3","key":"1538_CR8","doi-asserted-by":"publisher","first-page":"8036","DOI":"10.1109\/LRA.2022.3187258","volume":"7","author":"J Zhao","year":"2022","unstructured":"J. Zhao, A. Giammarino, E. Lamon, J. M. Gandarias, E. D. Momi, A. Ajoudani. A hybrid learning and optimization framework to achieve physically interactive tasks with mobile manipulators. IEEE Robotics and Automation Letters, vol. 7, no. 3, pp. 8036\u20138043, 2022. DOI: https:\/\/doi.org\/10.1109\/LRA.2022.3187258.","journal-title":"IEEE Robotics and Automation Letters"},{"key":"1538_CR9","doi-asserted-by":"publisher","unstructured":"J. Fu, I. Burzo, E. Iovene, J. Zhao, G. Ferrigno, E. De Momi. Optimization-based variable impedance control of robotic manipulator for medical contact tasks. IEEE Transactions on Instrumentation and Measurement, vol. 73, Article number 4004608, 2024. DOI: https:\/\/doi.org\/10.1109\/TIM.2024.3372209.","DOI":"10.1109\/TIM.2024.3372209"},{"key":"1538_CR10","doi-asserted-by":"publisher","first-page":"2748","DOI":"10.1109\/ICRA.2015.7139572","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation","author":"A M Zanchettin","year":"2015","unstructured":"A. M. Zanchettin, P. Rocco. Reactive motion planning and control for compliant and constraint-based task execution. In Proceedings of IEEE International Conference on Robotics and Automation, Seattle, USA, pp. 2748\u20132753, 2015. DOI: https:\/\/doi.org\/10.1109\/ICRA.2015.7139572."},{"key":"1538_CR11","doi-asserted-by":"publisher","first-page":"3568","DOI":"10.1109\/ICRA48506.2021.9561506","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation","author":"F Tassi","year":"2021","unstructured":"F. Tassi, E. De Momi, A. Ajoudani. Augmented hierarchical quadratic programming for adaptive compliance robot control. In Proceedings of IEEE International Conference on Robotics and Automation, Xi\u2019an, China, pp. 3568\u20133574, 2021. DOI: https:\/\/doi.org\/10.1109\/ICRA48506.2021.9561506."},{"key":"1538_CR12","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1109\/CASE49439.2021.9551432","volume-title":"Proceedings of the 17th International Conference on Automation Science and Engineering","author":"A Mavrommati","year":"2021","unstructured":"A. Mavrommati, C. Osorio, R. G. Valenti, A. Rajhans, P. J. Mosterman. An application of model predictive control to reactive motion planning of robot manipulators. In Proceedings of the 17th International Conference on Automation Science and Engineering, Lyon, France, pp. 915\u2013920, 2021. DOI: https:\/\/doi.org\/10.1109\/CASE49439.2021.9551432."},{"issue":"4","key":"1538_CR13","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/MRA.2015.2486583","volume":"22","author":"M A Roa","year":"2015","unstructured":"M. A. Roa, D. Berenson, W. Huang. Mobile manipulation: Toward smart manufacturing. IEEE Robotics & Automation Magazine, vol. 22, no. 4, pp. 14\u201315, 2015. DOI: https:\/\/doi.org\/10.1109\/MRA.2015.2486583.","journal-title":"IEEE Robotics & Automation Magazine"},{"key":"1538_CR14","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1109\/ICARM52023.2021.9536083","volume-title":"Proceedings of the 6th IEEE International Conference on Advanced Robotics and Mechatronics","author":"T Teng","year":"2021","unstructured":"T. Teng, M. Fernandes, M. Gatti, S. Poni, C. Semini, D. Caldwell, F. Chen. Whole-body control on non-holonomic mobile manipulation for grapevine winter pruning automation. In Proceedings of the 6th IEEE International Conference on Advanced Robotics and Mechatronics, Chongqing, China, pp. 37\u201342, 2021. DOI: https:\/\/doi.org\/10.1109\/ICARM52023.2021.9536083."},{"key":"1538_CR15","doi-asserted-by":"publisher","unstructured":"T. Sandakalum, M. H. Jr. Ang. Motion planning for mobile manipulators\u2013A systematic review. Machines, vol. 10, no. 2, Article number 97, 2022. DOI: https:\/\/doi.org\/10.3390\/machines10020097.","DOI":"10.3390\/machines10020097"},{"key":"1538_CR16","doi-asserted-by":"crossref","unstructured":"J. Zhao, F. Tassi, Y. Huang, E. De Momi, A. Ajoudani. A combined learning and optimization framework to transfer human whole-body loco-manipulation skills to mobile manipulators, [Online], Available: https:\/\/arxiv.org\/abs\/2402.13915, 2024.","DOI":"10.1016\/j.robot.2025.104958"},{"issue":"11","key":"1538_CR17","doi-asserted-by":"publisher","first-page":"14492","DOI":"10.1109\/TIE.2024.3370969","volume":"71","author":"Y Yang","year":"2024","unstructured":"Y. Yang, F. Meng, Z. Meng, C. Yang. RAMPAGE: Toward whole-body, real-time, and agile motion planning in unknown cluttered environments for mobile manipulators. IEEE Transactions on Industrial Electronics, vol. 71, no. 11, pp. 14492\u201314502, 2024. DOI: https:\/\/doi.org\/10.1109\/TIE.2024.3370969.","journal-title":"IEEE Transactions on Industrial Electronics"},{"key":"1538_CR18","doi-asserted-by":"publisher","first-page":"1970","DOI":"10.1109\/ICRA.2013.6630839","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation","author":"N Vahrenkamp","year":"2013","unstructured":"N. Vahrenkamp, T. Asfour, R. Dillmann. Robot placement based on reachability inversion. In Proceedings of IEEE International Conference on Robotics and Automation, Karlsruhe, Germany, pp. 1970\u20131975, 2013. DOI: https:\/\/doi.org\/10.1109\/ICRA.2013.6630839."},{"issue":"3","key":"1538_CR19","doi-asserted-by":"publisher","first-page":"8399","DOI":"10.1109\/LRA.2022.3188109","volume":"7","author":"S Jauhri","year":"2022","unstructured":"S. Jauhri, J. Peters, G. Chalvatzaki. Robot learning of mobile manipulation with reachability behavior priors. IEEE Robotics and Automation Letters, vol. 7, no. 3, pp. 8399\u20138406, 2022. DOI: https:\/\/doi.org\/10.1109\/LRA.2022.3188109.","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"4","key":"1538_CR20","doi-asserted-by":"publisher","first-page":"6177","DOI":"10.1109\/LRA.2020.3010721","volume":"5","author":"J Pankert","year":"2020","unstructured":"J. Pankert, M. Hutter. Perceptive model predictive control for continuous mobile manipulation. IEEE Robotics and Automation Letters, vol. 5, no. 4, pp. 6177\u20136184, 2020. DOI: https:\/\/doi.org\/10.1109\/LRA.2020.3010721.","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"12","key":"1538_CR21","doi-asserted-by":"publisher","first-page":"7986","DOI":"10.1109\/LRA.2023.3324520","volume":"8","author":"A Heins","year":"2023","unstructured":"A. Heins, A. P. Schoellig. Keep it upright: Model predictive control for nonprehensile object transportation with obstacle avoidance on a mobile manipulator. IEEE Robotics and Automation Letters, vol. 8, no. 12, pp. 7986\u20137993, 2023. DOI: https:\/\/doi.org\/10.1109\/LRA.2023.3324520.","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"2","key":"1538_CR22","doi-asserted-by":"publisher","first-page":"3122","DOI":"10.1109\/LRA.2022.3146554","volume":"7","author":"J Haviland","year":"2022","unstructured":"J. Haviland, N. S\u00fcnderhauf, P. Corke. A holistic approach to reactive mobile manipulation. IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 3122\u20133129, 2022. DOI: https:\/\/doi.org\/10.1109\/LRA.2022.3146554.","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"3","key":"1538_CR23","doi-asserted-by":"publisher","first-page":"1193","DOI":"10.1109\/TMECH.2018.2817589","volume":"23","author":"C Yang","year":"2018","unstructured":"C. Yang, C. Zeng, C. Fang, W. He, Z. Li. A dmps-based framework for robot learning and generalization of humanlike variable impedance skills. IEEE\/ASME Transactions on Mechatronics, vol. 23, no. 3, pp. 1193\u20131203, 2018. DOI: https:\/\/doi.org\/10.1109\/TMECH.2018.2817589.","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"key":"1538_CR24","doi-asserted-by":"publisher","first-page":"4428","DOI":"10.1109\/IROS55552.2023.10341600","volume-title":"Proceedings of IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"J Zhao","year":"2023","unstructured":"J. Zhao, G. J. G. Lahr, F. Tassi, A. Santopaolo, E. De Momi, A. Ajoudani. Impact-friendly object catching at non-zero velocity based on combined optimization and learning. In Proceedings of IEEE\/RSJ International Conference on Intelligent Robots and Systems, Detroit, USA, pp. 4428\u20134435, 2023. DOI: https:\/\/doi.org\/10.1109\/IROS55552.2023.10341600."},{"key":"1538_CR25","doi-asserted-by":"publisher","unstructured":"T. Teng, M. Gatti, S. Poni, D. Caldwell, F. Chen. Fuzzy dynamical system for robot learning motion skills from human demonstration. Robotics and Autonomous Systems, vol. 164, Article number 104406, 2023. DOI: https:\/\/doi.org\/10.1016\/j.robot.2023.104406.","DOI":"10.1016\/j.robot.2023.104406"},{"key":"1538_CR26","doi-asserted-by":"publisher","first-page":"3196","DOI":"10.1109\/IROS.2017.8206152","volume-title":"Proceedings of IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"T Welschehold","year":"2017","unstructured":"T. Welschehold, C. Dornhege, W. Burgard. Learning mobile manipulation actions from human demonstrations. In Proceedings of IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vancouver, Canada, pp. 3196\u20133201, 2017. DOI: https:\/\/doi.org\/10.1109\/IROS.2017.8206152."},{"issue":"7","key":"1538_CR27","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1177\/0278364919846363","volume":"38","author":"Y Huang","year":"2019","unstructured":"Y. Huang, L. Rozo, J. Silv\u00e9rio, D. G. Caldwell. Kernelized movement primitives. The International Journal of Robotics Research, vol. 38, no. 7, pp. 833\u2013852, 2019. DOI: https:\/\/doi.org\/10.1177\/0278364919846363.","journal-title":"The International Journal of Robotics Research"},{"key":"1538_CR28","doi-asserted-by":"publisher","first-page":"2988","DOI":"10.1109\/ICRA48891.2023.10161065","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation","author":"J Silv\u00e9rio","year":"2023","unstructured":"J. Silv\u00e9rio, Y. Huang. A non-parametric skill representation with soft null space projectors for fast generalization. In Proceedings of IEEE International Conference on Robotics and Automation, London, UK, pp. 2988\u20132994, 2023. DOI: https:\/\/doi.org\/10.1109\/ICRA48891.2023.10161065."}],"container-title":["Machine Intelligence Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11633-024-1538-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11633-024-1538-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11633-024-1538-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,6]],"date-time":"2025-09-06T23:32:30Z","timestamp":1757201550000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11633-024-1538-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,27]]},"references-count":28,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["1538"],"URL":"https:\/\/doi.org\/10.1007\/s11633-024-1538-9","relation":{},"ISSN":["2731-538X","2731-5398"],"issn-type":[{"type":"print","value":"2731-538X"},{"type":"electronic","value":"2731-5398"}],"subject":[],"published":{"date-parts":[[2025,6,27]]},"assertion":[{"value":"10 September 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declared that they have no conflicts of interest to this work.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations of conflict of interest"}}]}}