{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T00:43:44Z","timestamp":1771029824972,"version":"3.50.1"},"reference-count":65,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61573333"],"award-info":[{"award-number":["61573333"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>\n                    Performing daily interaction tasks such as opening doors and pulling drawers in unstructured environments is a challenging problem for robots. The emergence of soft-bodied robots brings a new perspective to solving this problem. In this paper, inspired by humans performing interaction tasks through simple behaviors, we propose a hierarchical control system for soft arms, in which the low-level controller achieves motion control of the arm tip, the high-level controller controls the behaviors of the arm based on the low-level controller, and the top-level planner chooses what behaviors should be taken according to tasks. To realize the motion control of the soft arm in interacting with environments, we propose two control methods. The first is a feedback control method based on a simplified Jacobian model utilizing the motion laws of the soft arm that are not affected by environments during interaction. The second is a control method based on\n                    <jats:inline-formula>\n                      <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\" overflow=\"scroll\">\n                        <mml:mrow>\n                          <mml:mi mathvariant=\"normal\">Q<\/mml:mi>\n                        <\/mml:mrow>\n                      <\/mml:math>\n                    <\/jats:inline-formula>\n                    -learning, in which we present a novel method to increase training data by setting virtual goals. We implement the hierarchical control system on a platform with the Honeycomb Pneumatic Networks Arm (HPN Arm) and validate the effectiveness of this system on a series of typical daily interaction tasks, which demonstrates this proposed hierarchical control system could render the soft arms to perform interaction tasks as simply as humans, without force sensors or accurate models of the environments. This work provides a new direction for the application of soft-bodied arms and offers a new perspective for the physical interactions between robots and environments.\n                  <\/jats:p>","DOI":"10.1177\/0278364920979367","type":"journal-article","created":{"date-parts":[[2021,1,18]],"date-time":"2021-01-18T04:14:24Z","timestamp":1610943264000},"page":"411-434","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":123,"title":["Hierarchical control of soft manipulators towards unstructured interactions"],"prefix":"10.1177","volume":"40","author":[{"given":"Hao","family":"Jiang","sequence":"first","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]},{"given":"Zhanchi","family":"Wang","sequence":"additional","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]},{"given":"Yusong","family":"Jin","sequence":"additional","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]},{"given":"Xiaotong","family":"Chen","sequence":"additional","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]},{"given":"Peijin","family":"Li","sequence":"additional","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]},{"given":"Yinghao","family":"Gan","sequence":"additional","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]},{"given":"Sen","family":"Lin","sequence":"additional","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]},{"given":"Xiaoping","family":"Chen","sequence":"additional","affiliation":[{"name":"Multi-Agent Systems Lab, School of Computer Science, University of Science and Technology of China, P.R. China"}]}],"member":"179","published-online":{"date-parts":[[2021,1,18]]},"reference":[{"key":"e_1_3_4_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/JRA.1986.1087032"},{"key":"e_1_3_4_3_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.2.253"},{"key":"e_1_3_4_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMECH.2015.2465849"},{"key":"e_1_3_4_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2018.2800115"},{"key":"e_1_3_4_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2013.6696866"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2017.2669367"},{"key":"e_1_3_4_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364915592961"},{"key":"e_1_3_4_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO.2013.6739547"},{"key":"e_1_3_4_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6631138"},{"key":"e_1_3_4_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139264"},{"key":"e_1_3_4_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2015.2428511"},{"key":"e_1_3_4_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s42235-018-0016-x"},{"key":"e_1_3_4_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364920917203."},{"key":"e_1_3_4_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989385"},{"key":"e_1_3_4_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2017.2655109"},{"key":"e_1_3_4_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2018.1528178"},{"key":"e_1_3_4_18_1","doi-asserted-by":"publisher","DOI":"10.23919\/ACC.1984.4788393"},{"key":"e_1_3_4_19_1","doi-asserted-by":"publisher","DOI":"10.1163\/156855312X625371"},{"key":"e_1_3_4_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2005.09.019"},{"key":"e_1_3_4_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/ange.201006464"},{"key":"e_1_3_4_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO.2016.7866347"},{"key":"e_1_3_4_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989727"},{"key":"e_1_3_4_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8206124"},{"key":"e_1_3_4_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6631214"},{"key":"e_1_3_4_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOSOFT.2019.8722804"},{"key":"e_1_3_4_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tibtech.2013.03.002"},{"key":"e_1_3_4_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364913495721"},{"key":"e_1_3_4_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1988.12222"},{"key":"e_1_3_4_30_1","doi-asserted-by":"publisher","DOI":"10.1089\/soro.2016.0065"},{"key":"e_1_3_4_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/0142331216685607"},{"key":"e_1_3_4_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2010.5509909"},{"key":"e_1_3_4_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBIO.2011.6181652"},{"key":"e_1_3_4_34_1","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2019.1587313"},{"key":"e_1_3_4_35_1","doi-asserted-by":"publisher","DOI":"10.1089\/soro.2013.0009"},{"key":"e_1_3_4_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364915587925"},{"key":"e_1_3_4_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1981.4308708"},{"key":"e_1_3_4_38_1","doi-asserted-by":"publisher","DOI":"10.1089\/soro.2018.0065"},{"key":"e_1_3_4_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2017.1364168"},{"key":"e_1_3_4_40_1","volume-title":"IEEE\/RSJ International Conference on Intelligent Robots and Systems, Workshop on Mobile Manipulators: Basic Techniques, New Trends and Applications","author":"Ott C","year":"2005","unstructured":"Ott C, B\u00e4uml B, Borst C, Hirzinger G (2005) Employing Cartesian impedance control for the opening of a door: A case study in mobile manipulation. In: IEEE\/RSJ International Conference on Intelligent Robots and Systems, Workshop on Mobile Manipulators: Basic Techniques, New Trends and Applications."},{"key":"e_1_3_4_41_1","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3182\/9\/1\/016007"},{"key":"e_1_3_4_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2006.03.003"},{"key":"e_1_3_4_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2016.2554078"},{"key":"e_1_3_4_44_1","unstructured":"Quei\u00dfer J (2018) Multi-modal skill memories for online learning of interactive robot movement generation. PhD thesis Universit\u00e4t Bielefeld"},{"key":"e_1_3_4_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/DEVLRN.2018.8761040"},{"key":"e_1_3_4_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.protcy.2016.08.003"},{"key":"e_1_3_4_47_1","doi-asserted-by":"publisher","DOI":"10.1088\/1748-3182\/7\/2\/025006"},{"key":"e_1_3_4_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2287890"},{"key":"e_1_3_4_49_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14543"},{"key":"e_1_3_4_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOSOFT.2018.8404895"},{"key":"e_1_3_4_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793653"},{"key":"e_1_3_4_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/RoboSoft48309.2020.9116003"},{"key":"e_1_3_4_53_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1116564108"},{"key":"e_1_3_4_54_1","doi-asserted-by":"publisher","DOI":"10.2316\/Journal.206.2016.6.206-4591"},{"key":"e_1_3_4_55_1","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R","year":"1988","unstructured":"Sutton R, Barto A (1988) Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press."},{"key":"e_1_3_4_56_1","doi-asserted-by":"publisher","DOI":"10.1089\/soro.2017.0007"},{"key":"e_1_3_4_57_1","doi-asserted-by":"publisher","DOI":"10.1089\/soro.2016.0051"},{"key":"e_1_3_4_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOSOFT.2018.8405380"},{"key":"e_1_3_4_59_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4048223"},{"key":"e_1_3_4_60_1","unstructured":"Watkins CJCH (1989) Learning from delayed rewards. PhD thesis King\u2019s College University of Cambridge."},{"key":"e_1_3_4_61_1","unstructured":"Watson PC (1982) Instrumented remote center compliance device. US patent US4316329A."},{"key":"e_1_3_4_62_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364910368147"},{"issue":"6","key":"e_1_3_4_63_1","first-page":"310","article-title":"Position control of cable-driven robotic soft arm based on deep reinforcement learning","volume":"11","author":"Wu Q","year":"2020","unstructured":"Wu Q, Gu Y, Li Y,et al. (2020) Position control of cable-driven robotic soft arm based on deep reinforcement learning. Information - an International Interdisciplinary Journal 11(6): 310.","journal-title":"Information - an International Interdisciplinary Journal"},{"key":"e_1_3_4_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2014.2309194"},{"key":"e_1_3_4_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2016.2526062"},{"key":"e_1_3_4_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8206123"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364920979367","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0278364920979367","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364920979367","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T18:44:49Z","timestamp":1767638689000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364920979367"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":65,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1177\/0278364920979367"],"URL":"https:\/\/doi.org\/10.1177\/0278364920979367","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]}}}