{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T10:03:18Z","timestamp":1777716198019,"version":"3.51.4"},"reference-count":33,"publisher":"SAGE Publications","issue":"7","license":[{"start":{"date-parts":[[2024,12,10]],"date-time":"2024-12-10T00:00:00Z","timestamp":1733788800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:p>In this work, we propose a vision-based and finite element method (FEM)-based controller to automate the 3D shaping of soft objects with dual-arm robots. Our controller relies on a data-based approach to learn how the robot\u2019s actions result in object deformations, while also running FEM-based simulations to infer the shape of the whole body. These model-based simulations are used to generate initial shape data, allowing to extract visual features through a principal component analysis and thus estimate the interaction matrix of the object\u2013robot system. In contrast with most existing shape servoing controllers, our new model-based approach continuously predicts the object deformations produced by the robot, which are then compared to the visually observed deformation feedback. This iterative process enables to correct the deformed mesh model before updating the interaction matrix. To validate this new control methodology, we present a detailed experimental study with a dual-arm robot and different soft objects, which showcases the performance of our automatic shaping framework.<\/jats:p>","DOI":"10.1177\/02783649241301076","type":"journal-article","created":{"date-parts":[[2024,12,11]],"date-time":"2024-12-11T02:59:18Z","timestamp":1733885958000},"page":"1138-1155","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Dual-arm shaping of soft objects in 3D based on visual servoing and online FEM simulations"],"prefix":"10.1177","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1576-5180","authenticated-orcid":false,"given":"C\u00e9lia","family":"Saghour","sequence":"first","affiliation":[{"name":"LIRMM, Universit\u00e9 de Montpellier, CNRS, Montpellier, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3426-6638","authenticated-orcid":false,"given":"David","family":"Navarro-Alarc\u00f3n","sequence":"additional","affiliation":[{"name":"The Hong Kong Polytechnic University, Kowloon, Hong Kong"}]},{"given":"Philippe","family":"Fraisse","sequence":"additional","affiliation":[{"name":"LIRMM, Universit\u00e9 de Montpellier, CNRS, Montpellier, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7272-6922","authenticated-orcid":false,"given":"Andrea","family":"Cherubini","sequence":"additional","affiliation":[{"name":"Nantes Universit\u00e9, \u00c9cole Centrale Nantes, CNRS, Nantes, France"}]}],"member":"179","published-online":{"date-parts":[[2024,12,10]]},"reference":[{"key":"e_1_3_5_2_1","doi-asserted-by":"publisher","unstructured":"Aghajanzadeh O Aranda M L\u00f3pez-Nicol\u00e1s G et al. (2022a) An offline geometric model for controlling the shape of elastic linear objects. In: 2022 IEEE\/RSJ international conference on intelligent robots and systems (IROS) Kyoto Japan 23\u201327 October 2022 pp. 2175\u20132181. DOI: 10.1109\/IROS47612.2022.9981466.","DOI":"10.1109\/IROS47612.2022.9981466"},{"key":"e_1_3_5_3_1","doi-asserted-by":"publisher","unstructured":"Aghajanzadeh O Picard G Ramon JAC et al. (2022b) Optimal deformation control framework for elastic linear objects. In: 2022 IEEE 18th international conference on automation science and engineering (CASE) Mexico City Mexico 20\u201324 August 2022 pp. 722\u2013728. DOI: 10.1109\/CASE49997.2022.9926528.","DOI":"10.1109\/CASE49997.2022.9926528"},{"key":"e_1_3_5_4_1","doi-asserted-by":"publisher","unstructured":"Andronas D Kampourakis E Bakopoulou K et al. (2021) Model-based robot control for human-robot flexible material co-manipulation. In: 2021 26th IEEE international conference on emerging technologies and factory automation (ETFA) Vasteras Sweden 7\u201310 September 2021 pp. 1\u20138. DOI: 10.1109\/ETFA45728.2021.9613235.","DOI":"10.1109\/ETFA45728.2021.9613235"},{"key":"e_1_3_5_5_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781420057775"},{"key":"e_1_3_5_6_1","doi-asserted-by":"publisher","unstructured":"Azad A Quentin H Faiz BA et al. (2023) Optimal cosserat-based deformation control for robotic manipulation of linear objects. In: 2023 IEEE\/ASME international conference on advanced intelligent mechatronics (AIM) Seattle WA 28\u201330 June 2023 pp. 381\u2013388. DOI: 10.1109\/AIM46323.2023.10196216.","DOI":"10.1109\/AIM46323.2023.10196216"},{"key":"e_1_3_5_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2022.3154477"},{"key":"e_1_3_5_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470612286.ch6"},{"key":"e_1_3_5_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2017.1395362"},{"key":"e_1_3_5_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/8415_2012_125"},{"key":"e_1_3_5_11_1","doi-asserted-by":"crossref","unstructured":"Ficuciello F Migliozzi A Coevoet E et al. (2018) Fem-based deformation control for dexterous manipulation of 3d soft objects. In: 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS) Madrid Spain 1\u20135 October 2018 4007\u20134013. IEEE.","DOI":"10.1109\/IROS.2018.8593512"},{"key":"e_1_3_5_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2018.2861900"},{"key":"e_1_3_5_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2019.2930476"},{"key":"e_1_3_5_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2020.3007114"},{"key":"e_1_3_5_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3130377"},{"key":"e_1_3_5_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2023.3280808"},{"key":"e_1_3_5_17_1","first-page":"281","volume-title":"Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability","author":"MacQueen J","year":"1967","unstructured":"MacQueen J (1967) Classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. Los Angeles, CA: University of California Los Angeles, 281\u2013297."},{"key":"e_1_3_5_18_1","doi-asserted-by":"crossref","unstructured":"Makiyeh F Chaumette F Marchal M et al. (2023) Shape servoing of a soft object using fourier series and a physics-based model. In: IEEE\/RSJ international conference on intelligent robots and systems Detroit MI 1\u20135 October 2023 pp. 6356\u20136363.","DOI":"10.1109\/IROS55552.2023.10342354"},{"key":"e_1_3_5_19_1","unstructured":"Maneewongvatana S Mount DM (1999) Analysis of approximate nearest neighbor searching with clustered point sets. ArXiv Preprint cs\/9901013."},{"key":"e_1_3_5_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2533639"},{"key":"e_1_3_5_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMECH.2021.3126383"},{"key":"e_1_3_5_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.isatra.2024.05.015"},{"key":"e_1_3_5_23_1","doi-asserted-by":"publisher","unstructured":"Ruan M McConachie D Berenson D (2018) Accounting for directional rigidity and constraints in control for manipulation of deformable objects without physical simulation. In: 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS) Madrid Spain 1\u20135 October 2018 pp. 512\u2013519. DOI: 10.1109\/IROS.2018.8594520.","DOI":"10.1109\/IROS.2018.8594520"},{"key":"e_1_3_5_24_1","doi-asserted-by":"crossref","unstructured":"Saghour C C\u00e9l\u00e9rier M Fraisse P et al. (2023) Visual servoing for dual arm shaping of soft objects in 3d. In: IEEE-RAS 22nd international conference on humanoid robots (humanoids) Austin TX 12\u201314 December 2023.","DOI":"10.1109\/Humanoids57100.2023.10375172"},{"key":"e_1_3_5_25_1","doi-asserted-by":"publisher","unstructured":"Seita D Florence P Tompson J et al. (2021) Learning to rearrange deformable cables fabrics and bags with goal-conditioned transporter networks. In: 2021 IEEE international conference on robotics and automation (ICRA) Xi\u2019an China 30 May 2021\u201305 June 2021 pp. 4568\u20134575. DOI: 10.1109\/ICRA48506.2021.9561391.","DOI":"10.1109\/ICRA48506.2021.9561391"},{"key":"e_1_3_5_26_1","unstructured":"Shetab-Bushehri M Aranda M Mezouar Y et al. (2022) Lattice-based shape tracking and servoing of elastic objects. ArXiv preprint arXiv:2209.01832."},{"key":"e_1_3_5_27_1","doi-asserted-by":"crossref","unstructured":"Shin C Ferguson PW Pedram SA et al. (2019) Autonomous tissue manipulation via surgical robot using learning based model predictive control. In: 2019 international conference on robotics and automation (ICRA) Montreal QC 20\u201324 May 2019 3875\u20133881. IEEE.","DOI":"10.1109\/ICRA.2019.8794159"},{"key":"e_1_3_5_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2018.11.004"},{"key":"e_1_3_5_29_1","doi-asserted-by":"publisher","DOI":"10.3390\/s23125721"},{"key":"e_1_3_5_30_1","doi-asserted-by":"crossref","unstructured":"Yu M Lv K Wang C et al. (2023) Generalizable whole-body global manipulation of deformable linear objects by dual-arm robot in 3-d constrained environments. ArXiv preprint arXiv:2310.09899.","DOI":"10.1177\/02783649241276886"},{"key":"e_1_3_5_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2024.102727"},{"key":"e_1_3_5_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2021.103798"},{"key":"e_1_3_5_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2022.3147415"},{"key":"e_1_3_5_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3066969"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649241301076","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02783649241301076","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649241301076","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:17:38Z","timestamp":1777457858000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649241301076"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,10]]},"references-count":33,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["10.1177\/02783649241301076"],"URL":"https:\/\/doi.org\/10.1177\/02783649241301076","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,10]]}}}