{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T20:34:00Z","timestamp":1776890040025,"version":"3.51.2"},"reference-count":37,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2024,3,4]],"date-time":"2024-03-04T00:00:00Z","timestamp":1709510400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotica"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Autonomous fabric manipulation is a challenging task due to complex dynamics and potential self-occlusion during fabric handling. An intuitive method of fabric-folding manipulation first involves obtaining a smooth and unfolded fabric configuration before the folding process begins. However, the combination of quasi-static actions like pick &amp; place and dynamic action like fling proves inadequate in effectively unfolding long-sleeved T-shirts with sleeves mostly tucked inside the garment. To address this limitation, this paper introduces an enhanced quasi-static action called pick &amp; drag, specifically designed to handle this type of fabric configuration. Additionally, an efficient dual-arm manipulation system is designed in this paper, which combines quasi-static (including pick &amp; place and pick &amp; drag) and dynamic fling actions to flexibly manipulate fabrics into unfolded and smooth configurations. Subsequently, once it is confirmed that the fabric is sufficiently unfolded and all fabric keypoints are detected, the keypoint-based heuristic folding algorithm is employed for the fabric-folding process. To address the scarcity of publicly available keypoint detection datasets for real fabric, we gathered images of various fabric configurations and types in real scenes to create a comprehensive keypoint dataset for fabric folding. This dataset aims to enhance the success rate of keypoint detection. Moreover, we evaluate the effectiveness of our proposed system in real-world settings, where it consistently and reliably unfolds and folds various types of fabrics, including challenging situations such as long-sleeved T-shirts with most parts of sleeves tucked inside the garment. Specifically, our method achieves a coverage rate of 0.822 and a success rate of 0.88 for long-sleeved T-shirts folding. Supplemental materials and dataset are available on our project webpage at <jats:uri xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/sites.google.com\/view\/fabricfolding\">https:\/\/sites.google.com\/view\/fabricfolding<\/jats:uri>.<\/jats:p>","DOI":"10.1017\/s0263574724000250","type":"journal-article","created":{"date-parts":[[2024,3,4]],"date-time":"2024-03-04T09:02:24Z","timestamp":1709542944000},"page":"1281-1296","source":"Crossref","is-referenced-by-count":13,"title":["FabricFolding: learning efficient fabric folding without expert demonstrations"],"prefix":"10.1017","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-3385-0333","authenticated-orcid":false,"given":"Can","family":"He","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lingxiao","family":"Meng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4977-1969","authenticated-orcid":false,"given":"Zhirui","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9139-0291","authenticated-orcid":false,"given":"Jiankun","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Max Q.-H.","family":"Meng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2024,3,4]]},"reference":[{"key":"S0263574724000250_ref19","doi-asserted-by":"crossref","unstructured":"[19] Lim, V. , Huang, H. , Chen, L. Y. , Wang, J. , Ichnowski, J. , Seita, D. , Laskey, M. and Goldberg, K. , \u201cReal2sim2real: Self-supervised Learning of Physical Single-step Dynamic Actions for Planar Robot Casting,\u201d In: 2022 IEEE International Conference on Robotics and Automation (ICRA), (2022) pp. 8282\u20138289.","DOI":"10.1109\/ICRA46639.2022.9811651"},{"key":"S0263574724000250_ref32","unstructured":"[32] Weng, T. , Bajracharya, S. M. , Wang, Y. , Agrawal, K. and Held, D. , \u201cFabricflownet: Bimanual Cloth Manipulation with a Flow-based Policy,\u201d In: Proceedings of the 2022 Conference on Robot Learning, PMLR 164, pp.192\u2013202 (2022)."},{"key":"S0263574724000250_ref4","doi-asserted-by":"crossref","unstructured":"[4] Ren, K. , Kavraki, L. E. and Hang, K. , \u201cRearrangement-based Manipulation via Kinodynamic Planning and Dynamic Planning Horizons,\u201d In: 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), (2022) pp. 1145\u20131152.","DOI":"10.1109\/IROS47612.2022.9981599"},{"key":"S0263574724000250_ref31","doi-asserted-by":"crossref","unstructured":"[31] Thach, B. , Cho, B. Y. , Kuntz, A. and Hermans, T. , \u201cLearning Visual Shape Control of Novel 3D Deformable Objects from Partial-view Point Clouds,\u201d In: 2022 IEEE International Conference on Robotics and Automation (ICRA), (2022) pp. 8274\u20138281.","DOI":"10.1109\/ICRA46639.2022.9812215"},{"key":"S0263574724000250_ref34","doi-asserted-by":"crossref","unstructured":"[34] Ronneberger, O. , Fischer, P. and Brox, T. , \u201cU-net: Convolutional Networks for Biomedical Image Segmentation,\u201d In: Proceedings of the 2015 Medical Image Computing and Computer-Assisted Intervention (MICCAI), Springer (2015) pp. 234\u2013241.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"S0263574724000250_ref12","doi-asserted-by":"crossref","unstructured":"[12] Canberk, A. , Chi, C. , Ha, H. , Burchfiel, B. , Cousineau, E. , Feng, S. and Song, S. , \u201cCloth Funnels: Canonicalized-Alignment for Multi-purpose Garment Manipulation,\u201d In: 2023 IEEE International Conference of Robotics and Automation (ICRA), (2023) pp. 5872\u20135879.","DOI":"10.1109\/ICRA48891.2023.10161546"},{"key":"S0263574724000250_ref26","unstructured":"[26] Matas, J. , James, S. and Davison, A. J. , \u201cSim-to-real Reinforcement Learning for Deformable Object Manipulation,\u201d In: Proceedings of the 2018 Conference on Robot Learning, PMLR 87, pp. 734\u2013743 (2018)."},{"key":"S0263574724000250_ref3","doi-asserted-by":"crossref","first-page":"103730","DOI":"10.1016\/j.robot.2021.103730","article-title":"Learning image-based receding horizon planning for manipulation in clutter","volume":"138","author":"Bejjani","year":"2021","journal-title":"Robot. Auton. Syst."},{"key":"S0263574724000250_ref17","doi-asserted-by":"crossref","unstructured":"[17] Ganapathi, A. , Sundaresan, P. , Thananjeyan, B. , Balakrishna, A. , Seita, D. , Grannen, J. , Hwang, M. , Hoque, R. , Gonzalez, J. E. , Jamali, N. , et al., \u201cLearning Dense Visual Correspondences in Simulation to Smooth and Fold Real Fabrics,\u201d In: 2021 IEEE International Conference on Robotics and Automation (ICRA), (2021) pp. 11515\u201311522.","DOI":"10.1109\/ICRA48506.2021.9561980"},{"key":"S0263574724000250_ref27","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1109\/LRA.2016.2633383","article-title":"Repeatable folding task by humanoid robot worker using deep learning","volume":"2","author":"Yang","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"S0263574724000250_ref37","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.media.2019.03.007","article-title":"Integrating spatial configuration into heatmap regression based cnns for landmark localization","volume":"54","author":"Payer","year":"2019","journal-title":"Med. Image Anal."},{"key":"S0263574724000250_ref14","doi-asserted-by":"crossref","unstructured":"[14] Maitin-Shepard, J. , Cusumano-Towner, M. , Lei, J. and Abbeel, P. , \u201cCloth Grasp Point Detection based on Multiple-view Geometric Cues with Application to Robotic Towel Folding,\u201d In: 2010 IEEE International Conference on Robotics and Automation (ICRA), (2010) pp. 2308\u20132315.","DOI":"10.1109\/ROBOT.2010.5509439"},{"key":"S0263574724000250_ref2","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1017\/S0263574721000941","article-title":"Global motion planning and redundancy resolution for large objects manipulation by dual redundant robots with closed kinematics","volume":"40","author":"Wu","year":"2022","journal-title":"Robotica"},{"key":"S0263574724000250_ref13","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1080\/01691864.2017.1285722","article-title":"Unfolding of a rectangular cloth from unarranged starting shapes by a dual-armed robot with a mechanism for managing recognition error and uncertainty","volume":"31","author":"Yuba","year":"2017","journal-title":"Adv. Robot."},{"key":"S0263574724000250_ref18","doi-asserted-by":"crossref","unstructured":"[18] Morrison, D. , Tow, A. W. , Mctaggart, M. , Smith, R. , Kelly-Boxall, N. , Wade-Mccue, S. , Erskine, J. , Grinover, R. , Gurman, A. , Hunn, T. , et al., \u201cCartman: The Low-cost Cartesian Manipulator that Won the Amazon Robotics Challenge,\u201d In: 2018 IEEE International Conference on Robotics and Automation (ICRA), (2018) pp. 7757\u20137764.","DOI":"10.1109\/ICRA.2018.8463191"},{"key":"S0263574724000250_ref36","unstructured":"[36] Lin, X. , Wang, Y. , Olkin, J. and Held, D. , \u201cSoftgym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulation,\u201d In: Proceedings of the 2021 Conference on Robot Learning, PMLR 155, pp. 432\u2013448 (2021)."},{"key":"S0263574724000250_ref10","unstructured":"[10] Ha, H. and Song, S. , \u201cFlingbot: The Unreasonable Effectiveness of Dynamic Manipulation for Cloth Unfolding,\u201d In: Proceedings of the 2022 Conference on Robot Learning, PMLR 164, pp. 24\u201333 (2022)."},{"key":"S0263574724000250_ref35","doi-asserted-by":"crossref","unstructured":"[35] Wu, J. , Sun, X. , Zeng, A. , Song, S. , Lee, J. , Rusinkiewicz, S. and Funkhouser, T. , \u201cSpatial Action Maps for Mobile Manipulation,\u201d In: Proceedings of the 2020 Robotics: Science and Systems (RSS), (2020).","DOI":"10.15607\/RSS.2020.XVI.035"},{"key":"S0263574724000250_ref5","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.robot.2015.09.025","article-title":"A geometric approach to robotic unfolding of garments","volume":"75","author":"Triantafyllou","year":"2016","journal-title":"Robot. Auton. Syst."},{"key":"S0263574724000250_ref24","first-page":"9","volume-title":"Proceeding of the 2022 ICAPS Workshop on Knowledge Engineering for Planning and Scheduling (KEPS)","author":"Camacho","year":"2022"},{"key":"S0263574724000250_ref15","doi-asserted-by":"crossref","unstructured":"[15] Seita, D. , Jamali, N. , Laskey, M. , Berenstein, R. , Tanwani, A. K. , Baskaran, P. , Iba, S. , Canny, J. and Goldberg, K. . \u201cDeep transfer learning of pick points on fabric for robot bed-making,\u201d In: 2019 The International Symposium of Robotics Research (ISRR), Springer (2019) pp. 275\u2013290.","DOI":"10.1007\/978-3-030-95459-8_17"},{"key":"S0263574724000250_ref28","first-page":"1","article-title":"Visuospatial foresight for physical sequential fabric manipulation","author":"Hoque","year":"2022","journal-title":"Auton. Robot."},{"key":"S0263574724000250_ref25","doi-asserted-by":"crossref","unstructured":"[25] Hietala, J. , Blanco-Mulero, D. , Alcan, G. and Kyrki, V. , \u201cLearning Visual Feedback Control for Dynamic Cloth Folding,\u201d In: 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), (2022) pp. 1455\u20131462.","DOI":"10.1109\/IROS47612.2022.9981376"},{"key":"S0263574724000250_ref6","doi-asserted-by":"crossref","unstructured":"[6] Sun, L. , Aragon-Camarasa, G. , Cockshott, P. , Rogers, S. and Siebert, J. P. , \u201cA Heuristic-based Approach for Flattening Wrinkled Clothes,\u201d Towards Autonomous Robotic Systems: 14th Annual Conference, TAROS 2013, Oxford, UK, August 28-30, 2013, Revised Selected Papers 14 (2014) pp. 148\u2013160.","DOI":"10.1007\/978-3-662-43645-5_16"},{"key":"S0263574724000250_ref11","doi-asserted-by":"crossref","unstructured":"[11] Avigal, Y. , Berscheid, L. , Asfour, T. , Kr\u00f6ger, T. and Goldberg, K. , \u201cSpeedfolding: Learning Efficient Bimanual Folding of Garments,\u201d In: 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE (2022) pp. 1\u20138.","DOI":"10.1109\/IROS47612.2022.9981402"},{"key":"S0263574724000250_ref23","doi-asserted-by":"crossref","unstructured":"[23] Cusumano-Towner, M. , Singh, A. , Miller, S. , O\u2019Brien, J. F. and Abbeel, P. , \u201cBringing Clothing into Desired Configurations with Limited Perception,\u201d In: 2011 IEEE International Conference on Robotics and Automation, (2011) pp. 3893\u20133900.","DOI":"10.1109\/ICRA.2011.5980327"},{"key":"S0263574724000250_ref9","unstructured":"[9] Lee, R. , Ward, D. , Dasagi, V. , Cosgun, A. , Leitner, J. and Corke, P. , \u201cLearning Arbitrary-goal Fabric Folding with One Hour of Real Robot Experience,\u201d In: Proceedings of the 2020 Conference on Robot Learning, PMLR 155, pp. 2317\u20132327 (2021)."},{"key":"S0263574724000250_ref22","doi-asserted-by":"crossref","unstructured":"[22] Xu, Z. , Chi, C. , Burchfiel, B. , Cousineau, E. , Feng, S. and Song, S. , \u201cDextairity: Deformable Manipulation can be a Breeze,\u201d In: Proceedings of the 2022 Robotics: Science and Systems (RSS), (2022).","DOI":"10.15607\/RSS.2022.XVIII.017"},{"key":"S0263574724000250_ref1","doi-asserted-by":"crossref","first-page":"2464","DOI":"10.1017\/S0263574723000474","article-title":"Jigless assembly of an industrial product by a universal robotic hand mounted on an industrial robot","volume":"41","author":"Fukuda","year":"2023","journal-title":"Robotica"},{"key":"S0263574724000250_ref8","doi-asserted-by":"crossref","unstructured":"[8] Wu, Y. , Yan, W. , Kurutach, T. , Pinto, L. and Abbeel, P. , \u201cLearning to Manipulate Deformable Objects without Demonstrations,\u201d In: Proceedings of the 2020 Robotics: Science and Systems (RSS), (2020).","DOI":"10.15607\/RSS.2020.XVI.065"},{"key":"S0263574724000250_ref16","doi-asserted-by":"crossref","unstructured":"[16] Seita, D. , Ganapathi, A. , Hoque, R. , Hwang, M. , Cen, E. , Tanwani, A. K. , Balakrishna, A. , Thananjeyan, B. , Ichnowski, J. , Jamali, N. , et al., \u201cDeep Imitation Learning of Sequential Fabric Smoothing from an Algorithmic Supervisor,\u201d In: 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), (2020) pp. 9651\u20139658.","DOI":"10.1109\/IROS45743.2020.9341608"},{"key":"S0263574724000250_ref29","doi-asserted-by":"crossref","unstructured":"[29] Huang, Z. , Lin, X. and Held, D. , \u201cMesh-based Dynamics with Occlusion Reasoning for Cloth Manipulation,\u201d In: Proceedings of the 2022 Robotics: Science and Systems (RSS), (2022).","DOI":"10.15607\/RSS.2022.XVIII.011"},{"key":"S0263574724000250_ref7","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1109\/TRO.2016.2602376","article-title":"Folding clothes autonomously: A complete pipeline","volume":"32","author":"Doumanoglou","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"S0263574724000250_ref20","doi-asserted-by":"crossref","unstructured":"[20] Wang, C. , Wang, S. , Romero, B. , Veiga, F. and Adelson, E. , \u201cSwingbot: Learning Physical Features from In-hand Tactile Exploration for Dynamic Swing-up Manipulation,\u201d In: 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), (2020) pp. 5633\u20135640.","DOI":"10.1109\/IROS45743.2020.9341006"},{"key":"S0263574724000250_ref21","doi-asserted-by":"crossref","unstructured":"[21] Jangir, R. , Alenya, G. and Torras, C. , \u201cDynamic Cloth Manipulation with Deep Reinforcement Learning,\u201d In: 2020 IEEE International Conference on Robotics and Automation (ICRA), (2020) pp. 4630\u20134636.","DOI":"10.1109\/ICRA40945.2020.9196659"},{"key":"S0263574724000250_ref30","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1109\/LRA.2022.3229573","article-title":"Foldsformer: Learning sequential multi-step cloth manipulation with space-time attention","volume":"8","author":"Mo","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"S0263574724000250_ref33","unstructured":"[33] Lips, T. , De Gusseme, V.-L. , et al., \u201cLearning keypoints from synthetic data for robotic cloth folding,\u201d In: 2nd Workshop on Representing and Manipulating Deformable Objects - ICRA (2022)."}],"container-title":["Robotica"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0263574724000250","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T10:21:07Z","timestamp":1712312467000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0263574724000250\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,4]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["S0263574724000250"],"URL":"https:\/\/doi.org\/10.1017\/s0263574724000250","relation":{},"ISSN":["0263-5747","1469-8668"],"issn-type":[{"value":"0263-5747","type":"print"},{"value":"1469-8668","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,4]]}}}