{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:09:57Z","timestamp":1784268597357,"version":"3.55.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T00:00:00Z","timestamp":1669766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Marie Sk?odowska-Curie grant agreement","award":["956585"],"award-info":[{"award-number":["956585"]}]},{"name":"ERC SmartGeometry"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:p>\n            Realistic dynamic garments on animated characters have many AR\/VR applications. While authoring such dynamic garment geometry is still a challenging task, data-driven simulation provides an attractive alternative, especially if it can be controlled simply using the motion of the underlying character. In this work, we focus on motion guided dynamic 3D garments, especially for loose garments. In a data-driven setup, we first learn a generative space of plausible garment geometries. Then, we learn a mapping to this space to capture the motion dependent dynamic deformations, conditioned on the previous state of the garment as well as its relative position with respect to the underlying body. Technically, we model garment dynamics, driven using the input character motion, by predicting per-frame local displacements in a canonical state of the garment that is enriched with frame-dependent skinning weights to bring the garment to the global space. We resolve any remaining per-frame collisions by predicting residual local displacements. The resultant garment geometry is used as history to enable iterative roll-out prediction. We demonstrate plausible generalization to unseen body shapes and motion inputs, and show improvements over multiple state-of-the-art alternatives.\n            <jats:italic>Code and data is released in https:\/\/geometry.cs.ucl.ac.uk\/projects\/2022\/MotionDeepGarment\/<\/jats:italic>\n          <\/jats:p>","DOI":"10.1145\/3550454.3555485","type":"journal-article","created":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T21:19:07Z","timestamp":1669843147000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Motion Guided Deep Dynamic 3D Garments"],"prefix":"10.1145","volume":"41","author":[{"given":"Meng","family":"Zhang","sequence":"first","affiliation":[{"name":"Nanjing University of Science and Technology, China, University College London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Duygu","family":"Ceylan","sequence":"additional","affiliation":[{"name":"Adobe Research, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niloy J.","family":"Mitra","sequence":"additional","affiliation":[{"name":"University College London and Adobe Research, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,11,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00127"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480479"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Hugo Bertiche Meysam Madadi Emilio Tylson and Sergio Escalera. 2021b. DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation. In ICCV.","DOI":"10.1109\/ICCV48922.2021.00542"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00552"},{"key":"e_1_2_2_5_1","first-page":"6","article-title":"Research Problems in Clothing","volume":"37","author":"Choi Kwang-Jin","year":"2005","unstructured":"Kwang-Jin Choi and Hyeong-Seok Ko. 2005. Research Problems in Clothing Simulation. Comput. Aided Des. 37, 6 (May 2005), 585--592.","journal-title":"Simulation. Comput. Aided Des."},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Enric Corona Albert Pumarola Guillem Aleny\u00e0 Gerard Pons-Moll and Francesc Moreno-Noguer. 2021. SMPLicit: Topology-aware Generative Model for Clothed People. In CVPR.","DOI":"10.1109\/CVPR46437.2021.01170"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778845"},{"key":"e_1_2_2_8_1","volume-title":"Real-Time Dynamic Wrinkling of Coarse Animated Cloth. In SCA (SCA '15)","author":"Gillette Russell","year":"2015","unstructured":"Russell Gillette, Craig Peters, Nicholas Vining, Essex Edwards, and Alla Sheffer. 2015. Real-Time Dynamic Wrinkling of Coarse Animated Cloth. In SCA (SCA '15). 10 pages."},{"key":"e_1_2_2_9_1","volume-title":"Proceedings of Machine Learning and Systems","author":"Gropp Amos","year":"2020","unstructured":"Amos Gropp, Lior Yariv, Niv Haim, Matan Atzmon, and Yaron Lipman. 2020. Implicit Geometric Regularization for Learning Shapes. In Proceedings of Machine Learning and Systems 2020. 3569--3579."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185531"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00883"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601160"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3309486.3340245"},{"key":"e_1_2_2_14_1","volume-title":"A Pixel-Based Framework for Data-Driven Clothing (SCA '20)","author":"Jin Ning","unstructured":"Ning Jin, Yilin. Zhu, Zhenglin Geng, and Ronald Fedkiw. 2020. A Pixel-Based Framework for Data-Driven Clothing (SCA '20). Eurographics Association, Article 13, 10 pages."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964988"},{"key":"e_1_2_2_16_1","volume-title":"Kingma and Max Welling","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. In ICLR."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01225-0_41"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344862"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417763"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459767"},{"key":"e_1_2_2_21_1","unstructured":"Junbang Liang Ming Lin and Vladlen Koltun. 2019. Differentiable Cloth Simulation for Inverse Problems. In Advances in Neural Information Processing Systems. 771--780."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_2_23_1","volume-title":"Proceedings IEEE\/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).","author":"Ma Qianli","unstructured":"Qianli Ma, Shunsuke Saito, Jinlong Yang, Siyu Tang, and Michael J. Black. 2021a. SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elements. In Proceedings IEEE\/CVF Conf. on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01582"},{"key":"e_1_2_2_25_1","volume-title":"Black","author":"Ma Qianli","year":"2020","unstructured":"Qianli Ma, Jinlong Yang, Anurag Ranjan, Sergi Pujades, Gerard Pons-Moll, Siyu Tang, and Michael J. Black. 2020a. Learning to Dress 3D People in Generative Clothing. In Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00650"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01079"},{"key":"e_1_2_2_28_1","first-page":"2579","article-title":"Visualizing data using t-SNE","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, Nov (2008), 2579--2605.","journal-title":"Journal of machine learning research 9"},{"key":"e_1_2_2_29_1","volume-title":"Wrinkle Meshes. In Proceedings of the 2010 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation","author":"M\u00fcller Matthias","year":"2010","unstructured":"Matthias M\u00fcller and Nuttapong Chentanez. 2010. Wrinkle Meshes. In Proceedings of the 2010 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation (Madrid, Spain) (SCA '10). Eurographics Association, Goslar, DEU, 85--92."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2006.01000.x"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00739"},{"key":"e_1_2_2_32_1","volume-title":"Shape and Garment Style. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE.","author":"Patel Chaitanya","year":"2020","unstructured":"Chaitanya Patel, Zhouyingcheng Liao, and Gerard Pons-Moll. 2020b. TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE."},{"key":"e_1_2_2_33_1","volume-title":"Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations.","author":"Pfaff Tobias","unstructured":"Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter W. Battaglia. 2021. Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073711"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866183"},{"key":"e_1_2_2_36_1","volume-title":"Proceedings IEEE\/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).","author":"Saito Shunsuke","unstructured":"Shunsuke Saito, Jinlong Yang, Qianli Ma, and Michael J. Black. 2021. SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks. In Proceedings IEEE\/CVF Conf. on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_37_1","volume-title":"Computer Graphics Forum","author":"Santesteban Igor","unstructured":"Igor Santesteban, Miguel A Otaduy, and Dan Casas. 2019. Learning-Based Animation of Clothing for Virtual Try-On. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 355--366."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00797"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01159"},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3272127.3275005","article-title":"I-cloth: incremental collision handling for GPU-based interactive cloth simulation","volume":"37","author":"Tang Min","year":"2018","unstructured":"Min Tang, Tongtong Wang, Zhongyuan Liu, Ruofeng Tong, and Dinesh Manocha. 2018. I-cloth: incremental collision handling for GPU-based interactive cloth simulation. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1--10.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_41_1","volume-title":"Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothing. In International Conference on Computer Vision (ICCV).","author":"Tiwari Garvita","year":"2021","unstructured":"Garvita Tiwari, Nikolaos Sarafianos, Tony Tung, and Gerard Pons-Moll. 2021. Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothing. In International Conference on Computer Vision (ICCV)."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW54120.2021.00163"},{"key":"e_1_2_2_43_1","article-title":"Visualizing data using t-SNE","volume":"9","author":"der Maaten Laurens Van","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, 11 (2008).","journal-title":"Journal of machine learning research"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778844"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275074"},{"key":"e_1_2_2_46_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3355089.3356512","article-title":"Learning an intrinsic garment space for interactive authoring of garment animation","volume":"38","author":"Wang Tuanfeng Y","year":"2019","unstructured":"Tuanfeng Y Wang, Tianjia Shao, Kai Fu, and Niloy J Mitra. 2019. Learning an intrinsic garment space for interactive authoring of garment animation. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1--12.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201281"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417865"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601136"},{"key":"e_1_2_2_50_1","volume-title":"LASR: Learning Articulated Shape Reconstruction from a Monocular Video. In CVPR.","author":"Yang Gengshan","year":"2021","unstructured":"Gengshan Yang, Deqing Sun, Varun Jampani, Daniel Vlasic, Forrester Cole, Huiwen Chang, Deva Ramanan, William T Freeman, and Ce Liu. 2021. LASR: Learning Articulated Shape Reconstruction from a Monocular Video. In CVPR."},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Gengshan Yang Minh Vo Neverova Natalia Deva Ramanan Vedaldi Andrea and Joo Hanbyul. 2022. BANMo: Building Animatable 3D Neural Models from Many Casual Videos. In CVPR.","DOI":"10.1109\/CVPR52688.2022.00288"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_15"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00565"},{"key":"e_1_2_2_54_1","volume-title":"Mitra","author":"Zhang Meng","year":"2021","unstructured":"Meng Zhang, Tuanfeng Wang, Duygu Ceylan, and Niloy J. Mitra. 2021. Deep Detail Enhancement for Any Garment. In Eurographics."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.79"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550454.3555485","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550454.3555485","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:43Z","timestamp":1750182703000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550454.3555485"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,30]]},"references-count":55,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1145\/3550454.3555485"],"URL":"https:\/\/doi.org\/10.1145\/3550454.3555485","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,30]]},"assertion":[{"value":"2022-11-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}