{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T19:44:22Z","timestamp":1783107862833,"version":"3.54.6"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>\n            Animating a newly designed character using motion capture (mocap) data is a long standing problem in computer animation. A key consideration is the skeletal structure that should correspond to the available mocap data, and the shape deformation in the joint regions, which often requires a tailored, pose-specific refinement. In this work, we develop a neural technique for articulating 3D characters using enveloping with a pre-defined skeletal structure which produces high quality pose dependent deformations. Our framework learns to rig and skin characters with the same articulation structure (\n            <jats:italic>e.g.<\/jats:italic>\n            , bipeds or quadrupeds), and builds the desired skeleton hierarchy into the network architecture.\n            <jats:italic>Furthermore<\/jats:italic>\n            , we propose\n            <jats:italic>neural blend shapes<\/jats:italic>\n            - a set of corrective pose-dependent shapes which improve the deformation quality in the joint regions in order to address the notorious artifacts resulting from standard rigging and skinning. Our system estimates neural blend shapes for input meshes with arbitrary connectivity, as well as weighting coefficients which are conditioned on the input joint rotations. Unlike recent deep learning techniques which supervise the network with ground-truth rigging and skinning parameters, our approach does not assume that the training data has a specific underlying deformation model. Instead, during training, the network observes deformed shapes and learns to infer the corresponding rig, skin and blend shapes using\n            <jats:italic>indirect supervision.<\/jats:italic>\n            During inference, we demonstrate that our network generalizes to unseen characters with arbitrary mesh connectivity, including unrigged characters built by 3D artists. Conforming to standard skeletal animation models enables direct plug-and-play in standard animation software, as well as game engines.\n          <\/jats:p>","DOI":"10.1145\/3450626.3459852","type":"journal-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T00:04:26Z","timestamp":1626739466000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":86,"title":["Learning skeletal articulations with neural blend shapes"],"prefix":"10.1145","volume":"40","author":[{"given":"Peizhuo","family":"Li","sequence":"first","affiliation":[{"name":"Peking University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kfir","family":"Aberman","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rana","family":"Hanocka","sequence":"additional","affiliation":[{"name":"Tel-Aviv University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Libin","family":"Liu","sequence":"additional","affiliation":[{"name":"Peking University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olga","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"ETH Zurich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baoquan","family":"Chen","sequence":"additional","affiliation":[{"name":"Peking University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392462"},{"key":"e_1_2_2_2_1","unstructured":"Adobe Systems Inc. 2018. Mixamo. https:\/\/www.mixamo.com. https:\/\/www.mixamo.com Accessed: 2018-12-27.  Adobe Systems Inc. 2018. Mixamo. https:\/\/www.mixamo.com. https:\/\/www.mixamo.com Accessed: 2018-12-27."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360643"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392397"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201300"},{"key":"e_1_2_2_6_1","volume-title":"Automatic rigging and animation of 3d characters. ACM Transactions on graphics (TOG) 26, 3","author":"Baran Ilya","year":"2007","unstructured":"Ilya Baran and Jovan Popovi\u0107 . 2007. Automatic rigging and animation of 3d characters. ACM Transactions on graphics (TOG) 26, 3 ( 2007 ), 72--es. Ilya Baran and Jovan Popovi\u0107. 2007. Automatic rigging and animation of 3d characters. ACM Transactions on graphics (TOG) 26, 3 (2007), 72--es."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03034.x_eprint"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00552"},{"key":"e_1_2_2_9_1","volume-title":"Polygon mesh processing","author":"Botsch Mario","unstructured":"Mario Botsch , Leif Kobbelt , Mark Pauly , Pierre Alliez , and Bruno L\u00e9vy . 2010. Polygon mesh processing . CRC press . Mario Botsch, Leif Kobbelt, Mark Pauly, Pierre Alliez, and Bruno L\u00e9vy. 2010. Polygon mesh processing. CRC press."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMI.2010.25"},{"key":"e_1_2_2_11_1","volume-title":"Computer Graphics Forum","author":"Aguiar Edilson De","unstructured":"Edilson De Aguiar , Christian Theobalt , Sebastian Thrun , and Hans-Peter Seidel . 2008. Automatic conversion of mesh animations into skeleton-based animations . In Computer Graphics Forum , Vol. 27 . Wiley Online Library , 389--397. Edilson De Aguiar, Christian Theobalt, Sebastian Thrun, and Hans-Peter Seidel. 2008. Automatic conversion of mesh animations into skeleton-based animations. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 389--397."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2485895.2485919"},{"key":"e_1_2_2_13_1","volume-title":"Example-driven deformations based on discrete shells. Computer graphics forum 30, 8","author":"Fr\u00f6hlich Stefan","year":"2011","unstructured":"Stefan Fr\u00f6hlich and Mario Botsch . 2011. Example-driven deformations based on discrete shells. Computer graphics forum 30, 8 ( 2011 ), 2246--2257. Stefan Fr\u00f6hlich and Mario Botsch. 2011. Example-driven deformations based on discrete shells. Computer graphics forum 30, 8 (2011), 2246--2257."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280820"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185568"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322959"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392415"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1730804.1730809"},{"key":"e_1_2_2_19_1","first-page":"487","article-title":"Hardware skinning with quaternions","volume":"4","author":"Hejl Jim","year":"2004","unstructured":"Jim Hejl . 2004 . Hardware skinning with quaternions . Game Programming Gems 4 (2004), 487 -- 495 . Jim Hejl. 2004. Hardware skinning with quaternions. Game Programming Gems 4 (2004), 487--495.","journal-title":"Game Programming Gems"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237216"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392385"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964973"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073206"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276466"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073229"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1230100.1230107"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366215"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1053427.1053429"},{"key":"e_1_2_2_29_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545286"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601161"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925959"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344862"},{"key":"e_1_2_2_34_1","volume-title":"DenseGATs: A Graph-Attention-Based Network for Nonlinear Character Deformation. In Symposium on Interactive 3D Graphics and Games. 1--9.","author":"Li Tianxing","year":"2020","unstructured":"Tianxing Li , Rui Shi , and Takashi Kanai . 2020 . DenseGATs: A Graph-Attention-Based Network for Nonlinear Character Deformation. In Symposium on Interactive 3D Graphics and Games. 1--9. Tianxing Li, Rui Shi, and Takashi Kanai. 2020. DenseGATs: A Graph-Attention-Based Network for Nonlinear Character Deformation. In Symposium on Interactive 3D Graphics and Games. 1--9."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3333002"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_2_37_1","volume-title":"In Proceedings on Graphics interface'88","author":"Magnenat-Thalmann Nadia","year":"1988","unstructured":"Nadia Magnenat-Thalmann , Richard Laperrire , and Daniel Thalmann . 1988 . Joint-dependent local deformations for hand animation and object grasping . In In Proceedings on Graphics interface'88 . Citeseer. Nadia Magnenat-Thalmann, Richard Laperrire, and Daniel Thalmann. 1988. Joint-dependent local deformations for hand animation and object grasping. In In Proceedings on Graphics interface'88. Citeseer."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183287.1183294"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1730804.1730810"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925905"},{"key":"e_1_2_2_41_1","volume-title":"Rig it right! Maya animation rigging concepts","author":"O'Hailey Tina","unstructured":"Tina O'Hailey . 2018. Rig it right! Maya animation rigging concepts . Routledge . Tina O'Hailey. 2018. Rig it right! Maya animation rigging concepts. Routledge."},{"key":"e_1_2_2_42_1","volume-title":"STAR: A Spare Trained Articulated Human Body Regressor. In European Conference on Computer Vision (ECCV). https:\/\/star.is.tue.mpg.de","author":"Osman Ahmed A A","unstructured":"Ahmed A A Osman , Timo Bolkart , and Michael J. Black . 2020 . STAR: A Spare Trained Articulated Human Body Regressor. In European Conference on Computer Vision (ECCV). https:\/\/star.is.tue.mpg.de Ahmed A A Osman, Timo Bolkart, and Michael J. Black. 2020. STAR: A Spare Trained Articulated Human Body Regressor. In European Conference on Computer Vision (ECCV). https:\/\/star.is.tue.mpg.de"},{"key":"e_1_2_2_43_1","volume-title":"PyTorch: An Imperative Style","author":"Paszke Adam","unstructured":"Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , Luca Antiga , Alban Desmaison , Andreas Kopf , Edward Yang , Zachary DeVito , Martin Raison , Alykhan Tejani , Sasank Chilamkurthy , Benoit Steiner , Lu Fang , Junjie Bai , and Soumith Chintala . 2019. PyTorch: An Imperative Style , High-Performance Deep Learning Library . In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024--8035. http:\/\/papers.neurips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alch\u00e9-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024--8035. http:\/\/papers.neurips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf"},{"key":"e_1_2_2_44_1","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition. 652--660","author":"Qi Charles R","year":"2017","unstructured":"Charles R Qi , Hao Su , Kaichun Mo , and Leonidas J Guibas . 2017 . Pointnet: Deep learning on point sets for 3d classification and segmentation . In Proceedings of the IEEE conference on computer vision and pattern recognition. 652--660 . Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 652--660."},{"key":"e_1_2_2_45_1","unstructured":"Autodesk research. 2020. Meshmixer. https:\/\/www.meshmixer.com\/  Autodesk research. 2020. Meshmixer. https:\/\/www.meshmixer.com\/"},{"key":"e_1_2_2_46_1","volume-title":"Symposium on Geometry Processing. 153--162","author":"Schaefer Scott","year":"2007","unstructured":"Scott Schaefer and Can Yuksel . 2007 . Example-based skeleton extraction . In Symposium on Geometry Processing. 153--162 . Scott Schaefer and Can Yuksel. 2007. Example-based skeleton extraction. In Symposium on Geometry Processing. 153--162."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024156.2024198"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/364338.364382"},{"key":"e_1_2_2_49_1","volume-title":"Accurate Face Rig Approximation with Deep Differential Subspace Reconstruction. arXiv preprint arXiv:2006.01746","author":"Song Steven L","year":"2020","unstructured":"Steven L Song , Weiqi Shi , and Michael Reed . 2020. Accurate Face Rig Approximation with Deep Differential Subspace Reconstruction. arXiv preprint arXiv:2006.01746 ( 2020 ). Steven L Song, Weiqi Shi, and Michael Reed. 2020. Accurate Face Rig Approximation with Deep Differential Subspace Reconstruction. arXiv preprint arXiv:2006.01746 (2020)."},{"key":"e_1_2_2_50_1","volume-title":"Meshbased inverse kinematics. ACM transactions on graphics (TOG) 24, 3","author":"Sumner Robert W","year":"2005","unstructured":"Robert W Sumner , Matthias Zwicker , Craig Gotsman , and Jovan Popovi\u0107 . 2005. Meshbased inverse kinematics. ACM transactions on graphics (TOG) 24, 3 ( 2005 ), 488--495. Robert W Sumner, Matthias Zwicker, Craig Gotsman, and Jovan Popovi\u0107. 2005. Meshbased inverse kinematics. ACM transactions on graphics (TOG) 24, 3 (2005), 488--495."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545283"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70517-8_7"},{"key":"e_1_2_2_53_1","volume-title":"Computer Graphics Forum","author":"Weber Ofir","unstructured":"Ofir Weber , Olga Sorkine , Yaron Lipman , and Craig Gotsman . 2007. Context-aware skeletal shape deformation . In Computer Graphics Forum , Vol. 26 . Wiley Online Library , 265--274. Ofir Weber, Olga Sorkine, Yaron Lipman, and Craig Gotsman. 2007. Context-aware skeletal shape deformation. In Computer Graphics Forum, Vol. 26. Wiley Online Library, 265--274."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392379"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00015"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417819"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459852","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459852","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:21Z","timestamp":1750191441000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459852"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":56,"aliases":["10.1145\/3476576.3476702"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3450626.3459852"],"URL":"https:\/\/doi.org\/10.1145\/3450626.3459852","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"2021-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}