{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T09:27:02Z","timestamp":1780392422083,"version":"3.54.1"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61976138, 61977047"],"award-info":[{"award-number":["61976138, 61977047"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018YFB2100500"],"award-info":[{"award-number":["2018YFB2100500"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003399","name":"STCSM","doi-asserted-by":"crossref","award":["2015F0203-000-06"],"award-info":[{"award-number":["2015F0203-000-06"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"crossref"}]},{"name":"SHMEC","award":["2019-01-07-00-01-E00003"],"award-info":[{"award-number":["2019-01-07-00-01-E00003"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p>Emerging Metaverse applications demand reliable, accurate, and photorealistic reproductions of human hands to perform sophisticated operations as if in the physical world. While real human hand represents one of the most intricate coordination between bones, muscle, tendon, and skin, state-of-the-art techniques unanimously focus on modeling only the skeleton of the hand. In this paper, we present NIMBLE, a novel parametric hand model that includes the missing key components, bringing 3D hand model to a new level of realism. We first annotate muscles, bones and skins on the recent Magnetic Resonance Imaging hand (MRI-Hand) dataset [Li et al. 2021] and then register a volumetric template hand onto individual poses and subjects within the dataset. NIMBLE consists of 20 bones as triangular meshes, 7 muscle groups as tetrahedral meshes, and a skin mesh. Via iterative shape registration and parameter learning, it further produces shape blend shapes, pose blend shapes, and a joint regressor. We demonstrate applying NIMBLE to modeling, rendering, and visual inference tasks. By enforcing the inner bones and muscles to match anatomic and kinematic rules, NIMBLE can animate 3D hands to new poses at unprecedented realism. To model the appearance of skin, we further construct a photometric HandStage to acquire high-quality textures and normal maps to model wrinkles and palm print. Finally, NIMBLE also benefits learning-based hand pose and shape estimation by either synthesizing rich data or acting directly as a differentiable layer in the inference network.<\/jats:p>","DOI":"10.1145\/3528223.3530079","type":"journal-article","created":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T21:06:27Z","timestamp":1658523987000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":45,"title":["NIMBLE"],"prefix":"10.1145","volume":"41","author":[{"given":"Yuwei","family":"Li","sequence":"first","affiliation":[{"name":"ShanghaiTech University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Longwen","family":"Zhang","sequence":"additional","affiliation":[{"name":"ShanghaiTech University, China and Deemos Technology, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zesong","family":"Qiu","sequence":"additional","affiliation":[{"name":"ShanghaiTech University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingwenqi","family":"Jiang","sequence":"additional","affiliation":[{"name":"ShanghaiTech University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nianyi","family":"Li","sequence":"additional","affiliation":[{"name":"Clemson University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuexin","family":"Ma","sequence":"additional","affiliation":[{"name":"ShanghaiTech University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuyao","family":"Zhang","sequence":"additional","affiliation":[{"name":"ShanghaiTech University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lan","family":"Xu","sequence":"additional","affiliation":[{"name":"Shanghaitech University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingyi","family":"Yu","sequence":"additional","affiliation":[{"name":"ShanghaiTech University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"3DSCANSTORE. 2022. 3D Scan Store: Captured Assets for Digital Artists. https:\/\/www.3dscanstore.com\/"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459769"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/846276.846290"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882311"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1218064.1218084"},{"key":"e_1_2_2_6_1","volume-title":"Olivier Devillers, and Martin Isenburg.","author":"Alliez Pierre","year":"2003","unstructured":"Pierre Alliez, Eric Colin De Verdire, Olivier Devillers, and Martin Isenburg. 2003. Isotropic surface remeshing. In 2003 Shape Modeling International. IEEE, 49--58."},{"key":"e_1_2_2_7_1","unstructured":"Amira. 2022. Amira Software for biomedical and life science research. https:\/\/www.thermofisher.com\/hk\/en\/home\/electron-microscopy\/products\/software-em-3d-vis\/amira-software.html"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2016.2529500"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073207"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00116"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_46"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_13_1","unstructured":"Blender. 2021. Cycles renderer."},{"key":"e_1_2_2_14_1","volume-title":"Proc. 3rd Scand. Conf. on Image Analysis (SCIA3). 250--255","author":"Borgefors Gunilla","year":"1983","unstructured":"Gunilla Borgefors. 1983. Chamfering: A fast method for obtaining approximations of the Euclidean distance in N dimensions. In Proc. 3rd Scand. Conf. on Image Analysis (SCIA3). 250--255."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073412"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.33"},{"key":"e_1_2_2_17_1","first-page":"1","article-title":"The light stages and their applications to photoreal digital actors","volume":"2","author":"Debevec Paul","year":"2012","unstructured":"Paul Debevec. 2012. The light stages and their applications to photoreal digital actors. SIGGRAPH Asia 2, 4 (2012), 1--6.","journal-title":"SIGGRAPH Asia"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_19_1","unstructured":"Caroline Erolin Clare Lamb Roger Soames and Caroline Wilkinson. 2016. Does Virtual Haptic Dissection Improve Student Learning? A Multi-Year Comparative Study.. In MMVR. 110--117."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459936"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1730804.1730809"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01208"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CA.2001.982387"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_18"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415263.3419160"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982438"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298869"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019627.2019640"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545286"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275016"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344862"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462008"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130813"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/113"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508427"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_2_37_1","volume-title":"Marching cubes: A high resolution 3D surface construction algorithm. ACM siggraph computer graphics 21, 4","author":"Lorensen William E","year":"1987","unstructured":"William E Lorensen and Harvey E Cline. 1987. Marching cubes: A high resolution 3D surface construction algorithm. ACM siggraph computer graphics 21, 4 (1987), 163--169."},{"key":"e_1_2_2_38_1","volume-title":"Proceedings on Graphics Interface '88 (Edmonton","author":"Magnenat-Thalmann N.","unstructured":"N. Magnenat-Thalmann, R. Laperri\u00e8re, and D. Thalmann. 1989. Joint-Dependent Local Deformations for Hand Animation and Object Grasping. In Proceedings on Graphics Interface '88 (Edmonton, Alberta, Canada). Canadian Information Processing Society, CAN, 26--33."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2448196.2448232"},{"key":"e_1_2_2_40_1","volume-title":"A musculoskeletal model of the hand and wrist: model definition and evaluation. Computer methods in biomechanics and biomedical engineering 21, 9","author":"Mirakhorlo M","year":"2018","unstructured":"M Mirakhorlo, N Van Beek, M Wesseling, H Maas, HEJ Veeger, and I Jonkers. 2018. A musculoskeletal model of the hand and wrist: model definition and evaluation. Computer methods in biomechanics and biomedical engineering 21, 9 (2018), 548--557."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58571-6_44"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","unstructured":"Gyeongsik Moon Takaaki Shiratori and Kyoung Mu Lee. 2020a. DeepHandMesh: A Weakly-Supervised Deep Encoder-Decoder Framework for High-Fidelity Hand Mesh Modeling. 440--455. 10.1007\/978-3-030-58536-5_26","DOI":"10.1007\/978-3-030-58536-5_26"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58565-5_33"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322958"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"e_1_2_2_46_1","volume-title":"Argyros","author":"Oikonomidis Iasonas","year":"2011","unstructured":"Iasonas Oikonomidis, Nikolaos Kyriazis, and Antonis A. Argyros. 2011. Efficient model-based 3D tracking of hand articulations using Kinect. In BMVC."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1979.4310076"},{"key":"e_1_2_2_48_1","volume-title":"Skeletal anatomy of the hand. Hand clinics 29, 4","author":"Panchal-Kildare Surbhi","year":"2013","unstructured":"Surbhi Panchal-Kildare and Kevin Malone. 2013. Skeletal anatomy of the hand. Hand clinics 29, 4 (2013), 459--471."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766993"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58621-8_4"},{"key":"e_1_2_2_51_1","unstructured":"R3DS. 2022. WRAP3D. https:\/\/www.russian3dscanner.com\/"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/PG.2007.46"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130883"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766987"},{"key":"e_1_2_2_55_1","volume-title":"DART: Dense Articulated Real-Time Tracking. In Robotics: Science and Systems.","author":"Schmidt Tanner","year":"2014","unstructured":"Tanner Schmidt, Richard A. Newcombe, and Dieter Fox. 2014. DART: Dense Articulated Real-Time Tracking. In Robotics: Science and Systems."},{"key":"e_1_2_2_56_1","volume-title":"The anatomy and mechanics of the human hand. Artificial limbs 2, 2","author":"Schwarz Robert J","year":"1955","unstructured":"Robert J Schwarz and C Taylor. 1955. The anatomy and mechanics of the human hand. Artificial limbs 2, 2 (1955), 22--35."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629697"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180491"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417768"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360682"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980226"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00675"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601225"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0895-4"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322983"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3443703"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_4"},{"key":"e_1_2_2_68_1","volume-title":"Flyfusion: Real-time dynamic scene reconstruction using a flying depth camera","author":"Xu Lan","year":"2019","unstructured":"Lan Xu, Wei Cheng, Kaiwen Guo, Lei Han, Yebin Liu, and Lu Fang. 2019. Flyfusion: Real-time dynamic scene reconstruction using a flying depth camera. IEEE Transactions on Visualization and Computer Graphics (2019)."},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3181973"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00090"},{"key":"e_1_2_2_71_1","volume-title":"State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications. Computer Graphics Forum 37","author":"Zollh\u00f6fer Michael","year":"2018","unstructured":"Michael Zollh\u00f6fer, Justus Thies, Pablo Garrido, Derek Bradley, Thabo Beeler, Patrick P\u00e9rez, Marc Stamminger, Matthias Nie\u00dfner, and Christian Theobalt. 2018. State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications. Computer Graphics Forum 37 (2018)."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528223.3530079","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3528223.3530079","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:25Z","timestamp":1750186945000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528223.3530079"}},"subtitle":["a non-rigid hand model with bones and muscles"],"short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":71,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10.1145\/3528223.3530079"],"URL":"https:\/\/doi.org\/10.1145\/3528223.3530079","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7]]},"assertion":[{"value":"2022-07-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}