{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,27]],"date-time":"2025-07-27T07:24:24Z","timestamp":1753601064224,"version":"3.41.0"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T00:00:00Z","timestamp":1562889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,8,31]]},"abstract":"<jats:p>We demonstrate how to acquire complete human hand bone anatomy (meshes) in multiple poses using magnetic resonance imaging (MRI). Such acquisition was previously difficult because MRI scans must be long for high-precision results (over 10 minutes) and because humans cannot hold the hand perfectly still in non-trivial and badly supported poses. We invent a manufacturing process whereby we use lifecasting materials commonly employed in film special effects industry to generate hand molds, personalized to the subject, and to each pose. These molds are both ergonomic and encasing, and they stabilize the hand during scanning. We also demonstrate how to efficiently segment the MRI scans into individual bone meshes in all poses, and how to correspond each bone's mesh to same mesh connectivity across all poses. Next, we interpolate and extrapolate the MRI-acquired bone meshes to the entire range of motion of the hand, producing an accurate data-driven animation-ready rig for bone meshes. We also demonstrate how to acquire not just bone geometry (using MRI) in each pose, but also a matching highly accurate surface geometry (using optical scanners) in each pose, modeling skin pores and wrinkles. We also give a soft tissue Finite Element Method simulation \"rig\", consisting of novel tet meshing for stability at the joints, spatially varying geometric and material detail, and quality constraints to the acquired skeleton kinematic rig. Given an animation sequence of hand joint angles, our FEM soft tissue rig produces quality hand surface shapes in arbitrary poses in the hand range of motion. Our results qualitatively reproduce important features seen in the photographs of the subject's hand, such as similar overall organic shape and fold formation.<\/jats:p>","DOI":"10.1145\/3306346.3322983","type":"journal-article","created":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T19:04:08Z","timestamp":1562958248000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Hand modeling and simulation using stabilized magnetic resonance imaging"],"prefix":"10.1145","volume":"38","author":[{"given":"Bohan","family":"Wang","sequence":"first","affiliation":[{"name":"University of Southern California"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George","family":"Matcuk","sequence":"additional","affiliation":[{"name":"University of Southern California"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jernej","family":"Barbi\u010d","sequence":"additional","affiliation":[{"name":"University of Southern California"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,7,12]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Agisoft. 2018. Photoscan http:\/\/www.agisoft.com.  Agisoft. 2018. Photoscan http:\/\/www.agisoft.com."},{"key":"e_1_2_2_2_1","unstructured":"AljaSafe. 2018. SmoothOn Inc. www.smooth-on.com.  AljaSafe. 2018. SmoothOn Inc. www.smooth-on.com."},{"key":"e_1_2_2_3_1","unstructured":"Amira. 2018. Amira for Life Sciences. https:\/\/www.fei.com\/software\/amira-3d-for-life-sciences\/.  Amira. 2018. Amira for Life Sciences. https:\/\/www.fei.com\/software\/amira-3d-for-life-sciences\/."},{"key":"e_1_2_2_4_1","unstructured":"Artec3D. 2018. Spider Scanner http:\/\/www.artec3d.com.  Artec3D. 2018. Spider Scanner http:\/\/www.artec3d.com."},{"key":"e_1_2_2_5_1","volume-title":"Austin","author":"Noelle","year":"2005","unstructured":"Noelle M. Austin . 2005 . Chapter 9: The Wrist and Hand Complex\". In Levangie, Pamela K.; Norkin, Cynthia C. Joint Structure and Function: A Comprehensive Analysis (4th ed.). F. A. Davis Company . Noelle M. Austin. 2005. Chapter 9: The Wrist and Hand Complex\". In Levangie, Pamela K.; Norkin, Cynthia C. Joint Structure and Function: A Comprehensive Analysis (4th ed.). F. A. Davis Company."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2008.1"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI.2012.6235735"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121791"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2005.01.004"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073412"},{"key":"e_1_2_2_11_1","volume-title":"Eurographics Italian Chapter Conference.","author":"Cignoni Paolo","year":"2008","unstructured":"Paolo Cignoni , Marco Callieri , Massimiliano Corsini , Matteo Dellepiane , Fabio Ganovelli , and Guido Ranzuglia . 2008 . MeshLab: an Open-Source Mesh Processing Tool . In Eurographics Italian Chapter Conference. Paolo Cignoni, Marco Callieri, Massimiliano Corsini, Matteo Dellepiane, Fabio Ganovelli, and Guido Ranzuglia. 2008. MeshLab: an Open-Source Mesh Processing Tool. In Eurographics Italian Chapter Conference."},{"key":"e_1_2_2_12_1","unstructured":"CyberGlove Systems. 2017. CyberGrasp. http:\/\/www.cyberglovesystems.com\/cybergrasp.  CyberGlove Systems. 2017. CyberGrasp. http:\/\/www.cyberglovesystems.com\/cybergrasp."},{"volume-title":"Seminars in Ultrasound, CT and MRI","author":"Dempsey Mary F","key":"e_1_2_2_13_1","unstructured":"Mary F Dempsey , Barrie Condon , and Donald M Hadley . 2002. MRI safety review . In Seminars in Ultrasound, CT and MRI , Vol. 23 . Elsevier , 392--401. Mary F Dempsey, Barrie Condon, and Donald M Hadley. 2002. MRI safety review. In Seminars in Ultrasound, CT and MRI, Vol. 23. Elsevier, 392--401."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"C. M. Deniz S. Xiang S. Hallyburton A. Welbeck S. Honig K. Cho and G. Chang. 2017. Segmentation of the Proximal Femur from MR Images using Deep Convolutional Neural Networks. arXiv preprint arXiv:1704.06176 (2017).  C. M. Deniz S. Xiang S. Hallyburton A. Welbeck S. Honig K. Cho and G. Chang. 2017. Segmentation of the Proximal Femur from MR Images using Deep Convolutional Neural Networks. arXiv preprint arXiv:1704.06176 (2017).","DOI":"10.1038\/s41598-018-34817-6"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"D. E. Discher D. J. Mooney and P. W. Zandstra. 2009. Growth factors matrices and forces combine and control stem cells. Science 324 5935 (2009) 1673--1677.  D. E. Discher D. J. Mooney and P. W. Zandstra. 2009. Growth factors matrices and forces combine and control stem cells. Science 324 5935 (2009) 1673--1677.","DOI":"10.1126\/science.1171643"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.824822"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1463-1326.2004.00410.x"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/51.544511"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2011.5945492"},{"key":"e_1_2_2_20_1","volume-title":"Musculoskeletal MRI segmentation using multi-resolution simplex meshes with medial representations. Medical image analysis 14, 3","author":"Gilles Benjamin","year":"2010","unstructured":"Benjamin Gilles and Nadia Magnenat-Thalmann . 2010. Musculoskeletal MRI segmentation using multi-resolution simplex meshes with medial representations. Medical image analysis 14, 3 ( 2010 ), 291--302. Benjamin Gilles and Nadia Magnenat-Thalmann. 2010. Musculoskeletal MRI segmentation using multi-resolution simplex meshes with medial representations. Medical image analysis 14, 3 (2010), 291--302."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.233"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbiomech.2016.07.018"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201399"},{"key":"e_1_2_2_24_1","unstructured":"Hang Si. 2011. TetGen: A Quality Tetrahedral Mesh Generator and a 3D Delaunay Triangulator.  Hang Si. 2011. TetGen: A Quality Tetrahedral Mesh Generator and a 3D Delaunay Triangulator."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201353"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028523.1028541"},{"key":"e_1_2_2_27_1","unstructured":"ITK-SNAP. 2018. ITK-SNAP. http:\/\/www.itksnap.org\/pmwiki\/pmwiki.php.  ITK-SNAP. 2018. ITK-SNAP. http:\/\/www.itksnap.org\/pmwiki\/pmwiki.php."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2659467.2675048"},{"key":"e_1_2_2_29_1","volume-title":"The Upper Limb","author":"Kapandji A.I.","unstructured":"A.I. Kapandji . 2009. The physiology of the joints , 6 th Edition, Vol. 1 : The Upper Limb . Elsevier Exclusive . A.I. Kapandji. 2009. The physiology of the joints, 6th Edition, Vol. 1: The Upper Limb. Elsevier Exclusive.","edition":"6"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409625.1409627"},{"key":"e_1_2_2_31_1","volume-title":"CNN-based segmentation of medical imaging data. arXiv preprint arXiv:1701.03056","author":"Kayalibay Baris","year":"2017","unstructured":"Baris Kayalibay , Grady Jensen , and Patrick van der Smagt . 2017. CNN-based segmentation of medical imaging data. arXiv preprint arXiv:1701.03056 ( 2017 ). Baris Kayalibay, Grady Jensen, and Patrick van der Smagt. 2017. CNN-based segmentation of medical imaging data. arXiv preprint arXiv:1701.03056 (2017)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019627.2019640"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2018.8624997"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545286"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028523.1028571"},{"key":"e_1_2_2_36_1","unstructured":"LeapMotion. 2017. https:\/\/www.leapmotion.com.  LeapMotion. 2017. https:\/\/www.leapmotion.com."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559755.1559756"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344862"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462008"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508427"},{"volume-title":"Proc. of Graphics Interface.","author":"Magnenat-Thalmann N.","key":"e_1_2_2_41_1","unstructured":"N. Magnenat-Thalmann , R. Laperrire , and D. Thalmann . 1988. Joint-dependent local deformations for hand animation and object grasping . In Proc. of Graphics Interface. N. Magnenat-Thalmann, R. Laperrire, and D. Thalmann. 1988. Joint-dependent local deformations for hand animation and object grasping. In Proc. of Graphics Interface."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2633374.2633376"},{"volume-title":"Proc. of Annual Meeting of the American Society of Biomechanics.","author":"Marai G.","key":"e_1_2_2_43_1","unstructured":"G. Marai , D. Laidlaw , J. Coburn , M. Upal , and J. Crisco . 2003. A 3D method for segmenting and registering carpal bones from CT volume images . In Proc. of Annual Meeting of the American Society of Biomechanics. G. Marai, D. Laidlaw, J. Coburn, M. Upal, and J. Crisco. 2003. A 3D method for segmenting and registering carpal bones from CT volume images. In Proc. of Annual Meeting of the American Society of Biomechanics."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964932"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1361-8415(96)80007-7"},{"key":"e_1_2_2_46_1","volume-title":"International Conf. on Image Processing and its Applications. IET, 303--306","author":"Meyer Fernand","year":"1992","unstructured":"Fernand Meyer . 1992 . Color image segmentation . In International Conf. on Image Processing and its Applications. IET, 303--306 . Fernand Meyer. 1992. Color image segmentation. In International Conf. on Image Processing and its Applications. IET, 303--306."},{"key":"e_1_2_2_47_1","volume-title":"Soft material for soft actuators. Nature Communications 8, 596","author":"Miriyev Aslan","year":"2017","unstructured":"Aslan Miriyev , Kenneth Stack , and Hod Lipson . 2017. Soft material for soft actuators. Nature Communications 8, 596 ( 2017 ). Aslan Miriyev, Kenneth Stack, and Hod Lipson. 2017. Soft material for soft actuators. Nature Communications 8, 596 (2017)."},{"volume-title":"IEEE\/RSJ Int. Conf. on Intelligent Robots and Systems. 2750--2755","author":"Miyata N.","key":"e_1_2_2_48_1","unstructured":"N. Miyata , M. Kouch , M. Mochimaru , and T. Kurihara . 2005. Finger joint kinematics from MR images . In IEEE\/RSJ Int. Conf. on Intelligent Robots and Systems. 2750--2755 . N. Miyata, M. Kouch, M. Mochimaru, and T. Kurihara. 2005. Finger joint kinematics from MR images. In IEEE\/RSJ Int. Conf. on Intelligent Robots and Systems. 2750--2755."},{"key":"e_1_2_2_49_1","unstructured":"NimbleVR. 2012. http:\/\/nimblevr.com.  NimbleVR. 2012. http:\/\/nimblevr.com."},{"key":"e_1_2_2_50_1","unstructured":"RadiologyInfo. 2018. Radiation Dose in X-Ray and CT Exams. https:\/\/www.radiologyinfo.org\/en\/pdf\/safety-xray.pdf.  RadiologyInfo. 2018. Radiation Dose in X-Ray and CT Exams. https:\/\/www.radiologyinfo.org\/en\/pdf\/safety-xray.pdf."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2006.00963.x"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130883"},{"volume-title":"Segmentation of bone structures in Magnetic Resonance Images (MRI) for human hand skeletal kinematics modelling. Master's thesis","author":"Rusu Alexandru","key":"e_1_2_2_53_1","unstructured":"Alexandru Rusu . 2011. Segmentation of bone structures in Magnetic Resonance Images (MRI) for human hand skeletal kinematics modelling. Master's thesis . German Aerospace Center . Alexandru Rusu. 2011. Segmentation of bone structures in Magnetic Resonance Images (MRI) for human hand skeletal kinematics modelling. Master's thesis. German Aerospace Center."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766987"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2018.8624937"},{"key":"e_1_2_2_56_1","volume-title":"Robust statistical shape models for MRI bone segmentation in presence of small field of view. Medical image analysis 15, 1","author":"Schmid J\u00e9r\u00f4me","year":"2011","unstructured":"J\u00e9r\u00f4me Schmid , Jinman Kim , and Nadia Magnenat-Thalmann . 2011. Robust statistical shape models for MRI bone segmentation in presence of small field of view. Medical image analysis 15, 1 ( 2011 ), 155--168. J\u00e9r\u00f4me Schmid, Jinman Kim, and Nadia Magnenat-Thalmann. 2011. Robust statistical shape models for MRI bone segmentation in presence of small field of view. Medical image analysis 15, 1 (2011), 155--168."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-85988-8_15"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180491"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ultrasmedbio.2007.02.015"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360682"},{"volume-title":"Weta Digital: Tissue Muscle and Fat Simulation System.","year":"2013","key":"e_1_2_2_62_1","unstructured":"Tissue. 2013 . Weta Digital: Tissue Muscle and Fat Simulation System. Tissue. 2013. Weta Digital: Tissue Muscle and Fat Simulation System."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661264"},{"key":"e_1_2_2_64_1","volume-title":"Conf. on Motion and Vibration Control (MOVIC).","author":"van der Smagt Patrick","year":"2008","unstructured":"Patrick van der Smagt and Georg Stillfried . 2008 . Using MRI data to compute a hand kinematic model . In Conf. on Motion and Vibration Control (MOVIC). Patrick van der Smagt and Georg Stillfried. 2008. Using MRI data to compute a hand kinematic model. In Conf. on Motion and Vibration Control (MOVIC)."},{"key":"e_1_2_2_65_1","unstructured":"VTK. 2018. VTK. https:\/\/www.vtk.org\/.  VTK. 2018. VTK. https:\/\/www.vtk.org\/."},{"key":"e_1_2_2_66_1","volume-title":"Biegler","author":"W\u00e4chter Andreas","year":"2006","unstructured":"Andreas W\u00e4chter and Lorenz T . Biegler . 2006 . On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Mathematical Programming 106, 1 (01 Mar 2006), 25--57. Andreas W\u00e4chter and Lorenz T. Biegler. 2006. On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Mathematical Programming 106, 1 (01 Mar 2006), 25--57."},{"key":"e_1_2_2_67_1","doi-asserted-by":"crossref","unstructured":"Andrea Walther and Andreas Griewank. 2009. Getting Started with ADOL-C. In Combinatorial scientific computing. 181--202.  Andrea Walther and Andreas Griewank. 2009. Getting Started with ADOL-C. In Combinatorial scientific computing. 181--202.","DOI":"10.1201\/b11644-8"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047269"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531369"},{"key":"e_1_2_2_70_1","volume-title":"Lessons Learned from MRI Safety Events. Current Radiology Reports 3, 10 (12","author":"Watson Robert E.","year":"2015","unstructured":"Robert E. Watson . 2015. Lessons Learned from MRI Safety Events. Current Radiology Reports 3, 10 (12 Aug 2015 ), 37. Robert E. Watson. 2015. Lessons Learned from MRI Safety Events. Current Radiology Reports 3, 10 (12 Aug 2015), 37."},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1515\/bmt-2014-0146"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12595"},{"key":"e_1_2_2_73_1","unstructured":"Wrap3. 2018. Nonlinear Iterative Closest Point mesh registration software. https:\/\/www.russian3dscanner.com.  Wrap3. 2018. Nonlinear Iterative Closest Point mesh registration software. https:\/\/www.russian3dscanner.com."},{"key":"e_1_2_2_74_1","volume-title":"IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 2605--2613","author":"Yuan Shanxin","year":"2017","unstructured":"Shanxin Yuan , Qi Ye , Bj\u00f6rn Stenger , Siddhant Jain , and Tae-Kyun Kim . 2017 . Bighand2. 2M benchmark: Hand pose dataset and state of the art analysis . In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 2605--2613 . Shanxin Yuan, Qi Ye, Bj\u00f6rn Stenger, Siddhant Jain, and Tae-Kyun Kim. 2017. Bighand2. 2M benchmark: Hand pose dataset and state of the art analysis. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 2605--2613."},{"key":"e_1_2_2_75_1","unstructured":"Zygote. 2016. Zygote body. http:\/\/www.zygotebody.com.  Zygote. 2016. Zygote body. http:\/\/www.zygotebody.com."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306346.3322983","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3306346.3322983","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:44Z","timestamp":1750206344000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306346.3322983"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,12]]},"references-count":74,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,8,31]]}},"alternative-id":["10.1145\/3306346.3322983"],"URL":"https:\/\/doi.org\/10.1145\/3306346.3322983","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2019,7,12]]},"assertion":[{"value":"2019-07-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}