{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T19:25:00Z","timestamp":1783106700130,"version":"3.54.6"},"reference-count":87,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003803","name":"University of Hong Kong","doi-asserted-by":"crossref","award":["187FRTAKU"],"award-info":[{"award-number":["187FRTAKU"]}],"id":[{"id":"10.13039\/501100003803","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003803","name":"University of Hong Kong","doi-asserted-by":"publisher","award":["182DRTAKU"],"award-info":[{"award-number":["182DRTAKU"]}],"id":[{"id":"10.13039\/501100003803","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>Natural hand manipulations exhibit complex finger maneuvers adaptive to object shapes and the tasks at hand. Learning dexterous manipulation from data in a brute force way would require a prohibitive amount of examples to effectively cover the combinatorial space of 3D shapes and activities. In this paper, we propose a hand-object spatial representation that can achieve generalization from limited data. Our representation combines the global object shape as voxel occupancies with local geometric details as samples of closest distances. This representation is used by a neural network to regress finger motions from input trajectories of wrists and objects. Specifically, we provide the network with the current finger pose, past and future trajectories, and the spatial representations extracted from these trajectories. The network then predicts a new finger pose for the next frame as an autoregressive model. With a carefully chosen hand-centric coordinate system, we can handle single-handed and two-handed motions in a unified framework. Learning from a small number of primitive shapes and kitchenware objects, the network is able to synthesize a variety of finger gaits for grasping, in-hand manipulation, and bimanual object handling on a rich set of novel shapes and functional tasks. We also demonstrate a live demo of manipulating virtual objects in real-time using a simple physical prop. Our system is useful for offline animation or real-time applications forgiving to a small delay.<\/jats:p>","DOI":"10.1145\/3450626.3459830","type":"journal-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T00:04:26Z","timestamp":1626739466000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":92,"title":["ManipNet"],"prefix":"10.1145","volume":"40","author":[{"given":"He","family":"Zhang","sequence":"first","affiliation":[{"name":"The University of Edinburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuting","family":"Ye","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Takaaki","family":"Shiratori","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taku","family":"Komura","sequence":"additional","affiliation":[{"name":"The University of Hong Kong and The University of Edinburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , Manjunath Kudlur , Josh Levenberg , Rajat Monga , Sherry Moore , Derek G. Murray , Benoit Steiner , Paul Tucker , Vijay Vasudevan , Pete Warden , Martin Wicke , Yuan Yu , and Xiaoqiang Zheng . 2016 . TensorFlow: A System for Large-scale Machine Learning . In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation ( Savannah, GA, USA) (OSDI'16). USENIX Association, Berkeley, CA, USA, 265--283. http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899 Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A System for Large-scale Machine Learning. In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (Savannah, GA, USA) (OSDI'16). USENIX Association, Berkeley, CA, USA, 265--283. http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899"},{"key":"e_1_2_2_2_1","volume-title":"Taras Kucherenko, and Jonas Beskow.","author":"Alexanderson Simon","year":"2020","unstructured":"Simon Alexanderson , Gustav Eje Henter , Taras Kucherenko, and Jonas Beskow. 2020 . Style-Controllable Speech-Driven Gesture Synthesis Using Normalising Flows. In Computer Graphics Forum, Vol. 39 . Wiley Online Library , 487--496. Simon Alexanderson, Gustav Eje Henter, Taras Kucherenko, and Jonas Beskow. 2020. Style-Controllable Speech-Driven Gesture Synthesis Using Normalising Flows. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 487--496."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919887447"},{"key":"e_1_2_2_4_1","unstructured":"Apple. [Online; accessed 27-January-2021]. Augmented Reality: Introducing ARKit 4. https:\/\/developer.apple.com\/augmented-reality\/arkit\/.  Apple. [Online; accessed 27-January-2021]. Augmented Reality: Introducing ARKit 4. https:\/\/developer.apple.com\/augmented-reality\/arkit\/."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2011.05.003"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_46"},{"key":"e_1_2_2_7_1","unstructured":"David Barraff. 1997. An introduction to physically based modeling: Rigid body simulation I - unconstrained rigid body dynamics. In ACM SIGGRAPH Courses.  David Barraff. 1997. An introduction to physically based modeling: Rigid body simulation I - unconstrained rigid body dynamics. In ACM SIGGRAPH Courses."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356536"},{"key":"e_1_2_2_9_1","volume-title":"Contactgrasp: Functional multi-finger grasp synthesis from contact. arXiv preprint arXiv:1904.03754","author":"Brahmbhatt Samarth","year":"2019","unstructured":"Samarth Brahmbhatt , Ankur Handa , James Hays , and Dieter Fox . 2019 . Contactgrasp: Functional multi-finger grasp synthesis from contact. arXiv preprint arXiv:1904.03754 (2019). Samarth Brahmbhatt, Ankur Handa, James Hays, and Dieter Fox. 2019. Contactgrasp: Functional multi-finger grasp synthesis from contact. arXiv preprint arXiv:1904.03754 (2019)."},{"key":"e_1_2_2_10_1","volume-title":"ContactPose: A dataset of grasps with object contact and hand pose. arXiv preprint arXiv:2007.09545","author":"Brahmbhatt Samarth","year":"2020","unstructured":"Samarth Brahmbhatt , Chengcheng Tang , Christopher D Twigg , Charles C Kemp , and James Hays . 2020. ContactPose: A dataset of grasps with object contact and hand pose. arXiv preprint arXiv:2007.09545 ( 2020 ). Samarth Brahmbhatt, Chengcheng Tang, Christopher D Twigg, Charles C Kemp, and James Hays. 2020. ContactPose: A dataset of grasps with object contact and hand pose. arXiv preprint arXiv:2007.09545 (2020)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793789"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.693"},{"key":"e_1_2_2_13_1","unstructured":"Facebook. [Online; accessed 27-January-2021]. Spark AR Studio. https:\/\/sparkar.facebook.com\/ar-studio\/.  Facebook. [Online; accessed 27-January-2021]. Spark AR Studio. https:\/\/sparkar.facebook.com\/ar-studio\/."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01109"},{"key":"e_1_2_2_15_1","unstructured":"Google. [Online; accessed 27-January-2021]. MediaPipe. https:\/\/google.github.io\/mediapipe\/.  Google. [Online; accessed 27-January-2021]. MediaPipe. https:\/\/google.github.io\/mediapipe\/."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1998.677060"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392452"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275082"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01208"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417836"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201302"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073663"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.1990.126232"},{"key":"e_1_2_2_25_1","volume-title":"Computer Graphics Forum","author":"Hu Ruizhen","unstructured":"Ruizhen Hu , Manolis Savva , and Oliver van Kaick . 2018. Functionality representations and applications for shape analysis . In Computer Graphics Forum , Vol. 37 . Wiley Online Library , 603--624. Ruizhen Hu, Manolis Savva, and Oliver van Kaick. 2018. Functionality representations and applications for shape analysis. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 603--624."},{"key":"e_1_2_2_26_1","volume-title":"Ariel Shamir, Hao Zhang, and Hui Huang.","author":"Hu Ruizhen","year":"2020","unstructured":"Ruizhen Hu , Zihao Yan , Jingwen Zhang , Oliver Van Kaick , Ariel Shamir, Hao Zhang, and Hui Huang. 2020 . Predictive and generative neural networks for object functionality. arXiv preprint arXiv:2006.15520 (2020). Ruizhen Hu, Zihao Yan, Jingwen Zhang, Oliver Van Kaick, Ariel Shamir, Hao Zhang, and Hui Huang. 2020. Predictive and generative neural networks for object functionality. arXiv preprint arXiv:2006.15520 (2020)."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1186\/1743-0003-11-113"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366208"},{"key":"e_1_2_2_29_1","volume-title":"Grasping Field: Learning Implicit Representations for Human Grasps. In International Conference on 3D Vision (3DV).","author":"Karunratanakul Korrawe","year":"2020","unstructured":"Korrawe Karunratanakul , Jinlong Yang , Yan Zhang , Michael Black , Krikamol Muandet , and Siyu Tang . 2020 . Grasping Field: Learning Implicit Representations for Human Grasps. In International Conference on 3D Vision (3DV). Korrawe Karunratanakul, Jinlong Yang, Yan Zhang, Michael Black, Krikamol Muandet, and Siyu Tang. 2020. Grasping Field: Learning Implicit Representations for Human Grasps. In International Conference on 3D Vision (3DV)."},{"key":"e_1_2_2_30_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141969"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.438"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925927"},{"key":"e_1_2_2_34_1","unstructured":"Magic Leap. [Online; accessed 27-January-2021]. Hand Tracking. https:\/\/developer.magicleap.com\/en-us\/learn\/guides\/lumin-sdk-handtracking.  Magic Leap. [Online; accessed 27-January-2021]. Hand Tracking. https:\/\/developer.magicleap.com\/en-us\/learn\/guides\/lumin-sdk-handtracking."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00085"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364914549607"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.2946684"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364917710318"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.1033"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531350"},{"key":"e_1_2_2_41_1","doi-asserted-by":"crossref","unstructured":"Min Liu Zherong Pan Kai Xu Kanishka Ganguly and Dinesh Manocha. 2019. Generating Grasp Poses for a High-DOF Gripper Using Neural Networks.  Min Liu Zherong Pan Kai Xu Kanishka Ganguly and Dinesh Manocha. 2019. Generating Grasp Poses for a High-DOF Gripper Using Neural Networks.","DOI":"10.1109\/IROS40897.2019.8968115"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179849.1179889"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392474"},{"key":"e_1_2_2_44_1","unstructured":"Microsoft. [Online; accessed 27-January-2021]. Microsoft Mixed Reality Toolkit: Hand Tracking. https:\/\/microsoft.github.io\/MixedRealityToolkit-Unity\/Documentation\/Input\/HandTracking.html.  Microsoft. [Online; accessed 27-January-2021]. Microsoft Mixed Reality Toolkit: Hand Tracking. https:\/\/microsoft.github.io\/MixedRealityToolkit-Unity\/Documentation\/Input\/HandTracking.html."},{"key":"e_1_2_2_45_1","volume-title":"A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image. arXiv preprint arXiv:2008.09309","author":"Moon Gyeongsik","year":"2020","unstructured":"Gyeongsik Moon , Shoou- I Yu , He Wen , Takaaki Shiratori , and Kyoung Mu Lee . 2020. InterHand2.6M : A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image. arXiv preprint arXiv:2008.09309 ( 2020 ). Gyeongsik Moon, Shoou-I Yu, He Wen, Takaaki Shiratori, and Kyoung Mu Lee. 2020. InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image. arXiv preprint arXiv:2008.09309 (2020)."},{"key":"e_1_2_2_46_1","volume-title":"Proceedings of the ACM SIGGRAPH\/Eurographics symposium on computer animation. 137--144","author":"Mordatch Igor","year":"2012","unstructured":"Igor Mordatch , Zoran Popovi\u0107 , and Emanuel Todorov . 2012 . Contact-invariant optimization for hand manipulation . In Proceedings of the ACM SIGGRAPH\/Eurographics symposium on computer animation. 137--144 . Igor Mordatch, Zoran Popovi\u0107, and Emanuel Todorov. 2012. Contact-invariant optimization for hand manipulation. In Proceedings of the ACM SIGGRAPH\/Eurographics symposium on computer animation. 137--144."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322958"},{"key":"e_1_2_2_48_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV).","author":"Mueller Franziska","year":"2017","unstructured":"Franziska Mueller , Dushyant Mehta , Oleksandr Sotnychenko , Srinath Sridhar , Dan Casas , and Christian Theobalt . 2017 . Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor . In Proceedings of the International Conference on Computer Vision (ICCV). Franziska Mueller, Dushyant Mehta, Oleksandr Sotnychenko, Srinath Sridhar, Dan Casas, and Christian Theobalt. 2017. Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor. In Proceedings of the International Conference on Computer Vision (ICCV)."},{"key":"e_1_2_2_49_1","unstructured":"Oculus. [Online; accessed 27-January-2021]. Oculus Touch Controllers. https:\/\/developer.oculus.com\/documentation\/native\/pc\/dg-input-touch-overview\/.  Oculus. [Online; accessed 27-January-2021]. Oculus Touch Controllers. https:\/\/developer.oculus.com\/documentation\/native\/pc\/dg-input-touch-overview\/."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00025"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356501"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201311"},{"key":"e_1_2_2_53_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3073602","article-title":"Deeploco: Dynamic locomotion skills using hierarchical deep reinforcement learning","volume":"36","author":"Peng Xue Bin","year":"2017","unstructured":"Xue Bin Peng , Glen Berseth , KangKang Yin , and Michiel Van De Panne . 2017 . Deeploco: Dynamic locomotion skills using hierarchical deep reinforcement learning . ACM Transactions on Graphics (TOG) 36 , 4 (2017), 1 -- 13 . Xue Bin Peng, Glen Berseth, KangKang Yin, and Michiel Van De Panne. 2017. Deeploco: Dynamic locomotion skills using hierarchical deep reinforcement learning. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1--13.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3083725"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073413"},{"key":"e_1_2_2_56_1","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition. 652--660","author":"Qi Charles R","year":"2017","unstructured":"Charles R Qi , Hao Su , Kaichun Mo , and Leonidas J Guibas . 2017 a. Pointnet: Deep learning on point sets for 3d classification and segmentation . In Proceedings of the IEEE conference on computer vision and pattern recognition. 652--660 . Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017a. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition. 652--660."},{"key":"e_1_2_2_57_1","unstructured":"Charles Ruizhongtai Qi Li Yi Hao Su and Leonidas J Guibas. 2017b. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. In Advances in neural information processing systems. 5099--5108.  Charles Ruizhongtai Qi Li Yi Hao Su and Leonidas J Guibas. 2017b. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. In Advances in neural information processing systems. 5099--5108."},{"key":"e_1_2_2_58_1","volume-title":"Learning complex dexterous manipulation with deep reinforcement learning and demonstrations. arXiv preprint arXiv:1709.10087","author":"Rajeswaran Aravind","year":"2017","unstructured":"Aravind Rajeswaran , Vikash Kumar , Abhishek Gupta , Giulia Vezzani , John Schulman , Emanuel Todorov , and Sergey Levine . 2017. Learning complex dexterous manipulation with deep reinforcement learning and demonstrations. arXiv preprint arXiv:1709.10087 ( 2017 ). Aravind Rajeswaran, Vikash Kumar, Abhishek Gupta, Giulia Vezzani, John Schulman, Emanuel Todorov, and Sergey Levine. 2017. Learning complex dexterous manipulation with deep reinforcement learning and demonstrations. arXiv preprint arXiv:1709.10087 (2017)."},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130883"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.18-23-10105.1998"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.22-04-01426.2002"},{"key":"e_1_2_2_62_1","volume-title":"Eugen Solowjow, and Sergey Levine.","author":"Schoettler Gerrit","year":"2019","unstructured":"Gerrit Schoettler , Ashvin Nair , Jianlan Luo , Shikhar Bahl , Juan Aparicio Ojea , Eugen Solowjow, and Sergey Levine. 2019 . Deep reinforcement learning for industrial insertion tasks with visual inputs and natural rewards. arXiv preprint arXiv:1906.05841 (2019). Gerrit Schoettler, Ashvin Nair, Jianlan Luo, Shikhar Bahl, Juan Aparicio Ojea, Eugen Solowjow, and Sergey Levine. 2019. Deep reinforcement learning for industrial insertion tasks with visual inputs and natural rewards. arXiv preprint arXiv:1906.05841 (2019)."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.494"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.28"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_19"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356505"},{"key":"e_1_2_2_69_1","volume-title":"GRAB: A Dataset of Whole-Body Human Grasping of Objects. In European Conference on Computer Vision (ECCV). https:\/\/grab.is.tue.mpg.de","author":"Taheri Omid","year":"2020","unstructured":"Omid Taheri , Nima Ghorbani , Michael J. Black , and Dimitrios Tzionas . 2020 . GRAB: A Dataset of Whole-Body Human Grasping of Objects. In European Conference on Computer Vision (ECCV). https:\/\/grab.is.tue.mpg.de Omid Taheri, Nima Ghorbani, Michael J. Black, and Dimitrios Tzionas. 2020. GRAB: A Dataset of Whole-Body Human Grasping of Objects. In European Conference on Computer Vision (ECCV). https:\/\/grab.is.tue.mpg.de"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629500"},{"key":"e_1_2_2_71_1","volume-title":"Grasp: combined contribution of object properties and task constraints on hand and finger posture. Experimental brain research 232, 10","author":"Touvet Fran\u00e7ois","year":"2014","unstructured":"Fran\u00e7ois Touvet , Agn\u00e8s Roby-Brami , Marc A Maier , and Selim Eskiizmirliler . 2014. Grasp: combined contribution of object properties and task constraints on hand and finger posture. Experimental brain research 232, 10 ( 2014 ), 3055--3067. Fran\u00e7ois Touvet, Agn\u00e8s Roby-Brami, Marc A Maier, and Selim Eskiizmirliler. 2014. Grasp: combined contribution of object properties and task constraints on hand and finger posture. Experimental brain research 232, 10 (2014), 3055--3067."},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0895-4"},{"key":"e_1_2_2_73_1","unstructured":"Ultraleap. [Online; accessed 27-January-2021]. Gemini: Fifth-generation hand tracking platform\". https:\/\/www.ultraleap.com\/tracking\/gemini-hand-tracking-platform\/.  Ultraleap. [Online; accessed 27-January-2021]. Gemini: Fifth-generation hand tracking platform\". https:\/\/www.ultraleap.com\/tracking\/gemini-hand-tracking-platform\/."},{"key":"e_1_2_2_74_1","unstructured":"Vive. [Online; accessed 27-January-2021]. VIVE TRACKER: GO BEYOND VR CONTROLLERS. https:\/\/www.vive.com\/us\/accessory\/vive-tracker\/.  Vive. [Online; accessed 27-January-2021]. VIVE TRACKER: GO BEYOND VR CONTROLLERS. https:\/\/www.vive.com\/us\/accessory\/vive-tracker\/."},{"key":"e_1_2_2_75_1","volume-title":"Computer Graphics Forum","author":"Wang He","unstructured":"He Wang , S\u00f6ren Pirk , Ersin Yumer , Vladimir G Kim , Ozan Sener , Srinath Sridhar , and Leonidas J Guibas . 2019. Learning a Generative Model for Multi-Step Human-Object Interactions from Videos . In Computer Graphics Forum , Vol. 38 . Wiley Online Library , 367--378. He Wang, S\u00f6ren Pirk, Ersin Yumer, Vladimir G Kim, Ozan Sener, Srinath Sridhar, and Leonidas J Guibas. 2019. Learning a Generative Model for Multi-Step Human-Object Interactions from Videos. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 367--378."},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417852"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12595"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356499"},{"key":"e_1_2_2_79_1","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition. 1912--1920","author":"Wu Zhirong","year":"2015","unstructured":"Zhirong Wu , Shuran Song , Aditya Khosla , Fisher Yu , Linguang Zhang , Xiaoou Tang , and Jianxiong Xiao . 2015 . 3d shapenets: A deep representation for volumetric shapes . In Proceedings of the IEEE conference on computer vision and pattern recognition. 1912--1920 . Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao. 2015. 3d shapenets: A deep representation for volumetric shapes. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1912--1920."},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185537"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00279"},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322998"},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275090"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00262"},{"key":"e_1_2_2_85_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2508363.2508412","article-title":"Robust realtime physics-based motion control for human grasping","volume":"32","author":"Zhao Wenping","year":"2013","unstructured":"Wenping Zhao , Jianjie Zhang , Jianyuan Min , and Jinxiang Chai . 2013 . Robust realtime physics-based motion control for human grasping . ACM Transactions on Graphics (TOG) 32 , 6 (2013), 1 -- 12 . Wenping Zhao, Jianjie Zhang, Jianyuan Min, and Jinxiang Chai. 2013. Robust realtime physics-based motion control for human grasping. ACM Transactions on Graphics (TOG) 32, 6 (2013), 1--12.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.525"},{"key":"e_1_2_2_87_1","volume-title":"Every Thing We Touch: A 24-Hour Inventory of Our Lives","author":"Zuccotti Paula","unstructured":"Paula Zuccotti . 2015. Every Thing We Touch: A 24-Hour Inventory of Our Lives . Viking . Paula Zuccotti. 2015. Every Thing We Touch: A 24-Hour Inventory of Our Lives. Viking."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459830","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459830","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:20Z","timestamp":1750191440000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459830"}},"subtitle":["neural manipulation synthesis with a hand-object spatial representation"],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":87,"aliases":["10.1145\/3476576.3476690"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3450626.3459830"],"URL":"https:\/\/doi.org\/10.1145\/3450626.3459830","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"2021-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}