{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T15:51:58Z","timestamp":1778860318348,"version":"3.51.4"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,4,27]],"date-time":"2021-04-27T00:00:00Z","timestamp":1619481600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61972160, 62072191, 61572202"],"award-info":[{"award-number":["61972160, 62072191, 61572202"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSF of Guangdong, China","award":["2021A1515012301, 2019A1515010860"],"award-info":[{"award-number":["2021A1515012301, 2019A1515010860"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,4,30]]},"abstract":"<jats:p>Parameterizing Variations of human shapes and motions is a long-standing problem in computer graphics and vision. Most of the existing methods only deal with a specific kind of motion, such as body poses, facial expressions, or hand gestures. We propose PanoMan (sParse locAlized compoNents based mOdel for full huMAn motioNs) to handle shape variation and full-motion across body, face, and hand in a unified framework. Like previous approaches, we factor shape variation into principal components to obtain a human shape space that approximates the shape of arbitrary identity. We then analyze sparse localized components in terms of relative edge length and dihedral angle to capture full motions of body poses, facial expressions, and hand gestures. The final piece of our model is a multilayer perceptron (MLP) that fits the residual between the ground truth and the aforementioned two-level approximation. As an application, we employ the discrete-shell deformation to drive the model to fit sparse constraints such as joint positions and surface feature points. We thoroughly evaluate PanoMan on body, face, and hand motion benchmarks as well as scanned data. The existing skinning-based techniques suffer from joint collapsing when encountering twisting motion of joints. Experiments show that PanoMan can capture all kinds of full human motions with high quality and is easier than the state-of-the-art models in recovering poses with wide joint twisting and complex hand gestures.<\/jats:p>","DOI":"10.1145\/3447244","type":"journal-article","created":{"date-parts":[[2021,4,27]],"date-time":"2021-04-27T15:20:51Z","timestamp":1619536851000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["PanoMan: Sparse Localized Components\u2013based Model for Full Human Motions"],"prefix":"10.1145","volume":"40","author":[{"given":"Yupan","family":"Wang","sequence":"first","affiliation":[{"name":"South\u00a0China University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guiqing","family":"Li","sequence":"additional","affiliation":[{"name":"South\u00a0China University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huiqian","family":"Zhang","sequence":"additional","affiliation":[{"name":"South\u00a0China University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinyi","family":"Zou","sequence":"additional","affiliation":[{"name":"South\u00a0China University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuxin","family":"Liu","sequence":"additional","affiliation":[{"name":"South\u00a0China University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongwei","family":"Nie","sequence":"additional","affiliation":[{"name":"South\u00a0China University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,4,27]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00127"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00875"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00238"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882311"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/AFGR.2008.4813376"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073207"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_46"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58536-5_19"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_1_10_1","volume-title":"Black","author":"Bogo Federica","year":"2016","unstructured":"Federica Bogo , Angjoo Kanazawa , Christoph Lassner , Peter Gehler , Javier Romero , and Michael J . Black . 2016 . Keep it SMPL : Automatic estimation of 3D human pose and shape from a single image. In Proceedings of the European Conference on Computer Vision. Springer , 561\u2013578. Federica Bogo, Angjoo Kanazawa, Christoph Lassner, Peter Gehler, Javier Romero, and Michael J. Black. 2016. Keep it SMPL: Automatic estimation of 3D human pose and shape from a single image. In Proceedings of the European Conference on Computer Vision. Springer, 561\u2013578."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5573\u20135582","author":"Bogo Federica","unstructured":"Federica Bogo , Javier Romero , Gerard Pons-Moll , and Michael J. Black . 2017. Dynamic FAUST: Registering human bodies in motion . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5573\u20135582 . Federica Bogo, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2017. Dynamic FAUST: Registering human bodies in motion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5573\u20135582."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461976"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cagd.2017.03.004"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.249"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2478779"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.21"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2019.03.013"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2511751"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2017.11.008"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.245"},{"key":"e_1_2_1_21_1","unstructured":"CMU. 2000. CMU graphics lab motion capture database. Retrieved from: http:\/\/mocap.cs.cmu.edu.  CMU. 2000. CMU graphics lab motion capture database. Retrieved from: http:\/\/mocap.cs.cmu.edu."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.01974.x"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12991"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908736"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2007.909557"},{"key":"e_1_2_1_26_1","first-page":"28","article-title":"Reconstruction of personalized 3D face rigs from monocular video","volume":"35","author":"Garrido Pablo","year":"2016","unstructured":"Pablo Garrido , Michael Zollh\u00f6fer , Dan Casas , Levi Valgaerts , Kiran Varanasi , Patrick P\u00e9rez , and Christian Theobalt . 2016 . Reconstruction of personalized 3D face rigs from monocular video . ACM Trans. Graph. 35 , 3 (2016), 28 . Pablo Garrido, Michael Zollh\u00f6fer, Dan Casas, Levi Valgaerts, Kiran Varanasi, Patrick P\u00e9rez, and Christian Theobalt. 2016. Reconstruction of personalized 3D face rigs from monocular video. ACM Trans. Graph. 35, 3 (2016), 28.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13500"},{"key":"e_1_2_1_28_1","volume-title":"Black","author":"Hirshberg David A.","year":"2012","unstructured":"David A. Hirshberg , Matthew Loper , Eric Rachlin , and Michael J . Black . 2012 . Coregistration : Simultaneous alignment and modeling of articulated 3D shape. In Proceedings of the European Conference on Computer Vision. Springer , 242\u2013255. David A. Hirshberg, Matthew Loper, Eric Rachlin, and Michael J. Black. 2012. Coregistration: Simultaneous alignment and modeling of articulated 3D shape. In Proceedings of the European Conference on Computer Vision. Springer, 242\u2013255."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12492"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024199"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866174"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2782743"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00868"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982438"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073685"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.1604"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)","volume":"2","author":"Lassner Christoph","unstructured":"Christoph Lassner , Javier Romero , Martin Kiefel , Federica Bogo , Michael J. Black , and Peter V. Gehler . 2017. Unite the people: Closing the loop between 3D and 2D human representations . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917) , Vol. 2 . 3. Christoph Lassner, Javier Romero, Martin Kiefel, Federica Bogo, Michael J. Black, and Peter V. Gehler. 2017. Unite the people: Closing the loop between 3D and 2D human representations. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917), Vol. 2. 3."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925959"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130813"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2018.11.005"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661273"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00013"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508417"},{"key":"e_1_2_1_45_1","unstructured":"Ver\u00f3nica Orvalho Pedro Bastos Frederic I. Parke Bruno Oliveira and Xenxo Alvarez. 2012. A facial rigging survey. In Eurographics (STARs). 183\u2013204.  Ver\u00f3nica Orvalho Pedro Bastos Frederic I. Parke Bruno Oliveira and Xenxo Alvarez. 2012. A facial rigging survey. In Eurographics (STARs). 183\u2013204."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10975\u201310985","author":"Pavlakos Georgios","unstructured":"Georgios Pavlakos , Vasileios Choutas , Nima Ghorbani , Timo Bolkart , Ahmed A. A. Osman , Dimitrios Tzionas , and Michael J. Black . 2019. Expressive body capture: 3D hands, face, and body from a single image . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10975\u201310985 . Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, and Michael J. Black. 2019. Expressive body capture: 3D hands, face, and body from a single image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10975\u201310985."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00055"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.02.018"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073711"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766993"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.145"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2016.56"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130883"},{"key":"e_1_2_1_54_1","volume-title":"FrankMocap: Fast monocular 3D hand and body motion capture by regression and integration. arXiv preprint arXiv:2008.08324","author":"Rong Yu","year":"2020","unstructured":"Yu Rong , Takaaki Shiratori , and Hanbyul Joo . 2020. FrankMocap: Fast monocular 3D hand and body motion capture by regression and integration. arXiv preprint arXiv:2008.08324 ( 2020 ). Yu Rong, Takaaki Shiratori, and Hanbyul Joo. 2020. FrankMocap: Fast monocular 3D hand and body motion capture by regression and integration. arXiv preprint arXiv:2008.08324 (2020)."},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7763\u20137772","author":"Sanyal Soubhik","unstructured":"Soubhik Sanyal , Timo Bolkart , Haiwen Feng , and Michael J. Black . 2019. Learning to regress 3D face shape and expression from an image without 3D supervision . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7763\u20137772 . Soubhik Sanyal, Timo Bolkart, Haiwen Feng, and Michael J. Black. 2019. Learning to regress 3D face shape and expression from an image without 3D supervision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7763\u20137772."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14073"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702179"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-009-0273-6"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.494"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/3151666.3151682"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298941"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015736"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298683"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58548-8_34"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00612"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence. 2452\u20132459","author":"Tan Qingyang","year":"2018","unstructured":"Qingyang Tan , Lin Gao , Yu-Kun Lai , Jie Yang , and Shihong Xia . 2018 b. Mesh-based autoencoders for localized deformation component analysis . In Proceedings of the AAAI Conference on Artificial Intelligence. 2452\u20132459 . Qingyang Tan, Lin Gao, Yu-Kun Lai, Jie Yang, and Shihong Xia. 2018b. Mesh-based autoencoders for localized deformation component analysis. In Proceedings of the AAAI Conference on Artificial Intelligence. 2452\u20132459."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925965"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980226"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130830"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.492"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13076"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2007.01048.x"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964972"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/97880.97906"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01600.x"},{"key":"e_1_2_1_76_1","first-page":"1","article-title":"Pose-space subspace dynamics","volume":"35","author":"Xu Hongyi","year":"2016","unstructured":"Hongyi Xu and Jernej Barbi\u010d . 2016 . Pose-space subspace dynamics . ACM Trans. Graph. 35 , 4 (2016), 1 \u2013 14 . Hongyi Xu and Jernej Barbi\u010d. 2016. Pose-space subspace dynamics. ACM Trans. Graph. 35, 4 (2016), 1\u201314.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00761"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.582"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00244"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2013.10.023"},{"key":"e_1_2_1_81_1","unstructured":"Zerong Zheng Tao Yu Yebin Liu and Qionghai Dai. 2020. PaMIR: Parametric model-conditioned implicit representation for image-based human reconstruction. arxiv:cs.CV\/2007.03858 (2020)  Zerong Zheng Tao Yu Yebin Liu and Qionghai Dai. 2020. PaMIR: Parametric model-conditioned implicit representation for image-based human reconstruction. arxiv:cs.CV\/2007.03858 (2020)"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237254"},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3537\u20133546","author":"Zuffi Silvia","unstructured":"Silvia Zuffi and Michael J. Black . 2015. The stitched puppet: A graphical model of 3D human shape and pose . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3537\u20133546 . Silvia Zuffi and Michael J. Black. 2015. The stitched puppet: A graphical model of 3D human shape and pose. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3537\u20133546."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447244","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447244","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:27Z","timestamp":1750195707000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447244"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,27]]},"references-count":83,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4,30]]}},"alternative-id":["10.1145\/3447244"],"URL":"https:\/\/doi.org\/10.1145\/3447244","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,27]]},"assertion":[{"value":"2019-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}