{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T02:10:32Z","timestamp":1774059032962,"version":"3.50.1"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T00:00:00Z","timestamp":1468195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,7,11]]},"abstract":"<jats:p>We present a new anatomically-constrained local face model and fitting approach for tracking 3D faces from 2D motion data in very high quality. In contrast to traditional global face models, often built from a large set of blendshapes, we propose a local deformation model composed of many small subspaces spatially distributed over the face. Our local model offers far more flexibility and expressiveness than global blendshape models, even with a much smaller model size. This flexibility would typically come at the cost of reduced robustness, in particular during the under-constrained task of monocular reconstruction. However, a key contribution of this work is that we consider the face anatomy and introduce subspace skin thickness constraints into our model, which constrain the face to only valid expressions and helps counteract depth ambiguities in monocular tracking. Given our new model, we present a novel fitting optimization that allows 3D facial performance reconstruction from a single view at extremely high quality, far beyond previous fitting approaches. Our model is flexible, and can be applied also when only sparse motion data is available, for example with marker-based motion capture or even face posing from artistic sketches. Furthermore, by incorporating anatomical constraints we can automatically estimate the rigid motion of the skull, obtaining a rigid stabilization of the performance for free. We demonstrate our model and single-view fitting method on a number of examples, including, for the first time, extreme local skin deformation caused by external forces such as wind, captured from a single high-speed camera.<\/jats:p>","DOI":"10.1145\/2897824.2925882","type":"journal-article","created":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T16:04:33Z","timestamp":1468253073000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":63,"title":["An anatomically-constrained local deformation model for monocular face capture"],"prefix":"10.1145","volume":"35","author":[{"given":"Chenglei","family":"Wu","sequence":"first","affiliation":[{"name":"ETH Zurich"}]},{"given":"Derek","family":"Bradley","sequence":"additional","affiliation":[{"name":"Disney Research"}]},{"given":"Markus","family":"Gross","sequence":"additional","affiliation":[{"name":"Disney Research and ETH Zurich"}]},{"given":"Thabo","family":"Beeler","sequence":"additional","affiliation":[{"name":"Disney Research"}]}],"member":"320","published-online":{"date-parts":[[2016,7,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601182"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778777"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_2_4_1","unstructured":"Black M. and Yacoob Y. 1995. Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In ICCV 374--381.   Black M. and Yacoob Y. 1995. Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In ICCV 374--381."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461976"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778778"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000011203.00237.9b"},{"key":"e_1_2_2_9_1","doi-asserted-by":"crossref","unstructured":"Brox T. Bruhn A. Papenberg N. and Weickert J. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. 25--36.  Brox T. Bruhn A. Papenberg N. and Weickert J. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV . 25--36.","DOI":"10.1007\/978-3-540-24673-2_3"},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Brunton A. Bolkart T. and Wuhrer S. 2014. Multilinear wavelets: A statistical shape space for human faces. In ECCV.  Brunton A. Bolkart T. and Wuhrer S. 2014. Multilinear wavelets: A statistical shape space for human faces. In ECCV .","DOI":"10.1007\/978-3-319-10590-1_20"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462012"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601204"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766943"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.449"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.927467"},{"key":"e_1_2_2_16_1","doi-asserted-by":"crossref","unstructured":"DeCarlo D. and Metaxas D. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In CVPR 231.   DeCarlo D. and Metaxas D. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In CVPR 231.","DOI":"10.1109\/CVPR.1996.517079"},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Ekman P. and Friesen W. V. 1977. Facial action coding system.  Ekman P. and Friesen W. V. 1977. Facial action coding system.","DOI":"10.1037\/t27734-000"},{"key":"e_1_2_2_18_1","volume-title":"Proc. of Computer Animation, 68","author":"Essa I.","unstructured":"Essa , I. , Basu , S. , Darrell , T. , and Pentland , A . 1996. Modeling, tracking and interactive animation of faces and heads using input from video . In Proc. of Computer Animation, 68 . Essa, I., Basu, S., Darrell, T., and Pentland, A. 1996. Modeling, tracking and interactive animation of faces and heads using input from video. In Proc. of Computer Animation, 68."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638549"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508380"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024163"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02291478"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964969"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Joshi P. Tien W. C. Desbrun M. and Pighin F. 2003. Learning controls for blend shape based realistic facial animation. In SCA 187--192.   Joshi P. Tien W. C. Desbrun M. and Pighin F. 2003. Learning controls for blend shape based realistic facial animation. In SCA 187--192.","DOI":"10.1145\/965400.965571"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-7721(99)00032-2"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1640443.1640446"},{"key":"e_1_2_2_27_1","unstructured":"Lewis J. P. Anjyo K. Rhee T. Zhang M. Pighin F. and Deng Z. 2014. Practice and Theory of Blendshape Facial Models. In Eurographics 2014 - State of the Art Reports The Eurographics Association S. Lefebvre and M. Spagnuolo Eds.  Lewis J. P. Anjyo K. Rhee T. Zhang M. Pighin F. and Deng Z. 2014. Practice and Theory of Blendshape Facial Models. In Eurographics 2014 - State of the Art Reports The Eurographics Association S. Lefebvre and M. Spagnuolo Eds."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.216724"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462019"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-011-0591-x"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508417"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019406.2019435"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0380-4"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661290"},{"key":"e_1_2_2_35_1","doi-asserted-by":"crossref","unstructured":"Suwajanakorn S. Kemelmacher-Shlizerman I. and Seitz S. M. 2014. Total moving face reconstruction. In ECCV.  Suwajanakorn S. Kemelmacher-Shlizerman I. and Seitz S. M. 2014. Total moving face reconstruction. In ECCV .","DOI":"10.1007\/978-3-319-10593-2_52"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964971"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366206"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073209"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1599470.1599472"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964972"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015759"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601165"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925882","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897824.2925882","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:38:46Z","timestamp":1750221526000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925882"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,11]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,11]]}},"alternative-id":["10.1145\/2897824.2925882"],"URL":"https:\/\/doi.org\/10.1145\/2897824.2925882","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,11]]},"assertion":[{"value":"2016-07-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}