{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T22:05:34Z","timestamp":1769637934461,"version":"3.49.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T00:00:00Z","timestamp":1597190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,8,31]]},"abstract":"<jats:p>Film-quality characters typically display highly complex and expressive facial deformation. The underlying rigs used to animate the deformations of a character's face are often computationally expensive, requiring high-end hardware to deform the mesh at interactive rates. In this paper, we present a method using convolutional neural networks for approximating the mesh deformations of characters' faces. For the models we tested, our approximation runs up to 17 times faster than the original facial rig while still maintaining a high level of fidelity to the original rig. We also propose an extension to the approximation for handling high-frequency deformations such as fine skin wrinkles. While the implementation of the original animation rig depends on an extensive set of proprietary libraries making it difficult to install outside of an in-house development environment, our fast approximation relies on the widely available and easily deployed TensorFlow libraries. In addition to allowing high frame rate evaluation on modest hardware and in a wide range of computing environments, the large speed increase also enables interactive inverse kinematics on the animation rig. We demonstrate our approach and its applicability through interactive character posing and real-time facial performance capture.<\/jats:p>","DOI":"10.1145\/3386569.3392397","type":"journal-article","created":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T11:44:27Z","timestamp":1597232667000},"update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["Fast and deep facial deformations"],"prefix":"10.1145","volume":"39","author":[{"given":"Stephen W.","family":"Bailey","sequence":"first","affiliation":[{"name":"University of California"}]},{"given":"Dalton","family":"Omens","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Paul","family":"Dilorenzo","sequence":"additional","affiliation":[{"name":"DreamWorks Animation"}]},{"given":"James F.","family":"O'Brien","sequence":"additional","affiliation":[{"name":"University of California"}]}],"member":"320","published-online":{"date-parts":[[2020,8,12]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Man\u00e9 Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https:\/\/www.tensorflow.org\/Software available from tensorflow.org."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13310"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201300"},{"key":"e_1_2_2_4_1","volume-title":"Shannon Thomas, Victor Vinyals, Mike Safianoff, Joe Bowers, and David Stodolny.","author":"Besedin Vadim","year":"2018","unstructured":"Vadim Besedin, Jalil Sadool, Ludovic bouancheau, Shannon Thomas, Victor Vinyals, Mike Safianoff, Joe Bowers, and David Stodolny. 2018. Ray Character Rig. CGTarian Animation & VFX Online School. https:\/\/www.cgtarian.com\/maya-character-rigs\/download-free-3d-character-ray.html"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1632592.1632602"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157455"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/2151237X.2005.10129202"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786784.2786786"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360690"},{"key":"e_1_2_2_10_1","volume-title":"Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network. CoRR abs\/1803.07835","author":"Feng Yao","year":"2018","unstructured":"Yao Feng, Fan Wu, Xiaohu Shao, Yanfeng Wang, and Xi Zhou. 2018. Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network. CoRR abs\/1803.07835 (2018). arXiv:1803.07835 http:\/\/arxiv.org\/abs\/1803.07835"},{"key":"e_1_2_2_11_1","volume-title":"Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks. 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Feng Zhen-Hua","year":"2017","unstructured":"Zhen-Hua Feng, Josef Kittler, Muhammad Awais, Patrik Huber, and Xiaojun Wu. 2017. Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks. 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2017), 2235--2245."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2890493"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/325334.325244"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185568"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2485895.2485918"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322959"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2628036"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073664"},{"key":"e_1_2_2_19_1","volume-title":"A Pixel-Based Framework for Data-Driven Clothing. CoRR abs\/1812.01677","author":"Jin Ning","year":"2018","unstructured":"Ning Jin, Yilin Zhu, Zhenglin Geng, and Ronald Fedkiw. 2018. A Pixel-Based Framework for Data-Driven Clothing. CoRR abs\/1812.01677 (2018). arXiv:1812.01677 http:\/\/arxiv.org\/abs\/1812.01677"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1230100.1230107"},{"key":"e_1_2_2_21_1","volume-title":"Adam: A Method for Stochastic Optimization. International Conference on Learning Representations (12","author":"Kingma Diederik","year":"2014","unstructured":"Diederik Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. International Conference on Learning Representations (12 2014)."},{"key":"e_1_2_2_22_1","volume-title":"SIGGRAPH '89 Course Notes 22: State of the Art in Facial Animation.","author":"Kleiser J.","year":"1989","unstructured":"J. Kleiser. 1989. A fast, efficient, accurate way to represent the human face. In SIGGRAPH '89 Course Notes 22: State of the Art in Facial Animation."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545286"},{"key":"e_1_2_2_24_1","volume-title":"DeepWrinkles: Accurate and Realistic Clothing Modeling. CoRR abs\/1808.03417","author":"L\u00e4hner Zorah","year":"2018","unstructured":"Zorah L\u00e4hner, Daniel Cremers, and Tony Tung. 2018. DeepWrinkles: Accurate and Realistic Clothing Modeling. CoRR abs\/1808.03417 (2018). arXiv:1808.03417 http:\/\/arxiv.org\/abs\/1808.03417"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3099564.3099581"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366218"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601161"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2010.41"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344862"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1833349.1778769"},{"key":"e_1_2_2_31_1","volume-title":"Deformable Shape Completion with Graph Convolutional Autoencoders. CoRR abs\/1712.00268","author":"Litany Or","year":"2017","unstructured":"Or Litany, Alexander M. Bronstein, Michael M. Bronstein, and Ameesh Makadia. 2017. Deformable Shape Completion with Graph Convolutional Autoencoders. CoRR abs\/1712.00268 (2017). arXiv:1712.00268 http:\/\/arxiv.org\/abs\/1712.00268"},{"key":"e_1_2_2_32_1","volume-title":"Proceedings on Graphics Interface '88","author":"Magnenat-Thalmann N.","unstructured":"N. Magnenat-Thalmann, R. Laperri\u00e8re, and D. Thalmann. 1988. Joint-dependent Local Deformations for Hand Animation and Object Grasping. In Proceedings on Graphics Interface '88. Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 26--33. http:\/\/dl.acm.org\/citation.cfm?id=102313.102317"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2015.112"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1201775.882308"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073313"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508417"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/800193.569955"},{"key":"e_1_2_2_38_1","unstructured":"Frederic Ira Parke. 1974. A Parametric Model for Human Faces. Ph.D. Dissertation. AAI7508697."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2791261.2791262"},{"key":"e_1_2_2_40_1","volume-title":"Black","author":"Ranjan Anurag","year":"2018","unstructured":"Anurag Ranjan, Timo Bolkart, Soubhik Sanyal, and Michael J. Black. 2018. Generating 3D Faces Using Convolutional Mesh Autoencoders. In Computer Vision - ECCV 2018, Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss (Eds.). Springer International Publishing, Cham, 725--741."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.00516"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024198"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073208"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46466-4_14"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2898350"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545283"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370919.2370930"},{"key":"e_1_2_2_48_1","unstructured":"Chris J. Welman. 1993. Inverse Kinematics and Geometric Constraints for Articulated Figure Manipulation. Ph.D. Dissertation. Simon Fraser University."},{"key":"e_1_2_2_49_1","volume-title":"Nickson Fong, and Tian Feng.","author":"Xiao Xian","year":"2006","unstructured":"Xian Xiao, John P. Lewis, Seah Hock Soon, Nickson Fong, and Tian Feng. 2006. A Powell Optimization Approach for Example-Based Skinning in a Production Animation Environment. Computer Animation and Social Agents (12 2006)."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015759"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13382"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386569.3392397","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3386569.3392397","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T05:42:49Z","timestamp":1750830169000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386569.3392397"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,12]]},"references-count":51,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,8,31]]}},"alternative-id":["10.1145\/3386569.3392397"],"URL":"https:\/\/doi.org\/10.1145\/3386569.3392397","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,12]]},"assertion":[{"value":"2020-08-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}