{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T00:06:21Z","timestamp":1774915581809,"version":"3.50.1"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,7,19]]},"abstract":"<jats:p>Physically-based simulation is a powerful approach for 3D facial animation as the resulting deformations are governed by physical constraints, allowing to easily resolve self-collisions, respond to external forces and perform realistic anatomy edits. Today's methods are data-driven, where the actuations for finite elements are inferred from captured skin geometry. Unfortunately, these approaches have not been widely adopted due to the complexity of initializing the material space and learning the deformation model for each character separately, which often requires a skilled artist followed by lengthy network training. In this work, we aim to make physics-based facial animation more accessible by proposing a generalized physical face model that we learn from a large 3D face dataset. Once trained, our model can be quickly fit to any unseen identity and produce a ready-to-animate physical face model automatically. Fitting is as easy as providing a single 3D face scan, or even a single face image. After fitting, we offer intuitive animation controls, as well as the ability to retarget animations across characters. All the while, the resulting animations allow for physical effects like collision avoidance, gravity, paralysis, bone reshaping and more.<\/jats:p>","DOI":"10.1145\/3658189","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T14:47:57Z","timestamp":1721400477000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Learning a Generalized Physical Face Model From Data"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9918-8055","authenticated-orcid":false,"given":"Lingchen","family":"Yang","sequence":"first","affiliation":[{"name":"ETH Z\u00fcrich, Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0022-8203","authenticated-orcid":false,"given":"Gaspard","family":"Zoss","sequence":"additional","affiliation":[{"name":"The Walt Disney Company (Switzerland) GmbH, Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6821-5815","authenticated-orcid":false,"given":"Prashanth","family":"Chandran","sequence":"additional","affiliation":[{"name":"The Walt Disney Company (Switzerland) GmbH, Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-9324-779X","authenticated-orcid":false,"given":"Markus","family":"Gross","sequence":"additional","affiliation":[{"name":"ETH Z\u00fcrich, Zurich, Switzerland"},{"name":"The Walt Disney Company (Switzerland) GmbH, Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7494-8660","authenticated-orcid":false,"given":"Barbara","family":"Solenthaler","sequence":"additional","affiliation":[{"name":"ETH Z\u00fcrich, Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5608-3085","authenticated-orcid":false,"given":"Eftychios","family":"Sifakis","sequence":"additional","affiliation":[{"name":"University of Wisconsin Madison, Madison, United States of America"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2055-9325","authenticated-orcid":false,"given":"Derek","family":"Bradley","sequence":"additional","affiliation":[{"name":"The Walt Disney Company (Switzerland) GmbH, Zurich, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (12 2018","author":"Bao Michael","year":"2018","unstructured":"Michael Bao, Matthew Cong, St\u00e9phane Grabli, and Ronald Fedkiw. 2018. High-Quality Face Capture Using Anatomical Muscles. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (12 2018). http:\/\/arxiv.org\/abs\/1812.02836"},{"key":"e_1_2_1_2_1","first-page":"187","article-title":"A morphable model for the synthesis of 3D faces","volume":"99","author":"Blanz Volker","year":"1999","unstructured":"Volker Blanz and Thomas Vetter. 1999. A morphable model for the synthesis of 3D faces. In Siggraph, Vol. 99. 187--194.","journal-title":"Siggraph"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601116"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20074-8_5"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV50981.2020.00044"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530114"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Prashanth Chandran and Gaspard Zoss. 2023. Anatomically Constrained Implicit Face Models. arXiv:2312.07538 [cs.GR]","DOI":"10.1109\/CVPR52733.2024.00216"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01617"},{"key":"e_1_2_1_9_1","volume-title":"Animation and Transfer. In SIGGRAPH Asia 2022 Conference Papers. Association for Computing Machinery, Article 16","author":"Choi Byungkuk","year":"2022","unstructured":"Byungkuk Choi, Haekwang Eom, Benjamin Mouscadet, Stephen Cullingford, Kurt Ma, Stefanie Gassel, Suzi Kim, Andrew Moffat, Millicent Maier, Marco Revelant, Joe Letteri, and Karan Singh. 2022. Animatomy: An Animator-Centric, Anatomically Inspired System for 3D Facial Modeling, Animation and Transfer. In SIGGRAPH Asia 2022 Conference Papers. Association for Computing Machinery, Article 16, 9 pages."},{"key":"e_1_2_1_10_1","volume-title":"International Journal of Computer Vision","author":"Dai Hang","year":"2019","unstructured":"Hang Dai, Nick Pears, William Smith, and Christian Duncan. 2019. Statistical Modeling of Craniofacial Shape and Texture. International Journal of Computer Vision (2019)."},{"key":"e_1_2_1_11_1","volume-title":"EMOCA: Emotion Driven Monocular Face Capture and Animation. In Conference on Computer Vision and Pattern Recognition (CVPR). 20311--20322","author":"Danecek Radek","year":"2022","unstructured":"Radek Danecek, Michael J. Black, and Timo Bolkart. 2022. EMOCA: Emotion Driven Monocular Face Capture and Animation. In Conference on Computer Vision and Pattern Recognition (CVPR). 20311--20322."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395208"},{"key":"e_1_2_1_13_1","first-page":"4","article-title":"Learning an Animatable Detailed 3D Face Model from In-the-Wild Images. ACM Transactions on Graphics (ToG)","volume":"40","author":"Feng Yao","year":"2021","unstructured":"Yao Feng, Haiwen Feng, Michael J. Black, and Timo Bolkart. 2021. Learning an Animatable Detailed 3D Face Model from In-the-Wild Images. ACM Transactions on Graphics (ToG), Proc. SIGGRAPH 40, 4 (Aug. 2021), 88:1--88:13.","journal-title":"Proc. SIGGRAPH"},{"key":"e_1_2_1_14_1","volume-title":"Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos. arXiv preprint arXiv:2207.11094","author":"Filntisis Panagiotis P.","year":"2022","unstructured":"Panagiotis P. Filntisis, George Retsinas, Foivos Paraperas-Papantoniou, Athanasios Katsamanis, Anastasios Roussos, and Petros Maragos. 2022. Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos. arXiv preprint arXiv:2207.11094 (2022)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00125"},{"key":"e_1_2_1_16_1","volume-title":"Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstruction","author":"Gecer Baris","year":"2021","unstructured":"Baris Gecer, Stylianos Ploumpis, Irene Kotsia, and Stefanos P Zafeiriou. 2021. Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14071"},{"key":"e_1_2_1_18_1","volume-title":"Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415","author":"Hendrycks Dan","year":"2016","unstructured":"Dan Hendrycks and Kevin Gimpel. 2016. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 (2016)."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073664"},{"key":"e_1_2_1_20_1","volume-title":"Adam: A Method for Stochastic Optimization. 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings (12","author":"Diederik","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings (12 2015). http:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3592455"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3388767.3407379"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Bo Li Lingchen Yang and Barbara Solenthaler. 2023. Efficient Incremental Potential Contact for Actuated Face Simulation. In SIGGRAPH Asia 2023 Technical Communications. 1--4.","DOI":"10.1145\/3610543.3626161"},{"key":"e_1_2_1_24_1","volume-title":"Learning a model of facial shape and expression from 4D scans. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia) 36, 6","author":"Li Tianye","year":"2017","unstructured":"Tianye Li, Timo Bolkart, Michael. J. Black, Hao Li, and Javier Romero. 2017. Learning a model of facial shape and expression from 4D scans. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia) 36, 6 (2017)."},{"key":"e_1_2_1_25_1","volume-title":"Learning Smooth Neural Functions via Lipschitz Regularization. arXiv preprint arXiv:2202.08345","author":"Derek Liu Hsueh-Ti","year":"2022","unstructured":"Hsueh-Ti Derek Liu, Francis Williams, Alec Jacobson, Sanja Fidler, and Or Litany. 2022. Learning Smooth Neural Functions via Lipschitz Regularization. arXiv preprint arXiv:2202.08345 (2022)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2021.100400"},{"key":"e_1_2_1_27_1","unstructured":"Christopher Otto Prashanth Chandran Gaspard Zoss Markus Gross Paulo Gotardo and Derek Bradley. 2023. A Perceptual Shape Loss for Monocular 3D Face Reconstruction. arXiv:2310.19580 [cs.CV]"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550454.3555462"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2018.10.045"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073208"},{"key":"e_1_2_1_31_1","volume-title":"Alexander W Bergman, David B Lindell, and Gordon Wetzstein.","author":"Sitzmann Vincent","year":"2020","unstructured":"Vincent Sitzmann, Julien N P Martel, Alexander W Bergman, David B Lindell, and Gordon Wetzstein. 2020. Implicit Neural Representations with Periodic Activation Functions. In NeurIPS 2020, Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin (Eds.). https:\/\/proceedings.neurips.cc\/paper\/2020\/hash\/53c04118df112c13a8c34b38343b9c10-Abstract.html"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459883"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3623264.3624439"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925882"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1115\/DETC2015-46363"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00068"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00068"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3528223.3530156","article-title":"Implicit neural representation for physics-driven actuated soft bodies","volume":"41","author":"Yang Lingchen","year":"2022","unstructured":"Lingchen Yang, Byungsoo Kim, Gaspard Zoss, Baran G\u00f6zc\u00fc, Markus Gross, and Barbara Solenthaler. 2022. Implicit neural representation for physics-driven actuated soft bodies. ACM Transactions on Graphics (TOG) 41, 4 (2022), 1--10.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618156"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00829"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01970"},{"key":"e_1_2_1_42_1","volume-title":"Towards Metrical Reconstruction of Human Faces. In European Conference on Computer Vision.","author":"Zielonka Wojciech","year":"2022","unstructured":"Wojciech Zielonka, Timo Bolkart, and Justus Thies. 2022. Towards Metrical Reconstruction of Human Faces. In European Conference on Computer Vision."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658189","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658189","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:16Z","timestamp":1750291456000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658189"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,7,19]]}},"alternative-id":["10.1145\/3658189"],"URL":"https:\/\/doi.org\/10.1145\/3658189","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,19]]},"assertion":[{"value":"2024-07-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}