{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T00:06:22Z","timestamp":1774915582260,"version":"3.50.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2025,8,31]]},"abstract":"<jats:p>Demand for high-quality virtual 3D characters continues to grow in both entertainment and communication, and with it, the desire for interactive avatars. This presents unique challenges for high-fidelity interactive solutions that must be quick to set up, efficient to run in real-time on consumer hardware, and work well, not only on human characters, but also on fantastical and heavily stylized ones.<\/jats:p>\n          <jats:p>We present Interactive Facial Animation (IFA), a novel approach to augment facial animation rigs with shell simulation and contact without requiring anatomical priors or artist intervention. Our method uses an efficient shell model that tracks the output of a face rig in real-time and incorporates realistic contact. By designing our shell model to be differentiable, we can use inverse simulation to reconstruct realistic non-uniform stiffness that captures both stiff (ears, nose) and soft (cheeks, lips) areas, based on the rig\u2019s deformation space. The reconstruction process imposes hard limits on acceptable errors, which ensures that IFA preserves the resolution and expressiveness of the source material, a common shortcoming in many face simulation pipelines. With performance in mind, we demonstrate IFA using a variant of the Fast Mass-Springs method. However, the presented concept can be realized with any differentiable physics solver that provides reliable convergence.<\/jats:p>\n          <jats:p>We showcase our method in four different character rigs, achieving simulation update runtimes between 0.39 and 1.27 milliseconds (787-2564 FPS) on a single CPU thread. Unlike existing methods that require lengthy preparation times, our pipeline can be ready to use within minutes, also on the CPU.<\/jats:p>","DOI":"10.1145\/3747860","type":"journal-article","created":{"date-parts":[[2025,8,8]],"date-time":"2025-08-08T15:33:31Z","timestamp":1754667211000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Interactive Facial Animation: Enhancing Facial Rigs With Real-Time Shell And Contact Simulation 58"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4651-7542","authenticated-orcid":false,"given":"Jos\u00e9 Antonio","family":"Fern\u00e1ndez-Fern\u00e1ndez","sequence":"first","affiliation":[{"name":"RWTH Aachen University","place":["Aachen, Germany"]},{"name":"Meta","place":["Aachen, Germany"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9336-8679","authenticated-orcid":false,"given":"Ryan","family":"Goldade","sequence":"additional","affiliation":[{"name":"Meta","place":["Zurich, Switzerland"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8549-0878","authenticated-orcid":false,"given":"Ladislav","family":"Kavan","sequence":"additional","affiliation":[{"name":"Meta","place":["Zurich, Switzerland"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1908-4027","authenticated-orcid":false,"given":"Jan","family":"Bender","sequence":"additional","affiliation":[{"name":"RWTH Aachen University","place":["Aachen, Germany"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8389-792X","authenticated-orcid":false,"given":"Philipp","family":"Herholz","sequence":"additional","affiliation":[{"name":"Meta","place":["Zurich, Switzerland"]}]}],"member":"320","published-online":{"date-parts":[[2025,8,8]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","unstructured":"V. Barrielle and N. Stoiber. 2019. Realtime Performance-Driven Physical Simulation for Facial Animation. Computer Graphics Forum 38 1 (2019) 151\u2013166. 10.1111\/cgf.13450 _eprint: https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.13450.","DOI":"10.1111\/cgf.13450"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","unstructured":"Vincent Barrielle Nicolas Stoiber and C\u00e9dric Cagniart. 2016. BlendForces: A Dynamic Framework for Facial Animation. Computer Graphics Forum 35 2 (2016) 341\u2013352. 10.1111\/cgf.12836 _eprint: https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.12836.","DOI":"10.1111\/cgf.12836"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","unstructured":"Bernd Bickel Mario Botsch Roland Angst Wojciech Matusik Miguel Otaduy Hanspeter Pfister and Markus Gross. 2007. Multi-scale capture of facial geometry and motion. ACM Trans. Graph. 26 3 (July 2007) 33\u2013es. 10.1145\/1276377.1276419","DOI":"10.1145\/1276377.1276419"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1632592.1632602"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","unstructured":"Sofien Bouaziz Sebastian Martin Tiantian Liu Ladislav Kavan and Mark Pauly. 2014. Projective dynamics: fusing constraint projections for fast simulation. ACM Trans. Graph. 33 4 (July 2014) 154:1\u2013154:11. 10.1145\/2601097.2601116","DOI":"10.1145\/2601097.2601116"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","unstructured":"Prashanth Chandran and Gaspard Zoss. 2023. Anatomically Constrained Implicit Face Models. 10.48550\/arXiv.2312.07538 arXiv:https:\/\/arXiv.org\/abs\/2312.07538.","DOI":"10.48550\/arXiv.2312.07538"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550469.3555398"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/2982818.2982835"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476117.3483433"},{"key":"e_1_3_2_11_1","unstructured":"Jos\u00e9\u00a0Antonio Fern\u00e1ndez-Fern\u00e1ndez Fabian L\u00f6schner Lukas Westhofen Andreas Longva and Jan Bender. 2023. Symx: Energy-based simulation from symbolic expressions. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2303.02156 (2023)."},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA57147.2024.10610574"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/846276.846284"},{"key":"e_1_3_2_14_1","unstructured":"Ga\u00ebl Guennebaud Beno\u00eet Jacob et\u00a0al. 2010. Eigen v3. http:\/\/eigen.tuxfamily.org."},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","unstructured":"Philipp Herholz Tuur Stuyck and Ladislav Kavan. 2024. A Mesh-based Simulation Framework using Automatic Code Generation. ACM Trans. Graph. 43 6 Article 58 (Nov. 2024) 17\u00a0pages. 10.1145\/3687986","DOI":"10.1145\/3687986"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","unstructured":"Alexandru-Eugen Ichim Petr Kadle\u010dek Ladislav Kavan and Mark Pauly. 2017. Phace: physics-based face modeling and animation. ACM Trans. Graph. 36 4 (July 2017) 153:1\u2013153:14. 10.1145\/3072959.3073664","DOI":"10.1145\/3072959.3073664"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/2982818.2982834"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","unstructured":"Petr Kadle\u010dek and Ladislav Kavan. 2019. Building Accurate Physics-based Face Models from Data. Proc. ACM Comput. Graph. Interact. Tech. 2 2 (July 2019) 15:1\u201315:16. 10.1145\/3340256","DOI":"10.1145\/3340256"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3641519.3657477"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384382.3384531"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","unstructured":"Dan Koschier Crispin Deul Magnus Brand and Jan Bender. 2017. An hp-Adaptive Discretization Algorithm for Signed Distance Field Generation. IEEE Transactions on Visualization and Computer Graphics 23 10 (Oct. 2017) 2208\u20132221. 10.1109\/TVCG.2017.2730202","DOI":"10.1109\/TVCG.2017.2730202"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","unstructured":"Yeara Kozlov Derek Bradley Moritz B\u00e4cher Bernhard Thomaszewski Thabo Beeler and Markus Gross. 2017. Enriching Facial Blendshape Rigs with Physical Simulation. Computer Graphics Forum 36 2 (May 2017) 75\u201384. 10.1111\/cgf.13108","DOI":"10.1111\/cgf.13108"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","unstructured":"Yeara Kozlov Hongyi Xu Moritz B\u00e4cher Derek Bradley Markus Gross and Thabo Beeler. 2019. Data-Driven Physical Face Inversion. 10.48550\/arXiv.1907.10402 arXiv:https:\/\/arXiv.org\/abs\/1907.10402 [cs].","DOI":"10.48550\/arXiv.1907.10402"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","unstructured":"Tassilo Kugelstadt Jan Bender Jos\u00e9\u00a0Antonio Fern\u00e1ndez-Fern\u00e1ndez Stefan\u00a0Rhys Jeske Fabian L\u00f6schner and Andreas Longva. 2021. Fast Corotated Elastic SPH Solids with Implicit Zero-Energy Mode Control. Proc. ACM Comput. Graph. Interact. Tech. 4 3 Article 58 (Sept. 2021) 21\u00a0pages. 10.1145\/3480142","DOI":"10.1145\/3480142"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","unstructured":"T. Kugelstadt D. Koschier and J. Bender. 2018. Fast Corotated FEM using Operator Splitting. Computer Graphics Forum 37 8 (2018) 149\u2013160. 10.1111\/cgf.13520 _eprint: https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.13520.","DOI":"10.1111\/cgf.13520"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218407"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","unstructured":"J.\u00a0P. Lewis Ken Anjyo Taehyun Rhee Mengjie Zhang Fred Pighin and Zhigang Deng. 2014. Practice and Theory of Blendshape Facial Models. (2014). 10.2312\/egst.20141042 Publisher: The Eurographics Association.","DOI":"10.2312\/egst.20141042"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3680528.3687653"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","unstructured":"Tiantian Liu Adam\u00a0W. Bargteil James\u00a0F. O\u2019Brien and Ladislav Kavan. 2013. Fast simulation of mass-spring systems. ACM Trans. Graph. 32 6 (Nov. 2013) 214:1\u2013214:7. 10.1145\/2508363.2508406","DOI":"10.1145\/2508363.2508406"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","unstructured":"Stephen Lombardi Jason Saragih Tomas Simon and Yaser Sheikh. 2018. Deep appearance models for face rendering. ACM Trans. Graph. 37 4 Article 58 (July 2018) 13\u00a0pages. 10.1145\/3197517.3201401","DOI":"10.1145\/3197517.3201401"},{"key":"e_1_3_2_31_1","unstructured":"Andreas Longva Fabian L\u00f6schner Jos\u00e9\u00a0Antonio Fern\u00e1ndez-Fern\u00e1ndez Egor Larionov Uri\u00a0M Ascher and Jan Bender. 2023. Pitfalls of Projection: A study of Newton-type solvers for incremental potentials. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2311.14526 (2023)."},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00013"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3309486.3340247"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","unstructured":"Sebastian Martin Bernhard Thomaszewski Eitan Grinspun and Markus Gross. 2011. Example-based elastic materials. ACM Trans. Graph. 30 4 Article 58 (July 2011) 8\u00a0pages. 10.1145\/2010324.1964967","DOI":"10.1145\/2010324.1964967"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","unstructured":"Antoine McNamara Adrien Treuille Zoran Popovi\u0107 and Jos Stam. 2004. Fluid control using the adjoint method. ACM Trans. Graph. 23 3 (Aug. 2004) 449\u2013456. 10.1145\/1015706.1015744","DOI":"10.1145\/1015706.1015744"},{"key":"e_1_3_2_36_1","doi-asserted-by":"crossref","unstructured":"Matthias M\u00fcller Bruno Heidelberger Marcus Hennix and John Ratcliff. 2007. Position based dynamics. Journal of Visual Communication and Image Representation 18 2 (2007) 109\u2013118.","DOI":"10.1016\/j.jvcir.2007.01.005"},{"key":"e_1_3_2_37_1","series-title":"(SCA \u201916)","first-page":"21","volume-title":"Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation","author":"Narain Rahul","year":"2016","unstructured":"Rahul Narain, Matthew Overby, and George\u00a0E. Brown. 2016. ADMM \u2287 projective dynamics: fast simulation of general constitutive models. In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation(SCA \u201916). Eurographics Association, Goslar, DEU, 21\u201328."},{"key":"e_1_3_2_38_1","volume-title":"Numerical optimization","author":"Nocedal Jorge","year":"2006","unstructured":"Jorge Nocedal and Stephen\u00a0J Wright. 2006. Numerical optimization. Springer."},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","unstructured":"Hyojoon Park Sangeetha Grama\u00a0Srinivasan Matthew Cong Doyub Kim Byungsoo Kim Jonathan Swartz Ken Museth and Eftychios Sifakis. 2024. Near-realtime Facial Animation by Deep 3D Simulation Super-Resolution. ACM Trans. Graph. 43 5 (Aug. 2024) 158:1\u2013158:20. 10.1145\/3670687","DOI":"10.1145\/3670687"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/800193.569955"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","unstructured":"Stephen\u00a0M. Platt and Norman\u00a0I. Badler. 1981. Animating facial expressions. SIGGRAPH Comput. Graph. 15 3 (Aug. 1981) 245\u2013252. 10.1145\/965161.806812","DOI":"10.1145\/965161.806812"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","unstructured":"M. Romeo and S.\u00a0C. Schvartzman. 2020. Data-Driven Facial Simulation. Computer Graphics Forum 39 6 (2020) 513\u2013526. 10.1111\/cgf.14089 _eprint: https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.14089.","DOI":"10.1111\/cgf.14089"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14607"},{"key":"e_1_3_2_44_1","doi-asserted-by":"crossref","unstructured":"Lior Shapira Ariel Shamir and Daniel Cohen-Or. 2008. Consistent mesh partitioning and skeletonisation using the shape diameter function. The Visual Computer 24 (2008) 249\u2013259.","DOI":"10.1007\/s00371-007-0197-5"},{"key":"e_1_3_2_45_1","unstructured":"Soshi Shimada Vladislav Golyanik Patrick P\u00e9rez and Christian Theobalt. 2023. Decaf: Monocular Deformation Capture for Face and Hand Interactions. https:\/\/arxiv.org\/abs\/2309.16670v2"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","unstructured":"Eftychios Sifakis Igor Neverov and Ronald Fedkiw. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Trans. Graph. 24 3 (July 2005) 417\u2013425. 10.1145\/1073204.1073208","DOI":"10.1145\/1073204.1073208"},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","unstructured":"Sangeetha\u00a0Grama Srinivasan Qisi Wang Junior Rojas Gergely Kl\u00e1r Ladislav Kavan and Eftychios Sifakis. 2021. Learning active quasistatic physics-based models from data. ACM Transactions on Graphics 40 4 (Aug. 2021) 1\u201314. 10.1145\/3450626.3459883","DOI":"10.1145\/3450626.3459883"},{"key":"e_1_3_2_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/1218064.1218078"},{"key":"e_1_3_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3623264.3624439"},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","unstructured":"Nicolas Wagner Mario Botsch and Ulrich Schwanecke. 2024. NePHIM: A Neural Physics-Based Head-Hand Interaction Model. 10.48550\/arXiv.2410.13503 arXiv:https:\/\/arXiv.org\/abs\/2410.13503.","DOI":"10.48550\/arXiv.2410.13503"},{"key":"e_1_3_2_51_1","unstructured":"Nicolas Wagner Ulrich Schwanecke and Mario Botsch. 2022. Neural Volumetric Blendshapes: Computationally Efficient Physics-Based Facial Blendshapes. https:\/\/arxiv.org\/abs\/2212.14784v2"},{"key":"e_1_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/37401.37405"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","unstructured":"Qingxuan Wu Zhiyang Dou Sirui Xu Soshi Shimada Chen Wang Zhengming Yu Yuan Liu Cheng Lin Zeyu Cao Taku Komura Vladislav Golyanik Christian Theobalt Wenping Wang and Lingjie Liu. 2024. DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image. 10.48550\/arXiv.2406.17988 arXiv:https:\/\/arXiv.org\/abs\/2406.17988 version: 1.","DOI":"10.48550\/arXiv.2406.17988"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","unstructured":"Lingchen Yang Byungsoo Kim Gaspard Zoss Baran G\u00f6zc\u00fc Markus Gross and Barbara Solenthaler. 2022. Implicit neural representation for physics-driven actuated soft bodies. ACM Transactions on Graphics 41 4 (July 2022) 1\u201310. 10.1145\/3528223.3530156","DOI":"10.1145\/3528223.3530156"},{"key":"e_1_3_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618156"},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","unstructured":"Lingchen Yang Gaspard Zoss Prashanth Chandran Markus Gross Barbara Solenthaler Eftychios Sifakis and Derek Bradley. 2024. Learning a Generalized Physical Face Model From Data. ACM Trans. Graph. 43 4 (July 2024) 94:1\u201394:14. 10.1145\/3658189","DOI":"10.1145\/3658189"},{"key":"e_1_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3680528.3687695"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3747860","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,8]],"date-time":"2025-08-08T16:25:11Z","timestamp":1754670311000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3747860"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,8]]},"references-count":56,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,8,31]]}},"alternative-id":["10.1145\/3747860"],"URL":"https:\/\/doi.org\/10.1145\/3747860","relation":{},"ISSN":["2577-6193"],"issn-type":[{"value":"2577-6193","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,8]]},"assertion":[{"value":"2025-08-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}