{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T16:33:24Z","timestamp":1768322004499,"version":"3.49.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T00:00:00Z","timestamp":1543881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>We present a method to acquire dynamic properties of facial skin appearance, including dynamic diffuse albedo encoding blood flow, dynamic specular intensity, and per-frame high resolution normal maps for a facial performance sequence. The method reconstructs these maps from a purely passive multi-camera setup, without the need for polarization or requiring temporally multiplexed illumination. Hence, it is very well suited for integration with existing passive systems for facial performance capture. To solve this seemingly underconstrained problem, we demonstrate that albedo dynamics during a facial performance can be modeled as a combination of: (1) a static, high-resolution base albedo map, modeling full skin pigmentation; and (2) a dynamic, one-dimensional component in the CIE L*a*b* color space, which explains changes in hemoglobin concentration due to blood flow. We leverage this albedo subspace and additional constraints on appearance and surface geometry to also estimate specular reflection parameters and resolve high-resolution normal maps with unprecedented detail in a passive capture system. These constraints are built into an inverse rendering framework that minimizes the difference of the rendered face to the captured images, incorporating constraints from multiple views for every texel on the face. The presented method is the first system capable of capturing high-quality dynamic appearance maps at full resolution and video framerates, providing a major step forward in the area of facial appearance acquisition.<\/jats:p>","DOI":"10.1145\/3272127.3275073","type":"journal-article","created":{"date-parts":[[2018,11,28]],"date-time":"2018-11-28T19:16:10Z","timestamp":1543432570000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":56,"title":["Practical dynamic facial appearance modeling and acquisition"],"prefix":"10.1145","volume":"37","author":[{"given":"Paulo","family":"Gotardo","sequence":"first","affiliation":[{"name":"Disney Research"}]},{"given":"J\u00e9r\u00e9my","family":"Riviere","sequence":"additional","affiliation":[{"name":"Disney Research"}]},{"given":"Derek","family":"Bradley","sequence":"additional","affiliation":[{"name":"Disney Research"}]},{"given":"Abhijeet","family":"Ghosh","sequence":"additional","affiliation":[{"name":"Imperial College London"}]},{"given":"Thabo","family":"Beeler","sequence":"additional","affiliation":[{"name":"Disney Research"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Sameer Agarwal Keir Mierle and Others. 2016. Ceres Solver. http:\/\/ceres-solver.org.  Sameer Agarwal Keir Mierle and Others. 2016. Ceres Solver. http:\/\/ceres-solver.org."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2010.65"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/1523-1747.ep12479191"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778777"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601182"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778778"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Thomas Brox Andr\u00e9s Bruhn Nils Papenberg and Joachim Weickert. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. 25--36.  Thomas Brox Andr\u00e9s Bruhn Nils Papenberg and Joachim Weickert. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. 25--36.","DOI":"10.1007\/978-3-540-24673-2_3"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766943"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-2494.1991.tb00561.x"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/965161.806819"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 18th Eurographics Conference on Rendering Techniques (EGSR'07)","author":"Eon Eugene","year":"2007","unstructured":"Eugene d' Eon , David Luebke , and Eric Enderton . 2007 . Efficient Rendering of Human Skin . In Proceedings of the 18th Eurographics Conference on Rendering Techniques (EGSR'07) . 147--157. Eugene d'Eon, David Luebke, and Eric Enderton. 2007. Efficient Rendering of Human Skin. In Proceedings of the 18th Eurographics Conference on Rendering Techniques (EGSR'07). 147--157."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073308"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383894.2383946"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409093"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2005.47"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2015.7168375"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12837"},{"key":"e_1_2_1_20_1","volume-title":"Comprehensive Facial Performance Capture. Computer Graphics Forum (CGF) 30, 2","author":"Fyffe Graham","year":"2011","unstructured":"Graham Fyffe , Tim Hawkins , Chris Watts , Wan-Chun Ma , and Paul Debevec . 2011. Comprehensive Facial Performance Capture. Computer Graphics Forum (CGF) 30, 2 ( 2011 ). Graham Fyffe, Tim Hawkins, Chris Watts, Wan-Chun Ma, and Paul Debevec. 2011. Comprehensive Facial Performance Capture. Computer Graphics Forum (CGF) 30, 2 (2011)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638549"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508380"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2014.01.005"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024163"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409092"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.103"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12053"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383533.2383575"},{"key":"e_1_2_1_29_1","volume-title":"Mesoscopic Facial Geometry Inference Using Deep Neural Networks. In IEEE International Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Huynh Loc","year":"2018","unstructured":"Loc Huynh , Weikai Chen , Shunsuke Saito , Jun Xing , Koki Nagano , Andrew Jones , Paul Debevec , and Hao Li . 2018 . Mesoscopic Facial Geometry Inference Using Deep Neural Networks. In IEEE International Conference on Computer Vision and Pattern Recognition (CVPR). Loc Huynh, Weikai Chen, Shunsuke Saito, Jun Xing, Koki Nagano, Andrew Jones, Paul Debevec, and Hao Li. 2018. Mesoscopic Facial Geometry Inference Using Deep Neural Networks. In IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766974"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383319"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866167"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1609967.1609970"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12594"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383873"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409074"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 10th Eurographics Conference on Rendering (EGWR'99)","author":"Marschner Stephen R.","unstructured":"Stephen R. Marschner , Stephen H. Westin , Eric P. F. Lafortune , Kenneth E. Torrance , and Donald P. Greenberg . 1999. Image-based BRDF Measurement Including Human Skin . In Proceedings of the 10th Eurographics Conference on Rendering (EGWR'99) . 131--144. Stephen R. Marschner, Stephen H. Westin, Eric P. F. Lafortune, Kenneth E. Torrance, and Donald P. Greenberg. 1999. Image-based BRDF Measurement Including Human Skin. In Proceedings of the 10th Eurographics Conference on Rendering (EGWR'99). 131--144."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766894"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00056773"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.250"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.1330233"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/136809.136817"},{"key":"e_1_2_1_43_1","volume-title":"Digital color imaging handbook","author":"Sharma Gaurav","unstructured":"Gaurav Sharma and Raja Bala . 2002. Digital color imaging handbook . CRC press . Gaurav Sharma and Raja Bala. 2002. Digital color imaging handbook. CRC press."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661290"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366206"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2614028.2615407"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073258"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000022"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141987"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1731047.1731055"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925882"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201364"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275073","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3272127.3275073","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:05Z","timestamp":1750207445000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275073"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,12,4]]},"references-count":52,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3272127.3275073"],"URL":"https:\/\/doi.org\/10.1145\/3272127.3275073","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,4]]},"assertion":[{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}