{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T14:44:59Z","timestamp":1761662699859,"version":"3.41.0"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2008,12,1]],"date-time":"2008-12-01T00:00:00Z","timestamp":1228089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2008,12]]},"abstract":"<jats:p>\n            We present a novel method for acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps. Our method consists of an analysis phase where the relationship between motion capture markers and detailed facial geometry is inferred, and a synthesis phase where novel detailed animated facial geometry is driven solely by a sparse set of motion capture markers. For analysis, we record the actor wearing facial markers while performing a set of training expression clips. We capture real-time high-resolution facial deformations, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, we compute displacements between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in a\n            <jats:italic>polynomial displacement map<\/jats:italic>\n            which is parameterized according to the local deformations of the motion capture dots. For synthesis, we drive the polynomial displacement map with new motion capture data. This allows the recreation of large-scale muscle deformation, medium and fine wrinkles, and dynamic skin pore detail. Applications include the compression of existing performance data and the synthesis of new performances. Our technique is independent of the underlying geometry capture system and can be used to automatically generate high-frequency wrinkle and pore details on top of many existing facial animation systems.\n          <\/jats:p>","DOI":"10.1145\/1409060.1409074","type":"journal-article","created":{"date-parts":[[2008,12,3]],"date-time":"2008-12-03T21:56:04Z","timestamp":1228341364000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":87,"title":["Facial performance synthesis using deformation-driven polynomial displacement maps"],"prefix":"10.1145","volume":"27","author":[{"given":"Wan-Chun","family":"Ma","sequence":"first","affiliation":[{"name":"University of Southern California and National Taiwan University"}]},{"given":"Andrew","family":"Jones","sequence":"additional","affiliation":[{"name":"University of Southern California"}]},{"given":"Jen-Yuan","family":"Chiang","sequence":"additional","affiliation":[{"name":"University of Southern California"}]},{"given":"Tim","family":"Hawkins","sequence":"additional","affiliation":[{"name":"University of Southern California"}]},{"given":"Sune","family":"Frederiksen","sequence":"additional","affiliation":[{"name":"University of Southern California"}]},{"given":"Pieter","family":"Peers","sequence":"additional","affiliation":[{"name":"University of Southern California"}]},{"given":"Marko","family":"Vukovic","sequence":"additional","affiliation":[{"name":"Sony Pictures Imageworks"}]},{"given":"Ming","family":"Ouhyoung","sequence":"additional","affiliation":[{"name":"National Taiwan University"}]},{"given":"Paul","family":"Debevec","sequence":"additional","affiliation":[{"name":"University of Southern California"}]}],"member":"320","published-online":{"date-parts":[[2008,12]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276419"},{"volume-title":"2008 ACM SIGGRAPH \/ Eurographics Symposium on Computer Animation, ACM","author":"Bickel B.","key":"e_1_2_2_2_1","unstructured":"Bickel , B. , Lang , M. , Botsch , M. , Otaduy , M. , and Gross , M . 2008. Pose-space animation and transfer of facial details . In 2008 ACM SIGGRAPH \/ Eurographics Symposium on Computer Animation, ACM , New York, NY, USA, 57--66. Bickel, B., Lang, M., Botsch, M., Otaduy, M., and Gross, M. 2008. Pose-space animation and transfer of facial details. In 2008 ACM SIGGRAPH \/ Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, 57--66."},{"volume-title":"Proc. of the 8th European Conference on Computer Vision, Springer-Verlag, Prague, Czech Republic.","author":"Brox T.","key":"e_1_2_2_3_1","unstructured":"Brox , T. , Bruhn , A. , Papenberg , N. , and Weickert , J . 2004. High accuracy optical flow estimation based on a theory for warping . In Proc. of the 8th European Conference on Computer Vision, Springer-Verlag, Prague, Czech Republic. Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proc. of the 8th European Conference on Computer Vision, Springer-Verlag, Prague, Czech Republic."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.90.074302"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.37"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141988"},{"volume-title":"Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 55--66","author":"Guenter B.","key":"e_1_2_2_7_1","unstructured":"Guenter , B. , Grimm , C. , Wood , D. , Malvar , H. , and Pighin , F . 1998. Making faces . In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 55--66 . 10.1145\/280814.280822 Guenter, B., Grimm, C., Wood, D., Malvar, H., and Pighin, F. 1998. Making faces. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 55--66. 10.1145\/280814.280822"},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Haro A. Guenter B. and Essa I. 2001. Real-time photorealistic physically based rendering of fine scale human skin structure. In Rendering Techniques 2001: 12th Eurographics Workshop on Rendering 53--62.   Haro A. Guenter B. and Essa I. 2001. Real-time photorealistic physically based rendering of fine scale human skin structure. In Rendering Techniques 2001: 12th Eurographics Workshop on Rendering 53--62.","DOI":"10.1007\/978-3-7091-6242-2_5"},{"key":"e_1_2_2_9_1","unstructured":"Hawkins T. Wenger A. Tchou C. Gardner A. G\u00f6ransson F. and Debevec P. 2004. Animatable facial reflectance fields. In Rendering Techniques 2004: 15th Eurographics Workshop on Rendering 309--320. 10.2312\/EGWR\/EGSR04\/309-319   Hawkins T. Wenger A. Tchou C. Gardner A. G\u00f6ransson F. and Debevec P. 2004. Animatable facial reflectance fields. In Rendering Techniques 2004: 15th Eurographics Workshop on Rendering 309--320. 10.2312\/EGWR\/EGSR04\/309-319"},{"key":"e_1_2_2_10_1","volume-title":"CVMP","author":"Jones A.","year":"2006","unstructured":"Jones , A. , Gardner , A. , Bolas , M. , McDowall , I. , and Debevec , P . 2006. Performance geometry capture for spatially varying relighting . In CVMP 2006 . Jones, A., Gardner, A., Bolas, M., McDowall, I., and Debevec, P. 2006. Performance geometry capture for spatially varying relighting. In CVMP 2006."},{"volume-title":"2003 ACM SIGGRAPH \/ Eurographics Symposium on Computer Animation, 187--192","author":"Joshi P.","key":"e_1_2_2_11_1","unstructured":"Joshi , P. , Tien , W. C. , Desbrun , M. , and Pighin , F . 2003. Learning controls for blend shape based realistic facial animation . In 2003 ACM SIGGRAPH \/ Eurographics Symposium on Computer Animation, 187--192 . Joshi, P., Tien, W. C., Desbrun, M., and Pighin, F. 2003. Learning controls for blend shape based realistic facial animation. In 2003 ACM SIGGRAPH \/ Eurographics Symposium on Computer Animation, 187--192."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218407"},{"key":"e_1_2_2_13_1","unstructured":"Ma W.-C. Hawkins T. Peers P. Chabert C.-F. Weiss M. and Debevec P. 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Rendering Techniques 183--194. 10.2312\/EGWR\/EGSR07\/183-194   Ma W.-C. Hawkins T. Peers P. Chabert C.-F. Weiss M. and Debevec P. 2007. Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In Rendering Techniques 183--194. 10.2312\/EGWR\/EGSR07\/183-194"},{"volume-title":"Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 519--528","author":"Malzbender T.","key":"e_1_2_2_14_1","unstructured":"Malzbender , T. , Gelb , D. , and Wolters , H . 2001. Polynomial texture maps . In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 519--528 . 10.1145\/383259.383320 Malzbender, T., Gelb, D., and Wolters, H. 2001. Polynomial texture maps. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 519--528. 10.1145\/383259.383320"},{"key":"e_1_2_2_15_1","unstructured":"Malzbender T. Wilburn B. Gelb D. and Ambrisco B. 2006. Surface enhancement using real-time photometric stereo and reflectance transformation. In Rendering Techniques 2006: 17th Eurographics Workshop on Rendering 245--250. 10.2312\/EGWR\/EGSR06\/245-250   Malzbender T. Wilburn B. Gelb D. and Ambrisco B. 2006. Surface enhancement using real-time photometric stereo and reflectance transformation. In Rendering Techniques 2006: 17th Eurographics Workshop on Rendering 245--250. 10.2312\/EGWR\/EGSR06\/245-250"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073226"},{"key":"e_1_2_2_17_1","volume-title":"SIGGRAPH 2007: ACM SIGGRAPH 2007 courses, ACM","author":"Oat C.","year":"2007","unstructured":"Oat , C. 2007 . Animated wrinkle maps . In SIGGRAPH 2007: ACM SIGGRAPH 2007 courses, ACM , New York, NY, USA, 33--37. 10.1145\/1281500.1281667 Oat, C. 2007. Animated wrinkle maps. In SIGGRAPH 2007: ACM SIGGRAPH 2007 courses, ACM, New York, NY, USA, 33--37. 10.1145\/1281500.1281667"},{"key":"e_1_2_2_18_1","volume-title":"ACM'72: Proceedings of the ACM annual conference, ACM","author":"Parke F. I.","year":"1972","unstructured":"Parke , F. I. 1972 . Computer generated animation of faces . In ACM'72: Proceedings of the ACM annual conference, ACM , New York, NY, USA, 451--457. 10.1145\/800193.569955 Parke, F. I. 1972. Computer generated animation of faces. In ACM'72: Proceedings of the ACM annual conference, ACM, New York, NY, USA, 451--457. 10.1145\/800193.569955"},{"volume-title":"Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 75--84","author":"Pighin F.","key":"e_1_2_2_19_1","unstructured":"Pighin , F. , Hecker , J. , Lischinski , D. , Szeliski , R. , and Salesin , D. H . 1998. Synthesizing realistic facial expressions from photographs . In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 75--84 . 10.1145\/280814.280825 Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., and Salesin, D. H. 1998. Synthesizing realistic facial expressions from photographs. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 75--84. 10.1145\/280814.280825"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566600"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073208"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/vis.4340010208"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073209"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073258"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Williams L. 1990. Performance-driven facial animation. In Computer Graphics (Proceedings of SIGGRAPH 90) 235--242. 10.1145\/97879.97906   Williams L. 1990. Performance-driven facial animation. In Computer Graphics (Proceedings of SIGGRAPH 90) 235--242. 10.1145\/97879.97906","DOI":"10.1145\/97880.97906"},{"key":"e_1_2_2_27_1","first-page":"12","article-title":"High-resolution, real-time three-dimensional shape measurement","volume":"45","author":"Zhang S.","year":"2006","unstructured":"Zhang , S. , and Huang , P. 2006 . High-resolution, real-time three-dimensional shape measurement . Optical Engineering 45 , 12 . Zhang, S., and Huang, P. 2006. High-resolution, real-time three-dimensional shape measurement. Optical Engineering 45, 12.","journal-title":"Optical Engineering"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015759"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1409060.1409074","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1409060.1409074","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:29:49Z","timestamp":1750285789000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1409060.1409074"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,12]]},"references-count":27,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2008,12]]}},"alternative-id":["10.1145\/1409060.1409074"],"URL":"https:\/\/doi.org\/10.1145\/1409060.1409074","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2008,12]]},"assertion":[{"value":"2008-12-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}