{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T14:35:50Z","timestamp":1761489350416,"version":"3.41.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2014,3,1]],"date-time":"2014-03-01T00:00:00Z","timestamp":1393632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2014,3]]},"abstract":"<jats:p>\n            The facial performance of an individual is inherently rich in subtle deformation and timing details. Although these subtleties make the performance realistic and compelling, they often elude both motion capture and hand animation. We present a technique for adding fine-scale details and expressiveness to low-resolution art-directed facial performances, such as those created manually using a rig, via marker-based capture, by fitting a morphable model to a video, or through Kinect reconstruction using recent\n            <jats:italic>faceshift<\/jats:italic>\n            technology. We employ a high-resolution facial performance capture system to acquire a representative performance of an individual in which he or she explores the full range of facial expressiveness. From the captured data, our system extracts an expressiveness model that encodes subtle spatial and temporal deformation details specific to that particular individual. Once this model has been built, these details can be transferred to low-resolution art-directed performances. We demonstrate results on various forms of input; after our enhancement, the resulting animations exhibit the same nuances and fine spatial details as the captured performance, with optional temporal enhancement to match the dynamics of the actor. Finally, we show that our technique outperforms the current state-of-the-art in example-based facial animation.\n          <\/jats:p>","DOI":"10.1145\/2546276","type":"journal-article","created":{"date-parts":[[2014,4,15]],"date-time":"2014-04-15T17:50:29Z","timestamp":1397584229000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Facial performance enhancement using dynamic shape space analysis"],"prefix":"10.1145","volume":"33","author":[{"given":"Amit H.","family":"Bermano","sequence":"first","affiliation":[{"name":"ETH Zurich and Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Derek","family":"Bradley","sequence":"additional","affiliation":[{"name":"Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thabo","family":"Beeler","sequence":"additional","affiliation":[{"name":"ETH Zurich and Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabio","family":"Zund","sequence":"additional","affiliation":[{"name":"ETH Zurich and Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Derek","family":"Nowrouzezahrai","sequence":"additional","affiliation":[{"name":"Disney Research Zurich and Universite de Montreal, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ilya","family":"Baran","sequence":"additional","affiliation":[{"name":"Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olga","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanspeter","family":"Pfister","sequence":"additional","affiliation":[{"name":"Harvard University, Cambridge, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert W.","family":"Sumner","sequence":"additional","affiliation":[{"name":"Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bernd","family":"Bickel","sequence":"additional","affiliation":[{"name":"Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markus","family":"Gross","sequence":"additional","affiliation":[{"name":"ETH Zurich and Disney Research Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,4,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2010.65"},{"key":"e_1_2_2_2_1","doi-asserted-by":"crossref","unstructured":"E. D. Andersen and K. D. Andersen. 2000. The mosek interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization. Kluwer Academic Publishers 197--232.  E. D. Andersen and K. D. Andersen. 2000. The mosek interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization. Kluwer Academic Publishers 197--232.","DOI":"10.1007\/978-1-4757-3216-0_8"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531342"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778777"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276419"},{"volume-title":"Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 57--66","author":"Bickel B.","key":"e_1_2_2_7_1","unstructured":"B. Bickel , M. Lang , M. Botsch , M. A. Otaduy , and M. Gross . 2008. Pose-space animation and transfer of facial details . In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 57--66 . B. Bickel, M. Lang, M. Botsch, M. A. Otaduy, and M. Gross. 2008. Pose-space animation and transfer of facial details. In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 57--66."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.t01-1-00712"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/965400.965469"},{"volume-title":"Proceedings of the Workshop on Vision, Modeling and Visualization. 357--364","author":"Botsch M.","key":"e_1_2_2_10_1","unstructured":"M. Botsch , R. Sumner , M. Pauly , and M. Gross . 2006. Deformation transfer for detail-preserving surface editing . In Proceedings of the Workshop on Vision, Modeling and Visualization. 357--364 . M. Botsch, R. Sumner, M. Pauly, and M. Gross. 2006. Deformation transfer for detail-preserving surface editing. In Proceedings of the Workshop on Vision, Modeling and Visualization. 357--364."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778778"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311537"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258880"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/340916.340929"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028523.1028570"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276387"},{"volume-title":"Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 193--206","author":"Chai J.-X.","key":"e_1_2_2_17_1","unstructured":"J.-X. Chai , J. Xiao , and J. Hodgins . 2003. Vision-based control of 3d facial animation . In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 193--206 . J.-X. Chai, J. Xiao, and J. Hodgins. 2003. Vision-based control of 3d facial animation. In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 193--206."},{"key":"e_1_2_2_18_1","unstructured":"E. Chuang and C. Bregler. 2002. Performance driven facial animation using blendshape interpolation. Tech. rep. CS-TR-2002-02 Department of Computer Science Stanford University.  E. Chuang and C. Bregler. 2002. Performance driven facial animation using blendshape interpolation. Tech. rep. CS-TR-2002-02 Department of Computer Science Stanford University."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024156.2024164"},{"volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'96)","author":"Decarlo D.","key":"e_1_2_2_20_1","unstructured":"D. Decarlo and D. Metaxas . 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation . In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'96) . 231--238. D. Decarlo and D. Metaxas. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR'96). 231--238."},{"volume-title":"Proceedings of the Computer Graphics International (CGI'05)","author":"Deng Z.","key":"e_1_2_2_21_1","unstructured":"Z. Deng , J. Lewis , and U. Neumann . 2005. Synthesizing speech animation by learning compact speech co-articulation models . In Proceedings of the Computer Graphics International (CGI'05) . 19--25. Z. Deng, J. Lewis, and U. Neumann. 2005. Synthesizing speech animation by learning compact speech co-articulation models. In Proceedings of the Computer Graphics International (CGI'05). 19--25."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311576"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"P. Ekman and W. Friesen. 1978. The Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press.  P. Ekman and W. Friesen. 1978. The Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press.","DOI":"10.1037\/t27734-000"},{"volume-title":"Proceedings of the Conference on Computer Animation (CA'96)","author":"Essa I.","key":"e_1_2_2_24_1","unstructured":"I. Essa , S. Basu , T. Darrell , and A. Pentland . 1996. Modeling, tracking and interactive animation of faces and heads: Using input from video . In Proceedings of the Conference on Computer Animation (CA'96) . 68--79. I. Essa, S. Basu, T. Darrell, and A. Pentland. 1996. Modeling, tracking and interactive animation of faces and heads: Using input from video. In Proceedings of the Conference on Computer Animation (CA'96). 68--79."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566594"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360690"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141988"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.4.000629"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964969"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019406.2019416"},{"volume-title":"Proceedings of the 3rd European Conference on Visual Media Production (CVMP'06)","author":"Jones A.","key":"e_1_2_2_31_1","unstructured":"A. Jones , A. Gardner , M. Bolas , I. Mcdowall , and P. Debevec . 2006. Performance geometry capture for spatially varying relighting . In Proceedings of the 3rd European Conference on Visual Media Production (CVMP'06) . A. Jones, A. Gardner, M. Bolas, I. Mcdowall, and P. Debevec. 2006. Performance geometry capture for spatially varying relighting. In Proceedings of the 3rd European Conference on Visual Media Production (CVMP'06)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.t01-2-00711"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344862"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1053427.1053431"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.216724"},{"key":"e_1_2_2_36_1","first-page":"5","article-title":"Global correspondence optimization for non-rigid registration of depth scans","volume":"27","author":"Sumner H. LI, R. W.","year":"2008","unstructured":"H. LI, R. W. Sumner , and M. Pauly . 2008 . Global correspondence optimization for non-rigid registration of depth scans . Comput. Graph. Forum 27 , 5 . H. LI, R. W. Sumner, and M. Pauly. 2008. Global correspondence optimization for non-rigid registration of depth scans. Comput. Graph. Forum 27, 5.","journal-title":"Comput. Graph. Forum"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.v15:5"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383873"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409074"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1599470.1599486"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383290"},{"volume-title":"Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV'99)","author":"Pighin F. H.","key":"e_1_2_2_43_1","unstructured":"F. H. Pighin , R. Szeliski , and D. Salesin . 1999. Resynthesizing facial animation through 3d model-based tracking . In Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV'99) . 143--150. F. H. Pighin, R. Szeliski, and D. Salesin. 1999. Resynthesizing facial animation through 3d model-based tracking. In Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV'99). 143--150."},{"volume-title":"Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 167--176","author":"Pyun H.","key":"e_1_2_2_44_1","unstructured":"H. Pyun , Y. Kim , W. Chae , H. Kang , and S. Shin . 2003. An example-based approach for facial expression cloning . In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 167--176 . H. Pyun, Y. Kim, W. Chae, H. Kang, and S. Shin. 2003. An example-based approach for facial expression cloning. In Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 167--176."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024196"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073208"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1057432.1057456"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015736"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.01883.x"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964971"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.216726"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2005.08.024"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073209"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2004.00800.x"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/37401.37405"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964972"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073258"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141987"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/97879.97906"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1731047.1731055"},{"volume-title":"Proceedings of the Conference on Computer Animation (CA'96)","author":"Wu Y.","key":"e_1_2_2_61_1","unstructured":"Y. Wu , P. Kalra , and N. Magnenat-Thalmann . 1996. Simulation of static and dynamic wrinkles of skin . In Proceedings of the Conference on Computer Animation (CA'96) . 90--97. Y. Wu, P. Kalra, and N. Magnenat-Thalmann. 1996. Simulation of static and dynamic wrinkles of skin. In Proceedings of the Conference on Computer Animation (CA'96). 90--97."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015759"},{"key":"e_1_2_2_63_1","first-page":"12","article-title":"High-resolution, real-time three-dimensional shape measurement","volume":"45","author":"Zhang S.","year":"2006","unstructured":"S. Zhang and P. Huang . 2006 . High-resolution, real-time three-dimensional shape measurement . Optical Engin. 45 , 12 . S. Zhang and P. Huang. 2006. High-resolution, real-time three-dimensional shape measurement. Optical Engin. 45, 12.","journal-title":"Optical Engin."},{"volume-title":"Proceedings of the Computer Graphics International (CGI'05)","author":"Zhang Y.","key":"e_1_2_2_64_1","unstructured":"Y. Zhang and T. Sim . 2005. Realistic and efficient wrinkle simulation using an anatomy-based face model with adaptive refinement . In Proceedings of the Computer Graphics International (CGI'05) . 3--10. Y. Zhang and T. Sim. 2005. Realistic and efficient wrinkle simulation using an anatomy-based face model with adaptive refinement. In Proceedings of the Computer Graphics International (CGI'05). 3--10."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2546276","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2546276","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:22:05Z","timestamp":1750278125000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2546276"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,3]]},"references-count":63,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2014,3]]}},"alternative-id":["10.1145\/2546276"],"URL":"https:\/\/doi.org\/10.1145\/2546276","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2014,3]]},"assertion":[{"value":"2012-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-04-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}