{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:35:56Z","timestamp":1770917756545,"version":"3.50.1"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,7,27]],"date-time":"2015-07-27T00:00:00Z","timestamp":1437955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,7,27]]},"abstract":"<jats:p>We present a complete pipeline for creating fully rigged, personalized 3D facial avatars from hand-held video. Our system faithfully recovers facial expression dynamics of the user by adapting a blendshape template to an image sequence of recorded expressions using an optimization that integrates feature tracking, optical flow, and shape from shading. Fine-scale details such as wrinkles are captured separately in normal maps and ambient occlusion maps. From this user- and expression-specific data, we learn a regressor for on-the-fly detail synthesis during animation to enhance the perceptual realism of the avatars. Our system demonstrates that the use of appropriate reconstruction priors yields compelling face rigs even with a minimalistic acquisition system and limited user assistance. This facilitates a range of new applications in computer animation and consumer-level online communication based on personalized avatars. We present realtime application demos to validate our method.<\/jats:p>","DOI":"10.1145\/2766974","type":"journal-article","created":{"date-parts":[[2015,7,28]],"date-time":"2015-07-28T12:26:38Z","timestamp":1438086398000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":198,"title":["Dynamic 3D avatar creation from hand-held video input"],"prefix":"10.1145","volume":"34","author":[{"given":"Alexandru Eugen","family":"Ichim","sequence":"first","affiliation":[{"name":"EPFL"}]},{"given":"Sofien","family":"Bouaziz","sequence":"additional","affiliation":[{"name":"EPFL"}]},{"given":"Mark","family":"Pauly","sequence":"additional","affiliation":[{"name":"EPFL"}]}],"member":"320","published-online":{"date-parts":[[2015,7,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1747592.1747812"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2503385.2503387"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Amberg B. Blake A. Fitzgibbon A. W. Romdhani S. and Vetter T. 2007. Reconstructing high quality face-surfaces using model based stereo. In ICCV. Amberg B. Blake A. Fitzgibbon A. W. Romdhani S. and Vetter T. 2007. Reconstructing high quality face-surfaces using model based stereo. In ICCV.","DOI":"10.1109\/ICCV.2007.4408998"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778777"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185613"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661285"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2546276"},{"key":"e_1_2_2_9_1","volume-title":"Symposium on Computer Animation.","author":"Bickel B."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Botsch M. Kobbelt L. Pauly M. Alliez P. and Levy B. 2010. Polygon Mesh Processing. AK Peters. Botsch M. Kobbelt L. Pauly M. Alliez P. and Levy B. 2010. Polygon Mesh Processing. AK Peters.","DOI":"10.1201\/b10688"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461976"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Bouaziz S. Tagliasacchi A. and Pauly M. 2014. Dynamic 2d\/3d registration. Eurographics Tutorial. Bouaziz S. Tagliasacchi A. and Pauly M. 2014. Dynamic 2d\/3d registration. Eurographics Tutorial.","DOI":"10.1145\/2504435.2504456"},{"key":"e_1_2_2_14_1","unstructured":"Bunnell M. 2005. Dynamic ambient occlusion and indirect lighting. Gpu gems. Bunnell M. 2005. Dynamic ambient occlusion and indirect lighting. Gpu gems."},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Cao X. Wei Y. Wen F. and Sun J. 2012. Face alignment by explicit shape regression. In CVPR. Cao X. Wei Y. Wen F. and Sun J. 2012. Face alignment by explicit shape regression. In CVPR.","DOI":"10.1007\/s11263-013-0667-3"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462012"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601204"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.249"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601211"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Chambolle A. Caselles V. Cremers D. Novaga M. and Pock T. 2010. An introduction to total variation for image analysis. Theoretical foundations and numerical methods for sparse recovery 9 263--340. Chambolle A. Caselles V. Cremers D. Novaga M. and Pock T. 2010. An introduction to total variation for image analysis. Theoretical foundations and numerical methods for sparse recovery 9 263--340.","DOI":"10.1515\/9783110226157.263"},{"key":"e_1_2_2_21_1","volume-title":"ICASSP 2008. IEEE international conference on, IEEE, 3869--3872","author":"Chartrand R."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/361237.361242"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Frolova D. Simakov D. and Basri R. 2004. Accuracy of spherical harmonic approximations for images of lambertian objects under far and near lighting. In Computer Vision-ECCV 2004. Frolova D. Simakov D. and Basri R. 2004. Accuracy of spherical harmonic approximations for images of lambertian objects under far and near lighting. In Computer Vision-ECCV 2004.","DOI":"10.1007\/978-3-540-24670-1_44"},{"key":"e_1_2_2_24_1","article-title":"Penalized Regressions: The Bridge versus the Lasso","author":"Fu W. J.","year":"1998","journal-title":"J. Comp. Graph. Stat.."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508380"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024156.2024163"},{"key":"e_1_2_2_28_1","unstructured":"Gonzalez R. C. and Woods R. E. 2006. Digital Image Processing (3rd Edition). Prentice-Hall Inc. Gonzalez R. C. and Woods R. E. 2006. Digital Image Processing (3rd Edition). Prentice-Hall Inc."},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Gray R. M. 2006. Toeplitz and circulant matrices: A review. now publishers Inc. Gray R. M. 2006. Toeplitz and circulant matrices: A review. now publishers Inc.","DOI":"10.1561\/9781933019680"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601194"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964969"},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Jimenez J. Echevarria J. I. Oat C. and Gutierrez D. 2011. GPU Pro 2. AK Peters Ltd. ch. Practical and Realistic Facial Wrinkles Animation. Jimenez J. Echevarria J. I. Oat C. and Gutierrez D. 2011. GPU Pro 2. AK Peters Ltd. ch. Practical and Realistic Facial Wrinkles Animation.","DOI":"10.1201\/b11325-4"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.63"},{"key":"e_1_2_2_34_1","unstructured":"Lewis J. P. Anjyo K. Rhee T. Zhang M. Pighin F. and Deng Z. 2014. Practice and Theory of Blendshape Facial Models. In EG - STARs. Lewis J. P. Anjyo K. Rhee T. Zhang M. Pighin F. and Deng Z. 2014. Practice and Theory of Blendshape Facial Models. In EG - STARs."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618521"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462019"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2014.08.016"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1457515.1409074"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281500.1281667"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882269"},{"key":"e_1_2_2_41_1","volume-title":"Computer Vision, 2009 IEEE 12th International Conference on.","author":"Saragih J. M."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0380-4"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661290"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015736"},{"key":"e_1_2_2_45_1","volume-title":"Proc. of ACM SIGGRAPH Asia.","author":"Valgaerts L."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2005.08.024"},{"key":"e_1_2_2_47_1","doi-asserted-by":"crossref","unstructured":"Vlasic D. Brand M. Pfister H. and Popovi\u0107 J. 2005. Face transfer with multilinear models. Vlasic D. Brand M. Pfister H. and Popovi\u0107 J. 2005. Face transfer with multilinear models.","DOI":"10.1145\/1186822.1073209"},{"key":"e_1_2_2_48_1","article-title":"Face\/off: Live facial puppetry. ACM","author":"Weise T.","year":"2009","journal-title":"Trans. Graph.."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964921.1964972"},{"key":"e_1_2_2_50_1","volume-title":"Proc. of IEEE Computer Animation.","author":"Wu Y."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661232"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2013.25"},{"key":"e_1_2_2_53_1","doi-asserted-by":"crossref","unstructured":"Zach C. Pock T. and Bischof H. 2007. A duality based approach for realtime tv-l 1 optical flow. In Pattern Recognition. Springer 214--223. Zach C. Pock T. and Bischof H. 2007. A duality based approach for realtime tv-l 1 optical flow. In Pattern Recognition. Springer 214--223.","DOI":"10.1007\/978-3-540-74936-3_22"},{"key":"e_1_2_2_54_1","volume-title":"ACM Annual Conference on Computer Graphics.","author":"Zhang L."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766974","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2766974","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:43:01Z","timestamp":1750225381000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766974"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,27]]},"references-count":54,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,7,27]]}},"alternative-id":["10.1145\/2766974"],"URL":"https:\/\/doi.org\/10.1145\/2766974","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,27]]},"assertion":[{"value":"2015-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}