{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T23:36:23Z","timestamp":1784936183153,"version":"3.55.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,11,20]],"date-time":"2017-11-20T00:00:00Z","timestamp":1511136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>The field of 3D face modeling has a large gap between high-end and low-end methods. At the high end, the best facial animation is indistinguishable from real humans, but this comes at the cost of extensive manual labor. At the low end, face capture from consumer depth sensors relies on 3D face models that are not expressive enough to capture the variability in natural facial shape and expression. We seek a middle ground by learning a facial model from thousands of accurately aligned 3D scans. Our FLAME model (Faces Learned with an Articulated Model and Expressions) is designed to work with existing graphics software and be easy to fit to data. FLAME uses a linear shape space trained from 3800 scans of human heads. FLAME combines this linear shape space with an articulated jaw, neck, and eyeballs, pose-dependent corrective blendshapes, and additional global expression blendshapes. The pose and expression dependent articulations are learned from 4D face sequences in the D3DFACS dataset along with additional 4D sequences. We accurately register a template mesh to the scan sequences and make the D3DFACS registrations available for research purposes. In total the model is trained from over 33, 000 scans. FLAME is low-dimensional but more expressive than the FaceWarehouse model and the Basel Face Model. We compare FLAME to these models by fitting them to static 3D scans and 4D sequences using the same optimization method. FLAME is significantly more accurate and is available for research purposes (http:\/\/flame.is.tue.mpg.de).<\/jats:p>","DOI":"10.1145\/3130800.3130813","type":"journal-article","created":{"date-parts":[[2017,11,22]],"date-time":"2017-11-22T16:25:08Z","timestamp":1511367908000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1055,"title":["Learning a model of facial shape and expression from 4D scans"],"prefix":"10.1145","volume":"36","author":[{"given":"Tianye","family":"Li","sequence":"first","affiliation":[{"name":"University of Southern California and Max Planck Institute for Intelligent Systems"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timo","family":"Bolkart","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Intelligent Systems"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael J.","family":"Black","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Intelligent Systems"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Li","sequence":"additional","affiliation":[{"name":"University of Southern California and USC Institute for Creative Technologies"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Javier","family":"Romero","sequence":"additional","affiliation":[{"name":"Body Labs Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,11,20]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1667239.1667251"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882311"},{"key":"e_1_2_2_3_1","volume-title":"ACM SIGGRAPH\/Eurographics Symposium on Computer Animation (SCA '06)","author":"Allen B."},{"key":"e_1_2_2_4_1","volume-title":"International Conference on Automatic Face Gesture Recognition. 1--6.","author":"Amberg B."},{"key":"e_1_2_2_5_1","volume-title":"Optimal Step Nonrigid ICP Algorithms for Surface Registration. In Conference on Computer Vision and Pattern Recognition. 1--8.","author":"Amberg B."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073207"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601182"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.265"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.491"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.411"},{"key":"e_1_2_2_13_1","unstructured":"J. Booth A. Roussos A. Ponniah D. Dunaway and S. Zafeiriou. 2017. Large Scale 3D Morphable Models. International Journal of Computer Vision (2017) 1--22. J. Booth A. Roussos A. Ponniah D. Dunaway and S. Zafeiriou. 2017. Large Scale 3D Morphable Models. International Journal of Computer Vision (2017) 1--22."},{"key":"e_1_2_2_14_1","volume-title":"Conference on Computer Vision and Pattern Recognition. 5543--5552","author":"Booth J."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461976"},{"key":"e_1_2_2_16_1","doi-asserted-by":"crossref","unstructured":"A. Bronstein M. Bronstein and R. Kimmel. 2008. Numerical Geometry of Non-Rigid Shapes (1 ed.). Springer Publishing Company Incorporated. A. Bronstein M. Bronstein and R. Kimmel. 2008. Numerical Geometry of Non-Rigid Shapes (1 ed.). Springer Publishing Company Incorporated.","DOI":"10.1007\/978-0-387-73301-2_1"},{"key":"e_1_2_2_17_1","volume-title":"European Conference on Computer Vision. 297--312","author":"Brunton A."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766943"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.249"},{"key":"e_1_2_2_20_1","volume-title":"British Machine Vision Conference. 82","author":"Chen Y."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126510"},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"R. Davies C. Twining and C. Taylor. 2008. Statistical Models of Shape: Optimisation and Evaluation. Springer. R. Davies C. Twining and C. Taylor. 2008. Statistical Models of Shape: Optimisation and Evaluation. Springer.","DOI":"10.1007\/978-1-84800-138-1_7"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.395"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"P. Ekman and W. Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press. P. Ekman and W. Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press.","DOI":"10.1037\/t27734-000"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2015.63"},{"key":"e_1_2_2_26_1","unstructured":"FLAME. 2017. http:\/\/flame.is.tue.mpg.de. (2017). FLAME. 2017. http:\/\/flame.is.tue.mpg.de. (2017)."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508380"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2890493"},{"key":"e_1_2_2_29_1","volume-title":"Proceedings of the 46th Session of the International Statistical Institute, Bulletin of the ISI 52","author":"Geman S.","year":"1987"},{"key":"e_1_2_2_30_1","volume-title":"A Statistical Model of Human Pose and Body Shape. Computer Graphics Forum","author":"Hasler N.","year":"2009"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_18"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766974"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126439"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280831"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/3128975.3128984"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778769"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462019"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2014.08.016"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_2_40_1","volume-title":"OpenDR: An Approximate Differentiable Renderer. In European Conference on Computer Vision. 154--169","author":"Loper M. M."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508417"},{"key":"e_1_2_2_42_1","unstructured":"J. Nocedal and S. J. Wright. 2006. Numerical Optimization. Springer. J. Nocedal and S. J. Wright. 2006. Numerical Optimization. Springer."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2009.58"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.02.018"},{"key":"e_1_2_2_46_1","volume-title":"Technical Report AFRL-HE-WP-TR-2002-0169. US Air Force Research Laboratory.","author":"Robinette K.","year":"2002"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-013-0579-9"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661290"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015736"},{"key":"e_1_2_2_50_1","volume-title":"Total Moving Face Reconstruction. In European Conference on Computer Vision. 796--812","author":"Suwajanakorn S."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.450"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818056"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073209"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964972"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.5555\/3059079.3059098"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925882"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.75"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601210"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964955"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/1126250.1126340"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130813","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130800.3130813","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:17Z","timestamp":1750213577000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130813"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,20]]},"references-count":60,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3130800.3130813"],"URL":"https:\/\/doi.org\/10.1145\/3130800.3130813","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,20]]},"assertion":[{"value":"2017-11-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}