{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T05:06:56Z","timestamp":1775020016959,"version":"3.50.1"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,7,27]],"date-time":"2015-07-27T00:00:00Z","timestamp":1437955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,7,27]]},"abstract":"<jats:p>In recent years we have seen numerous improvements on 3D scanning and tracking of human faces, greatly advancing the creation of digital doubles for film and video games. However, despite the high-resolution quality of the reconstruction approaches available, current methods are unable to capture one of the most important regions of the face - the eye region. In this work we present the first method for detailed spatio-temporal reconstruction of eyelids. Tracking and reconstructing eyelids is extremely challenging, as this region exhibits very complex and unique skin deformation where skin is folded under while opening the eye. Furthermore, eyelids are often only partially visible and obstructed due to self-occlusion and eyelashes. Our approach is to combine a geometric deformation model with image data, leveraging multi-view stereo, optical flow, contour tracking and wrinkle detection from local skin appearance. Our deformation model serves as a prior that enables reconstruction of eyelids even under strong self-occlusions caused by rolling and folding skin as the eye opens and closes. The output is a person-specific, time-varying eyelid reconstruction with anatomically plausible deformations. Our high-resolution detailed eyelids couple naturally with current facial performance capture approaches. As a result, our method can largely increase the fidelity of facial capture and the creation of digital doubles.<\/jats:p>","DOI":"10.1145\/2766924","type":"journal-article","created":{"date-parts":[[2015,7,28]],"date-time":"2015-07-28T12:26:38Z","timestamp":1438086398000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["Detailed spatio-temporal reconstruction of eyelids"],"prefix":"10.1145","volume":"34","author":[{"given":"Amit","family":"Bermano","sequence":"first","affiliation":[{"name":"Disney Research Zurich and ETH Zurich"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thabo","family":"Beeler","sequence":"additional","affiliation":[{"name":"Disney Research Zurich"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yeara","family":"Kozlov","sequence":"additional","affiliation":[{"name":"Disney Research Zurich and ETH Zurich"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Derek","family":"Bradley","sequence":"additional","affiliation":[{"name":"Disney Research Zurich"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bernd","family":"Bickel","sequence":"additional","affiliation":[{"name":"Disney Research Zurich and IST Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Markus","family":"Gross","sequence":"additional","affiliation":[{"name":"Disney Research Zurich and ETH Zurich"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,7,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2503385.2503387"},{"key":"e_1_2_2_2_1","volume-title":"Proc. Pacific Graphics.","author":"Bando Y.","unstructured":"Bando , Y. , Kuratate , T. , and Nishita , T . 2002. A simple method for modeling wrinkles on human skin . In Proc. Pacific Graphics. Bando, Y., Kuratate, T., and Nishita, T. 2002. A simple method for modeling wrinkles on human skin. In Proc. Pacific Graphics."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601182"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778777"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185613"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661285"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2546276"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276419"},{"key":"e_1_2_2_10_1","volume-title":"Proc. SCA, 57--66","author":"Bickel B.","unstructured":"Bickel , B. , Lang , M. , Botsch , M. , Otaduy , M. A. , and Gross , M . 2008. Pose-space animation and transfer of facial details . In Proc. SCA, 57--66 . Bickel, B., Lang, M., Botsch, M., Otaduy, M. A., and Gross, M. 2008. Pose-space animation and transfer of facial details. In Proc. SCA, 57--66."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.1054"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461976"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360698"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778778"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Brox T. Bruhn A. Papenberg N. and Weickert J. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. Springer 25--36. Brox T. Bruhn A. Papenberg N. and Weickert J. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. Springer 25--36.","DOI":"10.1007\/978-3-540-24673-2_3"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1986.4767851"},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Cao X. Wei Y. Wen F. and Sun J. 2012. Face alignment by explicit shape regression. In IEEE CVPR 2887--2894. Cao X. Wei Y. Wen F. and Sun J. 2012. Face alignment by explicit shape regression. In IEEE CVPR 2887--2894.","DOI":"10.1109\/CVPR.2012.6248015"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462012"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601204"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.927467"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2005.35"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.395"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778845"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.24"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508380"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024163"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964969"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545271"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462020"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DIMPVT.2012.67"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/1009379.1009641"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.74"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566629"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462019"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2014.08.016"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383873"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409074"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2002.806097"},{"key":"e_1_2_2_39_1","volume-title":"Proc. SCA, 85--92","author":"M\u00fcller M.","unstructured":"M\u00fcller , M. , and Chentanez , N . 2010. Wrinkle meshes . In Proc. SCA, 85--92 . M\u00fcller, M., and Chentanez, N. 2010. Wrinkle meshes. In Proc. SCA, 85--92."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.56205"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1214269109"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01382.x"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019406.2019435"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866183"},{"key":"e_1_2_2_45_1","unstructured":"Ruhland K. Andrist S. Badler J. Peters C. Badler N. Gleicher M. Mutlu B. and McDonnell R. 2014. Look me in the eyes: A survey of eye and gaze animation for virtual agents and artificial systems. In Eurographics State of the Art Reports 69--91. Ruhland K. Andrist S. Badler J. Peters C. Badler N. Gleicher M. Mutlu B. and McDonnell R. 2014. Look me in the eyes: A survey of eye and gaze animation for virtual agents and artificial systems. In Eurographics State of the Art Reports 69--91."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192200"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/2421731.2421734"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661290"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0956-7976.2005.00801.x"},{"key":"e_1_2_2_50_1","volume-title":"Symposium on Geometry processing","volume":"4","author":"Sorkine O.","unstructured":"Sorkine , O. , and Alexa , M . 2007. As-rigid-as-possible surface modeling . In Symposium on Geometry processing , vol. 4 . Sorkine, O., and Alexa, M. 2007. As-rigid-as-possible surface modeling. In Symposium on Geometry processing, vol. 4."},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Suwajanakorn S. Kemelmacher-Shlizerman I. and Seitz S. M. 2014. Total moving face reconstruction. In ECCV. Suwajanakorn S. Kemelmacher-Shlizerman I. and Seitz S. M. 2014. Total moving face reconstruction. In ECCV.","DOI":"10.1007\/978-3-319-10593-2_52"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010325.2010327"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366206"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778844"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.1565"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964972"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-009-0401-x"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126358"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/11428848_26"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.79"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766924","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2766924","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:56:02Z","timestamp":1750272962000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766924"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,27]]},"references-count":60,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,7,27]]}},"alternative-id":["10.1145\/2766924"],"URL":"https:\/\/doi.org\/10.1145\/2766924","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,27]]},"assertion":[{"value":"2015-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}