{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T18:11:40Z","timestamp":1780423900768,"version":"3.54.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,7,30]],"date-time":"2018-07-30T00:00:00Z","timestamp":1532908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,8,31]]},"abstract":"<jats:p>We propose HeadOn, the first real-time source-to-target reenactment approach for complete human portrait videos that enables transfer of torso and head motion, face expression, and eye gaze. Given a short RGB-D video of the target actor, we automatically construct a personalized geometry proxy that embeds a parametric head, eye, and kinematic torso model. A novel realtime reenactment algorithm employs this proxy to photo-realistically map the captured motion from the source actor to the target actor. On top of the coarse geometric proxy, we propose a video-based rendering technique that composites the modified target portrait video via view- and pose-dependent texturing, and creates photo-realistic imagery of the target actor under novel torso and head poses, facial expressions, and gaze directions. To this end, we propose a robust tracking of the face and torso of the source actor. We extensively evaluate our approach and show significant improvements in enabling much greater flexibility in creating realistic reenacted output videos.<\/jats:p>","DOI":"10.1145\/3197517.3201350","type":"journal-article","created":{"date-parts":[[2018,7,31]],"date-time":"2018-07-31T15:56:23Z","timestamp":1533052583000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":74,"title":["<i>Headon<\/i>"],"prefix":"10.1145","volume":"37","author":[{"given":"Justus","family":"Thies","sequence":"first","affiliation":[{"name":"Technical University of Munich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Zollh\u00f6fer","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Theobalt","sequence":"additional","affiliation":[{"name":"Max-Planck-Institute for Informatics"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Stamminger","sequence":"additional","affiliation":[{"name":"University of Erlangen-Nuremberg"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Niessner","sequence":"additional","affiliation":[{"name":"Technical University of Munich"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,7,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1667239.1667251"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130818"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121791"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.t01-1-00712"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_6_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Booth J."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461976"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766943"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601204"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462012"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.249"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925873"},{"key":"e_1_2_2_13_1","volume-title":"Proc. SCA. 193--206","author":"Xiao Jing","year":"2003"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/0262-8856(92)90066-C"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.449"},{"key":"e_1_2_2_16_1","volume-title":"Technical Report CS-TR-2002--02. Stanford University.","author":"Chuang E.","year":"2002"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.927467"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237269"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3054739"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024164"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638549"},{"key":"e_1_2_2_22_1","volume-title":"Lempitsky","author":"Ganin Yaroslav","year":"2016"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.537"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12552"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508380"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2890493"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237200"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298776"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.31310887"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766974"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073664"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344929"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000012"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.2197\/ipsjjip.22.401"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925871"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12594"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508369"},{"key":"e_1_2_2_38_1","unstructured":"J. P. Lewis Ken Anjyo Taehyun Rhee Mengjie Zhang Fred Pighin and Zhigang Deng. 2014. Practice and Theory of Blendshape Facial Models. In Eurographics STARs. 199--218.  J. P. Lewis Ken Anjyo Taehyun Rhee Mengjie Zhang Fred Pighin and Zhigang Deng. 2014. Practice and Theory of Blendshape Facial Models. In Eurographics STARs. 199--218."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766939"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462019"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130813"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2014.67"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/37401.37422"},{"key":"e_1_2_2_45_1","volume-title":"Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration. (01","author":"Low Kok-Lim","year":"2004"},{"key":"e_1_2_2_46_1","unstructured":"Liqian Ma Xu Jia Qianru Sun Bernt Schiele Tinne Tuytelaars and Luc Van Gool. 2017. Pose Guided Person Image Generation. In NIPS.  Liqian Ma Xu Jia Qianru Sun Bernt Schiele Tinne Tuytelaars and Luc Van Gool. 2017. Pose Guided Person Image Generation. In NIPS."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508374"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980252"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280825"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015720"},{"key":"e_1_2_2_52_1","volume-title":"Proceedings. Third International Conference on. IEEE, 145--152","author":"Rusinkiewicz Szymon","year":"2001"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0380-4"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661290"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661290"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073208"},{"key":"e_1_2_2_57_1","volume-title":"Seitz","author":"Suwajanakorn Supasorn","year":"2014"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.450"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073640"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964971"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818056"},{"key":"e_1_2_2_62_1","volume-title":"Proc. CVPR.","author":"Thies Justus"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3084822.3084841"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3182644"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366206"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073209"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964972"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/1599470.1599472"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344925"},{"key":"e_1_2_2_70_1","volume-title":"Proc. CVPR. 535 -- 542","author":"Xiao Jing","year":"2004"},{"key":"e_1_2_2_71_1","unstructured":"S. Zafeiriou A. Roussos A. Ponniah D. Dunaway and J. Booth. 2017. Large Scale 3D Morphable Models. International Journal of Computer Vision (2017).  S. Zafeiriou A. Roussos A. Ponniah D. Dunaway and J. Booth. 2017. Large Scale 3D Morphable Models. International Journal of Computer Vision (2017)."},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601165"},{"key":"e_1_2_2_73_1","doi-asserted-by":"crossref","unstructured":"M. Zollh\u00f6fer J. Thies P. Garrido D. Bradley T. Beeler P P\u00e9rez M. Stamminger M. Nie\u00dfner and C. Theobalt. 2018. State of the Art on Monocular 3D Face Reconstruction Tracking and Applications. Computer Graphics Forum (EUROGRAPHICS 2018) 37 2.  M. Zollh\u00f6fer J. Thies P. Garrido D. Bradley T. Beeler P P\u00e9rez M. Stamminger M. Nie\u00dfner and C. Theobalt. 2018. State of the Art on Monocular 3D Face Reconstruction Tracking and Applications. Computer Graphics Forum (EUROGRAPHICS 2018) 37 2.","DOI":"10.1111\/cgf.13382"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201350","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3197517.3201350","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:44Z","timestamp":1750210784000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201350"}},"subtitle":["real-time reenactment of human portrait videos"],"short-title":[],"issued":{"date-parts":[[2018,7,30]]},"references-count":73,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,8,31]]}},"alternative-id":["10.1145\/3197517.3201350"],"URL":"https:\/\/doi.org\/10.1145\/3197517.3201350","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,30]]},"assertion":[{"value":"2018-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}