{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T13:58:28Z","timestamp":1772114308218,"version":"3.50.1"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["788065"],"award-info":[{"award-number":["788065"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>Current Generative Adversarial Networks (GANs) produce photorealistic renderings of portrait images. Embedding real images into the latent space of such models enables high-level image editing. While recent methods provide considerable semantic control over the (re-)generated images, they can only generate a limited set of viewpoints and cannot explicitly control the camera. Such 3D camera control is required for 3D virtual and mixed reality applications. In our solution, we use a few images of a face to perform 3D reconstruction, and we introduce the notion of the GAN camera manifold, the key element allowing us to precisely define the range of images that the GAN can reproduce in a stable manner. We train a small face-specific neural implicit representation network to map a captured face to this manifold and complement it with a warping scheme to obtain free-viewpoint novel-view synthesis. We show how our approach - due to its precise camera control - enables the integration of a pre-trained StyleGAN into standard 3D rendering pipelines, allowing e.g., stereo rendering or consistent insertion of faces in synthetic 3D environments. Our solution proposes the first truly free-viewpoint rendering of realistic faces at interactive rates, using only a small number of casual photos as input, while simultaneously allowing semantic editing capabilities, such as facial expression or lighting changes.<\/jats:p>","DOI":"10.1145\/3478513.3480538","type":"journal-article","created":{"date-parts":[[2021,12,10]],"date-time":"2021-12-10T18:29:20Z","timestamp":1639160960000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["FreeStyleGAN"],"prefix":"10.1145","volume":"40","author":[{"given":"Thomas","family":"Leimk\u00fchler","sequence":"first","affiliation":[{"name":"Universit\u00e9 C\u00f4te d'Azur and Inria, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George","family":"Drettakis","sequence":"additional","affiliation":[{"name":"Universit\u00e9 C\u00f4te d'Azur and Inria, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,12,10]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"crossref","unstructured":"Rameen Abdal Yipeng Qin and Peter Wonka. 2019. Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?. In ICCV. 4432--4441. Rameen Abdal Yipeng Qin and Peter Wonka. 2019. Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?. In ICCV. 4432--4441.","DOI":"10.1109\/ICCV.2019.00453"},{"key":"e_1_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Rameen Abdal Yipeng Qin and Peter Wonka. 2020. Image2StyleGAN++: How to Edit the Embedded Images?. In CVPR. 8296--8305. Rameen Abdal Yipeng Qin and Peter Wonka. 2020. Image2StyleGAN++: How to Edit the Embedded Images?. In CVPR. 8296--8305.","DOI":"10.1109\/CVPR42600.2020.00832"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447648"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459765"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1833349.1778777"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459829"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Yochai Blau and Tomer Michaeli. 2018. The perception-distortion tradeoff. In CVPR. 6228--6237. Yochai Blau and Tomer Michaeli. 2018. The perception-distortion tradeoff. In CVPR. 6228--6237.","DOI":"10.1109\/CVPR.2018.00652"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.7751"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/1126929.1649166"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Adrian Bulat and Georgios Tzimiropoulos. 2017. How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230 000 3D facial landmarks). In ICCV. Adrian Bulat and Georgios Tzimiropoulos. 2017. How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230 000 3D facial landmarks). In ICCV.","DOI":"10.1109\/ICCV.2017.116"},{"key":"e_1_2_2_13_1","unstructured":"CapturingReality. 2016. RealityCapture. www.capturingreality.com. [accessed 20-July-2020]. CapturingReality. 2016. RealityCapture. www.capturingreality.com. [accessed 20-July-2020]."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Eric R Chan Marco Monteiro Petr Kellnhofer Jiajun Wu and Gordon Wetzstein. 2021. pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis. In CVPR. Eric R Chan Marco Monteiro Petr Kellnhofer Jiajun Wu and Gordon Wetzstein. 2021. pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis. In CVPR.","DOI":"10.1109\/CVPR46437.2021.00574"},{"key":"e_1_2_2_15_1","article-title":"SofGAN: A Portrait Image Generator with Dynamic Styling","volume":"41","author":"Chen Anpei","year":"2021","unstructured":"Anpei Chen , Ruiyang Liu , Ling Xie , Zhang Chen , Hao Su , and Yu Jingyi . 2021 . SofGAN: A Portrait Image Generator with Dynamic Styling . ACM Transactions on Graphics (TOG) 41 , 1, Article 1 (July 2021), 26 pages. Anpei Chen, Ruiyang Liu, Ling Xie, Zhang Chen, Hao Su, and Yu Jingyi. 2021. SofGAN: A Portrait Image Generator with Dynamic Styling. ACM Transactions on Graphics (TOG) 41, 1, Article 1 (July 2021), 26 pages.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_16_1","volume-title":"Computer Graphics Forum","author":"Christie Marc","unstructured":"Marc Christie , Patrick Olivier , and Jean-Marie Normand . 2008. Camera control in computer graphics . In Computer Graphics Forum , Vol. 27 . Wiley Online Library , 2197--2218. Marc Christie, Patrick Olivier, and Jean-Marie Normand. 2008. Camera control in computer graphics. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 2197--2218."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237191"},{"key":"e_1_2_2_19_1","doi-asserted-by":"crossref","unstructured":"Yu Deng Jiaolong Yang Dong Chen Fang Wen and Xin Tong. 2020. Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning. In CVPR. 5154--5163. Yu Deng Jiaolong Yang Dong Chen Fang Wen and Xin Tong. 2020. Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning. In CVPR. 5154--5163.","DOI":"10.1109\/CVPR42600.2020.00520"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395208"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024209"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1576246.1531373"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925933"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Guy Gafni Justus Thies Michael Zollh\u00f6fer and Matthias Nie\u00dfner. 2021. Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction. In CVPR. 8649--8658. Guy Gafni Justus Thies Michael Zollh\u00f6fer and Matthias Nie\u00dfner. 2021. Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction. In CVPR. 8649--8658.","DOI":"10.1109\/CVPR46437.2021.00854"},{"key":"e_1_2_2_25_1","volume-title":"Portrait Neural Radiance Fields from a Single Image. arXiv preprint arXiv:2012.05903","author":"Gao Chen","year":"2020","unstructured":"Chen Gao , Yichang Shih , Wei-Sheng Lai , Chia-Kai Liang , and Jia-Bin Huang . 2020. Portrait Neural Radiance Fields from a Single Image. arXiv preprint arXiv:2012.05903 ( 2020 ). Chen Gao, Yichang Shih, Wei-Sheng Lai, Chia-Kai Liang, and Jia-Bin Huang. 2020. Portrait Neural Radiance Fields from a Single Image. arXiv preprint arXiv:2012.05903 (2020)."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275043"},{"key":"e_1_2_2_27_1","doi-asserted-by":"crossref","unstructured":"Kyle Genova Forrester Cole Daniel Vlasic Aaron Sarna William T Freeman and Thomas Funkhouser. 2019. Learning shape templates with structured implicit functions. In ICCV. 7154--7164. Kyle Genova Forrester Cole Daniel Vlasic Aaron Sarna William T Freeman and Thomas Funkhouser. 2019. Learning shape templates with structured implicit functions. In ICCV. 7154--7164.","DOI":"10.1109\/ICCV.2019.00725"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024163"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969033.2969125"},{"key":"e_1_2_2_30_1","volume-title":"Proc. NeurIPS.","author":"H\u00e4rk\u00f6nen Erik","year":"2020","unstructured":"Erik H\u00e4rk\u00f6nen , Aaron Hertzmann , Jaakko Lehtinen , and Sylvain Paris . 2020 . GANSpace: Discovering Interpretable GAN Controls . In Proc. NeurIPS. Erik H\u00e4rk\u00f6nen, Aaron Hertzmann, Jaakko Lehtinen, and Sylvain Paris. 2020. GANSpace: Discovering Interpretable GAN Controls. In Proc. NeurIPS."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275084"},{"key":"e_1_2_2_32_1","unstructured":"Ali Jahanian Lucy Chai and Phillip Isola. 2020. On the \"steerability\" of generative adversarial networks. In ICLR. Ali Jahanian Lucy Chai and Phillip Isola. 2020. On the \"steerability\" of generative adversarial networks. In ICLR."},{"key":"e_1_2_2_33_1","volume-title":"Proc. NeurIPS.","author":"Karras Tero","year":"2020","unstructured":"Tero Karras , Miika Aittala , Janne Hellsten , Samuli Laine , Jaakko Lehtinen , and Timo Aila . 2020 a. Training Generative Adversarial Networks with Limited Data . In Proc. NeurIPS. Tero Karras, Miika Aittala, Janne Hellsten, Samuli Laine, Jaakko Lehtinen, and Timo Aila. 2020a. Training Generative Adversarial Networks with Limited Data. In Proc. NeurIPS."},{"key":"e_1_2_2_34_1","volume-title":"Alias-Free Generative Adversarial Networks. CoRR abs\/2106.12423","author":"Karras Tero","year":"2021","unstructured":"Tero Karras , Miika Aittala , Samuli Laine , Erik H\u00e4rk\u00f6nen , Janne Hellsten , Jaakko Lehtinen , and Timo Aila . 2021. Alias-Free Generative Adversarial Networks. CoRR abs\/2106.12423 ( 2021 ). Tero Karras, Miika Aittala, Samuli Laine, Erik H\u00e4rk\u00f6nen, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. 2021. Alias-Free Generative Adversarial Networks. CoRR abs\/2106.12423 (2021)."},{"key":"e_1_2_2_35_1","doi-asserted-by":"crossref","unstructured":"Tero Karras Samuli Laine and Timo Aila. 2019. A style-based generator architecture for generative adversarial networks. In CVPR. 4401--4410. Tero Karras Samuli Laine and Timo Aila. 2019. A style-based generator architecture for generative adversarial networks. In CVPR. 4401--4410.","DOI":"10.1109\/CVPR.2019.00453"},{"key":"e_1_2_2_36_1","doi-asserted-by":"crossref","unstructured":"Tero Karras Samuli Laine Miika Aittala Janne Hellsten Jaakko Lehtinen and Timo Aila. 2020b. Analyzing and improving the image quality of stylegan. In CVPR. 8110--8119. Tero Karras Samuli Laine Miika Aittala Janne Hellsten Jaakko Lehtinen and Timo Aila. 2020b. Analyzing and improving the image quality of stylegan. In CVPR. 8110--8119.","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.241"},{"key":"e_1_2_2_38_1","volume-title":"Is a Green Screen Really Necessary for Real-Time Human Matting? arXiv preprint arXiv:2011.11961","author":"Ke Zhanghan","year":"2020","unstructured":"Zhanghan Ke , Kaican Li , Yurou Zhou , Qiuhua Wu , Xiangyu Mao , Qiong Yan , and Rynson WH Lau . 2020. Is a Green Screen Really Necessary for Real-Time Human Matting? arXiv preprint arXiv:2011.11961 ( 2020 ). Zhanghan Ke, Kaican Li, Yurou Zhou, Qiuhua Wu, Xiangyu Mao, Qiong Yan, and Rynson WH Lau. 2020. Is a Green Screen Really Necessary for Real-Time Human Matting? arXiv preprint arXiv:2011.11961 (2020)."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201283"},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","unstructured":"Hans Knutsson and C-F Westin. 1993. Normalized and differential convolution. In CVPR. 515--523. Hans Knutsson and C-F Westin. 1993. Normalized and differential convolution. In CVPR. 515--523.","DOI":"10.1109\/CVPR.1993.341081"},{"key":"e_1_2_2_41_1","unstructured":"Zhengqi Li Wenqi Xian Abe Davis and Noah Snavely. 2020. Crowdsampling the Plenoptic Function. In ECCV. Zhengqi Li Wenqi Xian Abe Davis and Noah Snavely. 2020. Crowdsampling the Plenoptic Function. In ECCV."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/2421731.2421742"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766965"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201401"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323020"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/253284.253292"},{"key":"e_1_2_2_47_1","doi-asserted-by":"crossref","unstructured":"Ricardo Martin-Brualla Noha Radwan Mehdi S. M. Sajjadi Jonathan T. Barron Alexey Dosovitskiy and Daniel Duckworth. 2021. NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections. In CVPR. Ricardo Martin-Brualla Noha Radwan Mehdi S. M. Sajjadi Jonathan T. Barron Alexey Dosovitskiy and Daniel Duckworth. 2021. NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections. In CVPR.","DOI":"10.1109\/CVPR46437.2021.00713"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029666.37597.d3"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503250"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356568"},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"A. Nagrani J. S. Chung and A. Zisserman. 2017. VoxCeleb: a large-scale speaker identification dataset. In INTERSPEECH. A. Nagrani J. S. Chung and A. Zisserman. 2017. VoxCeleb: a large-scale speaker identification dataset. In INTERSPEECH.","DOI":"10.21437\/Interspeech.2017-950"},{"key":"e_1_2_2_52_1","volume-title":"Hologan: Unsupervised learning of 3d representations from natural images. In ICCV. 7588--7597.","author":"Nguyen-Phuoc Thu","year":"2019","unstructured":"Thu Nguyen-Phuoc , Chuan Li , Lucas Theis , Christian Richardt , and Yong-Liang Yang . 2019 . Hologan: Unsupervised learning of 3d representations from natural images. In ICCV. 7588--7597. Thu Nguyen-Phuoc, Chuan Li, Lucas Theis, Christian Richardt, and Yong-Liang Yang. 2019. Hologan: Unsupervised learning of 3d representations from natural images. In ICCV. 7588--7597."},{"key":"e_1_2_2_53_1","volume-title":"CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields. arXiv:2103.17269","author":"Niemeyer Michael","year":"2021","unstructured":"Michael Niemeyer and Andreas Geiger . 2021 . CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields. arXiv:2103.17269 Michael Niemeyer and Andreas Geiger. 2021. CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields. arXiv:2103.17269"},{"key":"e_1_2_2_54_1","volume-title":"Chen Change Loy, and Ping Luo","author":"Pan Xingang","year":"2021","unstructured":"Xingang Pan , Bo Dai , Ziwei Liu , Chen Change Loy, and Ping Luo . 2021 . Do 2D GANs Know 3D Shape? Unsupervised 3D Shape Reconstruction from 2D Image GANs. In ICLR. Xingang Pan, Bo Dai, Ziwei Liu, Chen Change Loy, and Ping Luo. 2021. Do 2D GANs Know 3D Shape? Unsupervised 3D Shape Reconstruction from 2D Image GANs. In ICLR."},{"key":"e_1_2_2_55_1","volume-title":"Nerfies: Deformable Neural Radiance Fields. ICCV","author":"Park Keunhong","year":"2021","unstructured":"Keunhong Park , Utkarsh Sinha , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Steven M. Seitz , and Ricardo Martin-Brualla . 2021 . Nerfies: Deformable Neural Radiance Fields. ICCV (2021). Keunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Steven M. Seitz, and Ricardo Martin-Brualla. 2021. Nerfies: Deformable Neural Radiance Fields. ICCV (2021)."},{"key":"e_1_2_2_56_1","first-page":"41","article-title":"Deep Face Recognition. In BMVC. BMVA Press","volume":"41","author":"Parkhi Omkar M.","year":"2015","unstructured":"Omkar M. Parkhi , Andrea Vedaldi , and Andrew Zisserman . 2015 . Deep Face Recognition. In BMVC. BMVA Press , Article 41 , 41 .1-41.12 pages. Omkar M. Parkhi, Andrea Vedaldi, and Andrew Zisserman. 2015. Deep Face Recognition. In BMVC. BMVA Press, Article 41, 41.1-41.12 pages.","journal-title":"Article"},{"key":"e_1_2_2_57_1","volume-title":"Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. In ICLR","author":"Radford Alec","year":"2016","unstructured":"Alec Radford , Luke Metz , and Soumith Chintala . 2016 . Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. In ICLR 2016. Alec Radford, Luke Metz, and Soumith Chintala. 2016. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. In ICLR 2016."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415264.3425453"},{"key":"e_1_2_2_59_1","doi-asserted-by":"crossref","unstructured":"Elad Richardson Yuval Alaluf Or Patashnik Yotam Nitzan Yaniv Azar Stav Shapiro and Daniel Cohen-Or. 2021. Encoding in style: a stylegan encoder for image-to-image translation. In CVPR. 2287--2296. Elad Richardson Yuval Alaluf Or Patashnik Yotam Nitzan Yaniv Azar Stav Shapiro and Daniel Cohen-Or. 2021. Encoding in style: a stylegan encoder for image-to-image translation. In CVPR. 2287--2296.","DOI":"10.1109\/CVPR46437.2021.00232"},{"key":"e_1_2_2_60_1","doi-asserted-by":"crossref","unstructured":"Gernot Riegler and Vladlen Koltun. 2020. Free view synthesis. In ECCV. 623--640. Gernot Riegler and Vladlen Koltun. 2020. Free view synthesis. In ECCV. 623--640.","DOI":"10.1007\/978-3-030-58529-7_37"},{"key":"e_1_2_2_61_1","doi-asserted-by":"crossref","unstructured":"Johannes L Schonberger and Jan-Michael Frahm. 2016. Structure-from-motion revisited. In CVPR. 4104--4113. Johannes L Schonberger and Jan-Michael Frahm. 2016. Structure-from-motion revisited. In CVPR. 4104--4113.","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_2_2_62_1","volume-title":"Facenet: A unified embedding for face recognition and clustering. In CVPR. 815--823.","author":"Schroff Florian","year":"2015","unstructured":"Florian Schroff , Dmitry Kalenichenko , and James Philbin . 2015 . Facenet: A unified embedding for face recognition and clustering. In CVPR. 815--823. Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015. Facenet: A unified embedding for face recognition and clustering. In CVPR. 815--823."},{"key":"e_1_2_2_63_1","volume-title":"GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. In NeurIPS.","author":"Schwarz Katja","year":"2020","unstructured":"Katja Schwarz , Yiyi Liao , Michael Niemeyer , and Andreas Geiger . 2020 . GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. In NeurIPS. Katja Schwarz, Yiyi Liao, Michael Niemeyer, and Andreas Geiger. 2020. GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. In NeurIPS."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3089269.3089276"},{"key":"e_1_2_2_65_1","doi-asserted-by":"crossref","unstructured":"Yujun Shen Jinjin Gu Xiaoou Tang and Bolei Zhou. 2020. Interpreting the latent space of gans for semantic face editing. In CVPR. 9243--9252. Yujun Shen Jinjin Gu Xiaoou Tang and Bolei Zhou. 2020. Interpreting the latent space of gans for semantic face editing. In CVPR. 9243--9252.","DOI":"10.1109\/CVPR42600.2020.00926"},{"key":"e_1_2_2_66_1","unstructured":"Yichun Shi Divyansh Aggarwal and Anil K Jain. 2021. Lifting 2D StyleGAN for 3D-Aware Face Generation. In CVPR. 6258--6266. Yichun Shi Divyansh Aggarwal and Anil K Jain. 2021. Lifting 2D StyleGAN for 3D-Aware Face Generation. In CVPR. 6258--6266."},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3454928"},{"key":"e_1_2_2_68_1","volume-title":"Implicit neural representations with periodic activation functions. NeurIPS 33","author":"Sitzmann Vincent","year":"2020","unstructured":"Vincent Sitzmann , Julien Martel , Alexander Bergman , David Lindell , and Gordon Wetzstein . 2020. Implicit neural representations with periodic activation functions. NeurIPS 33 ( 2020 ). Vincent Sitzmann, Julien Martel, Alexander Bergman, David Lindell, and Gordon Wetzstein. 2020. Implicit neural representations with periodic activation functions. NeurIPS 33 (2020)."},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3454388"},{"key":"e_1_2_2_70_1","doi-asserted-by":"crossref","unstructured":"William AP Smith Alassane Seck Hannah Dee Bernard Tiddeman Joshua B Tenenbaum and Bernhard Egger. 2020. A morphable face albedo model. In CVPR. 5011--5020. William AP Smith Alassane Seck Hannah Dee Bernard Tiddeman Joshua B Tenenbaum and Bernhard Egger. 2020. A morphable face albedo model. In CVPR. 5011--5020.","DOI":"10.1109\/CVPR42600.2020.00506"},{"key":"e_1_2_2_71_1","volume-title":"Barron","author":"Srinivasan Pratul P.","year":"2021","unstructured":"Pratul P. Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , and Jonathan T . Barron . 2021 . NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis. In CVPR. Pratul P. Srinivasan, Boyang Deng, Xiuming Zhang, Matthew Tancik, Ben Mildenhall, and Jonathan T. Barron. 2021. NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis. In CVPR."},{"key":"e_1_2_2_72_1","volume-title":"Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains. NeurIPS","author":"Tancik Matthew","year":"2020","unstructured":"Matthew Tancik , Pratul P. Srinivasan , Ben Mildenhall , Sara Fridovich-Keil , Nithin Raghavan , Utkarsh Singhal , Ravi Ramamoorthi , Jonathan T. Barron , and Ren Ng. 2020. Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains. NeurIPS ( 2020 ). Matthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T. Barron, and Ren Ng. 2020. Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains. NeurIPS (2020)."},{"key":"e_1_2_2_73_1","doi-asserted-by":"crossref","unstructured":"Ayush Tewari Mohamed Elgharib Gaurav Bharaj Florian Bernard Hans-Peter Seidel Patrick P\u00e9rez Michael Z\u00f6llhofer and Christian Theobalt. 2020a. StyleRig: Rigging StyleGAN for 3D Control over Portrait Images. In CVPR. Ayush Tewari Mohamed Elgharib Gaurav Bharaj Florian Bernard Hans-Peter Seidel Patrick P\u00e9rez Michael Z\u00f6llhofer and Christian Theobalt. 2020a. StyleRig: Rigging StyleGAN for 3D Control over Portrait Images. In CVPR.","DOI":"10.1109\/CVPR42600.2020.00618"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417803"},{"key":"e_1_2_2_75_1","volume-title":"State of the Art on Neural Rendering. Computer Graphics Forum (EG STAR 2020)","author":"Tewari A.","year":"2020","unstructured":"A. Tewari , O. Fried , J. Thies , V. Sitzmann , S. Lombardi , K. Sunkavalli , R. Martin-Brualla , T. Simon , J. Saragih , M. Nie\u00dfner , R. Pandey , S. Fanello , G. Wetzstein , J.-Y. Zhu , C. Theobalt , M. Agrawala , E. Shechtman , D. B Goldman , and M. Zollh\u00f6fer . 2020c . State of the Art on Neural Rendering. Computer Graphics Forum (EG STAR 2020) ( 2020 ). A. Tewari, O. Fried, J. Thies, V. Sitzmann, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nie\u00dfner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman, and M. Zollh\u00f6fer. 2020c. State of the Art on Neural Rendering. Computer Graphics Forum (EG STAR 2020) (2020)."},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323035"},{"key":"e_1_2_2_77_1","doi-asserted-by":"crossref","unstructured":"Justus Thies Michael Zollh\u00f6fer Christian Theobalt Marc Stamminger and Matthias Nie\u00dfner. 2019b. Image-guided neural object rendering. In ICLR. Justus Thies Michael Zollh\u00f6fer Christian Theobalt Marc Stamminger and Matthias Nie\u00dfner. 2019b. Image-guided neural object rendering. In ICLR.","DOI":"10.1145\/3306346.3323035"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459838"},{"key":"e_1_2_2_79_1","doi-asserted-by":"crossref","unstructured":"Paul Upchurch Jacob Gardner Geoff Pleiss Robert Pless Noah Snavely Kavita Bala and Kilian Weinberger. 2017. Deep feature interpolation for image content changes. In CVPR. 7064--7073. Paul Upchurch Jacob Gardner Geoff Pleiss Robert Pless Noah Snavely Kavita Bala and Kilian Weinberger. 2017. Deep feature interpolation for image content changes. In CVPR. 7064--7073.","DOI":"10.1109\/CVPR.2017.645"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3454738"},{"key":"e_1_2_2_81_1","doi-asserted-by":"crossref","unstructured":"Ziyan Wang Timur Bagautdinov Stephen Lombardi Tomas Simon Jason Saragih Jessica Hodgins and Michael Zollhofer. 2021. Learning Compositional Radiance Fields of Dynamic Human Heads. In CVPR. 5704--5713. Ziyan Wang Timur Bagautdinov Stephen Lombardi Tomas Simon Jason Saragih Jessica Hodgins and Michael Zollhofer. 2021. Learning Compositional Radiance Fields of Dynamic Human Heads. In CVPR. 5704--5713.","DOI":"10.1109\/CVPR46437.2021.00565"},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323030"},{"key":"e_1_2_2_83_1","volume-title":"Improving inversion and generation diversity in stylegan using a Gaussianized latent space. arXiv preprint arXiv:2009.06529","author":"Wulff Jonas","year":"2020","unstructured":"Jonas Wulff and Antonio Torralba . 2020. Improving inversion and generation diversity in stylegan using a Gaussianized latent space. arXiv preprint arXiv:2009.06529 ( 2020 ). Jonas Wulff and Antonio Torralba. 2020. Improving inversion and generation diversity in stylegan using a Gaussianized latent space. arXiv preprint arXiv:2009.06529 (2020)."},{"key":"e_1_2_2_84_1","unstructured":"Sicheng Xu Jiaolong Yang Dong Chen Fang Wen Yu Deng Yunde Jia and Xin Tong. 2020. Deep 3D Portrait from a Single Image. In CVPR. 7710--7720. Sicheng Xu Jiaolong Yang Dong Chen Fang Wen Yu Deng Yunde Jia and Xin Tong. 2020. Deep 3D Portrait from a Single Image. In CVPR. 7710--7720."},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024184"},{"key":"e_1_2_2_86_1","doi-asserted-by":"crossref","unstructured":"Tarun Yenamandra Ayush Tewari Florian Bernard Hans-Peter Seidel Mohamed Elgharib Daniel Cremers and Christian Theobalt. 2021. i3DMM: Deep Implicit 3D Morphable Model of Human Heads. In CVPR. Tarun Yenamandra Ayush Tewari Florian Bernard Hans-Peter Seidel Mohamed Elgharib Daniel Cremers and Christian Theobalt. 2021. i3DMM: Deep Implicit 3D Morphable Model of Human Heads. In CVPR.","DOI":"10.1109\/CVPR46437.2021.01261"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2010.01797.x"},{"key":"e_1_2_2_88_1","doi-asserted-by":"crossref","unstructured":"Egor Zakharov Aleksei Ivakhnenko Aliaksandra Shysheya and Victor Lempitsky. 2020. Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars. In ECCV. Egor Zakharov Aleksei Ivakhnenko Aliaksandra Shysheya and Victor Lempitsky. 2020. Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars. In ECCV.","DOI":"10.1007\/978-3-030-58610-2_31"},{"key":"e_1_2_2_89_1","doi-asserted-by":"crossref","unstructured":"Egor Zakharov Aliaksandra Shysheya Egor Burkov and Victor Lempitsky. 2019. Few-shot adversarial learning of realistic neural talking head models. In ICCV. 9459--9468. Egor Zakharov Aliaksandra Shysheya Egor Burkov and Victor Lempitsky. 2019. Few-shot adversarial learning of realistic neural talking head models. In ICCV. 9459--9468.","DOI":"10.1109\/ICCV.2019.00955"},{"key":"e_1_2_2_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459756"},{"key":"e_1_2_2_91_1","unstructured":"Kai Zhang Gernot Riegler Noah Snavely and Vladlen Koltun. 2020. NeRF++: Analyzing and Improving Neural Radiance Fields. arXiv:2010.07492 [cs.CV] Kai Zhang Gernot Riegler Noah Snavely and Vladlen Koltun. 2020. NeRF++: Analyzing and Improving Neural Radiance Fields. arXiv:2010.07492 [cs.CV]"},{"key":"e_1_2_2_92_1","doi-asserted-by":"crossref","unstructured":"Richard Zhang Phillip Isola Alexei A Efros Eli Shechtman and Oliver Wang. 2018. The unreasonable effectiveness of deep features as a perceptual metric. In CVPR. 586--595. Richard Zhang Phillip Isola Alexei A Efros Eli Shechtman and Oliver Wang. 2018. The unreasonable effectiveness of deep features as a perceptual metric. In CVPR. 586--595.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_2_2_93_1","volume-title":"Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering. In ICLR.","author":"Zhang Yuxuan","year":"2021","unstructured":"Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , and Sanja Fidler . 2021 a. Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering. In ICLR. Yuxuan Zhang, Wenzheng Chen, Huan Ling, Jun Gao, Yinan Zhang, Antonio Torralba, and Sanja Fidler. 2021a. Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering. In ICLR."},{"key":"e_1_2_2_94_1","doi-asserted-by":"crossref","unstructured":"Yajie Zhao Zeng Huang Tianye Li Weikai Chen Chloe LeGendre Xinglei Ren Ari Shapiro and Hao Li. 2019. Learning perspective undistortion of portraits. In ICCV. 7849--7859. Yajie Zhao Zeng Huang Tianye Li Weikai Chen Chloe LeGendre Xinglei Ren Ari Shapiro and Hao Li. 2019. Learning perspective undistortion of portraits. In ICCV. 7849--7859.","DOI":"10.1109\/ICCV.2019.00794"},{"key":"e_1_2_2_95_1","doi-asserted-by":"crossref","unstructured":"Hang Zhou Jihao Liu Ziwei Liu Yu Liu and Xiaogang Wang. 2020. Rotate-and-Render: Unsupervised Photorealistic Face Rotation from Single-View Images. In CVPR. 5911--5920. Hang Zhou Jihao Liu Ziwei Liu Yu Liu and Xiaogang Wang. 2020. Rotate-and-Render: Unsupervised Photorealistic Face Rotation from Single-View Images. In CVPR. 5911--5920.","DOI":"10.1109\/CVPR42600.2020.00595"},{"key":"e_1_2_2_96_1","unstructured":"Jiapeng Zhu Yujun Shen Deli Zhao and Bolei Zhou. 2020. In-domain GAN Inversion for Real Image Editing. In ECCV. Jiapeng Zhu Yujun Shen Deli Zhao and Bolei Zhou. 2020. In-domain GAN Inversion for Real Image Editing. In ECCV."},{"key":"e_1_2_2_97_1","volume-title":"Generative visual manipulation on the natural image manifold","author":"Zhu Jun-Yan","unstructured":"Jun-Yan Zhu , Philipp Kr\u00e4henb\u00fchl , Eli Shechtman , and Alexei A Efros . 2016. Generative visual manipulation on the natural image manifold . In ECCV. Springer , 597--613. Jun-Yan Zhu, Philipp Kr\u00e4henb\u00fchl, Eli Shechtman, and Alexei A Efros. 2016. Generative visual manipulation on the natural image manifold. In ECCV. Springer, 597--613."},{"key":"e_1_2_2_98_1","doi-asserted-by":"publisher","DOI":"10.5555\/3326943.3326955"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480538","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480538","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:40Z","timestamp":1750191100000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480538"}},"subtitle":["free-view editable portrait rendering with the camera manifold"],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":98,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3478513.3480538"],"URL":"https:\/\/doi.org\/10.1145\/3478513.3480538","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2021-12-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}