{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T09:29:47Z","timestamp":1780392587335,"version":"3.54.1"},"reference-count":82,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF","award":["IIS-1909028"],"award-info":[{"award-number":["IIS-1909028"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61822204, 61932003, 61521002"],"award-info":[{"award-number":["61822204, 61932003, 61521002"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>We present deferred neural lighting, a novel method for free-viewpoint relighting from unstructured photographs of a scene captured with handheld devices. Our method leverages a scene-dependent neural rendering network for relighting a rough geometric proxy with learnable neural textures. Key to making the rendering network lighting aware are radiance cues: global illumination renderings of a rough proxy geometry of the scene for a small set of basis materials and lit by the target lighting. As such, the light transport through the scene is never explicitely modeled, but resolved at rendering time by a neural rendering network. We demonstrate that the neural textures and neural renderer can be trained end-to-end from unstructured photographs captured with a double hand-held camera setup that concurrently captures the scene while being lit by only one of the cameras' flash lights. In addition, we propose a novel augmentation refinement strategy that exploits the linearity of light transport to extend the relighting capabilities of the neural rendering network to support other lighting types (e.g., environment lighting) beyond the lighting used during acquisition (i.e., flash lighting). We demonstrate our deferred neural lighting solution on a variety of real-world and synthetic scenes exhibiting a wide range of material properties, light transport effects, and geometrical complexity.<\/jats:p>","DOI":"10.1145\/3414685.3417767","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T21:51:05Z","timestamp":1606513865000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":53,"title":["Deferred neural lighting"],"prefix":"10.1145","volume":"39","author":[{"given":"Duan","family":"Gao","sequence":"first","affiliation":[{"name":"BNRist, Tsinghua University and Microsoft Research Asia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guojun","family":"Chen","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yue","family":"Dong","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pieter","family":"Peers","sequence":"additional","affiliation":[{"name":"College of William &amp; Mary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kun","family":"Xu","sequence":"additional","affiliation":[{"name":"BNRist, Tsinghua University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Tong","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Mart\u00edn Abadi Ashish Agarwal and et. al. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https:\/\/www.tensorflow.org\/ Software available from tensorflow.org. Mart\u00edn Abadi Ashish Agarwal and et. al. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https:\/\/www.tensorflow.org\/ Software available from tensorflow.org."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000065"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Sai Bi Z. Xu K. Sunkavalli David Kriegman and Ravi Ramamoorthi. 2020. Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images. In CVPR. Sai Bi Z. Xu K. Sunkavalli David Kriegman and Ravi Ramamoorthi. 2020. Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images. In CVPR.","DOI":"10.1109\/CVPR42600.2020.00600"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487238"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3203192"},{"key":"e_1_2_2_7_1","doi-asserted-by":"crossref","unstructured":"Zhang Chen Anpei Chen Guli Zhang Chengyuan Wang Yu Ji Kiriakos N. Kutulakos and Jingyi Yu. 2020. A Neural Rendering Framework for Free-Viewpoint Relighting. In CVRP. 5598--5609. Zhang Chen Anpei Chen Guli Zhang Chengyuan Wang Yu Ji Kiriakos N. Kutulakos and Jingyi Yu. 2020. A Neural Rendering Framework for Free-Viewpoint Relighting. In CVRP. 5598--5609.","DOI":"10.1109\/CVPR42600.2020.00564"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/357290.357293"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201378"},{"key":"e_1_2_2_11_1","volume-title":"Flexible SVBRDF Capture with a Multi-Image Deep Network. Comput. Graph. Forum 38, 4","author":"Deschaintre Valentin","year":"2019","unstructured":"Valentin Deschaintre , Miika Aittala , Fr\u00e9do Durand , George Drettakis , and Adrien Bousseau . 2019. Flexible SVBRDF Capture with a Multi-Image Deep Network. Comput. Graph. Forum 38, 4 ( 2019 ). Valentin Deschaintre, Miika Aittala, Fr\u00e9do Durand, George Drettakis, and Adrien Bousseau. 2019. Flexible SVBRDF Capture with a Multi-Image Deep Network. Comput. Graph. Forum 38, 4 (2019)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"John Flynn Michael Broxton Paul E. Debevec Matthew DuVall Graham Fyffe Ryan S. Overbeck Noah Snavely and Richard Tucker. 2019. DeepView: View Synthesis With Learned Gradient Descent. In CVPR. 2367--2376. John Flynn Michael Broxton Paul E. Debevec Matthew DuVall Graham Fyffe Ryan S. Overbeck Noah Snavely and Richard Tucker. 2019. DeepView: View Synthesis With Learned Gradient Descent. In CVPR. 2367--2376.","DOI":"10.1109\/CVPR.2019.00247"},{"key":"e_1_2_2_13_1","unstructured":"Ryo Furukawa Hiroshi Kawasaki Katsushi Ikeuchi and Masao Sakauchi. 2002. Appearance based object modeling using texture database: Acquisition compression and rendering. In Rendering Techniques. 257--265. Ryo Furukawa Hiroshi Kawasaki Katsushi Ikeuchi and Masao Sakauchi. 2002. Appearance based object modeling using texture database: Acquisition compression and rendering. In Rendering Techniques. 257--265."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323042"},{"key":"e_1_2_2_15_1","volume-title":"Deferred Lighting and Shading. In GDC 2014 Presentation.","author":"Geldreich Rich","year":"2014","unstructured":"Rich Geldreich , Matt Pritchard , and John Brooks . 2014 . Deferred Lighting and Shading. In GDC 2014 Presentation. Rich Geldreich, Matt Pritchard, and John Brooks. 2014. Deferred Lighting and Shading. In GDC 2014 Presentation."},{"key":"e_1_2_2_16_1","volume-title":"The Lumigraph. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '96)","author":"Gortler Steven J.","unstructured":"Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , and Michael F. Cohen . 1996 . The Lumigraph. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '96) . 43--54. Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. 1996. The Lumigraph. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '96). 43--54."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356571"},{"key":"e_1_2_2_18_1","volume-title":"Lensch","author":"Haber Tom","year":"2009","unstructured":"Tom Haber , Christian Fuchs , Philippe Bekaert , Hans-Peter Seidel , Michael Goesele , and Hendrik P. A . Lensch . 2009 . Relighting objects from image collections. In CVPR. 627--634. Tom Haber, Christian Fuchs, Philippe Bekaert, Hans-Peter Seidel, Michael Goesele, and Hendrik P. A. Lensch. 2009. Relighting objects from image collections. In CVPR. 627--634."},{"key":"e_1_2_2_19_1","doi-asserted-by":"crossref","unstructured":"Daniel Cabrini Hauagge Scott Wehrwein Paul Upchurch Kavita Bala and Noah Snavely. 2014. Reasoning about Photo Collections using Models of Outdoor Illumination. In BMVC. Daniel Cabrini Hauagge Scott Wehrwein Paul Upchurch Kavita Bala and Noah Snavely. 2014. Reasoning about Photo Collections using Models of Outdoor Illumination. In BMVC.","DOI":"10.5244\/C.28.78"},{"key":"e_1_2_2_20_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR. 770--778. Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR. 770--778."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275084"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982420"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778836"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Xun Huang Ming-Yu Liu Serge J. Belongie and Jan Kautz. 2018. Multimodal Unsupervised Image-to-Image Translation. In ECCV. 179--196. Xun Huang Ming-Yu Liu Serge J. Belongie and Jan Kautz. 2018. Multimodal Unsupervised Image-to-Image Translation. In ECCV. 179--196.","DOI":"10.1007\/978-3-030-01219-9_11"},{"key":"e_1_2_2_25_1","volume-title":"Sankaranarayanan","author":"Hui Zhuo","year":"2017","unstructured":"Zhuo Hui , Kalyan Sunkavalli , Joon-Young Lee , Sunil Hadap , Jian Wang , and Aswin C . Sankaranarayanan . 2017 . Reflectance capture using univariate sampling of BRDFs. In ICCV. Zhuo Hui, Kalyan Sunkavalli, Joon-Young Lee, Sunil Hadap, Jian Wang, and Aswin C. Sankaranarayanan. 2017. Reflectance capture using univariate sampling of BRDFs. In ICCV."},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"James Imber Jean-Yves Guillemaut and Adrian Hilton. 2014. Intrinsic Textures for Relightable Free-Viewpoint Video. In ECCV. 392--407. James Imber Jean-Yves Guillemaut and Adrian Hilton. 2014. Intrinsic Textures for Relightable Free-Viewpoint Video. In ECCV. 392--407.","DOI":"10.1007\/978-3-319-10605-2_26"},{"key":"e_1_2_2_27_1","unstructured":"Dinghuang Ji Junghyun Kwon Max McFarland and Silvio Savarese. 2017. Deep View Morphing. In CVPR. Dinghuang Ji Junghyun Kwon Max McFarland and Silvio Savarese. 2017. Deep View Morphing. In CVPR."},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Shi Jin Ruiynag Liu Yu Ji Jinwei Ye and Jingyi Yu. 2018. Learning to Dodge A Bullet: Concyclic View Morphing via Deep Learning. In ECCV. Shi Jin Ruiynag Liu Yu Ji Jinwei Ye and Jingyi Yu. 2018. Learning to Dodge A Bullet: Concyclic View Morphing via Deep Learning. In ECCV.","DOI":"10.1007\/978-3-030-01264-9_14"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Justin Johnson Alexandre Alahi and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In ECCV. Justin Johnson Alexandre Alahi and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In ECCV.","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980251"},{"key":"e_1_2_2_31_1","article-title":"Relighting Humans: Occlusion-Aware Inverse Rendering for Full-Body Human Images","volume":"37","author":"Kanamori Yoshihiro","year":"2018","unstructured":"Yoshihiro Kanamori and Yuki Endo . 2018 . Relighting Humans: Occlusion-Aware Inverse Rendering for Full-Body Human Images . ACM Trans. Graph. 37 , 6, Article 270 (Dec. 2018). Yoshihiro Kanamori and Yuki Endo. 2018. Relighting Humans: Occlusion-Aware Inverse Rendering for Full-Body Human Images. ACM Trans. Graph. 37, 6, Article 270 (Dec. 2018).","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201279"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356492"},{"key":"e_1_2_2_34_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba . 2015 . Adam : A Method for Stochastic Optimization. In ICLR. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSPA.2003.1224631"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/636886.636891"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1177"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237199"},{"key":"e_1_2_2_39_1","volume-title":"Capturing Relightable Human Performances under General Uncontrolled Illumination. Comput. Graph. Forum","author":"Li Guannan","year":"2013","unstructured":"Guannan Li , Chenglei Wu , Carsten Stoll , Yebin Liu , Kiran Varanasi , Qionghai Dai , and Christian Theobalt . 2013. Capturing Relightable Human Performances under General Uncontrolled Illumination. Comput. Graph. Forum ( 2013 ). Guannan Li, Chenglei Wu, Carsten Stoll, Yebin Liu, Kiran Varanasi, Qionghai Dai, and Christian Theobalt. 2013. Capturing Relightable Human Performances under General Uncontrolled Illumination. Comput. Graph. Forum (2013)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073641"},{"key":"e_1_2_2_41_1","doi-asserted-by":"crossref","unstructured":"Zhengqin Li Kalyan Sunkavalli and Manmohan Chandraker. 2018a. Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image. In ECCV. 74--90. Zhengqin Li Kalyan Sunkavalli and Manmohan Chandraker. 2018a. Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image. In ECCV. 74--90.","DOI":"10.1007\/978-3-030-01219-9_5"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275055"},{"key":"e_1_2_2_43_1","unstructured":"Miaomiao Liu Xuming He and Mathieu Salzmann. 2018. Geometry-Aware Deep Network for Single-Image Novel View Synthesis. In CVPR. 4616--4624. Miaomiao Liu Xuming He and Mathieu Salzmann. 2018. Geometry-Aware Deep Network for Single-Image Novel View Synthesis. In CVPR. 4616--4624."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323020"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383320"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323027"},{"key":"e_1_2_2_47_1","volume-title":"Noah Snavely, and Ricardo Martin Brualla.","author":"Meshry Moustafa Mahmoud","year":"2019","unstructured":"Moustafa Mahmoud Meshry , Dan B Goldman , Sameh Khamis , Hugues Hoppe , Rohit Kumar Pandey , Noah Snavely, and Ricardo Martin Brualla. 2019 . Neural Rerendering in the Wild. In CVPR. Moustafa Mahmoud Meshry, Dan B Goldman, Sameh Khamis, Hugues Hoppe, Rohit Kumar Pandey, Noah Snavely, and Ricardo Martin Brualla. 2019. Neural Rerendering in the Wild. In CVPR."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322980"},{"key":"e_1_2_2_49_1","volume-title":"Deep Shading: Convolutional Neural Networks for Screen Space Shading. Comp. Graph. Forum","author":"Nalbach Oliver","year":"2017","unstructured":"Oliver Nalbach , Elena Arabadzhiyska , Dushyant Mehta , Hans-Peter Seidel , and Tobias Ritschel . 2017 . Deep Shading: Convolutional Neural Networks for Screen Space Shading. Comp. Graph. Forum (2017). Oliver Nalbach, Elena Arabadzhiyska, Dushyant Mehta, Hans-Peter Seidel, and Tobias Ritschel. 2017. Deep Shading: Convolutional Neural Networks for Screen Space Shading. Comp. Graph. Forum (2017)."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275017"},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Kyle Olszewski Sergey Tulyakov Oliver Woodford Hao Li and Linjie Luo. 2019. Transformable Bottleneck Networks. In ICCV. Kyle Olszewski Sergey Tulyakov Oliver Woodford Hao Li and Linjie Luo. 2019. Transformable Bottleneck Networks. In ICCV.","DOI":"10.1109\/ICCV.2019.00774"},{"key":"e_1_2_2_52_1","volume-title":"Berg","author":"Park Eunbyung","year":"2017","unstructured":"Eunbyung Park , Jimei Yang , Ersin Yumer , Duygu Ceylan , and Alexander C . Berg . 2017 . Transformation-Grounded Image Generation Network for Novel 3D View Synthesis. In CVPR. Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, and Alexander C. Berg. 2017. Transformation-Grounded Image Generation Network for Novel 3D View Synthesis. In CVPR."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1477926.1477929"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130855"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323013"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383317"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766899"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964940"},{"key":"e_1_2_2_59_1","doi-asserted-by":"crossref","unstructured":"Johannes Lutz Sch\u00f6nberger and Jan-Michael Frahm. 2016. Structure-from-Motion Revisited. In CVPR. Johannes Lutz Sch\u00f6nberger and Jan-Michael Frahm. 2016. Structure-from-Motion Revisited. In CVPR.","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_2_2_60_1","doi-asserted-by":"crossref","unstructured":"Steven M. Seitz Brian Curless James Diebel Daniel Scharstein and Richard Szeliski. 2006. A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. In CVPR. 519--528. Steven M. Seitz Brian Curless James Diebel Daniel Scharstein and Richard Szeliski. 2006. A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. In CVPR. 519--528.","DOI":"10.1109\/CVPR.2006.19"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566612"},{"key":"e_1_2_2_62_1","doi-asserted-by":"crossref","unstructured":"Pratul P. Srinivasan Richard Tucker Jonathan T. Barron Ravi Ramamoorthi Ren Ng and Noah Snavely. 2019. Pushing the Boundaries of View Extrapolation With Multiplane Images. In CVPR. 175--184. Pratul P. Srinivasan Richard Tucker Jonathan T. Barron Ravi Ramamoorthi Ren Ng and Noah Snavely. 2019. Pushing the Boundaries of View Extrapolation With Multiplane Images. In CVPR. 175--184.","DOI":"10.1109\/CVPR.2019.00026"},{"key":"e_1_2_2_63_1","doi-asserted-by":"crossref","unstructured":"Pratul P. Srinivasan Tongzhou Wang Ashwin Sreelal Ravi Ramamoorthi and Ren Ng. 2017. Learning to Synthesize a 4D RGBD Light Field from a Single Image. In CVPR. 2262--2270. Pratul P. Srinivasan Tongzhou Wang Ashwin Sreelal Ravi Ramamoorthi and Ren Ng. 2017. Learning to Synthesize a 4D RGBD Light Field from a Single Image. In CVPR. 2262--2270.","DOI":"10.1109\/ICCV.2017.246"},{"key":"e_1_2_2_64_1","volume-title":"Lim","author":"Sun Shao-Hua","year":"2018","unstructured":"Shao-Hua Sun , Minyoung Huh , Yuan-Hong Liao , Ning Zhang , and Joseph J . Lim . 2018 . Multi-view to Novel view: Synthesizing novel views with Self-Learned Confidence. In ECCV. Shao-Hua Sun, Minyoung Huh, Yuan-Hong Liao, Ning Zhang, and Joseph J. Lim. 2018. Multi-view to Novel view: Synthesizing novel views with Self-Learned Confidence. In ECCV."},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323008"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14022"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323035"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618520"},{"key":"e_1_2_2_69_1","doi-asserted-by":"crossref","unstructured":"Michael Weinmann and Reinhard Klein. 2015. Advances in Geometry and Reflectance Acquisition (Course Notes). In SIGGRAPH Asia 2015 Courses. Michael Weinmann and Reinhard Klein. 2015. Advances in Geometry and Reflectance Acquisition (Course Notes). In SIGGRAPH Asia 2015 Courses.","DOI":"10.1145\/2818143.2818165"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344925"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980248"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323007"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982396"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201313"},{"key":"e_1_2_2_75_1","unstructured":"Xinchen Yan Jimei Yang Ersin Yumer Yijie Guo and Honglak Lee. 2016. Perspective transformer nets: Learning single-view 3d object reconstruction without 3d supervision. In Advances in Neural Information Processing Systems. 1696--1704. Xinchen Yan Jimei Yang Ersin Yumer Yijie Guo and Honglak Lee. 2016. Perspective transformer nets: Learning single-view 3d object reconstruction without 3d supervision. In Advances in Neural Information Processing Systems. 1696--1704."},{"key":"e_1_2_2_76_1","unstructured":"Jimei Yang Scott Reed Ming-Hsuan Yang and Honglak Lee. 2015. Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis. In NIPS. 1099--1107. Jimei Yang Scott Reed Ming-Hsuan Yang and Honglak Lee. 2015. Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis. In NIPS. 1099--1107."},{"key":"e_1_2_2_77_1","first-page":"7","article-title":"Single Photograph Surface Appearance Modeling with Self-Augmented CNNs and Inexact","volume":"37","author":"Ye Wenjie","year":"2018","unstructured":"Wenjie Ye , Xiao Li , Yue Dong , Pieter Peers , and Xin Tong . 2018 . Single Photograph Surface Appearance Modeling with Self-Augmented CNNs and Inexact Supervision. Comput. Graph. Forum 37 , 7 (Oct 2018). Wenjie Ye, Xiao Li, Yue Dong, Pieter Peers, and Xin Tong. 2018. Single Photograph Surface Appearance Modeling with Self-Augmented CNNs and Inexact Supervision. Comput. Graph. Forum 37, 7 (Oct 2018).","journal-title":"Supervision. Comput. Graph. Forum"},{"key":"e_1_2_2_78_1","doi-asserted-by":"crossref","unstructured":"Richard Zhang Phillip Isola Alexei A Efros Eli Shechtman and Oliver Wang. 2018. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In CVPR. Richard Zhang Phillip Isola Alexei A Efros Eli Shechtman and Oliver Wang. 2018. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In CVPR.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201323"},{"key":"e_1_2_2_80_1","doi-asserted-by":"crossref","unstructured":"Tinghui Zhou Shubham Tulsiani Weilun Sun Jitendra Malik and Alexei A Efros. 2016b. View Synthesis by Appearance Flow. In ECCV. Tinghui Zhou Shubham Tulsiani Weilun Sun Jitendra Malik and Alexei A Efros. 2016b. View Synthesis by Appearance Flow. In ECCV.","DOI":"10.1007\/978-3-319-46493-0_18"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980247"},{"key":"e_1_2_2_82_1","unstructured":"Jun-Yan Zhu Taesung Park Phillip Isola and Alexei A Efros. 2017. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. In ICCV. Jun-Yan Zhu Taesung Park Phillip Isola and Alexei A Efros. 2017. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. In ICCV."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417767","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3414685.3417767","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3414685.3417767","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:13Z","timestamp":1750197793000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417767"}},"subtitle":["free-viewpoint relighting from unstructured photographs"],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":82,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3414685.3417767"],"URL":"https:\/\/doi.org\/10.1145\/3414685.3417767","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]},"assertion":[{"value":"2020-11-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}