{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T04:50:43Z","timestamp":1781585443672,"version":"3.54.5"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T00:00:00Z","timestamp":1573171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>We present \"The Relightables\", a volumetric capture system for photorealistic and high quality relightable full-body performance capture. While significant progress has been made on volumetric capture systems, focusing on 3D geometric reconstruction with high resolution textures, much less work has been done to recover photometric properties needed for relighting. Results from such systems lack high-frequency details and the subject's shading is prebaked into the texture. In contrast, a large body of work has addressed relightable acquisition for image-based approaches, which photograph the subject under a set of basis lighting conditions and recombine the images to show the subject as they would appear in a target lighting environment. However, to date, these approaches have not been adapted for use in the context of a high-resolution volumetric capture system. Our method combines this ability to realistically relight humans for arbitrary environments, with the benefits of free-viewpoint volumetric capture and new levels of geometric accuracy for dynamic performances. Our subjects are recorded inside a custom geodesic sphere outfitted with 331 custom color LED lights, an array of high-resolution cameras, and a set of custom high-resolution depth sensors. Our system innovates in multiple areas: First, we designed a novel active depth sensor to capture 12.4 MP depth maps, which we describe in detail. Second, we show how to design a hybrid geometric and machine learning reconstruction pipeline to process the high resolution input and output a volumetric video. Third, we generate temporally consistent reflectance maps for dynamic performers by leveraging the information contained in two alternating color gradient illumination images acquired at 60Hz. Multiple experiments, comparisons, and applications show that The Relightables significantly improves upon the level of realism in placing volumetrically captured human performances into arbitrary CG scenes.<\/jats:p>","DOI":"10.1145\/3355089.3356571","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T20:27:58Z","timestamp":1573244878000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":213,"title":["The relightables"],"prefix":"10.1145","volume":"38","author":[{"given":"Kaiwen","family":"Guo","sequence":"first","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Lincoln","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"Davidson","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jay","family":"Busch","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xueming","family":"Yu","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matt","family":"Whalen","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geoff","family":"Harvey","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sergio","family":"Orts-Escolano","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rohit","family":"Pandey","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Dourgarian","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danhang","family":"Tang","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anastasia","family":"Tkach","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adarsh","family":"Kowdle","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily","family":"Cooper","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingsong","family":"Dou","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Fanello","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Graham","family":"Fyffe","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Rhemann","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Taylor","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Debevec","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shahram","family":"Izadi","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,8]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Jump: virtual reality video. ACM TOG","author":"Anderson Robert","year":"2016","unstructured":"Robert Anderson, David Gallup, Jonathan T Barron, Janne Kontkanen, Noah Snavely, Carlos Hern\u00e1ndez, Sameer Agarwal, and Steven M Seitz. 2016. Jump: virtual reality video. ACM TOG (2016)."},{"key":"e_1_2_2_2_1","volume-title":"Guttag","author":"Balakrishnan Guha","year":"2018","unstructured":"Guha Balakrishnan, Amy Zhao, Adrian V. Dalca, Fr\u00e9do Durand, and John V. Guttag. 2018. Synthesizing Images of Humans in Unseen Poses. CVPR (2018)."},{"key":"e_1_2_2_3_1","volume-title":"Patch-Match: A Randomized Correspondence Algorithm for Structural Image Editing. ACM TOG","author":"Barnes Connelly","year":"2009","unstructured":"Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. Patch-Match: A Randomized Correspondence Algorithm for Structural Image Editing. ACM TOG (2009)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2377712"},{"key":"e_1_2_2_5_1","volume-title":"High-quality Single-shot Capture of Facial Geometry. In ACM SIGGRAPH","author":"Beeler Thabo","year":"2010","unstructured":"Thabo Beeler, Bernd Bickel, Paul Beardsley, Bob Sumner, and Markus Gross. 2010. High-quality Single-shot Capture of Facial Geometry. In ACM SIGGRAPH 2010."},{"key":"e_1_2_2_6_1","volume-title":"High-quality Passive Facial Performance Capture Using Anchor Frames. In ACM SIGGRAPH","author":"Beeler Thabo","year":"2011","unstructured":"Thabo Beeler, Fabian Hahn, Derek Bradley, Bernd Bickel, Paul Beardsley, Craig Gotsman, Robert W. Sumner, and Markus Gross. 2011. High-quality Passive Facial Performance Capture Using Anchor Frames. In ACM SIGGRAPH 2011."},{"key":"e_1_2_2_7_1","first-page":"187","article-title":"A Morphable Model for the Synthesis of 3D Faces","volume":"99","author":"Blanz Volker","year":"1999","unstructured":"Volker Blanz and Thomas Vetter. 1999. A Morphable Model for the Synthesis of 3D Faces. In SIGGRAPH, Vol. 99. 187--194.","journal-title":"SIGGRAPH"},{"key":"e_1_2_2_8_1","first-page":"1","article-title":"PatchMatch Stereo-Stereo Matching with Slanted Support Windows","volume":"11","author":"Bleyer Michael","year":"2011","unstructured":"Michael Bleyer, Christoph Rhemann, and Carsten Rother. 2011. PatchMatch Stereo-Stereo Matching with Slanted Support Windows.. In Bmvc, Vol. 11. 1--11.","journal-title":"Bmvc"},{"key":"e_1_2_2_9_1","volume-title":"Efros","author":"Chan Caroline","year":"2018","unstructured":"Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A. Efros. 2018. Everybody Dance Now. CoRR (2018)."},{"key":"e_1_2_2_10_1","volume-title":"Yuille","author":"Chen Liang-Chieh","year":"2016","unstructured":"Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille. 2016. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. CoRR (2016)."},{"key":"e_1_2_2_11_1","volume-title":"High-quality Streamable Free-viewpoint Video. ACM TOG","author":"Collet Alvaro","year":"2015","unstructured":"Alvaro Collet, Ming Chuang, Pat Sweeney, Don Gillett, Dennis Evseev, David Calabrese, Hugues Hoppe, Adam Kirk, and Steve Sullivan. 2015. High-quality Streamable Free-viewpoint Video. ACM TOG (2015)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Paul Debevec Tim Hawkins Chris Tchou Haarm-Pieter Duiker Westley Sarokin and Mark Sagar. 2000. Acquiring the Reflectance Field of a Human Face. In SIGGRAPH.","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Paul Debevec Yizhou Yu and George Boshokov. 1998. Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping. In Rendering Techniques.","DOI":"10.1007\/978-3-7091-6453-2_10"},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"J. Deng W. Dong R. Socher L.-J. Li K. Li and L. Fei-Fei. 2009. ImageNet: A Large-Scale Hierarchical Image Database. In CVPR09.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_2_15_1","volume-title":"Sameh Khamis, Adarsh Kowdle, Christoph Rhemann, Vladimir Tankovich, and Shahram Izadi.","author":"Dou Mingsong","year":"2017","unstructured":"Mingsong Dou, Philip Davidson, Sean Ryan Fanello, Sameh Khamis, Adarsh Kowdle, Christoph Rhemann, Vladimir Tankovich, and Shahram Izadi. 2017. Motion2Fusion: Real-time Volumetric Performance Capture. SIGGRAPH Asia (2017)."},{"key":"e_1_2_2_16_1","volume-title":"Adarsh Kowdle, Sergio Orts Escolano, Christoph Rhemann, David Kim, Jonathan Taylor, Pushmeet Kohli, Vladimir Tankovich, and Shahram Izadi.","author":"Dou Mingsong","year":"2016","unstructured":"Mingsong Dou, Sameh Khamis, Yury Degtyarev, Philip Davidson, Sean Ryan Fanello, Adarsh Kowdle, Sergio Orts Escolano, Christoph Rhemann, David Kim, Jonathan Taylor, Pushmeet Kohli, Vladimir Tankovich, and Shahram Izadi. 2016. Fusion4D: Real-time Performance Capture of Challenging Scenes. SIGGRAPH (2016)."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298647"},{"key":"e_1_2_2_18_1","article-title":"Montage4D: Real-time Seamless Fusion and Stylization of Multiview Video Textures","volume":"8","author":"Du Ruofei","year":"2019","unstructured":"Ruofei Du, Ming Chuang, Wayne Chang, Hugues Hoppe, and Amitabh Varshney. 2019. Montage4D: Real-time Seamless Fusion and Stylization of Multiview Video Textures. Journal of Computer Graphics Techniques 8, 1 (17 January 2019).","journal-title":"Journal of Computer Graphics Techniques"},{"key":"e_1_2_2_19_1","volume-title":"Philip Davidson, and Shahram Izadi.","author":"Fanello Sean Ryan","year":"2017","unstructured":"Sean Ryan Fanello, Julien Valentin, Adarsh Kowdle, Christoph Rhemann, Vladimir Tankovich, Carlo Ciliberto, Philip Davidson, and Shahram Izadi. 2017a. Low Compute and Fully Parallel Computer Vision with HashMatch. In ICCV."},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Sean Ryan Fanello Julien Valentin Christoph Rhemann Adarsh Kowdle Vladimir Tankovich Philip Davidson and Shahram Izadi. 2017b. UltraStereo: Efficient Learning-based Matching for Active Stereo Systems. In CVPR.","DOI":"10.1109\/CVPR.2017.692"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","unstructured":"Graham Fyffe Cyrus A. Wilson and Paul Debevec. 2009. Cosine Lobe Based Relighting from Gradient Illumination Photographs. 100--108. 10.1109\/CVMP.2009.18","DOI":"10.1109\/CVMP.2009.18"},{"key":"e_1_2_2_22_1","volume-title":"Comprehensive Facial Performance Capture. Eurographics","author":"Fyffe Graham","year":"2011","unstructured":"Graham Fyffe, Tim Hawkins, Chris Watts, Wan-Chun Ma, and Paul Debevec. 2011. Comprehensive Facial Performance Capture. Eurographics (2011)."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.106"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258849"},{"key":"e_1_2_2_25_1","article-title":"Reconstructing Detailed Dynamic Face Geometry from Monocular Video","volume":"32","author":"Garrido Pablo","year":"2013","unstructured":"Pablo Garrido, Levi Valgaert, Chenglei Wu, and Christian Theobalt. 2013. Reconstructing Detailed Dynamic Face Geometry from Monocular Video. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 32, 6, Article 158 (Nov. 2013), 10 pages.","journal-title":"ACM Trans. Graph. (Proc. SIGGRAPH Asia)"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Pablo Garrido Michael Zollhoefer Dan Casas Levi Valgaerts Kiran Varanasi Patrick Perez and Christian Theobalt. 2016. Reconstruction of Personalized 3D Face Rigs from Monocular Video. (2016).","DOI":"10.1145\/2890493"},{"key":"e_1_2_2_27_1","doi-asserted-by":"crossref","unstructured":"Paulo Gotardo J\u00e9r\u00e9my Riviere Derek Bradley Abhijeet Ghosh and Thabo Beeler. 2018. Practical Dynamic Facial Appearance Modeling and Acquisition. In SIGGRAPH Asia.","DOI":"10.1145\/3272127.3275073"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Kaiwen Guo Jon Taylor Sean Fanello Andrea Tagliasacchi Mingsong Dou Philip Davidson Adarsh Kowdle and Shahram Izadi. 2018. TwinFusion: High Framerate Non-Rigid Fusion through Fast Correspondence Tracking. In 3DV.","DOI":"10.1109\/3DV.2018.00074"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/780986.780990"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766974"},{"key":"e_1_2_2_31_1","first-page":"2014","article-title":"Safety of laser products - Part 1: Equipment classification and requirements (3 ed.). International Electrotechnical Commission","volume":"60825","author":"International Electrotechnical Commission","year":"2014","unstructured":"International Electrotechnical Commission 2014. Safety of laser products - Part 1: Equipment classification and requirements (3 ed.). International Electrotechnical Commission. IEC 60825-1:2014.","journal-title":"IEC"},{"key":"e_1_2_2_32_1","volume-title":"Screened Poisson Surface Reconstruction. ACM TOG","author":"Kazhdan Michael","year":"2013","unstructured":"Michael Kazhdan and Hugues Hoppe. 2013. Screened Poisson Surface Reconstruction. ACM TOG (2013)."},{"key":"e_1_2_2_33_1","volume-title":"The Need 4 Speed in Real-Time Dense Visual Tracking. SIGGRAPH Asia","author":"Kowdle Adarsh","year":"2018","unstructured":"Adarsh Kowdle, Christoph Rhemann, Sean Fanello, Andrea Tagliasacchi, Jon Taylor, Philip Davidson, Mingsong Dou, Kaiwen Guo, Cem Keskin, Sameh Khamis, David Kim, Danhang Tang, Vladimir Tankovich, Julien Valentin, and Shahram Izadi. 2018. The Need 4 Speed in Real-Time Dense Visual Tracking. SIGGRAPH Asia (2018)."},{"key":"e_1_2_2_34_1","unstructured":"Philipp Kr\u00e4henb\u00fchl and Vladlen Koltun. 2011. Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials. In NIPS."},{"key":"e_1_2_2_35_1","volume-title":"Debevec","author":"LeGendre Chloe","year":"2019","unstructured":"Chloe LeGendre, Wan-Chun Ma, Graham Fyffe, John Flynn, Laurent Charbonnel, Jay Busch, and Paul E. Debevec. 2019. DeepLight: Learning Illumination for Unconstrained Mobile Mixed Reality. CoRR abs\/1904.01175 (2019). arXiv:1904.01175 http:\/\/arxiv.org\/abs\/1904.01175"},{"key":"e_1_2_2_36_1","doi-asserted-by":"crossref","unstructured":"V. Lempitsky and D. Ivanov. 2007. Seamless Mosaicing of Image-Based Texture Maps. In CVPR.","DOI":"10.1109\/CVPR.2007.383078"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12047"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618521"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508407"},{"key":"e_1_2_2_40_1","volume-title":"ECCV (Lecture Notes in Computer Science)","author":"Li Zhengqin","unstructured":"Zhengqin Li, Kalyan Sunkavalli, and Manmohan Chandraker. 2018a. Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image. In ECCV (Lecture Notes in Computer Science). Springer."},{"key":"e_1_2_2_41_1","unstructured":"Zhengqin Li Zexiang Xu Ravi Ramamoorthi Kalyan Sunkavalli and Manmohan Chandraker. 2018b. Learning to Reconstruct Shape and Spatially-varying Reflectance from a Single Image. In SSIGGRAPH Asia."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323020"},{"key":"e_1_2_2_44_1","unstructured":"Liqian Ma Xu Jia Qianru Sun Bernt Schiele Tinne Tuytelaars and Luc Van Gool. 2017. Pose guided person image generation. In NIPS."},{"key":"e_1_2_2_45_1","volume-title":"Bernt Schiele, and Mario Fritz.","author":"Ma Liqian","year":"2018","unstructured":"Liqian Ma, Qianru Sun, Stamatios Georgoulis, Luc Van Gool, Bernt Schiele, and Mario Fritz. 2018. Disentangled Person Image Generation. CVPR (2018)."},{"key":"e_1_2_2_46_1","unstructured":"Ricardo Martin-Brualla Rohit Pandey Shuoran Yang Pavel Pidlypenskyi Jonathan Taylor Julien Valentin Sameh Khamis Philip Davidson Anastasia Tkach Peter Lincoln Adarsh Kowdle Christoph Rhemann Dan B Goldman Cem Keskin Steve Seitz Shahram Izadi and Sean Fanello. 2018. LookinGood: Enhancing Performance Capture with Real-time Neural Re-Rendering. In SIGGRAPH Asia."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2734425"},{"key":"e_1_2_2_48_1","unstructured":"Abhimitra Meka Christian Haene Rohit Pandey Michael Zollhoefer Sean Fanello Graham Fyffe Adarsh Kowdle Xueming Yu Jay Busch Jason Dourgarian Peter Denny Sofien Bouaziz Peter Lincoln Matt Whalen Geoff Harvey Jonathan Taylor Shahram Izadi Andrea Tagliasacchi Paul Debevec Christian Theobalt Julien Valentin and Christoph Rhemann. 2019. Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination. ACM Transactions on Graphics (Proceedings SIGGRAPH)."},{"key":"e_1_2_2_49_1","unstructured":"Microsoft. 2019. UVAtlas - isochart texture atlasing. (2019). http:\/\/github.com\/Microsoft\/UVAtlas"},{"key":"e_1_2_2_50_1","doi-asserted-by":"crossref","unstructured":"P. Mirdehghan W. Chen and K. N. Kutulakos. 2018. Optimal Structured Light a la Carte. In CVPR.","DOI":"10.1109\/CVPR.2018.00654"},{"key":"e_1_2_2_51_1","volume-title":"Diego Gutierrez, and Min H. Kim.","author":"Nam Giljoo","year":"2018","unstructured":"Giljoo Nam, Joo Ho Lee, Diego Gutierrez, and Min H. Kim. 2018. Practical SVBRDF Acquisition of 3D Objects with Unstructured Flash Photography. In SIGGRAPH Asia."},{"key":"e_1_2_2_52_1","volume-title":"Riza Alp G\u00fcler, and Iasonas Kokkinos","author":"Neverova Natalia","year":"2018","unstructured":"Natalia Neverova, Riza Alp G\u00fcler, and Iasonas Kokkinos. 2018. Dense Pose Transfer. ECCV (2018)."},{"key":"e_1_2_2_53_1","doi-asserted-by":"crossref","unstructured":"R. A. Newcombe D. Fox and S. M. Seitz. 2015. DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time. In CVPR.","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"e_1_2_2_54_1","volume-title":"Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi.","author":"Orts-Escolano Sergio","year":"2016","unstructured":"Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In UIST."},{"key":"e_1_2_2_55_1","doi-asserted-by":"crossref","unstructured":"Rohit Pandey Anastasia Tkach Shuoran Yang Pavel Pidlypenskyi Jonathan Taylor Ricardo Martin-Brualla Andrea Tagliasacchi George Papandreou Philip Davidson Cem Keskin Shahram Izadi and Sean Fanello. 2019. Volumetric Capture of Humans with a Single RGBD Camera via Semi-Parametric Learning. In CVPR.","DOI":"10.1109\/CVPR.2019.00994"},{"key":"e_1_2_2_57_1","volume-title":"Spatiotemporal Atlas Parameterization for Evolving Meshes. ACM TOG","author":"Prada Fabi\u00e1n","year":"2017","unstructured":"Fabi\u00e1n Prada, Misha Kazhdan, Ming Chuang, Alvaro Collet, and Hugues Hoppe. 2017. Spatiotemporal Atlas Parameterization for Evolving Meshes. ACM TOG (2017)."},{"key":"e_1_2_2_58_1","volume-title":"Photorealistic Facial Texture Inference Using Deep Neural Networks","author":"Saito Shunsuke","unstructured":"Shunsuke Saito, Lingyu Wei, Liwen Hu, Koki Nagano, and Hao Li. 2017. Photorealistic Facial Texture Inference Using Deep Neural Networks. In CVPR. IEEE Computer Society, 2326--2335."},{"key":"e_1_2_2_59_1","volume-title":"Signal-specialized Parametrization. In Eurographics Workshop on Rendering.","author":"Sander Pedro V.","year":"2002","unstructured":"Pedro V. Sander, Steven J. Gortler, John Snyder, and Hugues Hoppe. 2002. Signal-specialized Parametrization. In Eurographics Workshop on Rendering."},{"key":"e_1_2_2_60_1","volume-title":"International journal of computer vision 47, 1--3","author":"Scharstein Daniel","year":"2002","unstructured":"Daniel Scharstein and Richard Szeliski. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International journal of computer vision 47, 1--3 (2002), 7--42."},{"key":"e_1_2_2_61_1","volume-title":"Pixelwise View Selection for Unstructured Multi-View Stereo. In European Conference on Computer Vision (ECCV).","author":"Sch\u00f6nberger Johannes Lutz","year":"2016","unstructured":"Johannes Lutz Sch\u00f6nberger, Enliang Zheng, Marc Pollefeys, and Jan-Michael Frahm. 2016. Pixelwise View Selection for Unstructured Multi-View Stereo. In European Conference on Computer Vision (ECCV)."},{"key":"e_1_2_2_62_1","unstructured":"Chenyang Si Wei Wang Liang Wang and Tieniu Tan. 2018. Multistage Adversarial Losses for Pose-Based Human Image Synthesis. In CVPR."},{"key":"e_1_2_2_63_1","unstructured":"K. Simonyan and A. Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. CoRR abs\/1409.1556 (2014)."},{"key":"e_1_2_2_64_1","doi-asserted-by":"crossref","unstructured":"J. Starck and A. Hilton. 2007. Surface Capture for Performance-Based Animation. IEEE Computer Graphics and Applications (2007).","DOI":"10.1109\/MCG.2007.68"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276478"},{"key":"e_1_2_2_66_1","unstructured":"Tiancheng Sun Jonathan T. Barron Yun-Ta Tsai Zexiang Xu Xueming Yu Graham Fyffe Christoph Rhemann Jay Busch Paul Debevec and Ravi Ramamoorthi. 2019. Single Image Portrait Relighting. ACM Transactions on Graphics (Proceedings SIGGRAPH)."},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/HUMO.2000.897383"},{"key":"e_1_2_2_68_1","volume-title":"Adarsh Kowdle, Christoph Rhemann, Max Dzitsiuk, Mirko Schmidt, Julien Valentin, and Shahram Izadi.","author":"Tankovich Vladimir","year":"2018","unstructured":"Vladimir Tankovich, Michael Schoenberg, Sean Ryan Fanello, Adarsh Kowdle, Christoph Rhemann, Max Dzitsiuk, Mirko Schmidt, Julien Valentin, and Shahram Izadi. 2018. SOS: Stereo Matching in O(1) with Slanted Support Windows. IROS (2018)."},{"key":"e_1_2_2_69_1","first-page":"663","article-title":"Seeing People in Different Light-Joint Shape, Motion, and Reflectance Capture","volume":"13","author":"Theobalt Christian","year":"2007","unstructured":"Christian Theobalt, Naveed Ahmed, Hendrik P. A. Lensch, Marcus A. Magnor, and Hans-Peter Seidel. 2007. Seeing People in Different Light-Joint Shape, Motion, and Reflectance Capture. IEEE TVCG 13, 4 (2007), 663--674.","journal-title":"IEEE TVCG"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2929464.2929475"},{"key":"e_1_2_2_71_1","unstructured":"Zhen Wen Zicheng Liu and T. S. Huang. 2003. Face relighting with radiance environment maps. In CVPR."},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201364"},{"key":"e_1_2_2_73_1","first-page":"1","article-title":"Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches","volume":"17","author":"\u017dbontar Jure","year":"2016","unstructured":"Jure \u017dbontar and Yann LeCun. 2016. Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches. Journal of Machine Learning Research 17, 65 (2016), 1--32. http:\/\/jmlr.org\/papers\/v17\/15-535.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"},{"key":"e_1_2_2_75_1","volume-title":"Multi-View Image Generation from a Single-View. CoRR","author":"Zhao Bo","year":"2017","unstructured":"Bo Zhao, Xiao Wu, Zhi-Qi Cheng, Hao Liu, and Jiashi Feng. 2017. Multi-View Image Generation from a Single-View. CoRR (2017)."},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1057432.1057439"},{"key":"e_1_2_2_77_1","doi-asserted-by":"crossref","unstructured":"Kun Zhou Xi Wang Yiying Tong Mathieu Desbrun Baining Guo and Heung-Yeung Shum. 2005. TextureMontage. ACM TOG (2005).","DOI":"10.1145\/1186822.1073325"},{"key":"e_1_2_2_78_1","volume-title":"Real-time Non-rigid Reconstruction using an RGB-D Camera. ACM TOG","author":"Zollh\u00f6fer Michael","year":"2014","unstructured":"Michael Zollh\u00f6fer, Matthias Nie\u00dfner, Shahram Izadi, Christoph Rehmann, Christopher Zach, Matthew Fisher, Chenglei Wu, Andrew Fitzgibbon, Charles Loop, Christian Theobalt, and Marc Stamminger. 2014. Real-time Non-rigid Reconstruction using an RGB-D Camera. ACM TOG (2014)."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356571","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3355089.3356571","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:41Z","timestamp":1750203881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356571"}},"subtitle":["volumetric performance capture of humans with realistic relighting"],"short-title":[],"issued":{"date-parts":[[2019,11,8]]},"references-count":76,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3355089.3356571"],"URL":"https:\/\/doi.org\/10.1145\/3355089.3356571","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,8]]},"assertion":[{"value":"2019-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}