{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T00:39:01Z","timestamp":1780447141743,"version":"3.54.1"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>Real-time rendering and animation of humans is a core function in games, movies, and telepresence applications. Existing methods have a number of drawbacks we aim to address with our work. Triangle meshes have difficulty modeling thin structures like hair, volumetric representations like Neural Volumes are too low-resolution given a reasonable memory budget, and high-resolution implicit representations like Neural Radiance Fields are too slow for use in real-time applications. We present Mixture of Volumetric Primitives (MVP), a representation for rendering dynamic 3D content that combines the completeness of volumetric representations with the efficiency of primitive-based rendering, e.g., point-based or mesh-based methods. Our approach achieves this by leveraging spatially shared computation with a convolutional architecture and by minimizing computation in empty regions of space with volumetric primitives that can move to cover only occupied regions. Our parameterization supports the integration of correspondence and tracking constraints, while being robust to areas where classical tracking fails, such as around thin or translucent structures and areas with large topological variability. MVP is a hybrid that generalizes both volumetric and primitive-based representations. Through a series of extensive experiments we demonstrate that it inherits the strengths of each, while avoiding many of their limitations. We also compare our approach to several state-of-the-art methods and demonstrate that MVP produces superior results in terms of quality and runtime performance.<\/jats:p>","DOI":"10.1145\/3450626.3459863","type":"journal-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T00:04:26Z","timestamp":1626739466000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":260,"title":["Mixture of volumetric primitives for efficient neural rendering"],"prefix":"10.1145","volume":"40","author":[{"given":"Stephen","family":"Lombardi","sequence":"first","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tomas","family":"Simon","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriel","family":"Schwartz","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Zollhoefer","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaser","family":"Sheikh","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Saragih","sequence":"additional","affiliation":[{"name":"Facebook Reality Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00453"},{"key":"e_1_2_2_2_1","volume-title":"Neural point-based graphics. arXiv preprint arXiv:1906.08240","author":"Aliev Kara-Ali","year":"2019","unstructured":"Kara-Ali Aliev , Artem Sevastopolsky , Maria Kolos , Dmitry Ulyanov , and Victor Lempitsky . 2019. Neural point-based graphics. arXiv preprint arXiv:1906.08240 ( 2019 ). Kara-Ali Aliev, Artem Sevastopolsky, Maria Kolos, Dmitry Ulyanov, and Victor Lempitsky. 2019. Neural point-based graphics. arXiv preprint arXiv:1906.08240 (2019)."},{"key":"e_1_2_2_3_1","volume-title":"MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images. arXiv preprint arXiv:2008.06534","author":"Attal Benjamin","year":"2020","unstructured":"Benjamin Attal , Selena Ling , Aaron Gokaslan , Christian Richardt , and James Tompkin . 2020. MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images. arXiv preprint arXiv:2008.06534 ( 2020 ). Benjamin Attal, Selena Ling, Aaron Gokaslan, Christian Richardt, and James Tompkin. 2020. MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images. arXiv preprint arXiv:2008.06534 (2020)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392485"},{"key":"e_1_2_2_5_1","volume-title":"Eddy Ilg, Tanner Schmidt, Julian Straub, Steven Lovegrove, and Richard Newcombe.","author":"Chabra Rohan","year":"2020","unstructured":"Rohan Chabra , Jan Eric Lenssen , Eddy Ilg, Tanner Schmidt, Julian Straub, Steven Lovegrove, and Richard Newcombe. 2020 . Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction . arXiv preprint arXiv:2003.10983 (2020). Rohan Chabra, Jan Eric Lenssen, Eddy Ilg, Tanner Schmidt, Julian Straub, Steven Lovegrove, and Richard Newcombe. 2020. Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction. arXiv preprint arXiv:2003.10983 (2020)."},{"key":"e_1_2_2_6_1","unstructured":"Wenzheng Chen Huan Ling Jun Gao Edward Smith Jaakko Lehtinen Alec Jacobson and Sanja Fidler. 2019. Learning to predict 3d objects with an interpolation-based differentiable renderer. In Advances in Neural Information Processing Systems. 9609--9619.  Wenzheng Chen Huan Ling Jun Gao Edward Smith Jaakko Lehtinen Alec Jacobson and Sanja Fidler. 2019. Learning to predict 3d objects with an interpolation-based differentiable renderer. In Advances in Neural Information Processing Systems. 9609--9619."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_38"},{"key":"e_1_2_2_8_1","volume-title":"Neural Radiance Flow for 4D View Synthesis and Video Processing. arXiv preprint arXiv:2012.09790","author":"Du Yilun","year":"2020","unstructured":"Yilun Du , Yinan Zhang , Hong-Xing Yu , Joshua B. Tenenbaum , and Jiajun Wu. 2020. Neural Radiance Flow for 4D View Synthesis and Video Processing. arXiv preprint arXiv:2012.09790 ( 2020 ). Yilun Du, Yinan Zhang, Hong-Xing Yu, Joshua B. Tenenbaum, and Jiajun Wu. 2020. Neural Radiance Flow for 4D View Synthesis and Video Processing. arXiv preprint arXiv:2012.09790 (2020)."},{"key":"e_1_2_2_9_1","volume-title":"Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction. https:\/\/arxiv.org\/abs\/2012.03065","author":"Gafni Guy","year":"2020","unstructured":"Guy Gafni , Justus Thies , Michael Zollh\u00f6fer , and Matthias Nie\u00dfner . 2020. Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction. https:\/\/arxiv.org\/abs\/2012.03065 ( 2020 ). Guy Gafni, Justus Thies, Michael Zollh\u00f6fer, and Matthias Nie\u00dfner. 2020. Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction. https:\/\/arxiv.org\/abs\/2012.03065 (2020)."},{"key":"e_1_2_2_10_1","volume-title":"Portrait Neural Radiance Fields from a Single Image. https:\/\/arxiv.org\/abs\/2012.05903","author":"Gao Chen","year":"2020","unstructured":"Chen Gao , Yichang Shih , Wei-Sheng Lai , Chia-Kai Liang , and Jia-Bin Huang . 2020. Portrait Neural Radiance Fields from a Single Image. https:\/\/arxiv.org\/abs\/2012.05903 ( 2020 ). Chen Gao, Yichang Shih, Wei-Sheng Lai, Chia-Kai Liang, and Jia-Bin Huang. 2020. Portrait Neural Radiance Fields from a Single Image. https:\/\/arxiv.org\/abs\/2012.05903 (2020)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00874"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00491"},{"key":"e_1_2_2_13_1","volume-title":"Advances in Neural Information Processing Systems 31 (NIPS","author":"Insafutdinov Eldar","year":"2018","unstructured":"Eldar Insafutdinov and Alexey Dosovitskiy . 2018. Unsupervised Learning of Shape and Pose with Differentiable Point Clouds . In Advances in Neural Information Processing Systems 31 (NIPS 2018 ), S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Montr\u00e9al, Canada , 2804--2814. Eldar Insafutdinov and Alexey Dosovitskiy. 2018. Unsupervised Learning of Shape and Pose with Differentiable Point Clouds. In Advances in Neural Information Processing Systems 31 (NIPS 2018), S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.). Curran Associates, Montr\u00e9al, Canada, 2804--2814."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00604"},{"key":"e_1_2_2_15_1","unstructured":"Abhishek Kar Christian H\u00e4ne and Jitendra Malik. 2017. Learning a multi-view stereo machine. In Advances in neural information processing systems. 365--376.  Abhishek Kar Christian H\u00e4ne and Jitendra Malik. 2017. Learning a multi-view stereo machine. In Advances in neural information processing systems. 365--376."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2492045.2492055"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00411"},{"key":"e_1_2_2_19_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba . 2015 . Adam : A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds .). http:\/\/arxiv.org\/abs\/1412.6980 Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_2_2_20_1","volume-title":"Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114","author":"Kingma Diederik P","year":"2013","unstructured":"Diederik P Kingma and Max Welling . 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 ( 2013 ). Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)."},{"key":"e_1_2_2_21_1","volume-title":"TRANSPR: Transparency Ray-Accumulating Neural 3D Scene Point Renderer. arXiv:2009.02819","author":"Kolos Maria","year":"2020","unstructured":"Maria Kolos , Artem Sevastopolsky , and Victor Lempitsky . 2020 . TRANSPR: Transparency Ray-Accumulating Neural 3D Scene Point Renderer. arXiv:2009.02819 Maria Kolos, Artem Sevastopolsky, and Victor Lempitsky. 2020. TRANSPR: Transparency Ray-Accumulating Neural 3D Scene Point Renderer. arXiv:2009.02819"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417861"},{"key":"e_1_2_2_23_1","volume-title":"Pulsar: Efficient Sphere-based Neural Rendering. arXiv:2004.07484 [cs.GR]","author":"Lassner Christoph","year":"2020","unstructured":"Christoph Lassner and Michael Zollh\u00f6fer . 2020 . Pulsar: Efficient Sphere-based Neural Rendering. arXiv:2004.07484 [cs.GR] Christoph Lassner and Michael Zollh\u00f6fer. 2020. Pulsar: Efficient Sphere-based Neural Rendering. arXiv:2004.07484 [cs.GR]"},{"key":"e_1_2_2_24_1","volume-title":"Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes. https:\/\/arxiv.org\/abs\/2011.13084","author":"Li Zhengqi","year":"2020","unstructured":"Zhengqi Li , Simon Niklaus , Noah Snavely , and Oliver Wang . 2020. Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes. https:\/\/arxiv.org\/abs\/2011.13084 ( 2020 ). Zhengqi Li, Simon Niklaus, Noah Snavely, and Oliver Wang. 2020. Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes. https:\/\/arxiv.org\/abs\/2011.13084 (2020)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12278"},{"key":"e_1_2_2_26_1","volume-title":"Tat-Seng Chua, and Christian Theobalt.","author":"Liu Lingjie","year":"2020","unstructured":"Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua, and Christian Theobalt. 2020 . Neural Sparse Voxel Fields . arXiv:2007.11571 Lingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua, and Christian Theobalt. 2020. Neural Sparse Voxel Fields. arXiv:2007.11571"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00780"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201401"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323020"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_11"},{"key":"e_1_2_2_31_1","volume-title":"Towards High-fidelity Nonlinear 3D Face Morphoable Model","author":"Xiaoming Liu Luan Tran Feng Liu","unstructured":"Feng Liu Xiaoming Liu Luan Tran . 2019. Towards High-fidelity Nonlinear 3D Face Morphoable Model . In IEEE Computer Vision and Pattern Recognition (CVPR) . Feng Liu Xiaoming Liu Luan Tran. 2019. Towards High-fidelity Nonlinear 3D Face Morphoable Model. In IEEE Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_32_1","volume-title":"NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections. https:\/\/arxiv.org\/abs\/2008.02268","author":"Martin-Brualla Ricardo","year":"2020","unstructured":"Ricardo Martin-Brualla , Noha Radwan , Mehdi Sajjadi , Jonathan Barron , Alexey Dosovitskiy , and Daniel Duckworth . 2020. NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections. https:\/\/arxiv.org\/abs\/2008.02268 ( 2020 ). Ricardo Martin-Brualla, Noha Radwan, Mehdi Sajjadi, Jonathan Barron, Alexey Dosovitskiy, and Daniel Duckworth. 2020. NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections. https:\/\/arxiv.org\/abs\/2008.02268 (2020)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00459"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00704"},{"key":"e_1_2_2_35_1","volume-title":"Ravi Ramamoorthi, Ren Ng, and Abhishek Kar.","author":"Mildenhall Ben","year":"2019","unstructured":"Ben Mildenhall , Pratul P. Srinivasan , Rodrigo Ortiz-Cayon , Nima Khademi Kalantari , Ravi Ramamoorthi, Ren Ng, and Abhishek Kar. 2019 . Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines. ACM Transactions on Graphics (TOG) ( 2019). Ben Mildenhall, Pratul P. Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, and Abhishek Kar. 2019. Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines. ACM Transactions on Graphics (TOG) (2019)."},{"key":"e_1_2_2_36_1","volume-title":"Nerf: Representing scenes as neural radiance fields for view synthesis. arXiv preprint arXiv:2003.08934","author":"Mildenhall Ben","year":"2020","unstructured":"Ben Mildenhall , Pratul P Srinivasan , Matthew Tancik , Jonathan T Barron , Ravi Ramamoorthi , and Ren Ng . 2020 . Nerf: Representing scenes as neural radiance fields for view synthesis. arXiv preprint arXiv:2003.08934 (2020). Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. 2020. Nerf: Representing scenes as neural radiance fields for view synthesis. arXiv preprint arXiv:2003.08934 (2020)."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984517"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00025"},{"key":"e_1_2_2_39_1","volume-title":"Deformable Neural Radiance Fields. https:\/\/arxiv.org\/abs\/2011.12948","author":"Park Keunhong","year":"2020","unstructured":"Keunhong Park , Utkarsh Sinha , Jonathan Barron , Sofien Bouaziz , Dan Goldman , Steven Seitz , and Ricardo Martin-Brualla . 2020. Deformable Neural Radiance Fields. https:\/\/arxiv.org\/abs\/2011.12948 ( 2020 ). Keunhong Park, Utkarsh Sinha, Jonathan Barron, Sofien Bouaziz, Dan Goldman, Steven Seitz, and Ricardo Martin-Brualla. 2020. Deformable Neural Radiance Fields. https:\/\/arxiv.org\/abs\/2011.12948 (2020)."},{"key":"e_1_2_2_40_1","volume-title":"Convolutional Occupancy Networks. In European Conference on Computer Vision (ECCV).","author":"Peng Songyou","year":"2020","unstructured":"Songyou Peng , Michael Niemeyer , Lars Mescheder , Marc Pollefeys , and Andreas Geiger . 2020 . Convolutional Occupancy Networks. In European Conference on Computer Vision (ECCV). Songyou Peng, Michael Niemeyer, Lars Mescheder, Marc Pollefeys, and Andreas Geiger. 2020. Convolutional Occupancy Networks. In European Conference on Computer Vision (ECCV)."},{"key":"e_1_2_2_41_1","volume-title":"Pix2vex: Image-to-geometry reconstruction using a smooth differentiable renderer. arXiv preprint arXiv:1903.11149","author":"Petersen Felix","year":"2019","unstructured":"Felix Petersen , Amit H Bermano , Oliver Deussen , and Daniel Cohen-Or . 2019. Pix2vex: Image-to-geometry reconstruction using a smooth differentiable renderer. arXiv preprint arXiv:1903.11149 ( 2019 ). Felix Petersen, Amit H Bermano, Oliver Deussen, and Daniel Cohen-Or. 2019. Pix2vex: Image-to-geometry reconstruction using a smooth differentiable renderer. arXiv preprint arXiv:1903.11149 (2019)."},{"key":"e_1_2_2_42_1","unstructured":"Nikhila Ravi Jeremy Reizenstein David Novotny Taylor Gordon Wan-Yen Lo Justin Johnson and Georgia Gkioxari. 2020. PyTorch3D. https:\/\/github.com\/facebookresearch\/pytorch3d.  Nikhila Ravi Jeremy Reizenstein David Novotny Taylor Gordon Wan-Yen Lo Justin Johnson and Georgia Gkioxari. 2020. PyTorch3D. https:\/\/github.com\/facebookresearch\/pytorch3d."},{"key":"e_1_2_2_43_1","volume-title":"Kwang Moo Yi, and Andrea Tagliasacchi","author":"Rebain Daniel","year":"2020","unstructured":"Daniel Rebain , Wei Jiang , Soroosh Yazdani , Ke Li , Kwang Moo Yi, and Andrea Tagliasacchi . 2020 . DeRF: Decomposed Radiance Fields . https:\/\/arxiv.org\/abs\/2011.12490 (2020). Daniel Rebain, Wei Jiang, Soroosh Yazdani, Ke Li, Kwang Moo Yi, and Andrea Tagliasacchi. 2020. DeRF: Decomposed Radiance Fields. https:\/\/arxiv.org\/abs\/2011.12490 (2020)."},{"key":"e_1_2_2_44_1","volume-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) (LNCS","volume":"241","author":"Ronneberger O.","unstructured":"O. Ronneberger , P. Fischer , and T. Brox . 2015 . U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) (LNCS , Vol. 9351). Springer, 234-- 241 . O. Ronneberger, P. Fischer, and T. Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) (LNCS, Vol. 9351). Springer, 234--241."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00439"},{"key":"e_1_2_2_46_1","volume-title":"PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization. https:\/\/arxiv.org\/abs\/1905.05172","author":"Saito Shunsuke","year":"2019","unstructured":"Shunsuke Saito , Zeng Huang , Ryota Natsume , Shigeo Morishima , Angjoo Kanazawa , and Hao Li. 2019a. PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization. https:\/\/arxiv.org\/abs\/1905.05172 ( 2019 ). Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, and Hao Li. 2019a. PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization. https:\/\/arxiv.org\/abs\/1905.05172 (2019)."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00239"},{"key":"e_1_2_2_48_1","volume-title":"Structure-from-Motion Revisited. In Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Sch\u00f6nberger Johannes Lutz","year":"2016","unstructured":"Johannes Lutz Sch\u00f6nberger and Jan-Michael Frahm . 2016 . Structure-from-Motion Revisited. In Conference on Computer Vision and Pattern Recognition (CVPR). Johannes Lutz Sch\u00f6nberger and Jan-Michael Frahm. 2016. Structure-from-Motion Revisited. In Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_49_1","volume-title":"Pixelwise View Selection for Unstructured Multi-View Stereo. In European Conference on Computer Vision (ECCV).","author":"Sch\u00f6nberger Johannes Lutz","year":"2016","unstructured":"Johannes Lutz Sch\u00f6nberger , Enliang Zheng , Marc Pollefeys , and Jan-Michael Frahm . 2016 . Pixelwise View Selection for Unstructured Multi-View Stereo. In European Conference on Computer Vision (ECCV). Johannes Lutz Sch\u00f6nberger, Enliang Zheng, Marc Pollefeys, and Jan-Michael Frahm. 2016. Pixelwise View Selection for Unstructured Multi-View Stereo. In European Conference on Computer Vision (ECCV)."},{"key":"e_1_2_2_50_1","volume-title":"GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. arXiv:2007.02442 [cs.CV]","author":"Schwarz Katja","year":"2020","unstructured":"Katja Schwarz , Yiyi Liao , Michael Niemeyer , and Andreas Geiger . 2020 . GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. arXiv:2007.02442 [cs.CV] Katja Schwarz, Yiyi Liao, Michael Niemeyer, and Andreas Geiger. 2020. GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. arXiv:2007.02442 [cs.CV]"},{"key":"e_1_2_2_51_1","volume-title":"Proceedings of Computer Vision and Pattern Recognition (CVPR","author":"Sitzmann V.","year":"2019","unstructured":"V. Sitzmann , J. Thies , F. Heide , M. Nie\u00dfner , G. Wetzstein , and M. Zollh\u00f6fer . 2019a. DeepVoxels: Learning Persistent 3D Feature Embeddings . In Proceedings of Computer Vision and Pattern Recognition (CVPR 2019 ). V. Sitzmann, J. Thies, F. Heide, M. Nie\u00dfner, G. Wetzstein, and M. Zollh\u00f6fer. 2019a. DeepVoxels: Learning Persistent 3D Feature Embeddings. In Proceedings of Computer Vision and Pattern Recognition (CVPR 2019)."},{"key":"e_1_2_2_52_1","unstructured":"Vincent Sitzmann Michael Zollh\u00f6fer and Gordon Wetzstein. 2019b. Scene representation networks: Continuous 3d-structure-aware neural scene representations. In Advances in Neural Information Processing Systems. 1121--1132.  Vincent Sitzmann Michael Zollh\u00f6fer and Gordon Wetzstein. 2019b. Scene representation networks: Continuous 3d-structure-aware neural scene representations. In Advances in Neural Information Processing Systems. 1121--1132."},{"key":"e_1_2_2_53_1","volume-title":"NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis. https:\/\/arxiv.org\/abs\/2012.03927","author":"Srinivasan Pratul","year":"2020","unstructured":"Pratul Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , and Jonathan Barron . 2020. NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis. https:\/\/arxiv.org\/abs\/2012.03927 ( 2020 ). Pratul Srinivasan, Boyang Deng, Xiuming Zhang, Matthew Tancik, Ben Mildenhall, and Jonathan Barron. 2020. NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis. https:\/\/arxiv.org\/abs\/2012.03927 (2020)."},{"key":"e_1_2_2_54_1","volume-title":"Pushing the Boundaries of View Extrapolation With Multiplane Images. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. 175--184","author":"Srinivasan Pratul P.","year":"2019","unstructured":"Pratul P. Srinivasan , Richard Tucker , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng , and Noah Snavely . 2019 . Pushing the Boundaries of View Extrapolation With Multiplane Images. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. 175--184 . Pratul P. Srinivasan, Richard Tucker, Jonathan T. Barron, Ravi Ramamoorthi, Ren Ng, and Noah Snavely. 2019. Pushing the Boundaries of View Extrapolation With Multiplane Images. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. 175--184."},{"key":"e_1_2_2_55_1","volume-title":"Learned Initializations for Optimizing Coordinate-Based Neural Representations. https:\/\/arxiv.org\/abs\/2012.02189","author":"Tancik Matthew","year":"2020","unstructured":"Matthew Tancik , Ben Mildenhall , Terrence Wang , Divi Schmidt , Pratul Srinivasan , Jonathan Barron , and Ren Ng. 2020. Learned Initializations for Optimizing Coordinate-Based Neural Representations. https:\/\/arxiv.org\/abs\/2012.02189 ( 2020 ). Matthew Tancik, Ben Mildenhall, Terrence Wang, Divi Schmidt, Pratul Srinivasan, Jonathan Barron, and Ren Ng. 2020. Learned Initializations for Optimizing Coordinate-Based Neural Representations. https:\/\/arxiv.org\/abs\/2012.02189 (2020)."},{"key":"e_1_2_2_56_1","volume-title":"State of the Art on Neural Rendering. Computer Graphics Forum (EG STAR 2020)","author":"Tewari A.","year":"2020","unstructured":"A. Tewari , O. Fried , J. Thies , V. Sitzmann , S. Lombardi , K. Sunkavalli , R. Martin-Brualla , T. Simon , J. Saragih , M. Nie\u00dfner , R. Pandey , S. Fanello , G. Wetzstein , J.-Y. Zhu , C. Theobalt , M. Agrawala , E. Shechtman , D. B Goldman , and M. Zollh\u00f6fer . 2020 . State of the Art on Neural Rendering. Computer Graphics Forum (EG STAR 2020) ( 2020 ). A. Tewari, O. Fried, J. Thies, V. Sitzmann, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nie\u00dfner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman, and M. Zollh\u00f6fer. 2020. State of the Art on Neural Rendering. Computer Graphics Forum (EG STAR 2020) (2020)."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00270"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323035"},{"key":"e_1_2_2_59_1","doi-asserted-by":"crossref","unstructured":"Edgar Tretschk Ayush Tewari Vladislav Golyanik Michael Zollh\u00f6fer Christoph Lassner and Christian Theobalt. 2020. Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video. arXiv:2012.12247 [cs.CV]  Edgar Tretschk Ayush Tewari Vladislav Golyanik Michael Zollh\u00f6fer Christoph Lassner and Christian Theobalt. 2020. Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video. arXiv:2012.12247 [cs.CV]","DOI":"10.1109\/ICCV48922.2021.01272"},{"key":"e_1_2_2_60_1","volume-title":"GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering. https:\/\/arxiv.org\/abs\/2010.04595","author":"Trevithick Alex","year":"2020","unstructured":"Alex Trevithick and Bo Yang . 2020 . GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering. https:\/\/arxiv.org\/abs\/2010.04595 (2020). Alex Trevithick and Bo Yang. 2020. GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering. https:\/\/arxiv.org\/abs\/2010.04595 (2020)."},{"key":"e_1_2_2_61_1","volume-title":"Single-view View Synthesis with Multiplane Images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Tucker Richard","year":"2020","unstructured":"Richard Tucker and Noah Snavely . 2020 . Single-view View Synthesis with Multiplane Images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Richard Tucker and Noah Snavely. 2020. Single-view View Synthesis with Multiplane Images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.30"},{"key":"e_1_2_2_63_1","unstructured":"Julien Valentin Cem Keskin Pavel Pidlypenskyi Ameesh Makadia Avneesh Sud and Sofien Bouaziz. 2019. TensorFlow Graphics: Computer Graphics Meets Deep Learning.  Julien Valentin Cem Keskin Pavel Pidlypenskyi Ameesh Makadia Avneesh Sud and Sofien Bouaziz. 2019. TensorFlow Graphics: Computer Graphics Meets Deep Learning."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323030"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00749"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275101"},{"key":"e_1_2_2_67_1","unstructured":"Jiajun Wu Chengkai Zhang Tianfan Xue Bill Freeman and Josh Tenenbaum. 2016. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. In Advances in neural information processing systems. 82--90.  Jiajun Wu Chengkai Zhang Tianfan Xue Bill Freeman and Josh Tenenbaum. 2016. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. In Advances in neural information processing systems. 82--90."},{"key":"e_1_2_2_68_1","volume-title":"Space-time Neural Irradiance Fields for Free-Viewpoint Video. https:\/\/arxiv.org\/abs\/2011.12950","author":"Xian Wenqi","year":"2020","unstructured":"Wenqi Xian , Jia-Bin Huang , Johannes Kopf , and Changil Kim . 2020. Space-time Neural Irradiance Fields for Free-Viewpoint Video. https:\/\/arxiv.org\/abs\/2011.12950 ( 2020 ). Wenqi Xian, Jia-Bin Huang, Johannes Kopf, and Changil Kim. 2020. Space-time Neural Irradiance Fields for Free-Viewpoint Video. https:\/\/arxiv.org\/abs\/2011.12950 (2020)."},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356513"},{"key":"e_1_2_2_70_1","volume-title":"pixelNeRF: Neural Radiance Fields from One or Few Images. https:\/\/arxiv.org\/abs\/2012.02190","author":"Yu Alex","year":"2020","unstructured":"Alex Yu , Vickie Ye , Matthew Tancik , and Angjoo Kanazawa . 2020. pixelNeRF: Neural Radiance Fields from One or Few Images. https:\/\/arxiv.org\/abs\/2012.02190 ( 2020 ). Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa. 2020. pixelNeRF: Neural Radiance Fields from One or Few Images. https:\/\/arxiv.org\/abs\/2012.02190 (2020)."},{"key":"e_1_2_2_71_1","volume-title":"Stereo magnification: Learning view synthesis using multiplane images. arXiv preprint arXiv:1805.09817","author":"Zhou Tinghui","year":"2018","unstructured":"Tinghui Zhou , Richard Tucker , John Flynn , Graham Fyffe , and Noah Snavely . 2018. Stereo magnification: Learning view synthesis using multiplane images. arXiv preprint arXiv:1805.09817 ( 2018 ). Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely. 2018. Stereo magnification: Learning view synthesis using multiplane images. arXiv preprint arXiv:1805.09817 (2018)."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459863","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459863","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:21Z","timestamp":1750191441000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459863"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":71,"aliases":["10.1145\/3476576.3476608","10.1145\/3476576.3476608"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3450626.3459863"],"URL":"https:\/\/doi.org\/10.1145\/3450626.3459863","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"2021-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}