{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T06:55:30Z","timestamp":1776063330306,"version":"3.50.1"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T00:00:00Z","timestamp":1573171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>We propose Differentiable Surface Splatting (DSS), a high-fidelity differentiable renderer for point clouds. Gradients for point locations and normals are carefully designed to handle discontinuities of the rendering function. Regularization terms are introduced to ensure uniform distribution of the points on the underlying surface. We demonstrate applications of DSS to inverse rendering for geometry synthesis and denoising, where large scale topological changes, as well as small scale detail modifications, are accurately and robustly handled without requiring explicit connectivity, outperforming state-of-the-art techniques. The data and code are at https:\/\/github.com\/yifita\/DSS.<\/jats:p>","DOI":"10.1145\/3355089.3356513","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T20:27:58Z","timestamp":1573244878000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":215,"title":["Differentiable surface splatting for point-based geometry processing"],"prefix":"10.1145","volume":"38","author":[{"given":"Wang","family":"Yifan","sequence":"first","affiliation":[{"name":"ETH Zurich, Switzerland"}]},{"given":"Felice","family":"Serena","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}]},{"given":"Shihao","family":"Wu","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}]},{"given":"Cengiz","family":"\u00d6ztireli","sequence":"additional","affiliation":[{"name":"Disney Research Zurich, Switzerland"}]},{"given":"Olga","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2019,11,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.120"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2003.1175093"},{"key":"e_1_2_2_3_1","volume-title":"Inverse Path Tracing for Joint Material and Lighting Estimation. arXiv preprint arXiv:1903.07145","author":"Azinovi\u0107 Dejan","year":"2019","unstructured":"Dejan Azinovi\u0107, Tzu-Mao Li, Anton Kaplanyan, and Matthias Nie\u00dfner. 2019. Inverse Path Tracing for Joint Material and Lighting Estimation. arXiv preprint arXiv:1903.07145 (2019)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12802"},{"key":"e_1_2_2_5_1","volume-title":"Eurographics Italian Chapter Conference.","author":"Cignoni Paolo","year":"2008","unstructured":"Paolo Cignoni, Marco Callieri, Massimiliano Corsini, Matteo Dellepiane, Fabio Ganovelli, and Guido Ranzuglia. 2008. MeshLab: an Open-Source Mesh Processing Tool. In Eurographics Italian Chapter Conference."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.34"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.264"},{"key":"e_1_2_2_8_1","volume-title":"Proc. Inter. Conf. on Artificial Intelligence and Statistics. 249--256","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proc. Inter. Conf. on Artificial Intelligence and Statistics. 249--256."},{"key":"e_1_2_2_9_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Nets. In In Advances in Neural Information Processing Systems (NIPS)."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13343"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_2_12_1","unstructured":"Paul S Heckbert. 1989. Fundamentals of texture mapping and image warping. (1989)."},{"key":"e_1_2_2_13_1","volume-title":"Total Denoising: Unsupervised Learning of 3D Point Cloud Cleaning. arXiv preprint arXiv:1904.07615","author":"Hermosilla Pedro","year":"2019","unstructured":"Pedro Hermosilla, Tobias Ritschel, and Timo Ropinski. 2019. Total Denoising: Unsupervised Learning of 3D Point Cloud Cleaning. arXiv preprint arXiv:1904.07615 (2019)."},{"key":"e_1_2_2_14_1","article-title":"Monte Carlo Convolution for Learning on Non-Uniformly Sampled Point Clouds","volume":"37","author":"Hermosilla P.","year":"2018","unstructured":"P. Hermosilla, T. Ritschel, P-P Vazquez, A. Vinacua, and T. Ropinski. 2018. Monte Carlo Convolution for Learning on Non-Uniformly Sampled Point Clouds. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 37, 6 (2018).","journal-title":"ACM Trans. on Graphics (Proc. of SIGGRAPH Asia)"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/133994.134011"},{"key":"e_1_2_2_16_1","volume-title":"Render4Completion: Synthesizing Multi-view Depth Maps for 3D Shape Completion. arXiv preprint arXiv:1904.08366","author":"Hu Tao","year":"2019","unstructured":"Tao Hu, Zhizhong Han, Abhinav Shrivastava, and Matthias Zwicker. 2019. Render4Completion: Synthesizing Multi-view Depth Maps for 3D Shape Completion. arXiv preprint arXiv:1904.08366 (2019)."},{"key":"e_1_2_2_17_1","article-title":"Consolidation of Unorganized Point Clouds for Surface Reconstruction","volume":"28","author":"Huang Hui","year":"2009","unstructured":"Hui Huang, Dan Li, Hao Zhang, Uri Ascher, and Daniel Cohen-Or. 2009. Consolidation of Unorganized Point Clouds for Surface Reconstruction. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 28, 5 (2009), 176:1--176:7.","journal-title":"ACM Trans. on Graphics (Proc. of SIGGRAPH Asia)"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2421636.2421645"},{"key":"e_1_2_2_19_1","unstructured":"Eldar Insafutdinov and Alexey Dosovitskiy. 2018. Unsupervised learning of shape and pose with differentiable point clouds. In In Advances in Neural Information Processing Systems (NIPS). 2802--2812."},{"key":"e_1_2_2_20_1","volume-title":"Proc. IEEE Conf. on Computer Vision & Pattern Recognition.","author":"Isola Phillip","unstructured":"Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. Image-To-Image Translation With Conditional Adversarial Networks. In Proc. IEEE Conf. on Computer Vision & Pattern Recognition."},{"key":"e_1_2_2_21_1","volume-title":"Proc. Int. Conf. on Learning Representations.","author":"Karras Tero","year":"2018","unstructured":"Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. 2018. Progressive Growing of GANs for Improved Quality, Stability, and Variation. In Proc. Int. Conf. on Learning Representations."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00411"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_29"},{"key":"e_1_2_2_24_1","unstructured":"Tzu-Mao Li Miika Aittala Fr\u00e9do Durand and Jaakko Lehtinen. 2018. Differentiable monte carlo ray tracing through edge sampling. In ACM Trans. on Graphics (Proc. of SIGGRAPH Asia). ACM 222."},{"key":"e_1_2_2_25_1","volume-title":"AAAI Conference on Artificial Intelligence.","author":"Lin Chen-Hsuan","year":"2018","unstructured":"Chen-Hsuan Lin, Chen Kong, and Simon Lucey. 2018. Learning efficient point cloud generation for dense 3D object reconstruction. In AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276405"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.248"},{"key":"e_1_2_2_28_1","volume-title":"Paparazzi: Surface Editing by way of Multi-View Image Processing. In ACM Trans. on Graphics (Proc. of SIGGRAPH Asia). ACM, 221.","author":"Derek Liu Hsueh-Ti","year":"2018","unstructured":"Hsueh-Ti Derek Liu, Michael Tao, and Alec Jacobson. 2018. Paparazzi: Surface Editing by way of Multi-View Image Processing. In ACM Trans. on Graphics (Proc. of SIGGRAPH Asia). ACM, 221."},{"key":"e_1_2_2_29_1","volume-title":"Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning. arXiv preprint arXiv:1904.01786","author":"Liu Shichen","year":"2019","unstructured":"Shichen Liu, Tianye Li, Weikai Chen, and Hao Li. 2019. Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning. arXiv preprint arXiv:1904.01786 (2019)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_11"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2725948"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.338"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.304"},{"key":"e_1_2_2_34_1","unstructured":"Thu H Nguyen-Phuoc Chuan Li Stephen Balaban and Yongliang Yang. 2018. RenderNet: A deep convolutional network for differentiable rendering from 3D shapes. In In Advances in Neural Information Processing Systems (NIPS). 7891--7901."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01388.x"},{"key":"e_1_2_2_36_1","unstructured":"Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. In NIPS-W."},{"key":"e_1_2_2_37_1","volume-title":"Pix2Vex: Image-to-Geometry Reconstruction using a Smooth Differentiable Renderer. arXiv preprint arXiv:1903.11149","author":"Petersen Felix","year":"2019","unstructured":"Felix Petersen, Amit H Bermano, Oliver Deussen, and Daniel Cohen-Or. 2019. Pix2Vex: Image-to-Geometry Reconstruction using a Smooth Differentiable Renderer. arXiv preprint arXiv:1903.11149 (2019)."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344936"},{"key":"e_1_2_2_39_1","volume-title":"Image2Mesh: A Learning Framework for Single Image 3D Reconstruction. arXiv preprint arXiv:1711.10669","author":"Pontes Jhony K","year":"2017","unstructured":"Jhony K Pontes, Chen Kong, Sridha Sridharan, Simon Lucey, Anders Eriksson, and Clinton Fookes. 2017. Image2Mesh: A Learning Framework for Single Image 3D Reconstruction. arXiv preprint arXiv:1711.10669 (2017)."},{"key":"e_1_2_2_40_1","volume-title":"Proc. IEEE Conf. on Computer Vision & Pattern Recognition.","author":"Qi Charles R","year":"2017","unstructured":"Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017a. PointNet: Deep learning on point sets for 3D classification and segmentation. In Proc. IEEE Conf. on Computer Vision & Pattern Recognition."},{"key":"e_1_2_2_41_1","unstructured":"Charles Ruizhongtai Qi Li Yi Hao Su and Leonidas J Guibas. 2017b. PointNet++: Deep hierarchical feature learning on point sets in a metric space. In In Advances in Neural Information Processing Systems (NIPS). 5099--5108."},{"key":"e_1_2_2_42_1","unstructured":"Sai Rajeswar Fahim Mannan Florian Golemo David Vazquez Derek Nowrouzezahrai and Aaron Courville. 2018. Pix2Scene: Learning Implicit 3D Representations from Images. (2018)."},{"key":"e_1_2_2_43_1","volume-title":"Paul Guerrero, Niloy J Mitra, and Maks Ovsjanikov.","author":"Rakotosaona Marie-Julie","year":"2019","unstructured":"Marie-Julie Rakotosaona, Vittorio La Barbera, Paul Guerrero, Niloy J Mitra, and Maks Ovsjanikov. 2019. POINTCLEANNET: Learning to Denoise and Remove Outliers from Dense Point Clouds. arXiv preprint arXiv:1901.01060 (2019)."},{"key":"e_1_2_2_44_1","volume-title":"Learning detailed face reconstruction from a single image","author":"Richardson Elad","unstructured":"Elad Richardson, Matan Sela, Roy Or-El, and Ron Kimmel. 2017. Learning detailed face reconstruction from a single image. In IEEE Trans. Pattern Analysis & Machine Intelligence. 1259--1268."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13344"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00439"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00659"},{"key":"e_1_2_2_49_1","volume-title":"Proc. IEEE Conf. on Computer Vision & Pattern Recognition.","author":"Shi Jian","unstructured":"Jian Shi, Yue Dong, Hao Su, and Stella X. Yu. 2017. Learning Non-Lambertian Object Intrinsics Across ShapeNet Categories. In Proc. IEEE Conf. on Computer Vision & Pattern Recognition."},{"key":"e_1_2_2_50_1","volume-title":"DeepVoxels: Learning Persistent 3D Feature Embeddings. arXiv preprint arXiv:1812.01024","author":"Sitzmann Vincent","year":"2018","unstructured":"Vincent Sitzmann, Justus Thies, Felix Heide, Matthias Nie\u00dfner, Gordon Wetzstein, and Michael Zollh\u00f6fer. 2018. DeepVoxels: Learning Persistent 3D Feature Embeddings. arXiv preprint arXiv:1812.01024 (2018)."},{"key":"e_1_2_2_51_1","volume-title":"Proc. IEEE Int. Conf. on Machine Learning. 1139--1147","author":"Sutskever Ilya","year":"2013","unstructured":"Ilya Sutskever, James Martens, George Dahl, and Geoffrey Hinton. 2013. On the importance of initialization and momentum in deep learning. In Proc. IEEE Int. Conf. on Machine Learning. 1139--1147."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.30"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201388"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980232"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024208"},{"key":"e_1_2_2_56_1","unstructured":"Xinchen Yan Jimei Yang Ersin Yumer Yijie Guo and Honglak Lee. 2016. Perspective transformer nets: Learning single-view 3d object reconstruction without 3d supervision. In In Advances in Neural Information Processing Systems (NIPS). 1696--1704."},{"key":"e_1_2_2_57_1","volume-title":"Jun-Yan Zhu, Jiajun Wu, Antonio Torralba","author":"Yao Shunyu","year":"2018","unstructured":"Shunyu Yao, Tzu Ming Hsu, Jun-Yan Zhu, Jiajun Wu, Antonio Torralba, Bill Freeman, and Josh Tenenbaum. 2018. 3D-aware scene manipulation via inverse graphics. In In Advances in Neural Information Processing Systems (NIPS). 1887--1898."},{"key":"e_1_2_2_58_1","volume-title":"Patch-based Progressive 3D Point Set Upsampling. arXiv preprint arXiv:1811.11286","author":"Yifan Wang","year":"2018","unstructured":"Wang Yifan, Shihao Wu, Hui Huang, Daniel Cohen-Or, and Olga Sorkine-Hornung. 2018. Patch-based Progressive 3D Point Set Upsampling. arXiv preprint arXiv:1811.11286 (2018)."},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_24"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.16"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/566570.566584"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383300"},{"key":"e_1_2_2_63_1","volume-title":"Proc. of Graphics interface. Canadian Human-Computer Communications Society, 247--254","author":"Zwicker Matthias","year":"2004","unstructured":"Matthias Zwicker, Jussi R\u00e4s\u00e4nen, Mario Botsch, Carsten Dachsbacher, and Mark Pauly. 2004. Perspective accurate splatting. In Proc. of Graphics interface. Canadian Human-Computer Communications Society, 247--254."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356513","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3355089.3356513","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:41Z","timestamp":1750203881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356513"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,8]]},"references-count":63,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3355089.3356513"],"URL":"https:\/\/doi.org\/10.1145\/3355089.3356513","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,8]]},"assertion":[{"value":"2019-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}