{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:10:40Z","timestamp":1784268640534,"version":"3.55.0"},"reference-count":104,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Innovation Funding of ICT, CAS","award":["E461020"],"award-info":[{"award-number":["E461020"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62322210"],"award-info":[{"award-number":["62322210"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62302484"],"award-info":[{"award-number":["62302484"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Beijing Municipal Natural Science Foundation for Distinguished Young Scholars","award":["JQ21013"],"award-info":[{"award-number":["JQ21013"]}]},{"DOI":"10.13039\/501100009592","name":"Beijing Municipal Science and Technology Commission","doi-asserted-by":"publisher","award":["Z231100005923031"],"award-info":[{"award-number":["Z231100005923031"]}],"id":[{"id":"10.13039\/501100009592","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,12,19]]},"abstract":"<jats:p>\n            Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a scene. Nevertheless, it is challenging for users to directly deform or manipulate these implicit representations with large deformations in a real-time fashion. Gaussian Splatting (GS) has recently become a promising method with explicit geometry for representing static scenes and facilitating high-quality and real-time synthesis of novel views. However, it cannot be easily deformed due to the use of discrete Gaussians and the lack of explicit topology. To address this, we develop a novel GS-based method (GaussianMesh) that enables interactive deformation. Our key idea is to design an innovative mesh-based GS representation, which is integrated into Gaussian learning and manipulation. 3D Gaussians are defined over an explicit mesh, and they are bound with each other: the rendering of 3D Gaussians guides the mesh face split for adaptive refinement, and the mesh face split directs the splitting of 3D Gaussians. Moreover, the explicit mesh constraints help regularize the Gaussian distribution, suppressing poor-quality Gaussians (\n            <jats:italic>e.g.<\/jats:italic>\n            , misaligned Gaussians, long-narrow shaped Gaussians), thus enhancing visual quality and reducing artifacts during deformation. Based on this representation, we further introduce a large-scale Gaussian deformation technique to enable deformable GS, which alters the parameters of 3D Gaussians according to the manipulation of the associated mesh. Our method benefits from existing mesh deformation datasets for more realistic data-driven Gaussian deformation. Extensive experiments show that our approach achieves high-quality reconstruction and effective deformation, while maintaining the promising rendering results at a high frame rate (65 FPS on average on a single commodity GPU).\n          <\/jats:p>","DOI":"10.1145\/3687756","type":"journal-article","created":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T15:46:04Z","timestamp":1732031164000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Real-time Large-scale Deformation of Gaussian Splatting"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1021-8148","authenticated-orcid":false,"given":"Lin","family":"Gao","sequence":"first","affiliation":[{"name":"Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chijnese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6503-8312","authenticated-orcid":false,"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9489-7385","authenticated-orcid":false,"given":"Bo-Tao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4589-8745","authenticated-orcid":false,"given":"Jia-Mu","family":"Sun","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5646-6211","authenticated-orcid":false,"given":"Yu-Jie","family":"Yuan","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0284-726X","authenticated-orcid":false,"given":"Hongbo","family":"Fu","sequence":"additional","affiliation":[{"name":"Division of Arts and Machine Creativity, Hong Kong University of Science and Technology, Hong Kong, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2094-5680","authenticated-orcid":false,"given":"Yu-Kun","family":"Lai","sequence":"additional","affiliation":[{"name":"School of Computer Science and Informatics, Cardiff University, Cardiff, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,11,19]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"International conference on machine learning. PMLR, 40--49","author":"Achlioptas Panos","year":"2018","unstructured":"Panos Achlioptas, Olga Diamanti, Ioannis Mitliagkas, and Leonidas Guibas. 2018. Learning Representations and Generative Models for 3D Point Clouds. In International conference on machine learning. PMLR, 40--49."},{"key":"e_1_2_1_2_1","volume-title":"Olivier Devillers, and Martin Isenburg.","author":"Alliez Pierre","year":"2003","unstructured":"Pierre Alliez, Eric Colin De Verdire, Olivier Devillers, and Martin Isenburg. 2003. Isotropic Surface Remeshing. In 2003 Shape Modeling International. IEEE, 49--58."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20919--20929","author":"Bao Chong","unstructured":"Chong Bao, Yinda Zhang, and Bangbang et al. Yang. 2023. SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20919--20929."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00539"},{"key":"e_1_2_1_5_1","volume-title":"Nonlinear Continuum Mechanics for Finite Element Analysis","author":"Bonet Javier","unstructured":"Javier Bonet and Richard D Wood. 1997. Nonlinear Continuum Mechanics for Finite Element Analysis. Cambridge university press."},{"key":"e_1_2_1_6_1","volume-title":"A Survey on 3D Gaussian Splatting. arXiv preprint arXiv:2401.03890","author":"Chen Guikun","year":"2024","unstructured":"Guikun Chen and Wenguan Wang. 2024. A Survey on 3D Gaussian Splatting. arXiv preprint arXiv:2401.03890 (2024)."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 21401--21412","author":"Chen Zilong","year":"2024","unstructured":"Zilong Chen, Feng Wang, Yikai Wang, and Huaping Liu. 2024. Text-to-3D using Gaussian Splatting. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 21401--21412."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00609"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 3151--3161","author":"Cheng Ho Kei","year":"2024","unstructured":"Ho Kei Cheng, Seoung Wug Oh, Brian Price, Joon-Young Lee, and Alexander Schwing. 2024. Putting the Object Back Into Video Object Segmentation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 3151--3161."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00700"},{"key":"e_1_2_1_11_1","first-page":"21638","article-title":"Neural unsigned distance fields for implicit function learning","volume":"33","author":"Chibane Julian","year":"2020","unstructured":"Julian Chibane, Gerard Pons-Moll, et al. 2020b. Neural unsigned distance fields for implicit function learning. Advances in Neural Information Processing Systems 33 (2020), 21638--21652.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings, Part VIII 14","author":"Choy Christopher B","year":"2016","unstructured":"Christopher B Choy, Danfei Xu, JunYoung Gwak, Kevin Chen, and Silvio Savarese. 2016. 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction. In Computer Vision-ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11--14, 2016, Proceedings, Part VIII 14. Springer, 628--644."},{"key":"e_1_2_1_13_1","volume-title":"Shuran Song, and Jeffrey Ichnowski.","author":"Duisterhof Bardienus P","year":"2023","unstructured":"Bardienus P Duisterhof, Zhao Mandi, Yunchao Yao, Jia-Wei Liu, Mike Zheng Shou, Shuran Song, and Jeffrey Ichnowski. 2023. MD-Splatting: Learning Metric Deformation from 4D Gaussians in Highly Deformable Scenes. arXiv preprint arXiv:2312.00583 (2023)."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the IEEE\/CVF Conference on computer vision and pattern recognition. 605--613","author":"Fan Haoqiang","year":"2017","unstructured":"Haoqiang Fan, Hao Su, and Leonidas J Guibas. 2017. A Point Set Generation Network for 3D Object Reconstruction from a Single Image. In Proceedings of the IEEE\/CVF Conference on computer vision and pattern recognition. 605--613."},{"key":"e_1_2_1_15_1","volume-title":"3D Gaussian as a New Vision Era: A Survey. arXiv preprint arXiv:2402.07181","author":"Fei Ben","year":"2024","unstructured":"Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, and Ying He. 2024. 3D Gaussian as a New Vision Era: A Survey. arXiv preprint arXiv:2402.07181 (2024)."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00542"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2941200"},{"key":"e_1_2_1_18_1","article-title":"SDM-NET: Deep Generative Network for Structured Deformable Mesh","volume":"38","author":"Gao Lin","year":"2019","unstructured":"Lin Gao, Jie Yang, Tong Wu, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai, and Hao(Richard) Zhang. 2019b. SDM-NET: Deep Generative Network for Structured Deformable Mesh. ACM Transactions on Graphics 38, 6 (2019), 243:1--243:15.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591552"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258849"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00030"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5354--5363","author":"Gu\u00e9don Antoine","year":"2024","unstructured":"Antoine Gu\u00e9don and Vincent Lepetit. 2024. SuGaR: Surface-aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-quality Mesh Rendering. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5354--5363."},{"key":"e_1_2_1_23_1","volume-title":"MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks. In European Conference on Computer Vision. Springer, 576--592","author":"Guillard Benoit","year":"2022","unstructured":"Benoit Guillard, Federico Stella, and Pascal Fua. 2022. MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks. In European Conference on Computer Vision. Springer, 576--592."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322959"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.01808"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3618314"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 634--644","author":"Hu Liangxiao","year":"2024","unstructured":"Liangxiao Hu, Hongwen Zhang, Yuxiang Zhang, Boyao Zhou, Boning Liu, Shengping Zhang, and Liqiang Nie. 2024. GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 634--644."},{"key":"e_1_2_1_28_1","article-title":"Subdivision-based Mesh Convolution Networks","volume":"41","author":"Hu Shi-Min","year":"2022","unstructured":"Shi-Min Hu, Zheng-Ning Liu, Meng-Hao Guo, Jun-Xiong Cai, Jiahui Huang, Tai-Jiang Mu, and Ralph R Martin. 2022. Subdivision-based Mesh Convolution Networks. ACM Transactions on Graphics 41, 3 (2022), 25:1--16.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 4220--4230","author":"Huang Yi-Hua","year":"2024","unstructured":"Yi-Hua Huang, Yang-Tian Sun, Ziyi Yang, Xiaoyang Lyu, Yan-Pei Cao, and Xiaojuan Qi. 2024. SC-GS: Sparse-controlled Gaussian Splatting for Editable Dynamic Scenes. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 4220--4230."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3585499"},{"key":"e_1_2_1_31_1","volume-title":"4D-Editor","author":"Jiang Dadong","year":"2023","unstructured":"Dadong Jiang, Zhihui Ke, Xiaobo Zhou, and Xidong Shi. 2023a. 4D-Editor: Interactive Object-level Editing in Dynamic Neural Radiance Fields via Semantic Distillation. arXiv e-prints (2023), arXiv-2310."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision. 14371--14382","author":"Jiang Ruixiang","year":"2023","unstructured":"Ruixiang Jiang, Can Wang, Jingbo Zhang, Menglei Chai, Mingming He, Dongdong Chen, and Jing Liao. 2023b. AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 14371--14382."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3641519.3657448"},{"key":"e_1_2_1_34_1","volume-title":"Ray Tracing","author":"Kajiya James T","year":"1984","unstructured":"James T Kajiya and Brian P Von Herzen. 1984. Ray Tracing Volume Densities. ACM SIGGRAPH computer graphics 18, 3 (1984), 165--174."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3592433"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073599"},{"key":"e_1_2_1_37_1","first-page":"23311","article-title":"Decomposing NeRF for Editing via Feature Field Distillation","volume":"35","author":"Kobayashi Sosuke","year":"2022","unstructured":"Sosuke Kobayashi, Eiichi Matsumoto, and Vincent Sitzmann. 2022. Decomposing NeRF for Editing via Feature Field Distillation. Advances in Neural Information Processing Systems 35 (2022), 23311--23330.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 505--515","author":"Kocabas Muhammed","year":"2024","unstructured":"Muhammed Kocabas, Jen-Hao Rick Chang, James Gabriel, Oncel Tuzel, and Anurag Ranjan. 2024. HUGS: Human Gaussian Splats. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 505--515."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417861"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/364338.364407"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00817"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 19711--19722","author":"Li Zhe","year":"2024","unstructured":"Zhe Li, Zerong Zheng, Lizhen Wang, and Yebin Liu. 2024. Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 19711--19722."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218654305000724"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/MCG.2023.3336224","article-title":"NeRF-In: Free-form NeRF Inpainting with RGB-D Priors","volume":"44","author":"Liu Hao-Kang","year":"2024","unstructured":"Hao-Kang Liu, I Shen, Bing-Yu Chen, et al. 2024b. NeRF-In: Free-form NeRF Inpainting with RGB-D Priors. Computer Graphics and Applications 44, 2 (2024), 100--109.","journal-title":"Computer Graphics and Applications"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00853"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00572"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 237--247","author":"Liu Yu-Tao","year":"2023","unstructured":"Yu-Tao Liu, Li Wang, Jie Yang, Weikai Chen, Xiaoxu Meng, Bo Yang, and Lin Gao. 2023a. NeUDF: Leaning Neural Unsigned Distance Fields with Volume Rendering. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 237--247."},{"key":"e_1_2_1_48_1","volume-title":"International Conference on Learning Representations. 1:14","author":"Liu Zhen","year":"2024","unstructured":"Zhen Liu, Yao Feng, Yuliang Xiu, Weiyang Liu, Liam Paull, Michael J. Black, and Bernhard Sch\u00f6lkopf. 2024a. Ghost-on-the-Shell: An Expressive Representation of General 3D Shapes. In International Conference on Learning Representations. 1:14."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20834--20843","author":"Long Xiaoxiao","year":"2023","unstructured":"Xiaoxiao Long, Cheng Lin, Lingjie Liu, Yuan Liu, Peng Wang, Christian Theobalt, Taku Komura, and Wenping Wang. 2023. NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20834--20843."},{"key":"e_1_2_1_50_1","volume-title":"International Conference on 3D Vision. 1--11","author":"Luiten Jonathon","year":"2024","unstructured":"Jonathon Luiten, Georgios Kopanas, Bastian Leibe, and Deva Ramanan. 2024. Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis. In International Conference on 3D Vision. 1--11."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7353481"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 248--258","author":"Meng Xiaoxu","year":"2023","unstructured":"Xiaoxu Meng, Weikai Chen, and Bo Yang. 2023. NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 248--258."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00459"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503250"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530127"},{"key":"e_1_2_1_56_1","volume-title":"GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting. arXiv preprint arXiv:2403.05154","author":"Palandra Francesco","year":"2024","unstructured":"Francesco Palandra, Andrea Sanchietti, Daniele Baieri, and Emanuele Rodol\u00e0. 2024. GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting. arXiv preprint arXiv:2403.05154 (2024)."},{"key":"e_1_2_1_57_1","volume-title":"Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold. In ACM SIGGRAPH Conference Proceedings. 1--11","author":"Pan Xingang","year":"2023","unstructured":"Xingang Pan, Ayush Tewari, Thomas Leimk\u00fchler, Lingjie Liu, Abhimitra Meka, and Christian Theobalt. 2023. Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold. In ACM SIGGRAPH Conference Proceedings. 1--11."},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 9054--9063","author":"Peng Sida","unstructured":"Sida Peng, Yuanqing Zhang, Yinghao Xu, and et al. 2021. Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 9054--9063."},{"key":"e_1_2_1_59_1","unstructured":"C\u00e9dric Pinson. 2011. Sketchfab - The Best 3D Viewer on the Web. https:\/\/sketchfab.com\/."},{"key":"e_1_2_1_60_1","volume-title":"The Eleventh International Conference on Learning Representations. 1--14","author":"Poole Ben","year":"2023","unstructured":"Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Mildenhall. 2023. DreamFusion: Text-to-3D using 2D Diffusion. In The Eleventh International Conference on Learning Representations. 1--14."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01018"},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of the IEEE\/CVF Conference on computer vision and pattern recognition. 652--660","author":"Qi Charles R","year":"2017","unstructured":"Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017a. PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. In Proceedings of the IEEE\/CVF Conference on computer vision and pattern recognition. 652--660."},{"key":"e_1_2_1_63_1","unstructured":"Charles Ruizhongtai Qi Li Yi Hao Su and Leonidas J Guibas. 2017b. PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. In Advances in neural information processing systems. 5099--5108."},{"key":"e_1_2_1_64_1","volume-title":"Accelerating 3D Deep Learning with PyTorch3D. arXiv:2007.08501","author":"Ravi Nikhila","year":"2020","unstructured":"Nikhila Ravi, Jeremy Reizenstein, David Novotny, Taylor Gordon, Wan-Yen Lo, Justin Johnson, and Georgia Gkioxari. 2020. Accelerating 3D Deep Learning with PyTorch3D. arXiv:2007.08501 (2020)."},{"key":"e_1_2_1_65_1","volume-title":"Structure-from-motion Revisited. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4104--4113","author":"Schonberger Johannes L","year":"2016","unstructured":"Johannes L Schonberger and Jan-Michael Frahm. 2016. Structure-from-motion Revisited. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4104--4113."},{"key":"e_1_2_1_66_1","volume-title":"Proceedings, Part III 14","author":"Sch\u00f6nberger Johannes L","year":"2016","unstructured":"Johannes L Sch\u00f6nberger, Enliang Zheng, Jan-Michael Frahm, and Marc Pollefeys. 2016. Pixelwise View Selection for Unstructured Multi-view Stereo. In Computer Vision-ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11--14, 2016, Proceedings, Part III 14. Springer, 501--518."},{"key":"e_1_2_1_67_1","volume-title":"DMesh: A Differentiable Representation for General Meshes. arXiv preprint arXiv:2404.13445","author":"Son Sanghyun","year":"2024","unstructured":"Sanghyun Son, Matheus Gadelha, Yang Zhou, Zexiang Xu, Ming C Lin, and Yi Zhou. 2024. DMesh: A Differentiable Representation for General Meshes. arXiv preprint arXiv:2404.13445 (2024)."},{"key":"e_1_2_1_68_1","first-page":"1","article-title":"Laplacian Mesh Processing","volume":"4","author":"Sorkine Olga","year":"2005","unstructured":"Olga Sorkine. 2005. Laplacian Mesh Processing. Eurographics (State of the Art Reports) 4, 4 (2005), 1.","journal-title":"Eurographics (State of the Art Reports)"},{"key":"e_1_2_1_69_1","volume-title":"As-rigid-as-possible Surface Modeling. In Symposium on Geometry processing","volume":"4","author":"Sorkine Olga","year":"2007","unstructured":"Olga Sorkine and Marc Alexa. 2007. As-rigid-as-possible Surface Modeling. In Symposium on Geometry processing, Vol. 4. Citeseer, 109--116."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3168569"},{"key":"e_1_2_1_71_1","volume-title":"Mesh-based Inverse Kinematics. ACM transactions on graphics 24, 3","author":"Sumner Robert W","year":"2005","unstructured":"Robert W Sumner, Matthias Zwicker, Craig Gotsman, and Jovan Popovi\u0107. 2005. Mesh-based Inverse Kinematics. ACM transactions on graphics 24, 3 (2005), 488--495."},{"key":"e_1_2_1_72_1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s44267-024-00042-1","article-title":"Recent Advances in Implicit Representation-based 3D Shape Generation","volume":"2","author":"Sun Jia-Mu","year":"2024","unstructured":"Jia-Mu Sun, Tong Wu, and Lin Gao. 2024. Recent Advances in Implicit Representation-based 3D Shape Generation. Visual Intelligence 2, 1 (2024), 9.","journal-title":"Visual Intelligence"},{"key":"e_1_2_1_73_1","volume-title":"International Conference on Learning Representations. 1--14","author":"Tang Jiaxiang","year":"2024","unstructured":"Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, and Gang Zeng. 2024. DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation. In International Conference on Learning Representations. 1--14."},{"key":"e_1_2_1_74_1","series-title":"Series B. Biological Sciences 203, 1153","volume-title":"The Interpretation of Structure from Motion. Proceedings of the Royal Society of London","author":"Ullman Shimon","year":"1979","unstructured":"Shimon Ullman. 1979. The Interpretation of Structure from Motion. Proceedings of the Royal Society of London. Series B. Biological Sciences 203, 1153 (1979), 405--426."},{"key":"e_1_2_1_75_1","volume-title":"GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting. arXiv preprint arXiv:2402.01459","author":"Waczy\u0144ska Joanna","year":"2024","unstructured":"Joanna Waczy\u0144ska, Piotr Borycki, S\u0142awomir Tadeja, Jacek Tabor, and Przemys\u0142aw Spurek. 2024. GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting. arXiv preprint arXiv:2402.01459 (2024)."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00381"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2023.3283400"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_4"},{"key":"e_1_2_1_79_1","volume-title":"Advances in Neural Information Processing Systems","volume":"34","author":"Wang Peng","year":"2021","unstructured":"Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, and Wenping Wang. 2021. NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc., 27171--27183."},{"key":"e_1_2_1_80_1","article-title":"Adaptive O-CNN: A Patch-based Deep Representation of 3D Shapes","volume":"37","author":"Wang Peng-Shuai","year":"2018","unstructured":"Peng-Shuai Wang, Chun-Yu Sun, Yang Liu, and Xin Tong. 2018a. Adaptive O-CNN: A Patch-based Deep Representation of 3D Shapes. ACM Transactions on Graphics 37, 6 (2018), 217:1--11.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the IEEE\/CVF Conference on International Conference on Computer Vision. 17683--17693","author":"Wang Xiangyu","year":"2023","unstructured":"Xiangyu Wang, Jingsen Zhu, Qi Ye, Yuchi Huo, Yunlong Ran, Zhihua Zhong, and Jiming Chen. 2023b. Seal-3D: Interactive Pixel-level Editing for Neural Radiance Fields. In Proceedings of the IEEE\/CVF Conference on International Conference on Computer Vision. 17683--17693."},{"key":"e_1_2_1_82_1","volume-title":"Proceedings of the IEEE\/CVF Conference on International Conference on Computer Vision. 3295--3306","author":"Wang Yiming","year":"2023","unstructured":"Yiming Wang, Qin Han, Marc Habermann, Kostas Daniilidis, Christian Theobalt, and Lingjie Liu. 2023a. NeuS2: Fast Learning of Neural Implicit Surfaces for Multiview Reconstruction. In Proceedings of the IEEE\/CVF Conference on International Conference on Computer Vision. 3295--3306."},{"key":"e_1_2_1_83_1","volume-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","author":"Wang Zhou","year":"2004","unstructured":"Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE transactions on image processing 13, 4 (2004), 600--612."},{"key":"e_1_2_1_84_1","volume-title":"Proceedings of the European Conference on Computer Vision. 1--17","author":"Wu Jing","year":"2024","unstructured":"Jing Wu, Jia-Wang Bian, Xinghui Li, Guangrun Wang, Ian Reid, Philip Torr, and Victor Adrian Prisacariu. 2024a. GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing. In Proceedings of the European Conference on Computer Vision. 1--17."},{"key":"e_1_2_1_85_1","unstructured":"JiajunWu Chengkai Zhang Tianfan Xue William T Freeman and Joshua B Tenenbaum. 2016. Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling. In Advances in Neural Information Processing Systems. 82--90."},{"key":"e_1_2_1_86_1","volume-title":"Recent Advances in 3D Gaussian Splatting. Computational Visual Media","author":"Wu Tong","year":"2024","unstructured":"Tong Wu, Yu-Jie Yuan, Ling-Xiao Zhang, Jie Yang, Yan-Pei Cao, Ling-Qi Yan, and Lin Gao. 2024b. Recent Advances in 3D Gaussian Splatting. Computational Visual Media (2024), 1--30."},{"key":"e_1_2_1_87_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 4389--4398","author":"Xie Tianyi","year":"2024","unstructured":"Tianyi Xie, Zeshun Zong, Yuxing Qiu, Xuan Li, Yutao Feng, Yin Yang, and Chenfanfu Jiang. 2024. PhysGaussian: Physics-integrated 3D Gaussians for Generative Dynamics. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 4389--4398."},{"key":"e_1_2_1_88_1","volume-title":"Deforming Radiance Fields with Cages. In European Conference on Computer Vision. Springer, 159--175","author":"Xu Tianhan","year":"2022","unstructured":"Tianhan Xu and Tatsuya Harada. 2022. Deforming Radiance Fields with Cages. In European Conference on Computer Vision. Springer, 159--175."},{"key":"e_1_2_1_89_1","volume-title":"NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing. In European Conference on Computer Vision. Springer, 597--614","author":"Yang Bangbang","year":"2022","unstructured":"Bangbang Yang, Chong Bao, Junyi Zeng, Hujun Bao, Yinda Zhang, Zhaopeng Cui, and Guofeng Zhang. 2022a. NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing. In European Conference on Computer Vision. Springer, 597--614."},{"key":"e_1_2_1_90_1","article-title":"DSG-Net: Learning Disentangled Structure and Geometry for 3D Shape Generation","volume":"42","author":"Yang Jie","year":"2022","unstructured":"Jie Yang, Kaichun Mo, Yu-Kun Lai, Leonidas J Guibas, and Lin Gao. 2022b. DSG-Net: Learning Disentangled Structure and Geometry for 3D Shape Generation. ACM Transactions on Graphics 42, 1 (2022), 1:1--17.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_2_1_91_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20331--20341","author":"Yang Ziyi","year":"2024","unstructured":"Ziyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao, Yuqing Zhang, and Xiaogang Jin. 2024. Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20331--20341."},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00186"},{"key":"e_1_2_1_93_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 6796--6807","author":"Yi Taoran","year":"2024","unstructured":"Taoran Yi, Jiemin Fang, Junjie Wang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, and Xinggang Wang. 2024. GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 6796--6807."},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00015"},{"key":"e_1_2_1_95_1","volume-title":"Proceedings of the IEEE\/CVF Conference on International Conference on Computer Vision. 5752--5761","author":"Yu Alex","year":"2021","unstructured":"Alex Yu, Ruilong Li, Matthew Tancik, Hao Li, Ren Ng, and Angjoo Kanazawa. 2021. Plenoctrees for Real-time Rendering of Neural Radiance Fields. In Proceedings of the IEEE\/CVF Conference on International Conference on Computer Vision. 5752--5761."},{"key":"e_1_2_1_96_1","volume-title":"Mesh Editing with Poisson-based Gradient Field Manipulation. In ACM SIGGRAPH 2004 Papers. 644--651","author":"Yu Yizhou","year":"2004","unstructured":"Yizhou Yu, Kun Zhou, Dong Xu, Xiaohan Shi, Hujun Bao, Baining Guo, and Heung-Yeung Shum. 2004. Mesh Editing with Poisson-based Gradient Field Manipulation. In ACM SIGGRAPH 2004 Papers. 644--651."},{"key":"e_1_2_1_97_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 18332--18343","author":"Yuan Yu-Jie","year":"2022","unstructured":"Yu-Jie Yuan, Yang-Tian Sun, Yu-Kun Lai, Yuewen Ma, Rongfei Jia, and Lin Gao. 2022. NeRF-Editing: Geometry Editing of Neural Radiance Fields. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 18332--18343."},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the IEEE conference Conference on Computer Vision and Pattern Recognition. 586--595","author":"Zhang Richard","year":"2018","unstructured":"Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman, and Oliver Wang. 2018. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In Proceedings of the IEEE conference Conference on Computer Vision and Pattern Recognition. 586--595."},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2020.05.013"},{"key":"e_1_2_1_100_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 19680--19690","author":"Zheng Shunyuan","year":"2024","unstructured":"Shunyuan Zheng, Boyao Zhou, Ruizhi Shao, Boning Liu, Shengping Zhang, Liqiang Nie, and Yebin Liu. 2024. GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 19680--19690."},{"key":"e_1_2_1_101_1","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s11704-016-5520-8","article-title":"The Role of Prior in Image based 3D Modeling: A Survey","volume":"11","author":"Zhu Hao","year":"2017","unstructured":"Hao Zhu, Yongming Nie, Tao Yue, and Xun Cao. 2017. The Role of Prior in Image based 3D Modeling: A Survey. Frontiers of Computer Science 11 (2017), 175--191.","journal-title":"Frontiers of Computer Science"},{"key":"e_1_2_1_102_1","article-title":"TIP-Editor: An Accurate 3D Editor following Both Text-prompts and Image-prompts","volume":"43","author":"Zhuang Jingyu","year":"2024","unstructured":"Jingyu Zhuang, Di Kang, Yan-Pei Cao, Guanbin Li, Liang Lin, and Ying Shan. 2024. TIP-Editor: An Accurate 3D Editor following Both Text-prompts and Image-prompts. ACM Transactions on Graphics 43, 4 (2024), 121:1--12.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_2_1_103_1","volume-title":"SIGGRAPH Asia 2023 Conference Papers. 26:1--10","author":"Zhuang Jingyu","year":"2023","unstructured":"Jingyu Zhuang, Chen Wang, Liang Lin, Lingjie Liu, and Guanbin Li. 2023. DreamEditor: Text-driven 3D Scene Editing with Neural Fields. In SIGGRAPH Asia 2023 Conference Papers. 26:1--10."},{"key":"e_1_2_1_104_1","volume-title":"Surface Splatting. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 371--378","author":"Zwicker Matthias","year":"2001","unstructured":"Matthias Zwicker, Hanspeter Pfister, Jeroen Van Baar, and Markus Gross. 2001. Surface Splatting. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 371--378."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687756","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3687756","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:45Z","timestamp":1750295865000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687756"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,19]]},"references-count":104,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,12,19]]}},"alternative-id":["10.1145\/3687756"],"URL":"https:\/\/doi.org\/10.1145\/3687756","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,19]]},"assertion":[{"value":"2024-11-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}