{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T02:14:37Z","timestamp":1786068877519,"version":"3.56.0"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972194"],"award-info":[{"award-number":["61972194"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62032011"],"award-info":[{"award-number":["62032011"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20211147"],"award-info":[{"award-number":["BK20211147"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2025,8,1]]},"abstract":"<jats:p>The emergence of neural and Gaussian-based radiance field methods has led to considerable advancements in novel view synthesis and 3D object reconstruction. Nonetheless, specular reflection and refraction continue to pose significant challenges due to the instability and incorrect overfitting of radiance fields to high-frequency light variations. Currently, even 3D Gaussian Splatting (3D-GS), as a powerful and efficient tool, falls short in recovering transparent objects with nearby contents due to the existence of apparent secondary ray effects. To address this issue, we propose TransparentGS, a fast inverse rendering pipeline for transparent objects based on 3D-GS. The main contributions are three-fold. Firstly, an efficient representation of transparent objects, transparent Gaussian primitives, is designed to enable specular refraction through a deferred refraction strategy. Secondly, we leverage Gaussian light field probes (GaussProbe) to encode both ambient light and nearby contents in a unified framework. Thirdly, a depth-based iterative probes query (IterQuery) algorithm is proposed to reduce the parallax errors in our probe-based framework. Experiments demonstrate the speed and accuracy of our approach in recovering transparent objects from complex environments, as well as several applications in computer graphics and vision.<\/jats:p>","DOI":"10.1145\/3730892","type":"journal-article","created":{"date-parts":[[2025,7,27]],"date-time":"2025-07-27T04:02:22Z","timestamp":1753588942000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussians"],"prefix":"10.1145","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-1454-7824","authenticated-orcid":false,"given":"Letian","family":"Huang","sequence":"first","affiliation":[{"name":"State Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8637-4384","authenticated-orcid":false,"given":"Dongwei","family":"Ye","sequence":"additional","affiliation":[{"name":"State Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2228-4648","authenticated-orcid":false,"given":"Jialin","family":"Dan","sequence":"additional","affiliation":[{"name":"State Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0736-7951","authenticated-orcid":false,"given":"Chengzhi","family":"Tao","sequence":"additional","affiliation":[{"name":"State Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6423-4812","authenticated-orcid":false,"given":"Huiwen","family":"Liu","sequence":"additional","affiliation":[{"name":"TMCC, College of Computer Science, Nankai University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4243-6112","authenticated-orcid":false,"given":"Kun","family":"Zhou","sequence":"additional","affiliation":[{"name":"State Key Lab of CAD&amp;CG, Zhejiang University, Hangzhou, China"},{"name":"Institute of Hangzhou Holographic Intelligent Technology, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8179-9122","authenticated-orcid":false,"given":"Bo","family":"Ren","sequence":"additional","affiliation":[{"name":"TMCC, College of Computer Science, Nankai University, Tianjin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4100-7471","authenticated-orcid":false,"given":"Yuanqi","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7605-5206","authenticated-orcid":false,"given":"Yanwen","family":"Guo","sequence":"additional","affiliation":[{"name":"State Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4176-7617","authenticated-orcid":false,"given":"Jie","family":"Guo","sequence":"additional","affiliation":[{"name":"State Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,7,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00539"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.959611"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528233.3530706"},{"key":"e_1_2_2_4_1","volume-title":"Tensorf: Tensorial radiance fields","author":"Chen Anpei","year":"2022","unstructured":"Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, and Hao Su. 2022. Tensorf: Tensorial radiance fields. In ECCV. Springer, 333\u2013350."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/965161.806819"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/54852.378468"},{"key":"e_1_2_2_7_1","volume-title":"Subsurface Scattering for Gaussian Splatting. In The Thirty-eighth Annual Conference on Neural Information Processing Systems.","author":"Dihlmann Jan-Niklas","year":"2024","unstructured":"Jan-Niklas Dihlmann, Arjun Majumdar, Andreas Engelhardt, Raphael Braun, and Hendrik Lensch. 2024. Subsurface Scattering for Gaussian Splatting. In The Thirty-eighth Annual Conference on Neural Information Processing Systems."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618236"},{"key":"e_1_2_2_9_1","volume-title":"Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracing","author":"Gao Jian","unstructured":"Jian Gao, Chun Gu, Youtian Lin, Zhihao Li, Hao Zhu, Xun Cao, Li Zhang, and Yao Yao. 2024. Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracing. In ECCV. Springer, 73\u201389."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00392"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00512"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275084"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.15163"},{"key":"e_1_2_2_14_1","volume-title":"European Conference on Computer Vision. Springer, 247\u2013263","author":"Huang Letian","year":"2024","unstructured":"Letian Huang, Jiayang Bai, Jie Guo, Yuanqi Li, and Yanwen Guo. 2024. On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategy. In European Conference on Computer Vision. Springer, 247\u2013263."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539828"},{"key":"e_1_2_2_16_1","volume-title":"Marcus Magnor, and Wolfgang Heidrich.","author":"Ihrke Ivo","year":"2010","unstructured":"Ivo Ihrke, Kiriakos N Kutulakos, Hendrik PA Lensch, Marcus Magnor, and Wolfgang Heidrich. 2010. Transparent and specular object reconstruction. In Computer graphics forum, Vol. 29. Wiley Online Library, 2400\u20132426."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00509"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00024"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/15886.15902"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3592433"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141937"},{"key":"e_1_2_2_22_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073599"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0049-9"},{"key":"e_1_2_2_26_1","volume-title":"GlossyGS: Inverse Rendering of Glossy Objects With 3D Gaussian Splatting","author":"Lai Shuichang","year":"2025","unstructured":"Shuichang Lai, Letian Huang, Jie Guo, Kai Cheng, Bowen Pan, Xiaoxiao Long, Jiangjing Lyu, Chengfei Lv, and Yanwen Guo. 2025. GlossyGS: Inverse Rendering of Glossy Objects With 3D Gaussian Splatting. IEEE Transactions on Visualization and Computer Graphics (2025), 1\u201314."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3658211"},{"key":"e_1_2_2_28_1","unstructured":"Zongcheng Li Xiaoxiao Long Yusen Wang Tuo Cao Wenping Wang Fei Luo and Chunxia Xiao. 2023. NeTO: neural reconstruction of transparent objects with self-occlusion aware refraction-tracing. In ICCV. 18547\u201318557."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00134"},{"key":"e_1_2_2_30_1","volume-title":"Envidr: Implicit differentiable renderer with neural environment lighting. In CVPR. 79\u201389.","author":"Liang Ruofan","year":"2023","unstructured":"Ruofan Liang, Huiting Chen, Chunlin Li, Fan Chen, Selvakumar Panneer, and Nandita Vijaykumar. 2023. Envidr: Implicit differentiable renderer with neural environment lighting. In CVPR. 79\u201389."},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Zhihao Liang Qi Zhang Ying Feng Ying Shan and Kui Jia. 2024. Gs-ir: 3d gaussian splatting for inverse rendering. In CVPR. 21644\u201321653.","DOI":"10.1109\/CVPR52733.2024.02045"},{"key":"e_1_2_2_32_1","volume-title":"European Conference on Computer Vision. Springer, 38\u201355","author":"Liu Shilong","year":"2024","unstructured":"Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, et al. 2024. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. In European Conference on Computer Vision. Springer, 38\u201355."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3592134"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/37402.37422"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417815"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_24"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3687934"},{"key":"e_1_2_2_38_1","volume-title":"Instant neural graphics primitives with a multiresolution hash encoding. ACM transactions on graphics (TOG) 41, 4","author":"M\u00fcller Thomas","year":"2022","unstructured":"Thomas M\u00fcller, Alex Evans, Christoph Schied, and Alexander Keller. 2022. Instant neural graphics primitives with a multiresolution hash encoding. ACM transactions on graphics (TOG) 41, 4 (2022), 1\u201315."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.473"},{"key":"e_1_2_2_40_1","unstructured":"Nikhila Ravi Valentin Gabeur Yuan-Ting Hu Ronghang Hu Chaitanya Ryali Tengyu Ma Haitham Khedr Roman R\u00e4dle Chloe Rolland Laura Gustafson et al. 2024. Sam 2: Segment anything in images and videos. arXiv preprint arXiv:2408.00714 (2024)."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.1330233"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2024.3371792"},{"key":"e_1_2_2_43_1","volume-title":"Jannik Boll Nielsen, Rasmus Ahrenkiel Lyngby, Sebastian Hoppe Nesgaard Jensen, Jakob Wilm, Mads Brix Doest, Carsten Gundlach, Eythor Runar Eiriksson, Knut Conradsen, et al.","author":"Stets Jonathan Dyssel","year":"2017","unstructured":"Jonathan Dyssel Stets, Alessandro Dal Corso, Jannik Boll Nielsen, Rasmus Ahrenkiel Lyngby, Sebastian Hoppe Nesgaard Jensen, Jakob Wilm, Mads Brix Doest, Carsten Gundlach, Eythor Runar Eiriksson, Knut Conradsen, et al. 2017. Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering. Applied optics 56, 27 (2017), 7679\u20137690."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3687757"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01208"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00541"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00036"},{"key":"e_1_2_2_48_1","first-page":"27171","article-title":"NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction","volume":"34","author":"Wang Peng","year":"2021","unstructured":"Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, and Wenping Wang. 2021. NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction. Advances in Neural Information Processing Systems 34 (2021), 27171\u201327183.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_49_1","volume-title":"Image quality assessment: from error visibility to structural similarity","author":"Wang Zhou","year":"2004","unstructured":"Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing 13, 4 (2004), 600\u2013612."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126367"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201286"},{"key":"e_1_2_2_52_1","volume-title":"DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading. arXiv preprint arXiv:2404.09412","author":"Wu Tong","year":"2024","unstructured":"Tong Wu, Jia-Mu Sun, Yu-Kun Lai, Yuewen Ma, Leif Kobbelt, and Lin Gao. 2024a. DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading. arXiv preprint arXiv:2404.09412 (2024)."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-024-0436-y"},{"key":"e_1_2_2_54_1","article-title":"A hybrid mesh-neural representation for 3D transparent object reconstruction","volume":"1","author":"Xu Jiamin","year":"2022","unstructured":"Jiamin Xu, Zihan Zhu, Hujun Bao, and Weiwei Xu. 2022. A hybrid mesh-neural representation for 3D transparent object reconstruction. ACM Trans. Graph 1, 1 (2022).","journal-title":"ACM Trans. Graph"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3641519.3657456"},{"key":"e_1_2_2_56_1","doi-asserted-by":"crossref","unstructured":"Zinuo You Andreas Geiger and Anpei Chen. 2024. NeLF-Pro: Neural Light Field Probes for Multi-Scale Novel View Synthesis. In CVPR. 19833\u201319843.","DOI":"10.1109\/CVPR52733.2024.01875"},{"key":"e_1_2_2_57_1","volume-title":"The Thirty-eighth Annual Conference on Neural Information Processing Systems.","author":"Yu Mulin","year":"2024","unstructured":"Mulin Yu, Tao Lu, Linning Xu, Lihan Jiang, Yuanbo Xiangli, and Bo Dai. 2024. GSDF: 3DGS Meets SDF for Improved Neural Rendering and Reconstruction. In The Thirty-eighth Annual Conference on Neural Information Processing Systems."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.01687"},{"key":"e_1_2_2_59_1","doi-asserted-by":"crossref","unstructured":"Jingyang Zhang Yao Yao Shiwei Li Jingbo Liu Tian Fang David McKinnon Yanghai Tsin and Long Quan. 2023. Neilf++: Inter-reflectable light fields for geometry and material estimation. In ICCV. 3601\u20133610.","DOI":"10.1109\/ICCV51070.2023.00333"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_2_2_61_1","volume-title":"Unified Gaussian Primitives for Scene Representation and Rendering. arXiv preprint arXiv:2406.09733","author":"Zhou Yang","year":"2024","unstructured":"Yang Zhou, Songyin Wu, and Ling-Qi Yan. 2024. Unified Gaussian Primitives for Scene Representation and Rendering. arXiv preprint arXiv:2406.09733 (2024)."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2002.1021576"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3730892","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T17:50:29Z","timestamp":1774633829000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3730892"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,27]]},"references-count":62,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,8,1]]}},"alternative-id":["10.1145\/3730892"],"URL":"https:\/\/doi.org\/10.1145\/3730892","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,27]]},"assertion":[{"value":"2025-01-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-29","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}