{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T10:25:15Z","timestamp":1768731915348,"version":"3.49.0"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62132012"],"award-info":[{"award-number":["62132012"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"the Fundamental Research Funds for the Central Universities","award":["63233080"],"award-info":[{"award-number":["63233080"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,7,19]]},"abstract":"<jats:p>Learning from multi-view images using neural implicit signed distance functions shows impressive performance on 3D Reconstruction of opaque objects. However, existing methods struggle to reconstruct accurate geometry when applied to translucent objects due to the non-negligible bias in their rendering function. To address the inaccuracies in the existing model, we have reparameterized the density function of the neural radiance field by incorporating an estimated constant extinction coefficient. This modification forms the basis of our innovative framework, which is geared towards highfidelity surface reconstruction and the novel-view synthesis of translucent objects. Our framework contains two stages. In the reconstruction stage, we introduce a novel weight function to achieve accurate surface geometry reconstruction. Following the recovery of geometry, the second phase involves learning the distinct scattering properties of the participating media to enhance rendering. A comprehensive dataset, comprising both synthetic and real translucent objects, has been built for conducting extensive experiments. Experiments reveal that our method outperforms existing approaches in terms of reconstruction and novel-view synthesis.<\/jats:p>","DOI":"10.1145\/3658186","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T14:47:57Z","timestamp":1721400477000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["NeuralTO: Neural Reconstruction and View Synthesis of Translucent Objects"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-7211-3279","authenticated-orcid":false,"given":"Yuxiang","family":"Cai","sequence":"first","affiliation":[{"name":"TMCC, College of Computer Science, Nankai University, Tianjin, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6065-7296","authenticated-orcid":false,"given":"Jiaxiong","family":"Qiu","sequence":"additional","affiliation":[{"name":"TMCC, College of Computer Science, Nankai University, Tianjin, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7416-1216","authenticated-orcid":false,"given":"Zhong","family":"Li","sequence":"additional","affiliation":[{"name":"OPPO US Research, palo alto, CA, United States of America"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8179-9122","authenticated-orcid":false,"given":"Bo","family":"Ren","sequence":"additional","affiliation":[{"name":"TMCC, College of Computer Science, Nankai University, Tianjin, China"}]}],"member":"320","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00580"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528233.3530706"},{"key":"e_1_2_2_3_1","first-page":"9","article-title":"Extending the Disney BRDF to a BSDF with integrated subsurface scattering. SIGGRAPH Course: Physically Based Shading in Theory and Practice. ACM, New York","volume":"19","author":"Burley Brent","year":"2015","unstructured":"Brent Burley. 2015. Extending the Disney BRDF to a BSDF with integrated subsurface scattering. SIGGRAPH Course: Physically Based Shading in Theory and Practice. ACM, New York, NY 19, 7 (2015), 9.","journal-title":"NY"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-005-0287-1"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19824-3_20"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00386"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00609"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528233.3530714"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201378"},{"key":"e_1_2_2_10_1","volume-title":"Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy Objects. arXiv preprint arXiv:2305.17929","author":"Fan Yue","year":"2023","unstructured":"Yue Fan, Ivan Skorokhodov, Oleg Voynov, Savva Ignatyev, Evgeny Burnaev, Peter Wonka, and Yiqun Wang. 2023. Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy Objects. arXiv preprint arXiv:2305.17929 (2023)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00542"},{"key":"e_1_2_2_12_1","first-page":"3403","article-title":"Geo-neus: Geometry-consistent neural implicit surfaces learning for multi-view reconstruction","volume":"35","author":"Fu Qiancheng","year":"2022","unstructured":"Qiancheng Fu, Qingshan Xu, Yew Soon Ong, and Wenbing Tao. 2022. Geo-neus: Geometry-consistent neural implicit surfaces learning for multi-view reconstruction. Advances in Neural Information Processing Systems 35 (2022), 3403--3416.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618236"},{"key":"e_1_2_2_14_1","volume-title":"Nerf: Neural radiance field in 3d vision, a comprehensive review. arXiv preprint arXiv:2210.00379","author":"Gao Kyle","year":"2022","unstructured":"Kyle Gao, Yina Gao, Hongjie He, Dening Lu, Linlin Xu, and Jonathan Li. 2022. Nerf: Neural radiance field in 3d vision, a comprehensive review. arXiv preprint arXiv:2210.00379 (2022)."},{"key":"e_1_2_2_15_1","volume-title":"Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflection. arXiv preprint arXiv:2303.10840","author":"Ge Wenhang","year":"2023","unstructured":"Wenhang Ge, Tao Hu, Haoyu Zhao, Shu Liu, and Ying-Cong Chen. 2023. Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflection. arXiv preprint arXiv:2303.10840 (2023)."},{"key":"e_1_2_2_16_1","volume-title":"Implicit Geometric Regularization for Learning Shapes. In International Conference on Machine Learning. PMLR, 3789--3799","author":"Gropp Amos","year":"2020","unstructured":"Amos Gropp, Lior Yariv, Niv Haim, Matan Atzmon, and Yaron Lipman. 2020. Implicit Geometric Regularization for Learning Shapes. In International Conference on Machine Learning. PMLR, 3789--3799."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01786"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766988"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591493"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276451"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.59"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130880"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV51458.2022.00402"},{"key":"e_1_2_2_24_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01204"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.3724\/SP.J.1089.2023-00376"},{"key":"e_1_2_2_27_1","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision. 18547--18557","author":"Li Zongcheng","year":"2023","unstructured":"Zongcheng Li, Xiaoxiao Long, Yusen Wang, Tuo Cao, Wenping Wang, Fei Luo, and Chunxia Xiao. 2023b. NeTO: Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracing. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 18547--18557."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00255"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3612160"},{"key":"e_1_2_2_30_1","volume-title":"Neulf: Efficient novel view synthesis with neural 4d light field. arXiv preprint arXiv:2105.07112","author":"Li Zhong","year":"2021","unstructured":"Zhong Li, Liangchen Song, Celong Liu, Junsong Yuan, and Yi Xu. 2021. Neulf: Efficient novel view synthesis with neural 4d light field. arXiv preprint arXiv:2105.07112 (2021)."},{"key":"e_1_2_2_31_1","volume-title":"Computer Graphics Forum","author":"Lin Arvin","unstructured":"Arvin Lin, Yiming Lin, and Abhijeet Ghosh. 2023. Practical Acquisition of Shape and Plausible Appearance of Reflective and Translucent Objects. In Computer Graphics Forum, Vol. 42. Wiley Online Library, e14889."},{"key":"e_1_2_2_32_1","volume-title":"NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images. arXiv preprint arXiv:2305.17398","author":"Liu Yuan","year":"2023","unstructured":"Yuan Liu, Peng Wang, Cheng Lin, Xiaoxiao Long, Jiepeng Wang, Lingjie Liu, Taku Komura, and Wenping Wang. 2023. NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images. arXiv preprint arXiv:2305.17398 (2023)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417815"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19790-1_10"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503250"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-023-0337-5"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530127"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00356"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00554"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01995"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-022-0289-1"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00541"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409071"},{"key":"e_1_2_2_45_1","first-page":"27171","article-title":"NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction","volume":"34","author":"Wang Peng","year":"2021","unstructured":"Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, and Wenping Wang. 2021. NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction. Advances in Neural Information Processing Systems 34 (2021), 27171--27183.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_46_1","first-page":"1966","article-title":"Hf-neus: Improved surface reconstruction using high-frequency details","volume":"35","author":"Wang Yiqun","year":"2022","unstructured":"Yiqun Wang, Ivan Skorokhodov, and Peter Wonka. 2022. Hf-neus: Improved surface reconstruction using high-frequency details. Advances in Neural Information Processing Systems 35 (2022), 1966--1978.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-022-0294-4"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00329"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3013971.3013973"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19769-7_16"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00186"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19821-2_40"},{"key":"e_1_2_2_53_1","first-page":"4805","article-title":"Volume rendering of neural implicit surfaces","volume":"34","author":"Yariv Lior","year":"2021","unstructured":"Lior Yariv, Jiatao Gu, Yoni Kasten, and Yaron Lipman. 2021. Volume rendering of neural implicit surfaces. Advances in Neural Information Processing Systems 34 (2021), 4805--4815.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_54_1","volume-title":"BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis. arXiv preprint arXiv:2302.14859","author":"Yariv Lior","year":"2023","unstructured":"Lior Yariv, Peter Hedman, Christian Reiser, Dor Verbin, Pratul P Srinivasan, Richard Szeliski, Jonathan T Barron, and Ben Mildenhall. 2023. BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis. arXiv preprint arXiv:2302.14859 (2023)."},{"key":"e_1_2_2_55_1","first-page":"3","article-title":"Multiview neural surface reconstruction with implicit lighting and material","volume":"1","author":"Yariv Lior","year":"2020","unstructured":"Lior Yariv, Yoni Kasten, Dror Moran, Meirav Galun, Matan Atzmon, Ronen Basri, and Yaron Lipman. 2020. Multiview neural surface reconstruction with implicit lighting and material. Adv. Neural Inform. Process. Syst 1, 2 (2020), 3.","journal-title":"Adv. Neural Inform. Process. Syst"},{"key":"e_1_2_2_56_1","volume-title":"Ruohan Gao, Thomas Funkhouser, and Jiajun Wu.","author":"Yu Hong-Xing","year":"2023","unstructured":"Hong-Xing Yu, Michelle Guo, Alireza Fathi, Yen-Yu Chang, Eric Ryan Chan, Ruohan Gao, Thomas Funkhouser, and Jiajun Wu. 2023. Learning object-centric neural scattering functions for free-viewpoint relighting and scene composition. arXiv preprint arXiv:2303.06138 (2023)."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3611857"},{"key":"e_1_2_2_58_1","first-page":"29835","article-title":"Ners: Neural reflectance surfaces for sparse-view 3d reconstruction in the wild","volume":"34","author":"Zhang Jason","year":"2021","unstructured":"Jason Zhang, Gengshan Yang, Shubham Tulsiani, and Deva Ramanan. 2021c. Ners: Neural reflectance surfaces for sparse-view 3d reconstruction in the wild. Advances in Neural Information Processing Systems 34 (2021), 29835--29847.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_59_1","volume-title":"Inter-Reflectable Light Fields for Geometry and Material Estimation. arXiv preprint arXiv:2303.17147","author":"Zhang Jingyang","year":"2023","unstructured":"Jingyang Zhang, Yao Yao, Shiwei Li, Jingbo Liu, Tian Fang, David McKinnon, Yanghai Tsin, and Long Quan. 2023b. NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimation. arXiv preprint arXiv:2303.17147 (2023)."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00548"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00541"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480500"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.02095"},{"key":"e_1_2_2_65_1","first-page":"15203","article-title":"Neural relightable participating media rendering","volume":"34","author":"Zheng Quan","year":"2021","unstructured":"Quan Zheng, Gurprit Singh, and Hans-Peter Seidel. 2021. Neural relightable participating media rendering. Advances in Neural Information Processing Systems 34 (2021), 15203--15215.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00284"},{"key":"e_1_2_2_67_1","volume-title":"Neural Relighting with Subsurface Scattering by Learning the Radiance Transfer Gradient. arXiv preprint arXiv:2306.09322","author":"Zhu Shizhan","year":"2023","unstructured":"Shizhan Zhu, Shunsuke Saito, Aljaz Bozic, Carlos Aliaga, Trevor Darrell, and Christop Lassner. 2023. Neural Relighting with Subsurface Scattering by Learning the Radiance Transfer Gradient. arXiv preprint arXiv:2306.09322 (2023)."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658186","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658186","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:16Z","timestamp":1750291456000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":67,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,7,19]]}},"alternative-id":["10.1145\/3658186"],"URL":"https:\/\/doi.org\/10.1145\/3658186","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,19]]},"assertion":[{"value":"2024-07-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}