{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:04:20Z","timestamp":1777658660614,"version":"3.51.4"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T00:00:00Z","timestamp":1651104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2019YFB1707501"],"award-info":[{"award-number":["2019YFB1707501"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61772267"],"award-info":[{"award-number":["61772267"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"crossref","award":["BK20190016"],"award-info":[{"award-number":["BK20190016"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,6,30]]},"abstract":"<jats:p>Reconstruction of high-fidelity 3D objects or scenes is a fundamental research problem. Recent advances in RGB-D fusion have demonstrated the potential of producing 3D models from consumer-level RGB-D cameras. However, due to the discrete nature and limited resolution of their surface representations (e.g., point or voxel based), existing approaches suffer from the accumulation of errors in camera tracking and distortion in the reconstruction, which leads to an unsatisfactory 3D reconstruction. In this article, we present a method using on-the-fly implicits of Hermite Radial Basis Functions (HRBFs) as a continuous surface representation for camera tracking in an existing RGB-D fusion framework. Furthermore, curvature estimation and confidence evaluation are coherently derived from the inherent surface properties of the on-the-fly HRBF implicits, which are devoted to a data fusion with better quality. We argue that our continuous but on-the-fly surface representation can effectively mitigate the impact of noise with its robustness and constrain the reconstruction with inherent surface smoothness when being compared with discrete representations. Experimental results on various real-world and synthetic datasets demonstrate that our HRBF-fusion outperforms the state-of-the-art approaches in terms of tracking robustness and reconstruction accuracy.<\/jats:p>","DOI":"10.1145\/3516521","type":"journal-article","created":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T21:17:19Z","timestamp":1645651039000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["HRBF-Fusion: Accurate 3D Reconstruction from RGB-D Data Using On-the-fly Implicits"],"prefix":"10.1145","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1919-8673","authenticated-orcid":false,"given":"Yabin","family":"Xu","sequence":"first","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics, Nanjing, China \/ Delft University of Technology, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5629-9975","authenticated-orcid":false,"given":"Liangliang","family":"Nan","sequence":"additional","affiliation":[{"name":"Delft University of Technology, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laishui","family":"Zhou","sequence":"additional","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4406-8480","authenticated-orcid":false,"given":"Charlie C. L.","family":"Wang","sequence":"additional","affiliation":[{"name":"The University of Manchester, United Kingdom \/ Delft University of Technology, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,4,28]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121791"},{"key":"e_1_3_3_3_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611971484"},{"key":"e_1_3_3_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.400574"},{"key":"e_1_3_3_5_1","article-title":"Transformerfusion: Monocular RGB scene reconstruction using transformers","volume":"34","author":"Bozic A.","year":"2021","unstructured":"A. Bozic, P. Palafox, J. Thies, A. Dai, and M. Nie\u00dfner. 2021. Transformerfusion: Monocular RGB scene reconstruction using transformers. Advances in Neural Information Processing Systems 34 (2021), 17.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3182157"},{"key":"e_1_3_3_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383266"},{"key":"e_1_3_3_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461940"},{"key":"e_1_3_3_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299195"},{"key":"e_1_3_3_10_1","unstructured":"S. Choi Q. Zhou S. Miller and V. Koltun. 2016. A Large Dataset of Object Scans. (2016). arxiv:cs.CV\/1602.02481."},{"key":"e_1_3_3_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237269"},{"key":"e_1_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.261"},{"key":"e_1_3_3_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3054739"},{"key":"e_1_3_3_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.201"},{"key":"e_1_3_3_15_1","first-page":"714\u2013 730","volume-title":"Computer Vision (ECCV\u201918)","author":"Dong W.","year":"2018","unstructured":"W. Dong, Q. Wang, X. Wang, and H. Zha. 2018. PSDF fusion: Probabilistic signed distance function for on-the-fly 3D data fusion and scene reconstruction. In Computer Vision (ECCV\u201918), Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss (Eds.). Springer International Publishing, Cham, 714\u2013 730."},{"key":"e_1_3_3_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2012.6225199"},{"key":"e_1_3_3_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.183"},{"key":"e_1_3_3_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6906584"},{"key":"e_1_3_3_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/1926258.1926260"},{"key":"e_1_3_3_20_1","first-page":"279","article-title":"Three-dimensional registration using range and intensity information","volume":"2350","author":"Godin G.","year":"1994","unstructured":"G. Godin, M. Rioux, and R. Baribeau. 1994. Three-dimensional registration using range and intensity information. Proceedings of SPIE - The International Society for Optical Engineering 2350 (1994), 279\u2013290.","journal-title":"Proceedings of SPIE - The International Society for Optical Engineering"},{"key":"e_1_3_3_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/966131.966134"},{"key":"e_1_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6907054"},{"key":"e_1_3_3_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911434148"},{"key":"e_1_3_3_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00882"},{"key":"e_1_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3137912"},{"key":"e_1_3_3_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.223"},{"key":"e_1_3_3_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2013.9"},{"key":"e_1_3_3_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2013.6696650"},{"key":"e_1_3_3_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"e_1_3_3_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2648803"},{"key":"e_1_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508407"},{"key":"e_1_3_3_32_1","article-title":"Neural sparse voxel fields","author":"Liu L.","year":"2020","unstructured":"L. Liu, Kyaw Z. Gu, J. Lin, T. Chua, and C. Theobalt. 2020. Neural sparse voxel fields. In NeurIPS.","journal-title":"NeurIPS"},{"key":"e_1_3_3_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00183"},{"key":"e_1_3_3_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2016.05.001"},{"key":"e_1_3_3_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2010.01785.x"},{"key":"e_1_3_3_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-018-0121-0"},{"key":"e_1_3_3_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2013.6696881"},{"key":"e_1_3_3_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2015.2463671"},{"key":"e_1_3_3_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2017.2705103"},{"key":"e_1_3_3_40_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.03255"},{"key":"e_1_3_3_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"e_1_3_3_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508374"},{"key":"e_1_3_3_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/582753"},{"key":"e_1_3_3_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995550"},{"key":"e_1_3_3_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"e_1_3_3_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/IM.2001.924423"},{"key":"e_1_3_3_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2015.05.006"},{"key":"e_1_3_3_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2947048"},{"key":"e_1_3_3_49_1","first-page":"435","volume-title":"Robotics: Science and Systems","author":"Segal A.","year":"2009","unstructured":"A. Segal, D. Haehnel, and S. Thrun. 2009. Generalized-ICP. In Robotics: Science and Systems, Vol. 2. 435."},{"key":"e_1_3_3_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01237-3_46"},{"key":"e_1_3_3_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6385773"},{"key":"e_1_3_3_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2013.02.008"},{"key":"e_1_3_3_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00617"},{"key":"e_1_3_3_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV50981.2020.00105"},{"key":"e_1_3_3_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01534"},{"key":"e_1_3_3_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-016-0072-2"},{"key":"e_1_3_3_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2016.7477636"},{"key":"e_1_3_3_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00494"},{"key":"e_1_3_3_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00318"},{"key":"e_1_3_3_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2009.5457479"},{"key":"e_1_3_3_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02123482"},{"key":"e_1_3_3_62_1","volume-title":"RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras","author":"Whelan T.","year":"2012","unstructured":"T. Whelan, M. Kaess, M. F. Fallon, H. Johannsson, J. J. Leonard, and J. B. McDonald. 2012. Kintinuous: Spatially extended KinectFusion. In RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras. Sydney, Australia."},{"key":"e_1_3_3_63_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364916669237"},{"key":"e_1_3_3_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661242"},{"key":"e_1_3_3_65_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13282"},{"key":"e_1_3_3_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3389412"},{"key":"e_1_3_3_67_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17102260"},{"key":"e_1_3_3_68_1","first-page":"72","article-title":"Curvature estimation of 3D point cloud surfaces through the fitting of normal section curvatures","author":"Zhang X.","year":"2008","unstructured":"X. Zhang, H. Li, and Z. Cheng. 2008. Curvature estimation of 3D point cloud surfaces through the fitting of normal section curvatures. In Proceedings of AsiaGraph 2008, 72\u201379.","journal-title":"Proceedings of AsiaGraph 2008"},{"key":"e_1_3_3_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2768821"},{"key":"e_1_3_3_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461919"},{"key":"e_1_3_3_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298662"},{"key":"e_1_3_3_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.65"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3516521","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3516521","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:49:23Z","timestamp":1750193363000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3516521"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,28]]},"references-count":71,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,6,30]]}},"alternative-id":["10.1145\/3516521"],"URL":"https:\/\/doi.org\/10.1145\/3516521","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,28]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}