{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T03:31:07Z","timestamp":1764646267146,"version":"3.38.0"},"reference-count":58,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2020,7,15]],"date-time":"2020-07-15T00:00:00Z","timestamp":1594771200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/L015897\/1"],"award-info":[{"award-number":["EP\/L015897\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/M019918\/1"],"award-info":[{"award-number":["EP\/M019918\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010687","name":"H2020 Euratom","doi-asserted-by":"publisher","award":["633053"],"award-info":[{"award-number":["633053"]}],"id":[{"id":"10.13039\/100010687","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2022,5]]},"abstract":"<jats:p> We provide the theory and the system needed to create large-scale dense reconstructions for mobile-robotics applications: this stands in contrast to the object-centric reconstructions dominant in the literature. Our BOR<jats:sup>2<\/jats:sup>G system fuses data from multiple sensor modalities (cameras, lidars, or both) and regularizes the resulting 3D model. We use a compressed 3D data structure, which allows us to operate over a large scale. In addition, because of the paucity of surface observations by the camera and lidar sensors, we regularize over both two (camera depth maps) and three dimensions (voxel grid) to provide a local contextual prior for the reconstruction. Our regularizer reduces the median error between 27% and 36% in 7.3 km of dense reconstructions with a median accuracy between 4 and 8 cm. Our pipeline does not end with regularization. We take the unusual step to apply a learned correction mechanism that takes the global context of the reconstruction and adjusts the constructed mesh, addressing errors that are pathological to the first-pass camera-derived reconstruction. We evaluate our system using the Stanford Burghers of Calais, Imperial College ICL-NUIM, Oxford Broad Street (released with this paper), and the KITTI datasets. These latter datasets see us operating at a combined scale and accuracy not seen in the literature. We provide statistics for the metric errors in all surfaces created compared with those measured with 3D lidar as ground truth. We demonstrate our system in practice by reconstructing the inside of the EUROfusion Joint European Torus (JET) fusion reactor, located at the Culham Centre for Fusion Energy (UK Atomic Energy Authority) in Oxfordshire. <\/jats:p>","DOI":"10.1177\/0278364920937052","type":"journal-article","created":{"date-parts":[[2020,7,15]],"date-time":"2020-07-15T11:26:37Z","timestamp":1594812397000},"page":"637-663","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Large-scale outdoor scene reconstruction and correction with vision"],"prefix":"10.1177","volume":"41","author":[{"given":"Michael","family":"Tanner","sequence":"first","affiliation":[{"name":"Oxford Robotics Institute, University of Oxford, UK"}]},{"given":"Pedro","family":"Pini\u00e9s","sequence":"additional","affiliation":[{"name":"Oxford Robotics Institute, University of Oxford, UK"}]},{"given":"Lina Mar\u00eda","family":"Paz","sequence":"additional","affiliation":[{"name":"Oxford Robotics Institute, University of Oxford, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9414-5571","authenticated-orcid":false,"given":"\u015etefan","family":"S\u0103ftescu","sequence":"additional","affiliation":[{"name":"Oxford Robotics Institute, University of Oxford, UK"}]},{"given":"Alex","family":"Bewley","sequence":"additional","affiliation":[{"name":"Oxford Robotics Institute, University of Oxford, UK"}]},{"given":"Emil","family":"Jonasson","sequence":"additional","affiliation":[{"name":"RACE, UK Atomic Energy Authority, Abingdon, UK"}]},{"given":"Paul","family":"Newman","sequence":"additional","affiliation":[{"name":"Oxford Robotics Institute, University of Oxford, UK"}]}],"member":"179","published-online":{"date-parts":[[2020,7,15]]},"reference":[{"doi-asserted-by":"publisher","key":"bibr1-0278364920937052","DOI":"10.1109\/ICCV.2009.5459148"},{"key":"bibr2-0278364920937052","first-page":"00652","volume":"87","author":"Amanatides J","year":"1987","journal-title":"Eurographics"},{"doi-asserted-by":"publisher","key":"bibr3-0278364920937052","DOI":"10.1109\/MC.2010.170"},{"doi-asserted-by":"publisher","key":"bibr4-0278364920937052","DOI":"10.3390\/s141120882"},{"doi-asserted-by":"publisher","key":"bibr5-0278364920937052","DOI":"10.1017\/CBO9780511804441"},{"doi-asserted-by":"publisher","key":"bibr6-0278364920937052","DOI":"10.1137\/090769521"},{"doi-asserted-by":"publisher","key":"bibr7-0278364920937052","DOI":"10.1109\/TPAMI.1986.4767851"},{"doi-asserted-by":"publisher","key":"bibr8-0278364920937052","DOI":"10.1007\/s10851-010-0251-1"},{"doi-asserted-by":"publisher","key":"bibr9-0278364920937052","DOI":"10.1145\/2461912.2461940"},{"doi-asserted-by":"publisher","key":"bibr10-0278364920937052","DOI":"10.1109\/CVPR.2015.7299195"},{"doi-asserted-by":"publisher","key":"bibr11-0278364920937052","DOI":"10.1145\/237170.237269"},{"doi-asserted-by":"publisher","key":"bibr12-0278364920937052","DOI":"10.1109\/IROS.2015.7353631"},{"unstructured":"Felzenszwalb P, Huttenlocher D (2004) Distance transforms of sampled functions. Technical report, Cornell University.","key":"bibr13-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr14-0278364920937052","DOI":"10.1109\/CVPR.2010.5539802"},{"doi-asserted-by":"publisher","key":"bibr15-0278364920937052","DOI":"10.1109\/CVPR.2012.6248074"},{"doi-asserted-by":"publisher","key":"bibr16-0278364920937052","DOI":"10.1109\/CVPR.2017.699"},{"doi-asserted-by":"publisher","key":"bibr17-0278364920937052","DOI":"10.1137\/110823766"},{"doi-asserted-by":"publisher","key":"bibr18-0278364920937052","DOI":"10.1109\/CVPR.2015.7299044"},{"unstructured":"Handa A, Newcombe RA, Angeli A, Davison AJ (2011) Applications of Legendre\u2013Fenchel transformation to computer vision problems. Technical Report DTR11-7, Department of Computing, Imperial College, London.","key":"bibr19-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr20-0278364920937052","DOI":"10.1109\/ICRA.2014.6907054"},{"year":"2016","author":"He K","journal-title":"Computer Vision and Pattern Recognition (CVPR)","key":"bibr21-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr22-0278364920937052","DOI":"10.1109\/ICCV.2013.293"},{"doi-asserted-by":"publisher","key":"bibr23-0278364920937052","DOI":"10.1109\/DigitalHeritage.2015.7419578"},{"volume-title":"International Conference on Learning Representations (ICLR)","year":"2015","author":"Kingma D","key":"bibr24-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr25-0278364920937052","DOI":"10.15607\/RSS.2015.XI.040"},{"doi-asserted-by":"publisher","key":"bibr26-0278364920937052","DOI":"10.1109\/ICCV.2013.122"},{"doi-asserted-by":"publisher","key":"bibr27-0278364920937052","DOI":"10.1109\/3DV.2016.32"},{"doi-asserted-by":"publisher","key":"bibr28-0278364920937052","DOI":"10.1145\/37401.37422"},{"doi-asserted-by":"publisher","key":"bibr29-0278364920937052","DOI":"10.1109\/IVS.2014.6856471"},{"doi-asserted-by":"publisher","key":"bibr30-0278364920937052","DOI":"10.1109\/CVPR.2018.00594"},{"year":"2012","author":"Moussa W","journal-title":"EuroMed","key":"bibr31-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr32-0278364920937052","DOI":"10.1109\/TRO.2015.2463671"},{"doi-asserted-by":"publisher","key":"bibr33-0278364920937052","DOI":"10.1109\/ISMAR.2011.6092378"},{"doi-asserted-by":"publisher","key":"bibr34-0278364920937052","DOI":"10.1109\/ICCV.2011.6126513"},{"doi-asserted-by":"publisher","key":"bibr35-0278364920937052","DOI":"10.1145\/2508363.2508374"},{"doi-asserted-by":"publisher","key":"bibr36-0278364920937052","DOI":"10.1007\/978-0-387-40065-5_10"},{"doi-asserted-by":"publisher","key":"bibr37-0278364920937052","DOI":"10.1090\/conm\/443\/08555"},{"doi-asserted-by":"publisher","key":"bibr38-0278364920937052","DOI":"10.1109\/ICRA.2015.7138991"},{"doi-asserted-by":"publisher","key":"bibr39-0278364920937052","DOI":"10.1109\/ICCV.2011.6126441"},{"doi-asserted-by":"publisher","key":"bibr40-0278364920937052","DOI":"10.1007\/s11263-007-0086-4"},{"doi-asserted-by":"publisher","key":"bibr41-0278364920937052","DOI":"10.1109\/IVS.2012.6232171"},{"doi-asserted-by":"publisher","key":"bibr42-0278364920937052","DOI":"10.1109\/CVPR.2017.701"},{"doi-asserted-by":"publisher","key":"bibr43-0278364920937052","DOI":"10.1515\/9781400873173"},{"year":"2015","author":"Ronneberger O","journal-title":"Medical Image Computing and Computer Assisted Intervention (MICCAI)","key":"bibr44-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr45-0278364920937052","DOI":"10.1023\/A:1014573219977"},{"doi-asserted-by":"publisher","key":"bibr46-0278364920937052","DOI":"10.1109\/3DV.2015.40"},{"key":"bibr47-0278364920937052","first-page":"2217","volume-title":"International Conference on Machine Learning (ICML)","author":"Shang W","year":"2016"},{"doi-asserted-by":"publisher","key":"bibr48-0278364920937052","DOI":"10.1109\/ICRA.2012.6224750"},{"volume-title":"International Conference on Field and Service Robotics (FSR)","year":"2015","author":"Tanner M","key":"bibr49-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr50-0278364920937052","DOI":"10.1109\/ICRA.2016.7487230"},{"doi-asserted-by":"publisher","key":"bibr51-0278364920937052","DOI":"10.1109\/ICRA.2018.8460977"},{"volume-title":"RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras","year":"2012","author":"Whelan T","key":"bibr52-0278364920937052"},{"doi-asserted-by":"publisher","key":"bibr53-0278364920937052","DOI":"10.1177\/0278364914551008"},{"doi-asserted-by":"publisher","key":"bibr54-0278364920937052","DOI":"10.1007\/s11263-014-0711-y"},{"doi-asserted-by":"publisher","key":"bibr55-0278364920937052","DOI":"10.1007\/BFb0028345"},{"key":"bibr56-0278364920937052","volume-title":"Proceedings of the International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT)","volume":"1","author":"Zach C","year":"2008"},{"doi-asserted-by":"publisher","key":"bibr57-0278364920937052","DOI":"10.1109\/ICCV.2007.4408983"},{"doi-asserted-by":"publisher","key":"bibr58-0278364920937052","DOI":"10.1145\/2461912.2461919"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364920937052","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0278364920937052","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364920937052","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,27]],"date-time":"2025-02-27T18:57:54Z","timestamp":1740682674000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364920937052"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,15]]},"references-count":58,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,5]]}},"alternative-id":["10.1177\/0278364920937052"],"URL":"https:\/\/doi.org\/10.1177\/0278364920937052","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"type":"print","value":"0278-3649"},{"type":"electronic","value":"1741-3176"}],"subject":[],"published":{"date-parts":[[2020,7,15]]}}}