{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T11:16:52Z","timestamp":1769599012142,"version":"3.49.0"},"reference-count":48,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2019,8,20]],"date-time":"2019-08-20T00:00:00Z","timestamp":1566259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Mobile Mapping is an efficient technology to acquire spatial data of the environment. The spatial data is fundamental for applications in crisis management, civil engineering or autonomous driving. The extrinsic calibration of the Mobile Mapping System is a decisive factor that affects the quality of the spatial data. Many existing extrinsic calibration approaches require the use of artificial targets in a time-consuming calibration procedure. Moreover, they are usually designed for a specific combination of sensors and are, thus, not universally applicable. We introduce a novel extrinsic self-calibration algorithm, which is fully automatic and completely data-driven. The fundamental assumption of the self-calibration is that the calibration parameters are estimated the best when the derived point cloud represents the real physical circumstances the best. The cost function we use to evaluate this is based on geometric features which rely on the 3D structure tensor derived from the local neighborhood of each point. We compare different cost functions based on geometric features and a cost function based on the R\u00e9nyi quadratic entropy to evaluate the suitability for the self-calibration. Furthermore, we perform tests of the self-calibration on synthetic and two different real datasets. The real datasets differ in terms of the environment, the scale and the utilized sensors. We show that the self-calibration is able to extrinsically calibrate Mobile Mapping Systems with different combinations of mapping and pose estimation sensors such as a 2D laser scanner to a Motion Capture System and a 3D laser scanner to a stereo camera and ORB-SLAM2. For the first dataset, the parameters estimated by our self-calibration lead to a more accurate point cloud than two comparative approaches. For the second dataset, which has been acquired via a vehicle-based mobile mapping, our self-calibration achieves comparable results to a manually refined reference calibration, while it is universally applicable and fully automated.<\/jats:p>","DOI":"10.3390\/rs11161955","type":"journal-article","created":{"date-parts":[[2019,8,21]],"date-time":"2019-08-21T11:19:06Z","timestamp":1566386346000},"page":"1955","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Automatic Extrinsic Self-Calibration of Mobile Mapping Systems Based on Geometric 3D Features"],"prefix":"10.3390","volume":"11","author":[{"given":"Markus","family":"Hillemann","sequence":"first","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76131 Karlsruhe, Germany"},{"name":"Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB, 76275 Ettlingen, Germany"}]},{"given":"Martin","family":"Weinmann","sequence":"additional","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76131 Karlsruhe, Germany"}]},{"given":"Markus S.","family":"Mueller","sequence":"additional","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76131 Karlsruhe, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4322-3074","authenticated-orcid":false,"given":"Boris","family":"Jutzi","sequence":"additional","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76131 Karlsruhe, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,20]]},"reference":[{"key":"ref_1","unstructured":"Zhang, Q., and Pless, R. (October, January 28). Extrinsic Calibration of a Camera and Laser Range Finder (Improves Camera Calibration). Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Sendai, Japan."},{"key":"ref_2","unstructured":"Kassir, A., and Peynot, T. (2010, January 1\u20133). Reliable automatic camera-laser calibration. Proceedings of the 2010 Australasian Conference on Robotics and Automation (ARAA), Brisbane, Australia."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2097","DOI":"10.1109\/TPAMI.2012.18","article-title":"A Minimal Solution for the Extrinsic Calibration of a Camera and a Laser-Rangefinder","volume":"34","author":"Vasconcelos","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.isprsjprs.2015.01.016","article-title":"Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers","volume":"105","author":"Weinmann","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"177","DOI":"10.5194\/isprs-annals-III-3-177-2016","article-title":"Fast semantic segmentation of 3D point clouds with strongly varying density","volume":"3","author":"Hackel","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.autcon.2018.01.014","article-title":"4-Plane congruent sets for automatic registration of as-is 3D point clouds with 3D BIM models","volume":"89","author":"Bueno","year":"2018","journal-title":"Autom. Constr."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Frome, A., Huber, D., Kolluri, R., B\u00fclow, T., and Malik, J. (2004, January 11\u201314). Recognizing objects in range data using regional point descriptors. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24672-5_18"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1177\/0278364911429475","article-title":"Self-calibration for a 3D laser","volume":"31","author":"Sheehan","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_9","first-page":"777","article-title":"Improved Accurate Extrinsic Calibration Algorithm of Camera and Two-dimensional Laser Scanner","volume":"8-6","author":"Kong","year":"2013","journal-title":"J. Multimed."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"367","DOI":"10.5772\/56985","article-title":"Separated Calibration of a Camera and a Laser Rangefinder for Robotic Heterogeneous Sensors","volume":"10-10","author":"Yu","year":"2013","journal-title":"J. Adv. Robot. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/TIM.2016.2518248","article-title":"Extrinsic Calibration of 2-D Laser Rangefinder and Camera From Single Shot Based on Minimal Solution","volume":"65","author":"Hu","year":"2016","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sim, S., Sock, J., and Kwak, K. (2016). Indirect Correspondence-Based Robust Extrinsic Calibration of LiDAR and Camera. Sensors, 16.","DOI":"10.3390\/s16060933"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Dong, W., and Isler, V. (June, January 29). A novel method for the extrinsic calibration of a 2-D laser-rangefinder & a camera. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989596"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2270","DOI":"10.1364\/AO.55.002270","article-title":"Flexible extrinsic calibration of a camera and a two-dimensional laser rangefinder with a folding pattern","volume":"55","author":"Li","year":"2016","journal-title":"Appl. Opt."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chen, Z., Yang, X., Zhang, C., and Jiang, S. (2016, January 15\u201317). Extrinsic calibration of a laser range finder and a camera based on the automatic detection of line feature. Proceedings of the 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Datong, China.","DOI":"10.1109\/CISP-BMEI.2016.7852753"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1109\/JSEN.2013.2284789","article-title":"A New Minimal Solution for the Extrinsic Calibration of a 2D LIDAR and a Camera Using Three Plane-Line Correspondences","volume":"14","author":"Zhou","year":"2014","journal-title":"IEEE Sens. J."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tulsuk, P., Srestasathiern, P., Ruchanurucks, M., Phatrapornnant, T., and Nagahashi, H. (2014, January 8\u201311). A novel method for extrinsic parameters estimation between a single-line scan LiDAR and a camera. Proceedings of the 2014 IEEE Intelligent Vehicles Symposium, Dearborn, MI, USA.","DOI":"10.1109\/IVS.2014.6856408"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"17","DOI":"10.5194\/isprs-annals-IV-2-W3-17-2017","article-title":"UCalMiCeL\u2013Unified intrinsic and extrinsic calibration of a Multi-Camera-System and a Laserscanner","volume":"4","author":"Hillemann","year":"2017","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_19","unstructured":"Talaya, J., Alamus, R., Bosch, E., Serra, A., Kornus, W., and Baron, A. (2004, January 12\u201323). Integration of a terrestrial laser scanner with GPS\/IMU orientation sensors. Proceedings of the XXth ISPRS Congress, Istanbul, Turkey."},{"key":"ref_20","first-page":"185","article-title":"High precision kinematic surveying with laser scanners","volume":"1-4","year":"2007","journal-title":"J. Appl. Geod."},{"key":"ref_21","first-page":"227","article-title":"Development, calibration and evaluation of a portable and direct georeferenced laser scanning system for kinematic 3D mapping","volume":"9-4","author":"Heinz","year":"2015","journal-title":"J. Appl. Geod."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"10292","DOI":"10.3390\/s150510292","article-title":"Bore-sight calibration of multiple laser range finders for kinematic 3D laser scanning systems","volume":"15","author":"Jung","year":"2015","journal-title":"Sensors"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.isprsjprs.2006.07.003","article-title":"Rigorous approach to bore-sight self-calibration in airborne laser scanning","volume":"61","author":"Skaloud","year":"2006","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"9069","DOI":"10.3390\/s110909069","article-title":"Geometric calibration and radiometric correction of LiDAR data and their impact on the quality of derived products","volume":"11","author":"Habib","year":"2011","journal-title":"Sensors"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0262-8856(92)90066-C","article-title":"Object modelling by registration of multiple range images","volume":"10","author":"Chen","year":"1992","journal-title":"Image Vis. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ravi, R., Shamseldin, T., Elbahnasawy, M., Lin, Y.J., and Habib, A. (2018). Bias Impact Analysis and Calibration of UAV-Based Mobile LiDAR System with Spinning Multi-Beam Laser Scanner. Appl. Sci., 8.","DOI":"10.3390\/app8020297"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Maddern, W., Harrison, A., and Newman, P. (2012, January 14\u201318). Lost in translation (and rotation): Rapid extrinsic calibration for 2D and 3D LIDARs. Proceedings of the 2012 IEEE International Conference on Proceedings of the Robotics and Automation (ICRA), Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224607"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, F., Syeda-Mahmood, T., Vemuri, B.C., Beymer, D., and Rangarajan, A. (2009, January 20\u201324). Closed-form Jensen-Renyi divergence for mixture of Gaussians and applications to group-wise shape registration. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, London, UK.","DOI":"10.1007\/978-3-642-04268-3_80"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1177\/0278364916679498","article-title":"1 year, 1000 km: The Oxford RobotCar dataset","volume":"36","author":"Maddern","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_31","first-page":"4","article-title":"Nearest neighbour classification on laser point clouds to gain object structures from buildings","volume":"38","author":"Jutzi","year":"2009","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1117\/12.542536","article-title":"Context-driven automated target detection in 3-D data","volume":"Volume 5426","author":"West","year":"2004","journal-title":"Automatic Target Recognition XIV"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1111\/1467-8659.00675","article-title":"Multi-scale feature extraction on point-sampled surfaces","volume":"22","author":"Pauly","year":"2003","journal-title":"Comput. Graph. Forum"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.isprsjprs.2017.02.012","article-title":"Analytical and numerical investigations on the accuracy and robustness of geometric features extracted from 3D point cloud data","volume":"126","author":"Dittrich","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Munoz, D., Bagnell, J.A., Vandapel, N., and Hebert, M. (2009, January 20\u201325). Contextual classification with functional max-margin Markov networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206590"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Koziel, S., Leifsson, L., and Yang, X.-S. (2014). Automated classification of airborne laser scanning point clouds. Solving Computationally Expensive Engineering Problems: Methods and Applications, Springer.","DOI":"10.1007\/978-3-319-08985-0"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1109\/34.765655","article-title":"Using spin images for efficient object recognition in cluttered 3d scenes","volume":"21","author":"Johnson","year":"1999","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tombari, F., Salti, S., and Di Stefano, L. (2010, January 5\u201311). Unique signatures of histograms for local surface description. Proceedings of the European Conference on Computer Vision, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15558-1_26"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.cviu.2014.04.011","article-title":"SHOT: unique signatures of histograms for surface and texture description","volume":"125","author":"Salti","year":"2014","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1145\/571647.571648","article-title":"Shape distributions","volume":"21","author":"Osada","year":"2002","journal-title":"ACM Trans. Graph."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12\u201317). Fast point feature histograms (FPFH) for 3D registration. Proceedings of the IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152473"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s13218-010-0059-6","article-title":"Semantic 3D object maps for everyday manipulation in human living environments","volume":"24","author":"Rusu","year":"2010","journal-title":"K\u00fcnstl. Intell. (KI)"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Huber, P.J. (2011). Robust statistics. International Encyclopedia of Statistical Science, Springer.","DOI":"10.1007\/978-3-642-04898-2_594"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The KITTI vision benchmark suite. Proceedings of the 2012 IEEE Conference on Proceedings of the Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_46","unstructured":"Geiger, A., Lenz, P., Stiller, C., and Urtasun, R. (2019, July 23). Visual Odometry\/SLAM Evaluation 2012. Available online: http:\/\/www.cvlibs.net\/datasets\/kitti\/eval_odometry.php."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Geiger, A., Moosmann, F., Car, O., and Schuster, B. (2012, January 14\u201318). Automatic camera and range sensor calibration using a single shot. Proceedings of the International Conference on Robotics and Automation (ICRA), Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224570"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"107","DOI":"10.5194\/isprs-annals-IV-1-W1-107-2017","article-title":"An Approach to Extract Moving Objects from MLS Data Using a Volumetric Background Representation","volume":"4","author":"Gehrung","year":"2017","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/16\/1955\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:12:33Z","timestamp":1760188353000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/16\/1955"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,20]]},"references-count":48,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["rs11161955"],"URL":"https:\/\/doi.org\/10.3390\/rs11161955","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,20]]}}}