{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T17:20:05Z","timestamp":1771521605939,"version":"3.50.1"},"reference-count":49,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,4,11]],"date-time":"2017-04-11T00:00:00Z","timestamp":1491868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A mobile mapping system (MMS) is usually utilized to collect environmental data on and around urban roads. Laser scanners and panoramic cameras are the main sensors of an MMS. This paper presents a new method for the registration of the point clouds and panoramic images based on sensor constellation. After the sensor constellation was analyzed, a feature point, the intersection of the connecting line between the global positioning system (GPS) antenna and the panoramic camera with a horizontal plane, was utilized to separate the point clouds into blocks. The blocks for the central and sideward laser scanners were extracted with the segmentation feature points. Then, the point clouds located in the blocks were separated from the original point clouds. Each point in the blocks was used to find the accurate corresponding pixel in the relative panoramic images via a collinear function, and the position and orientation relationship amongst different sensors. A search strategy is proposed for the correspondence of laser scanners and lenses of panoramic cameras to reduce calculation complexity and improve efficiency. Four cases of different urban road types were selected to verify the efficiency and accuracy of the proposed method. Results indicate that most of the point clouds (with an average of 99.7%) were successfully registered with the panoramic images with great efficiency. Geometric evaluation results indicate that horizontal accuracy was approximately 0.10\u20130.20 m, and vertical accuracy was approximately 0.01\u20130.02 m for all cases. Finally, the main factors that affect registration accuracy, including time synchronization amongst different sensors, system positioning and vehicle speed, are discussed.<\/jats:p>","DOI":"10.3390\/s17040837","type":"journal-article","created":{"date-parts":[[2017,4,11]],"date-time":"2017-04-11T11:41:42Z","timestamp":1491910902000},"page":"837","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Registration of Vehicle-Borne Point Clouds and Panoramic Images Based on Sensor Constellations"],"prefix":"10.3390","volume":"17","author":[{"given":"Lianbi","family":"Yao","sequence":"first","affiliation":[{"name":"College of Surveying and Geoinformatics, Tongji University, Shanghai 200092, China"}]},{"given":"Hangbin","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Surveying and Geoinformatics, Tongji University, Shanghai 200092, China"}]},{"given":"Yayun","family":"Li","sequence":"additional","affiliation":[{"name":"College of Surveying and Geoinformatics, Tongji University, Shanghai 200092, China"}]},{"given":"Bin","family":"Meng","sequence":"additional","affiliation":[{"name":"College of Surveying and Geoinformatics, Tongji University, Shanghai 200092, China"}]},{"given":"Jinfei","family":"Qian","sequence":"additional","affiliation":[{"name":"College of Surveying and Geoinformatics, Tongji University, Shanghai 200092, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9319-1640","authenticated-orcid":false,"given":"Chun","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Surveying and Geoinformatics, Tongji University, Shanghai 200092, China"}]},{"given":"Hongchao","family":"Fan","sequence":"additional","affiliation":[{"name":"Institute of Geography, Heidelberg University, Heidelberg D-69120, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2017,4,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2127","DOI":"10.1016\/j.measurement.2013.03.006","article-title":"Review of mobile mapping and surveying technologies","volume":"46","author":"Puente","year":"2013","journal-title":"Measurement"},{"key":"ref_2","unstructured":"Goad, C. (1991, January 10\u201312). The Ohio State University highway mapping project: The positioning component. Proceedings of the 47th Annual Meeting of the Institute of Navigation, Williamsburg, VA, USA."},{"key":"ref_3","unstructured":"Novak, K. (1991, January 10\u201312). The Ohio State University highway mapping system: The stereo vision system component. Proceedings of the 47th Annual Meeting of The Institute of Navigation, Williamsburg, VA, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.neucom.2016.02.033","article-title":"Local Quality Assessment of Point Clouds for Indoor Mobile Mapping","volume":"196","author":"Huang","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"685","DOI":"10.14358\/PERS.70.6.685","article-title":"Redefining the Paradigm of Modern Mobile Mapping: An Automated High-Precision Road Centerline Mapping System","volume":"70","author":"Toth","year":"2004","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.atmosenv.2015.01.017","article-title":"Mobile monitoring for mapping spatial variation in urban air quality: Development and validation of a methodology based on an extensive dataset","volume":"105","author":"Bossche","year":"2015","journal-title":"Atmos. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.jenvman.2015.12.012","article-title":"Mapping real-time air pollution health risk for environmental management: Combining mobile and stationary air pollution monitoring with neural network models","volume":"168","author":"Adams","year":"2015","journal-title":"J. Environ. Manag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.isprsjprs.2007.03.001","article-title":"Building detection by fusion of airborne laser scanner data and multi-spectral images: Performance evaluation and sensitivity analysis","volume":"62","author":"Rottensteiner","year":"2007","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.isprsjprs.2014.08.001","article-title":"Fusion of imaging spectroscopy and airborne laser scanning data for characterization of forest ecosystems\u2014A review","volume":"97","author":"Torabzadeh","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.optlaseng.2015.09.003","article-title":"Fusion of 3D laser scanner and depth images for obstacle recognition in mobile applications","volume":"77","author":"Budzan","year":"2016","journal-title":"Opt. Laser Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.isprsjprs.2013.10.011","article-title":"Fusion of airborne laserscanning point clouds and images for supervised and unsupervised scene classification","volume":"87","author":"Gerke","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.imavis.2015.02.002","article-title":"Stabilization of panoramic videos from mobile multi-camera platforms","volume":"37","author":"Hamza","year":"2015","journal-title":"Image Vis. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2015.03.005","article-title":"Particle filtering methods for georeferencing panoramic image sequence in complex urban scenes","volume":"105","author":"Ji","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.imavis.2015.06.002","article-title":"Fusion of a panoramic camera and 2D laser scanner data for constrained bundle adjustment in GPS-denied environments","volume":"40","author":"Shi","year":"2015","journal-title":"Image Vis. Comput."},{"key":"ref_15","unstructured":"Uwe, S., Franz, R., Helmut, M., Boris, J., and Matthias, B. (2011). Refined Non-rigid Registration of a Panoramic Image Sequence to a LiDAR Point Cloud. Photogrammetric Image Analysis, Springer. [1st ed.]."},{"key":"ref_16","first-page":"401","article-title":"Registration of vehicle based panoramic image and LiDAR point cloud","volume":"8919","author":"Chen","year":"2013","journal-title":"Proc. SPIE Int. Soc. Opt. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zeng, F., and Zhong, R. (2014, January 22\u201326). The algorithm to generate color point-cloud with the registration between panoramic image and laser point-cloud. Proceedings of the 35th International Symposium on Remote Sensing of Environment, Beijing, China.","DOI":"10.1088\/1755-1315\/17\/1\/012160"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cui, T., Ji, S., Shan, J., Gong, J., and Liu, K. (2016). Line-Based Registration of Panoramic Images and LiDAR Point Clouds for Mobile Mapping. Sensors, 17.","DOI":"10.20944\/preprints201612.0016.v1"},{"key":"ref_19","first-page":"1477","article-title":"Semi-Automated Object Measurement Using Multiple-Image Matching from Mobile Mapping Image Sequences","volume":"66","author":"Tao","year":"2000","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Daniilidis, K., Maragos, P., and Paragios, N. (2010). Efficient Structure from Motion by Graph Optimization. Computer Vision\u2014ECCV 2010; Lecture Notes in Computer Science, Volume 6312, Springer.","DOI":"10.1007\/978-3-642-15561-1"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0262-8856(92)90066-C","article-title":"Object modelling by registration of multiple range images","volume":"10","author":"Chen","year":"1992","journal-title":"Image Vis. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1006\/cviu.1995.1024","article-title":"A robust method for registration and segmentation of multiple range images","volume":"61","author":"Masuda","year":"1995","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"6260","DOI":"10.3390\/rs5126260","article-title":"Semi-Automatic Registration of Airborne and Terrestrial Laser Scanning Data Using Building Corner Matching with Boundaries as Reliability Check","volume":"5","author":"Cheng","year":"2013","journal-title":"Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhong, L., Tong, L., Chen, Y., Wang, Y., Li, M., and Cheng, L. (2013, January 20\u201322). An automatic technique for registering airborne and terrestrial LiDAR data, in Geoinformatics. Proceedings of the IEEE 21st International Conference on Geoinformatics, Kaifeng, China.","DOI":"10.1109\/Geoinformatics.2013.6626163"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"083587","DOI":"10.1117\/1.JRS.8.083587","article-title":"Feature-constrained registration of building point clouds acquired by terrestrial and airborne laser scanners","volume":"8","author":"Wu","year":"2014","journal-title":"J. Appl. Remote Sens."},{"key":"ref_27","first-page":"49","article-title":"Automatic Registration of Multiple Laser Scans using Panoramic RGB and Intensity Images","volume":"3812","author":"Alba","year":"2011","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.isprsjprs.2011.09.010","article-title":"Fast and automatic image-based registration of TLS data","volume":"66","author":"Weinmann","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wu, H., and Fan, H. (2016). Registration of airborne LiDAR point clouds by matching the linear plane features of building roof facets. Remote Sens., 8.","DOI":"10.3390\/rs8060447"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s12518-009-0002-4","article-title":"Reliable automatic classification and segmentation of laser point clouds by statistical analysis of surface curvature values","volume":"1","author":"Crosilla","year":"2009","journal-title":"Appl. Geomat."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"13921","DOI":"10.3390\/rs71013921","article-title":"Hierarchical Registration Method for Integration of Airborne and Vehicle LiDAR Data","volume":"7","author":"Cheng","year":"2015","journal-title":"Remote Sens."},{"key":"ref_32","unstructured":"Bouroumand, M., and Studnicka, N. (2004, January 12\u201323). The Fusion of Laser Scanning and Close Range Photogrammetry in Bam. Laser-photogrammetric Mapping of Bam Citadel (ARG-E-BAM) Iran. Proceedings of the ISPRS Commission V, Istanbul, Turkey."},{"key":"ref_33","unstructured":"Reulke, R., and Wehr, A. (2004, January 19\u201322). Mobile panoramic mapping using CCD-line camera and laser scanner with integrated position and orientation system. Proceedings of the ISPRS Workshop Group V\/1, Dresden, Germany."},{"key":"ref_34","unstructured":"R\u00f6nnholm, P. (2011). Registration Quality\u2014Towards Integration of Laser Scanning and Photogrammetry, EuroSDR Official Publication."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"63","DOI":"10.5194\/isprsannals-I-3-63-2012","article-title":"Registration of laser scanning point clouds and aerial images using either artificial or natural tie features","volume":"I-3","year":"2012","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"699","DOI":"10.14358\/PERS.71.6.699","article-title":"Photogrammetric and LiDAR data registration using linear features","volume":"71","author":"Habib","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1879","DOI":"10.1016\/j.isprsjprs.2011.09.004","article-title":"Fusion of camera images and laser scans for wide baseline 3D scene alignment in urban environments","volume":"66","author":"Yang","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, L., and Neumann, U. (2009, January 20\u201325). A robust approach for automatic registration of aerial images with untextured aerial LiDAR data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206600"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1111\/j.1477-9730.2008.00464.x","article-title":"Photogrammetric and lidar data integration using the centroid of a rectangular roof as a control point","volume":"23","author":"Mitishita","year":"2008","journal-title":"Photogramm. Rec."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.cviu.2011.07.009","article-title":"A systematic approach for 2D-image to 3D-range registration in urban environments","volume":"116","author":"Liu","year":"2012","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Mastin, A., Kepner, J., and Fisher, J. (2009, January 20\u201325). Automatic registration of LIDAR and optical images of urban scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206539"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.isprsjprs.2013.11.015","article-title":"Automatic registration of optical imagery with 3D LiDAR data using statistical similarity","volume":"88","author":"Parmehr","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_44","unstructured":"Hough, P. (1962). A Method and Means for Recognizing Complex Patterns. (3069654), U.S. Patent."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.isprsjprs.2014.12.025","article-title":"Automatic registration of UAV-borne sequent images and LiDAR data","volume":"101","author":"Yang","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1109\/LGRS.2005.850534","article-title":"Study of surface brightness from backscattered laser intensity: Calibration of laser data","volume":"2","author":"Kaasalainen","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens. Lett."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1109\/TGRS.2008.2003351","article-title":"Radiometric calibration of LIDAR intensity with commercially available reference targets","volume":"47","author":"Kaasalainen","year":"2009","journal-title":"IEEE Trans. Geosci. Remote"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/LGRS.2013.2274557","article-title":"Radiometrically calibrated features of full-waveform lidar point clouds based on statistical moments","volume":"11","author":"Roncat","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.isprsjprs.2005.12.001","article-title":"Gaussian decomposition and calibration of a novel small-footprint full-waveform digitising airborne laser scanner","volume":"60","author":"Wagner","year":"2006","journal-title":"ISPRS J. Photogramm. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/4\/837\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:32:25Z","timestamp":1760207545000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/4\/837"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,4,11]]},"references-count":49,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,4]]}},"alternative-id":["s17040837"],"URL":"https:\/\/doi.org\/10.3390\/s17040837","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,4,11]]}}}