{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T04:30:03Z","timestamp":1772253003489,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2016,12,31]],"date-time":"2016-12-31T00:00:00Z","timestamp":1483142400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41271431"],"award-info":[{"award-number":["41271431"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41471288"],"award-info":[{"award-number":["41471288"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61403285"],"award-info":[{"award-number":["61403285"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>For multi-sensor integrated systems, such as the mobile mapping system (MMS), data fusion at sensor-level, i.e., the 2D-3D registration between an optical camera and LiDAR, is a prerequisite for higher level fusion and further applications. This paper proposes a line-based registration method for panoramic images and a LiDAR point cloud collected by a MMS. We first introduce the system configuration and specification, including the coordinate systems of the MMS, the 3D LiDAR scanners, and the two panoramic camera models. We then establish the line-based transformation model for the panoramic camera. Finally, the proposed registration method is evaluated for two types of camera models by visual inspection and quantitative comparison. The results demonstrate that the line-based registration method can significantly improve the alignment of the panoramic image and the LiDAR datasets under either the ideal spherical or the rigorous panoramic camera model, with the latter being more reliable.<\/jats:p>","DOI":"10.3390\/s17010070","type":"journal-article","created":{"date-parts":[[2017,1,2]],"date-time":"2017-01-02T09:54:18Z","timestamp":1483350858000},"page":"70","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Line-Based Registration of Panoramic Images and LiDAR Point Clouds for Mobile Mapping"],"prefix":"10.3390","volume":"17","author":[{"given":"Tingting","family":"Cui","sequence":"first","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"},{"name":"Research Center of Remote Sensing in Public Security, People\u2019s Public Security University of China, Beijing 100038, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shunping","family":"Ji","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"},{"name":"RSISE, Australian National University, Canberra, ACT 2600, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1948-9657","authenticated-orcid":false,"given":"Jie","family":"Shan","sequence":"additional","affiliation":[{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, Wuhan 430079, China"},{"name":"Lyles School of Civil Engineering, Purdue University, West Lafayette, IN 47907, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianya","family":"Gong","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"},{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"},{"name":"Collaborative Innovation Center of Geospatial Technology, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kejian","family":"Liu","sequence":"additional","affiliation":[{"name":"Research Center of Remote Sensing in Public Security, People\u2019s Public Security University of China, Beijing 100038, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,12,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/s11263-007-0081-9","article-title":"3D urban scene modeling integrating recognition and reconstruction","volume":"78","author":"Cornelis","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_2","unstructured":"Wonka, P., Muller, P., Watson, B., and Fuller, A. (2007). ACM SIGGRAPH 2007 Courses, ACM."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1177\/0142331214541140","article-title":"A novel outdoor scene-understanding framework for unmanned ground vehicles with 3d laser scanners","volume":"37","author":"Zhuang","year":"2015","journal-title":"Trans. Inst. Meas. Control"},{"key":"ref_4","first-page":"125","article-title":"Mobile mapping technology and its applications","volume":"4","author":"Li","year":"2006","journal-title":"Geospat. Inf."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4525","DOI":"10.3390\/s90604525","article-title":"Building facade reconstruction by fusing terrestrial laser points and images","volume":"9","author":"Pu","year":"2009","journal-title":"Sensors"},{"key":"ref_6","first-page":"187","article-title":"Building reconstruction from images and laser scanning","volume":"6","author":"Brenner","year":"2005","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Pu, S. (2010). Knowledge Based Building Facade Reconstruction from Laser Point Clouds and Images, University of Twente.","DOI":"10.54419\/6tzrzg"},{"key":"ref_8","unstructured":"Wang, R. (2011). Towards Urban 3d Modeling Using Mobile Lidar and Images, McGill University."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"5333","DOI":"10.3390\/s140305333","article-title":"Calibration between color camera and 3d lidar instruments with a polygonal planar board","volume":"14","author":"Park","year":"2014","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Naroditsky, O., Patterson, A., and Daniilidis, K. (2011, January 9\u201313). Automatic alignment of a camera with a line scan lidar system. Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980513"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.3390\/s130201902","article-title":"3d lidar-camera extrinsic calibration using an arbitrary trihedron","volume":"13","author":"Gong","year":"2013","journal-title":"Sensors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TIM.2014.2307731","article-title":"Automatic extrinsic self-calibration for fusing data from monocular vision and 3-d laser scanner","volume":"63","author":"Zhuang","year":"2014","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_13","first-page":"24","article-title":"Automatic Online Calibration of Cameras and Lasers","volume":"2013","author":"Levinson","year":"2013","journal-title":"Robot. Sci. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"54","DOI":"10.2174\/1875413901205010054","article-title":"A review of optical imagery and airborne lidar data registration methods","volume":"5","author":"Mishra","year":"2012","journal-title":"Open Remote Sens. J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"699","DOI":"10.14358\/PERS.71.6.699","article-title":"Photogrammetric and lidar data registration using linear features","volume":"71","author":"Habib","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/146370.146374","article-title":"A Survey of Image Registration Techniques","volume":"24","author":"Brown","year":"1992","journal-title":"ACM Comput. Surv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A computational approach to edge detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/0031-3203(81)90009-1","article-title":"Generalizing the hough transform to detect arbitrary shapes","volume":"13","author":"Ballard","year":"1981","journal-title":"Pattern Recognit."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5201\/ipol.2012.gjmr-lsd","article-title":"LSD: A line segment detector","volume":"2","author":"Jakubowicz","year":"2012","journal-title":"Image Process. Line"},{"key":"ref_20","unstructured":"Liu, L., and Stamos, I. (2005, January 20\u201325). Automatic 3d to 2d registration for the photorealistic rendering of urban scenes. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), San Diego, CA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.cviu.2011.07.009","article-title":"A systematic approach for 2d-image to 3d-range registration in urban environments","volume":"116","author":"Liu","year":"2012","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Moghadam, P., Bosse, M., and Zlot, R. (2013, January 6\u201310). Line-based extrinsic calibration of range and image sensors. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631095"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Borges, P., Zlot, R., Bosse, M., Nuske, S., and Tews, A. (2010, January 3\u20137). Vision-based localization using an edge map extracted from 3d laser range data. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509517"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.isprsjprs.2014.12.027","article-title":"Line segment extraction for large scale unorganized point clouds","volume":"102","author":"Lin","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1374","DOI":"10.1109\/TGRS.2014.2338915","article-title":"Semiautomated extraction of street light poles from mobile lidar point-clouds","volume":"53","author":"Yu","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","first-page":"115","article-title":"Pole-Like Objects Recognition from Mobile Laser Scanning Data Using Smoothing and Principal Component Analysis","volume":"38","author":"Yokoyama","year":"2011","journal-title":"Int. Archives Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"El-Halawany, S., Moussa, A., Lichti, D.D., and El-Sheimy, N. (2011, January 29\u201331). Detection of Road Curb from Mobile Terrestrial Laser Scanner Point Cloud. Proceedings of the 2011 ISPRS Workshop om Laser Scanning, Calgary, AB, Canada.","DOI":"10.1109\/M2RSM.2011.5697364"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"9046","DOI":"10.3390\/s140509046","article-title":"Robust curb detection with fusion of 3d-lidar and camera data","volume":"14","author":"Tan","year":"2014","journal-title":"Sensors"},{"key":"ref_29","unstructured":"Ronnholm, P. (2011). Registration Quality-Towards Integration of Laser Scanning and Photogrammetry, European Spatial Data Research Network."},{"key":"ref_30","unstructured":"Patias, P., Petsa, E., and Streilein, A. (1995). Digital Line Photogrammetry: Concepts, Formulations, Degeneracies, Simulations, Algorithms, Practical Examples, ETH Z\u00fcrich."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.isprsjprs.2004.02.003","article-title":"From point-based to feature-based aerial triangulation","volume":"58","author":"Schenk","year":"2004","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.14358\/PERS.74.9.1119","article-title":"Photogrammetric modeling of linear features with generalized point photogrammetry","volume":"74","author":"Zhang","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mastin, A., Kepner, J., and Fisher, J. (2009, January 20\u201325). Automatic Registration of Lidar and Optical Images of Urban Scenes. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206539"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.isprsjprs.2013.11.015","article-title":"Automatic registration of optical imagery with 3d lidar data using statistical similarity","volume":"88","author":"Parmehr","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sen."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, R., Ferrie, F.P., and Macfarlane, J. (2012, January 18\u201320). Automatic registration of mobile lidar and spherical panoramas. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238912"},{"key":"ref_36","unstructured":"Torii, A., Havlena, M., and Pajdla, T. (October, January 29). From google street view to 3d city models. Proceedings of the IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), Kyoto, Japan."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Micusik, B., and Kosecka, J. (2009, January 20\u201325). Piecewise planar city 3d modeling from street view panoramic sequences. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206535"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"119","DOI":"10.3390\/s130100119","article-title":"GPS-supported visual slam with a rigorous sensor model for a panoramic camera in outdoor environments","volume":"13","author":"Shi","year":"2013","journal-title":"Sensors"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"229","DOI":"10.14358\/PERS.80.3.229","article-title":"Comparison of two panoramic sensor models for precise 3d measurements","volume":"80","author":"Ji","year":"2014","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_40","unstructured":"PointGrey Ladybug 3. Available online: https:\/\/www.ptgrey.com\/ladybug3-360-degree-firewire-spherical-camera-systems."},{"key":"ref_41","unstructured":"SICK Lms5xx. Available online: https:\/\/www.sick.com\/de\/en\/product-portfolio\/detection-and-ranging-solutions\/2d-laser-scanners\/lms5xx\/c\/g179651."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sairam, N., Nagarajan, S., and Ornitz, S. (2016). Development of mobile mapping system for 3d road asset inventory. Sensors, 16.","DOI":"10.3390\/s16030367"},{"key":"ref_43","unstructured":"Point Grey Research, I. Geometric Vision Using Ladybug Cameras. Available online: http:\/\/www.ptgrey.com\/tan\/10621."},{"key":"ref_44","first-page":"248","article-title":"Segmentation of point clouds using smoothness constraint","volume":"36","author":"Rabbani","year":"2006","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1111\/j.1467-8659.2007.01016.x","article-title":"Efficient Ransac for Point-Cloud Shape Detection","volume":"24","author":"Schnabel","year":"2007","journal-title":"Comput. Graph. Forum"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"S28","DOI":"10.1016\/j.isprsjprs.2011.08.006","article-title":"Recognizing basic structures from mobile laser scanning data for road inventory studies","volume":"66","author":"Pu","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_47","unstructured":"Meguro, J., Hashizume, T., Takiguchi, J., and Kurosaki, R. (2005, January 18\u201322). Development of an autonomous mobile surveillance system using a network-based rtk-GPS. Proceedings of the International Conference on Robotics and Automation, Barcelona, Spain."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/34.1000236","article-title":"Mean shift: A robust approach toward feature space analysis","volume":"24","author":"Comaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/1\/70\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:29:36Z","timestamp":1760210976000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/1\/70"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12,31]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,1]]}},"alternative-id":["s17010070"],"URL":"https:\/\/doi.org\/10.3390\/s17010070","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints201612.0016.v1","asserted-by":"object"}]},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,12,31]]}}}