{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T17:20:04Z","timestamp":1771521604297,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2018,5,21]],"date-time":"2018-05-21T00:00:00Z","timestamp":1526860800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We propose utilizing a rigorous registration model and a skyline-based method for automatic registration of LiDAR points and a sequence of panoramic\/fish-eye images in a mobile mapping system (MMS). This method can automatically optimize original registration parameters and avoid the use of manual interventions in control point-based registration methods. First, the rigorous registration model between the LiDAR points and the panoramic\/fish-eye image was built. Second, skyline pixels from panoramic\/fish-eye images and skyline points from the MMS\u2019s LiDAR points were extracted, relying on the difference in the pixel values and the registration model, respectively. Third, a brute force optimization method was used to search for optimal matching parameters between skyline pixels and skyline points. In the experiments, the original registration method and the control point registration method were used to compare the accuracy of our method with a sequence of panoramic\/fish-eye images. The result showed: (1) the panoramic\/fish-eye image registration model is effective and can achieve high-precision registration of the image and the MMS\u2019s LiDAR points; (2) the skyline-based registration method can automatically optimize the initial attitude parameters, realizing a high-precision registration of a panoramic\/fish-eye image and the MMS\u2019s LiDAR points; and (3) the attitude correction values of the sequences of panoramic\/fish-eye images are different, and the values must be solved one by one.<\/jats:p>","DOI":"10.3390\/s18051651","type":"journal-article","created":{"date-parts":[[2018,5,22]],"date-time":"2018-05-22T04:34:03Z","timestamp":1526963643000},"page":"1651","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Registration of Panoramic\/Fish-Eye Image Sequence and LiDAR Points Using Skyline Features"],"prefix":"10.3390","volume":"18","author":[{"given":"Ningning","family":"Zhu","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yonghong","family":"Jia","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shunping","family":"Ji","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,5,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Cui, T., Ji, S., Shan, J., Gong, J., and Liu, K. (2017). Line-based registration of panoramic images and LiDAR point clouds for mobile mapping. Sensors, 17.","DOI":"10.20944\/preprints201612.0016.v1"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.isprsjprs.2017.12.005","article-title":"Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features","volume":"136","author":"Li","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wang, R., Ferrie, F.P., and MacFarlane, J. (2012, January 16\u201321). Automatic registration of mobile LiDAR and spherical panoramas. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238912"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"699","DOI":"10.14358\/PERS.71.6.699","article-title":"Photogrammetric and Lidar Data Registration Using Linear Features","volume":"71","author":"Habib","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"181","DOI":"10.5194\/isprsannals-II-5-181-2014","article-title":"Skyline matching based camera orientation from images and mobile mapping point clouds","volume":"II-5","author":"Hofmann","year":"2014","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"ASIFT: A New Framework for Fully Affine Invariant Image Comparison","volume":"2","author":"Morel","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_9","unstructured":"Yang, G., Becker, J., and Stewart, C.V. (2007, January 21\u201323). Estimating the location of a camera with respect to a 3D model. Proceedings of the 6th International Conference on 3-D Digital Imaging and Modeling, 3DIM 2007, Montreal, QC, Canada."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1016\/j.isprsjprs.2008.10.002","article-title":"An automatic procedure for co-registration of terrestrial laser scanners and digital cameras","volume":"64","year":"2009","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","unstructured":"Ding, M., Lyngbaek, K., and Zakhor, A. (2008, January 23\u201328). Automatic registration of aerial imagery with untextured 3D LiDAR models. Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR, Anchorage, AK, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Brown, M., Windridge, D., and Guillemaut, J.Y. (2015, January 7\u201313). Globally optimal 2D-3D registration from points or lines without correspondences. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.244"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.infrared.2015.06.006","article-title":"Automatic registration of airborne LiDAR point cloud data and optical imagery depth map based on line and points features","volume":"71","author":"Lv","year":"2015","journal-title":"Infrared Phys. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/s11263-017-1022-x","article-title":"Automatic Registration of Images to Untextured Geometry Using Average Shading Gradients","volume":"125","author":"Roth","year":"2017","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.isprsjprs.2013.11.015","article-title":"Automatic registration of optical imagery with 3D LiDAR data using statistical similarity","volume":"88","author":"Parmehr","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignement by Maximization of Mutual Information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4328","DOI":"10.1109\/TGRS.2013.2281391","article-title":"A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information","volume":"52","author":"Gong","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1755","DOI":"10.1111\/j.1467-8659.2009.01552.x","article-title":"Image-to-geometry registration: A Mutual Information method exploiting illumination-related geometric properties","volume":"28","author":"Corsini","year":"2009","journal-title":"Comput. Graph. Forum"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mastin, A., Kepner, J., and Fisher, J. (2009, January 20\u201325). Automatic registration of LIDAR and optical images of urban scenes. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206539"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"25","DOI":"10.5194\/isprs-annals-III-1-25-2016","article-title":"Hybrid online mobile laser scanner calibration through image alignment by mutual information","volume":"III-1","author":"Miled","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_21","unstructured":"Taylor, Z., and Nieto, J. (2013, January 6\u201310). Automatic calibration of lidar and camera images using normalized mutual information. Proceedings of the 2013 IEEE Conference on Robotics and Automation (ICRA 2013), Karlsruhe, Germany."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pascoe, G., Maddern, W., and Newman, P. (2015). Robust Direct Visual Localisation using Normalised Information Distance. BMVC, 1\u201313.","DOI":"10.5244\/C.29.70"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An accurate O(n) solution to the PnP problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Shao, J., Zhang, W., Zhu, Y., and Shen, A. (2017, January 18\u201322). Fast registration of terrestrial LiDAR point cloud and sequence images. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences\u2014ISPRS Archives, Wuhan, China.","DOI":"10.5194\/isprs-archives-XLII-2-W7-875-2017"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.14358\/PERS.74.9.1119","article-title":"Photogrammetric Modeling of Linear Features with Generalized Point Photogrammetry","volume":"74","author":"Zhang","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_26","unstructured":"Stamos, I., and Leordean, M. (2003, January 18\u201320). Automated feature-based range registration of urban scenes of large scale. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.isprsjprs.2004.02.003","article-title":"From point-based to feature-based aerial triangulation","volume":"58","author":"Schenk","year":"2004","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.cviu.2011.07.009","article-title":"A systematic approach for 2D-image to 3D-range registration in urban environments","volume":"116","author":"Liu","year":"2012","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_29","unstructured":"Liu, L., and Stamos, I. (2005, January 20\u201325). Automatic 3D to 2D registration for the photorealistic rendering of urban scenes. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kaminsky, R.S., Snavely, N., Seitz, S.M., and Szeliski, R. (2009, January 20\u201325). Alignment of 3d point clouds to overhead images. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5204180"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/s11263-012-0552-5","article-title":"Fully automatic registration of image sets on approximate geometry","volume":"102","author":"Corsini","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A Method for Registration of 3-D Shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1002\/rob.20204","article-title":"Scan registration for autonomous mining vehicles using 3D-NDT","volume":"24","author":"Magnusson","year":"2007","journal-title":"J. Field Robot."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"731","DOI":"10.14358\/PERS.79.8.731","article-title":"Registration of optical images with LiDAR data and its accuracy assessment","volume":"79","author":"Zheng","year":"2013","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1305","DOI":"10.1109\/TPAMI.2005.152","article-title":"Alignment of continuous video onto 3D point clouds","volume":"27","author":"Zhao","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.isprsjprs.2015.05.006","article-title":"Automatic registration of optical aerial imagery to a LiDAR point cloud for generation of city models","volume":"106","author":"Abayowa","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_37","unstructured":"Bakstein, H., and Pajdla, T. (2002, January 2). Panoramic mosaicing with a 180\/spl deg\/field of view lens. Proceedings of the 2002 Third Workshop on Omnidirectional Vision, Copenhagen, Denmark."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.isprsjprs.2009.01.001","article-title":"Validation of geometric models for fisheye lenses","volume":"64","author":"Schneider","year":"2009","journal-title":"ISPRS J. Photogramm. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1651\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:05:17Z","timestamp":1760195117000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1651"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,21]]},"references-count":38,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2018,5]]}},"alternative-id":["s18051651"],"URL":"https:\/\/doi.org\/10.3390\/s18051651","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5,21]]}}}