{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T07:58:17Z","timestamp":1767772697033,"version":"build-2065373602"},"reference-count":60,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,5]],"date-time":"2020-09-05T00:00:00Z","timestamp":1599264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2018YFB0504500"],"award-info":[{"award-number":["2018YFB0504500"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41601504 and 61378078"],"award-info":[{"award-number":["41601504 and 61378078"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National High Resolution Earth Observation Foundation","award":["11-Y20A12-9001-17\/18"],"award-info":[{"award-number":["11-Y20A12-9001-17\/18"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Airborne Light Detection and Ranging (LiDAR) system and digital camera are usually integrated on a flight platform to obtain multi-source data. However, the photogrammetric system calibration is often independent of the LiDAR system and performed by the aerial triangulation method, which needs a test field with ground control points. In this paper, we present a method for the direct georeferencing of images collected by a digital camera integrated in an airborne LiDAR system by automatic boresight misalignments calibration with the auxiliary of point cloud. The method firstly uses an image matching to generate a tie point set. Space intersection is then performed to obtain the corresponding object coordinate values of the tie points, while the elevation calculated from the space intersection is replaced by the value from the LiDAR data, resulting in a new object point called Virtual Control Point (VCP). Because boresight misalignments exist, a distance between the tie point and the image point of VCP can be found by collinear equations in that image from which the tie point is selected. An iteration process is performed to minimize the distance with boresight corrections in each epoch, and it stops when the distance is smaller than a predefined threshold or the total number of epochs is reached. Two datasets from real projects were used to validate the proposed method and the experimental results show the effectiveness of the method by being evaluated both quantitatively and visually.<\/jats:p>","DOI":"10.3390\/s20185056","type":"journal-article","created":{"date-parts":[[2020,9,6]],"date-time":"2020-09-06T23:12:49Z","timestamp":1599433969000},"page":"5056","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Direct Georeferencing for the Images in an Airborne LiDAR System by Automatic Boresight Misalignments Calibration"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9470-2067","authenticated-orcid":false,"given":"Haichi","family":"Ma","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongchao","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"},{"name":"Department of Oceanography, Dalhousie University, Halifax, NS B3H 4R2, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5407-3860","authenticated-orcid":false,"given":"Ke","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenjun","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Resources and Environmental Science, Hubei University, Wuhan 430062, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.rse.2006.10.013","article-title":"Repetitive interpolation: A robust algorithm for DTM generation from Aerial Laser Scanner Data in forested terrain","volume":"108","author":"Kobler","year":"2007","journal-title":"Remote. Sens. Environ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.measurement.2014.12.017","article-title":"Investigating performance of Airborne LiDAR data filtering algorithms for DTM generation","volume":"63","author":"Polat","year":"2015","journal-title":"Measurement"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"045203","DOI":"10.1088\/1361-6501\/aa59f3","article-title":"Decomposition of small-footprint full waveform LiDAR data based on generalized Gaussian model and grouping LM optimization","volume":"28","author":"Ma","year":"2017","journal-title":"Meas. Sci. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"437","DOI":"10.14358\/PERS.75.4.437","article-title":"Morphology-based Building Detection from Airborne Lidar Data","volume":"75","author":"Meng","year":"2009","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.isprsjprs.2019.10.011","article-title":"Deep learning for conifer\/deciduous classification of airborne LiDAR 3D point clouds representing individual trees","volume":"158","author":"Hamraz","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","first-page":"110","article-title":"DEM generation from laser scanner data using adaptive TIN models","volume":"33","author":"Axelsson","year":"2000","journal-title":"Int. Arch. Photogram. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1111\/j.1477-9730.2011.00621.x","article-title":"Indirect georeferencing of digital SLR imagery using signalised lidar control points","volume":"26","author":"Mitishita","year":"2011","journal-title":"Photogramm. Rec."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Huang, Y., Zhuo, L., Tao, H., Shi, Q., and Liu, K. (2017). A Novel Building Type Classification Scheme Based on Integrated LiDAR and High-Resolution Images. Remote Sens., 9.","DOI":"10.3390\/rs9070679"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Castagno, J., and Atkins, E.M. (2018). Roof Shape Classification from LiDAR and Satellite Image Data Fusion Using Supervised Learning. Sensors, 18.","DOI":"10.3390\/s18113960"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Luo, S., Wang, C., Xi, X., Zeng, H., Li, D., Xia, S., and Wang, P. (2015). Fusion of Airborne Discrete-Return LiDAR and Hyperspectral Data for Land Cover Classification. Remote Sens., 8.","DOI":"10.3390\/rs8010003"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.isprsjprs.2018.08.005","article-title":"A 3D convolutional neural network method for land cover classification using LiDAR and multi-temporal Landsat imagery","volume":"144","author":"Xu","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1729881417738102","article-title":"Road detection based on the fusion of Lidar and image data","volume":"14","author":"Han","year":"2017","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2017\/6431519","article-title":"A Two-Stage Optimization Strategy for Fuzzy Object-Based Analysis Using Airborne LiDAR and High-Resolution Orthophotos for Urban Road Extraction","volume":"2017","author":"Sameen","year":"2017","journal-title":"J. Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1109\/JSTARS.2015.2417859","article-title":"Hyperspectral Tree Species Classification of Japanese Complex Mixed Forest With the Aid of Lidar Data","volume":"8","author":"Matsuki","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_15","first-page":"187","article-title":"Combining QuickBird, LiDAR, and GIS topography indices to identify a single native tree species in a complex landscape using an object-based classification approach","volume":"50","author":"Pham","year":"2016","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.isprsjprs.2014.04.019","article-title":"In-flight photogrammetric camera calibration and validation via complementary lidar","volume":"100","author":"Gneeniss","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1111\/j.1477-9730.2002.tb01907.x","article-title":"Solutions for Exterior Orientation in Photogrammetry: A Review","volume":"17","author":"Grussenmeyer","year":"2002","journal-title":"Photogramm. Rec."},{"key":"ref_18","unstructured":"Mikolajczyk, K., and Schmid, C. (2001, January 7\u201314). Indexing Based on Scale Invariant Interest Points. Proceedings of the Eighth IEEE International Conference on Computer Vision ICCV, Vancouver, BC, Canada."},{"key":"ref_19","first-page":"555","article-title":"Calibrating digital photogrammetric airborne imaging systems in a test field","volume":"37","author":"Honkavaara","year":"2008","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1111\/j.1477-9730.2005.00318.x","article-title":"Direct Sensor Orientation for Large Scale Mapping\u2014Potential, Problems, Solutions","volume":"20","author":"Yastikli","year":"2005","journal-title":"Photogramm. Rec."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.isprsjprs.2019.06.016","article-title":"Lever-arm and boresight correction, and field of view determination of a spectroradiometer mounted on an unmanned aircraft system","volume":"155","author":"Gautam","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","first-page":"247","article-title":"Lever arm compensation for GPS\/INS\/Odometer integrated system","volume":"4","author":"Seo","year":"2006","journal-title":"Int. J. Control Autom. Syst."},{"key":"ref_23","unstructured":"Heier, H., Kiefner, M., and Zeitler, W. (2002, January 19\u201326). Calibration of the Digital Modular Camera. Proceedings of the FIG XXII International Congress, Washington, DC, USA."},{"key":"ref_24","unstructured":"Skaloud, J., Cramer, M., and Schwarz, K.P. (1996). Exterior orientation by direct measurement of position and attitude. Bmc Health Serv. Res., 8."},{"key":"ref_25","unstructured":"Skaloud, J. (1999). Optimizing Georeferencing of Airborne Survey Systems by INS\/GPS. [Ph.D. Thesis, Department of Geomatics Engineering, The University of Calgary]."},{"key":"ref_26","unstructured":"Fritsch, D., and Spiller, R. (2001, January 24-28). The OEEPE Test on Integrated Sensor Orientation\u2014Results of Phase I. Proceedings of the Photogrammetric Week, Stuttgart, Germany."},{"key":"ref_27","unstructured":"Jacobsen, K. (2001, January 23\u201327). Aspects of Handling Image Orientation by Direct Sensor Orientation. Proceedings of the American Society of Photogrammetry and Remote Sensing Annual Convention, St. Louis, MO, USA."},{"key":"ref_28","unstructured":"Mostafa, M.M.R., and Corporation, A. (2002, January 21\u201326). Camera\/IMU Boresight Calibration: New Advances and Performance Analysis. Proceedings of the American Society of Photogrammetry and Remote Sensing Annual Conference, Washington, DC, USA."},{"key":"ref_29","first-page":"3","article-title":"Calibration field structures for GPS\/IMU\/camera-system calibration","volume":"18","author":"Honkavaara","year":"2003","journal-title":"Photogramm. J. Finl."},{"key":"ref_30","first-page":"1207","article-title":"Calibration in direct georeferencing: Theoretical considerations and practical results","volume":"70","author":"Honkavaara","year":"2004","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_31","first-page":"829","article-title":"Direct integrated sensor orientation\u2014Pros and Cons","volume":"35","author":"Jacobsen","year":"2004","journal-title":"Int. Arch. Photogramm. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JSTARS.2017.2666298","article-title":"Geometric Calibration of an Aerial Multihead Camera System for Direct Georeferencing Applications","volume":"10","author":"Filho","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_33","unstructured":"Kruck, E.J. (2006, January 25\u201327). Simultaneous calibration of digital aerial survey cameras. Proceedings of the EuroSDR Commission I and ISPRS Working Group 1\/3 Workshop EuroCOW, Castelldefels, Spain."},{"key":"ref_34","first-page":"164","article-title":"Geometric handling of large size digital airborne frame camera images","volume":"8","author":"Jacobsen","year":"2007","journal-title":"Opt. 3D Meas. Tech."},{"key":"ref_35","first-page":"13","article-title":"Bundle adjustment of images from nonmetric CCD camera using LiDAR data as control points","volume":"20","author":"Delara","year":"2004","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_36","unstructured":"Habib, A., Ghanma, M., Mitishita, E., Kim, E., and Kim, C.J. (2005, January 29). Image georeferencing using LIDAR data. Proceedings of the 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS \u201905, Seoul, Korea."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"699","DOI":"10.14358\/PERS.71.6.699","article-title":"Photogrammetric and Lidar Data Registration Using Linear Features","volume":"71","author":"Habib","year":"2005","journal-title":"Photogramm. Eng. Remote. Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1007\/BF02830090","article-title":"Registration of aerial imagery and aerial LiDAR data using centroids of plane roof surfaces as control information","volume":"10","author":"Kwak","year":"2006","journal-title":"KSCE J. Civ. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s10707-006-0005-9","article-title":"Lidar-derived high quality ground control information and DEM for image orthorectification","volume":"11","author":"Liu","year":"2007","journal-title":"GeoInformatica"},{"key":"ref_40","unstructured":"Yastikli, N., Toth, C., and Brzezinska, D. (2007, January 29\u201331). In-Situ camera and boresight calibration with lidar data. Proceedings of the 5th International Symposium on Mobile Mapping Technology, Padua, It\u00e1lia."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1111\/j.1477-9730.2008.00464.x","article-title":"Photogrammetric and lidar data integration using the centroid of a rectangular roof as a control point","volume":"23","author":"Mitishita","year":"2008","journal-title":"Photogramm. Rec."},{"key":"ref_42","unstructured":"Ding, M., Lyngbaek, K., and Zakhor, A. (2008, January 24\u201326). Automatic registration of aerial imagery with untextured 3D LiDAR models. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wang, L., and Neumann, U. (2009, January 20\u201325). A Robust Approach for Automatic Registration of Aerial Images with Untextured Aerial LiDAR Data. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206600"},{"key":"ref_44","unstructured":"Wildan, F., Aldino, R., and Aji, P.P. (2011, January 17\u201319). Application of LIDAR Technology for GCP Determination in Papua Topographic Mapping Scale 1:50,000. Proceedings of the 10th Annual Asian Conference & Exhibition on Geospatial Information, Technology & Applications, Jakarta, Indonesia."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/LGRS.2011.2161070","article-title":"Boresight Calibration of Airborne LiDAR System Without Ground Control Points","volume":"9","author":"Siying","year":"2011","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_46","unstructured":"Gneeniss, A.S. (2014). Integration of LiDAR and Photogrammetric Data for Enhanced Aerial Triangulation and Camera Calibration. [Ph.D. Thesis, Newcastle University]."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3D Is here: Point Cloud Library (PCL). Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_48","first-page":"1","article-title":"Vertical accuracy validation of LiDAR data","volume":"4","author":"Dharmapuri","year":"2014","journal-title":"LiDAR Mag."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1109\/TGRS.1986.289597","article-title":"A Region-Based Approach to Digital Image Registration with Subpixel Accuracy","volume":"24","author":"Goshtasby","year":"1986","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1109\/83.862635","article-title":"A wavelet-based coarse-to-fine image matching scheme in a parallel virtual machine environment","volume":"9","author":"You","year":"2000","journal-title":"IEEE Trans. Image Process."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"2589","DOI":"10.1109\/TGRS.2011.2109389","article-title":"Automatic Image Registration Through Image Segmentation and SIFT","volume":"49","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/LGRS.2017.2781741","article-title":"Remote Sensing Image Registration Using Convolutional Neural Network Features","volume":"15","author":"Ye","year":"2018","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"235","DOI":"10.5194\/isprs-annals-IV-2-W4-235-2017","article-title":"Imaging Geometry and Positioning Accuracy of Dual Satellite Stereo Images: A Review","volume":"4","author":"Jeong","year":"2017","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_56","first-page":"415","article-title":"Simple method of LiDAR point density definition for automatic building recognition","volume":"5","author":"Kodors","year":"2016","journal-title":"Eng. Rural Dev."},{"key":"ref_57","unstructured":"Jacobsen, K. (2008). BLUH Bundle Block Adjustment, Institute of Photogrammetry and GeoInformation, Leibniz University Hannover. Program User Manual."},{"key":"ref_58","first-page":"197","article-title":"New Calibration and Computing Method for Direct Georeferencing of Image and Scanner Data Using the Position and Angular Data of an Hybrid Inertial Navigation System","volume":"43","author":"Baumker","year":"2002","journal-title":"Integr. Sens. Orientat."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.isprsjprs.2012.12.004","article-title":"Development of a Coordinate Transformation method for direct georeferencing in map projection frames","volume":"77","author":"Zhao","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_60","first-page":"7","article-title":"Comparison of Feature Detection and Matching Approaches: SIFT and SURF","volume":"2","author":"Mistry","year":"2017","journal-title":"GRD J. Global Res. Dev. J. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5056\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:07:15Z","timestamp":1760177235000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5056"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,5]]},"references-count":60,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185056"],"URL":"https:\/\/doi.org\/10.3390\/s20185056","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,9,5]]}}}