{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T21:05:23Z","timestamp":1765487123588,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T00:00:00Z","timestamp":1724803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005416","name":"The Research Council of Norway","doi-asserted-by":"publisher","award":["311356","12828"],"award-info":[{"award-number":["311356","12828"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Field Geospatial AS","award":["311356","12828"],"award-info":[{"award-number":["311356","12828"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In airborne surveying, light detection and ranging (LiDAR) strip adjustment and image bundle adjustment are customarily performed as separate processes. The bundle adjustment is usually conducted from frame images, while using linear pushbroom (LP) images in the bundle adjustment has been historically challenging due to the limited number of observations available to estimate the exterior image orientations. However, data from these three sensors conceptually provide information to estimate the same trajectory corrections, which is favorable for solving the problems of image depth estimation or the planimetric correction of LiDAR point clouds. Thus, our purpose with the presented study is to jointly estimate corrections to the trajectory and interior sensor states in a scalable hybrid adjustment between 3D LiDAR point clouds, 2D frame images, and 1D LP images. Trajectory preprocessing is performed before the low-frequency corrections are estimated for certain time steps in the following adjustment using cubic spline interpolation. Furthermore, the voxelization of the LiDAR data is used to robustly and efficiently form LiDAR observations and hybrid observations between the image tie-points and the LiDAR point cloud to be used in the adjustment. The method is successfully demonstrated with an experiment, showing the joint adjustment of data from the three different sensors using the same trajectory correction model with spline interpolation of the trajectory corrections. The results show that the choice of the trajectory segmentation time step is not critical. Furthermore, photogrammetric sub-pixel planimetric accuracy is achieved, and height accuracy on the order of mm is achieved for the LiDAR point cloud. This is the first time these three types of sensors with fundamentally different acquisition techniques have been integrated. The suggested methodology presents a joint adjustment of all sensor observations and lays the foundation for including additional sensors for kinematic mapping in the future.<\/jats:p>","DOI":"10.3390\/rs16173179","type":"journal-article","created":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T07:52:08Z","timestamp":1724831528000},"page":"3179","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Aerial Hybrid Adjustment of LiDAR Point Clouds, Frame Images, and Linear Pushbroom Images"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0004-0398","authenticated-orcid":false,"given":"Vetle O.","family":"Jonassen","sequence":"first","affiliation":[{"name":"Department of Geomatics, Norwegian University of Life Sciences, P.O. Box 5003 NMBU, 1432 \u00c5s, Norway"},{"name":"Field Geospatial AS, P.O. Box 185 Sk\u00f8yen, 0212 Oslo, Norway"}]},{"given":"Narve S.","family":"Kj\u00f8rsvik","sequence":"additional","affiliation":[{"name":"Field Geospatial AS, P.O. Box 185 Sk\u00f8yen, 0212 Oslo, Norway"}]},{"given":"Leif Erik","family":"Blankenberg","sequence":"additional","affiliation":[{"name":"Field Geospatial AS, P.O. Box 185 Sk\u00f8yen, 0212 Oslo, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9650-3910","authenticated-orcid":false,"given":"Jon Glenn Omholt","family":"Gjevestad","sequence":"additional","affiliation":[{"name":"Department of Geomatics, Norwegian University of Life Sciences, P.O. Box 5003 NMBU, 1432 \u00c5s, Norway"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.isprsjprs.2020.05.014","article-title":"A flexible targetless LiDAR-GNSS\/INS-camera calibration method for UAV platforms","volume":"166","author":"Pentek","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1016\/j.isprsjprs.2021.08.020","article-title":"Tightly-coupled camera\/LiDAR integration for point cloud generation from GNSS\/INS-assisted UAV mapping systems","volume":"180","author":"Zhou","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"100014","DOI":"10.1016\/j.ophoto.2022.100014","article-title":"Hybrid georeferencing of images and LiDAR data for UAV-based point cloud collection at millimetre accuracy","volume":"4","author":"Haala","year":"2022","journal-title":"ISPRS Open J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.rse.2017.04.007","article-title":"UAV lidar and hyperspectral fusion for forest monitoring in the southwestern USA","volume":"195","author":"Sankey","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"173","DOI":"10.5194\/isprs-annals-V-1-2020-173-2020","article-title":"Fusion of Photo with Airborne Laser Scanning","volume":"1","author":"Cledat","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kuras, A., Brell, M., Rizzi, J., and Burud, I. (2021). Hyperspectral and Lidar Data Applied to the Urban Land Cover Machine Learning and Neural-Network-Based Classification: A Review. Remote Sens., 13.","DOI":"10.3390\/rs13173393"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kuras, A., Heincke, B.H., Salehi, S., Mielke, C., K\u00f6llner, N., Rogass, C., Altenberger, U., and Burud, I. (2022). Integration of Hyperspectral and Magnetic Data for Geological Characterization of the Niaqornarssuit Ultramafic Complex in West-Greenland. Remote Sens., 14.","DOI":"10.3390\/rs14194877"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ren, Z., Zhai, Q., and Sun, L. (2022). A Novel Method for Hyperspectral Mineral Mapping Based on Clustering-Matching and Nonnegative Matrix Factorization. Remote Sens., 14.","DOI":"10.3390\/rs14041042"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1080\/22797254.2018.1434424","article-title":"Tree species classification in Norway from airborne hyperspectral and airborne laser scanning data","volume":"51","author":"Trier","year":"2018","journal-title":"Eur. J. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Allen, B., Dalponte, M., \u00d8rka, H.O., N\u00e6sset, E., Puliti, S., Astrup, R., and Gobakken, T. (2022). UAV-Based Hyperspectral Imagery for Detection of Root, Butt, and Stem Rot in Norway Spruce. Remote Sens., 14.","DOI":"10.3390\/rs14153830"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jonassen, V.O., Aarsten, D., Kailainathan, J., and Maalen-Johansen, I. (2019, January 24\u201326). Urban Blue-Green Factor Estimation in Fredrikstad, Norway from Hyperspectral and LiDAR Remote Sensing Data Fusion\u2014A Concept Study. Proceedings of the 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing, Amsterdam, The Netherlands.","DOI":"10.1109\/WHISPERS.2019.8921111"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lu, B., Dao, P., Liu, J., He, Y., and Shang, J. (2020). Recent Advances of Hyperspectral Imaging Technology and Applications in Agriculture. Remote Sens., 12.","DOI":"10.3390\/rs12162659"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1016\/j.isprsjprs.2023.07.007","article-title":"Scalable Hybrid Adjustment of Images and LiDAR Point Clouds","volume":"202","author":"Jonassen","year":"2023","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","first-page":"1","article-title":"Bundle Adjustment of Aerial Linear Pushbroom Hyperspectral Images with Sub-Pixel Accuracy","volume":"92","author":"Jonassen","year":"2024","journal-title":"PFG\u2014J. Photogramm. Remote Sens. Geoinf. Sci."},{"key":"ref_15","first-page":"383","article-title":"Capture and evaluation of airborne laser scanner data","volume":"Volume XVII-B3","author":"Kraus","year":"1996","journal-title":"Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"73","DOI":"10.5194\/isprsannals-II-3-W5-73-2015","article-title":"Rigorous Strip Adjustment of Airborne Laserscanning Data Based on the Icp Algorithm","volume":"II-3\/W5","author":"Glira","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_17","first-page":"298","article-title":"Bundle Adjustment\u2014A Modern Synthesis","volume":"Volume 1883","author":"Triggs","year":"2000","journal-title":"Vision Algorithms: Theory and Practice. IWVA 1999. Lecture Notes in Computer Science"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"F\u00f6rstner, W., and Wrobel, B.P. (2016). Photogrammetric Computer Vision, Springer.","DOI":"10.1007\/978-3-319-11550-4"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.isprsjprs.2022.12.022","article-title":"Integrated trajectory estimation for 3D kinematic mapping with GNSS, INS and imaging sensors: A framework and review","volume":"196","author":"Neuner","year":"2023","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2017.05.008","article-title":"Bundle adjustment with raw inertial observations in UAV applications","volume":"130","author":"Cucci","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tan, Z., Zhang, X., Teng, S., Wang, L., and Gao, F. (2024). A Review of Deep Learning-Based LiDAR and Camera Extrinsic Calibration. Sensors, 24.","DOI":"10.3390\/s24123878"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"945","DOI":"10.14358\/PERS.82.12.945","article-title":"Rigorous Strip Adjustment of UAV-based Laserscanning Data Including Time-Dependent Correction of Trajectory Errors","volume":"82","author":"Glira","year":"2016","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"567","DOI":"10.5194\/isprs-annals-IV-2-W5-567-2019","article-title":"Hybrid Orientation of Airborne Lidar Point Clouds and Aerial Images","volume":"4","author":"Glira","year":"2019","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"54","DOI":"10.2174\/1875413901205010054","article-title":"A Review of Optical Imagery and Airborne LiDAR Data Registration Methods","volume":"5","author":"Mishra","year":"2012","journal-title":"Open Remote Sens. J."},{"key":"ref_25","first-page":"691","article-title":"Kinematic Precise Point Positioning During Marginal Satellite Availability","volume":"Volume 133","author":"Sideris","year":"2009","journal-title":"Proceedings of the Observing our Changing Earth. International Association of Geodesy Symposia"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Leonardis, A., Bischof, H., and Pinz, A. (2006, January 7\u201313). Machine Learning for High-Speed Corner Detection. Proceedings of the Computer Vision\u2014ECCV 2006, Graz, Austria.","DOI":"10.1007\/11744023"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary Robust Invariant Scalable Keypoints. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Agarwal, P., Tipaldi, G.D., Spinello, L., Stachniss, C., and Burgard, W. (2013, January 6\u201310). Robust map optimization using dynamic covariance scaling. Proceedings of the International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630557"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"MacTavish, K., and Barfoot, T.D. (2015, January 3\u20135). At all Costs: A Comparison of Robust Cost Functions for Camera Correspondence Outliers. Proceedings of the 12th Conference on Computer and Robot Vision, Halifax, NS, Canada.","DOI":"10.1109\/CRV.2015.52"},{"key":"ref_31","first-page":"444","article-title":"Decentering Distortion of Lenses","volume":"32","author":"Brown","year":"1966","journal-title":"Photogramm. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3814","DOI":"10.1364\/OL.43.003814","article-title":"Full characterization of spatial coregistration errors and spatial resolution in spectral imagers","volume":"43","author":"Torkildsen","year":"2018","journal-title":"Opt. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"727","DOI":"10.5194\/isprs-annals-V-2-2020-727-2020","article-title":"Hybrid Georeferencing, Enhancement and Classification of Ultra-High Resolution Uav Lidar and Image Point Clouds for Monitoring Applications","volume":"2","author":"Haala","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3179\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:44:14Z","timestamp":1760111054000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3179"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,28]]},"references-count":33,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["rs16173179"],"URL":"https:\/\/doi.org\/10.3390\/rs16173179","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2024,8,28]]}}}