{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T16:41:59Z","timestamp":1778690519166,"version":"3.51.4"},"reference-count":40,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,1,5]],"date-time":"2021-01-05T00:00:00Z","timestamp":1609804800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cameras and laser scanners are complementary tools for a 2D\/3D information generation. Systematic and random errors cause the misalignment of the multi-sensor imagery and point cloud data. In this paper, a novel feature-based approach is proposed for imagery and point cloud fine registration. The tie points and its two neighbor pixels are matched in the overlap images, which are intersected in the object space to create the differential tie plane. A preprocessing is applied to the corresponding tie points and non-robust ones are removed. Initial coarse Exterior Orientation Parameters (EOPs), Interior Orientation Parameters (IOPs), and Additional Parameters (APs) are used to transform tie plane points to the object space. Then, the nearest points of the point cloud data to the transformed tie plane points are estimated. These estimated points are used to calculate Directional Vectors (DV) of the differential planes. As a constraint equation along with the collinearity equation, each object space tie point is forced to be located on the point cloud differential plane. Two different indoor and outdoor experimental data are used to assess the proposed approach. Achieved results show about 2.5 pixels errors on checkpoints. Such results demonstrated the robustness and practicality of the proposed approach.<\/jats:p>","DOI":"10.3390\/s21010317","type":"journal-article","created":{"date-parts":[[2021,1,5]],"date-time":"2021-01-05T21:18:57Z","timestamp":1609881537000},"page":"317","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Imagery Network Fine Registration by Reference Point Cloud Data Based on the Tie Points and Planes"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4446-7361","authenticated-orcid":false,"given":"Mehrdad","family":"Eslami","sequence":"first","affiliation":[{"name":"School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran 1439957131, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad","family":"Saadatseresht","sequence":"additional","affiliation":[{"name":"School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran 1439957131, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,5]]},"reference":[{"key":"ref_1","first-page":"026028","article-title":"Deep convolutional recurrent neural network with transfer learning for hyperspectral image classification","volume":"12","author":"Bing","year":"2018","journal-title":"J. Appl. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4604","DOI":"10.1109\/JSTARS.2018.2880783","article-title":"Convolutional Neural Network-Based Land Cover Classification Using 2-D Spectral Reflectance Curve Graphs with Multitemporal Satellite Imagery","volume":"11","author":"Kim","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","first-page":"37","article-title":"Land use classification and change detection by using multi-temporal remotely sensed imagery The case of Chunati wildlife sanctuary Bangladesh","volume":"21","author":"Islam","year":"2018","journal-title":"Egypt. J. Remote Sens. Space Sci."},{"key":"ref_4","first-page":"264","article-title":"Embedded, real-time UAV control for improved, image-based 3D scene reconstruction","volume":"81","author":"Vogs","year":"2016","journal-title":"Meas. J. Int. Meas. Confed."},{"key":"ref_5","first-page":"23","article-title":"Deep learning-based method for reconstructing three-dimensional building cadastre models from aerial images Appl","volume":"13","author":"Sadeghian","year":"2019","journal-title":"Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2068","DOI":"10.1109\/JSTARS.2018.2835483","article-title":"Classification of Airborne Multispectral Lidar Point Clouds for Land Cover Mapping","volume":"11","author":"Ekhtari","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"281","DOI":"10.14358\/PERS.83.4.281","article-title":"Building Roof Reconstruction Based on Residue Anomaly Analysis and Shape Descriptors from Lidar and Optical Data","volume":"83","author":"Salehi","year":"2017","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/s00371-018-1584-9","article-title":"Preparation and enhancement of 3D laser scanner data for realistic coloured BIM models","volume":"36","author":"Prieto","year":"2018","journal-title":"Vis. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Schmitz, B., Holst, C., Medic, T., and Lichti, D.D. (2019). How to Efficiently Determine the Range Precision of 3D Terrestrial Laser Scanners. Sensors, 19.","DOI":"10.3390\/s19061466"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1111\/phor.12110","article-title":"Registration of Aerial Imagery and Lidar Data in Desert Areas Using Sand Ridges","volume":"30","author":"Li","year":"2015","journal-title":"Photogramm. Rec."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/19479832.2016.1160960","article-title":"Advances in fusion of optical imagery and LiDAR point cloud applied to photogrammetry and remote sensing","volume":"8","author":"Zhang","year":"2017","journal-title":"Int. J. Image Data Fusion"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.isprsjprs.2014.12.025","article-title":"Automatic registration of UAV-borne sequent images and LiDAR data","volume":"101","author":"Yang","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.isprsjprs.2013.11.015","article-title":"Automatic registration of optical imagery with 3D LiDAR data using statistical similarity","volume":"88","author":"Parmehr","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"54","DOI":"10.2174\/1875413901205010054","article-title":"A review of optical imagery and airborne lidar data registration methods","volume":"5","author":"Mishra","year":"2012","journal-title":"Open Remote Sens. J."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sun, S., and Savalggio, C. (2012, January 22\u201327). Complex building roof detection and strict description from LIDAR data and orthorectified aerial imagery. Proceedings of the 2012 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Munich, Germany.","DOI":"10.1109\/IGARSS.2012.6352369"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Pandey, G., McBride, J.R., Savarese, S., and Eustice, R.M. (2012, January 22\u201326). Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information. Proceedings of the AAAI, Toronto, ON, Canada.","DOI":"10.1609\/aaai.v26i1.8379"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"25","DOI":"10.5194\/isprs-annals-III-1-25-2016","article-title":"Hybrid online mobile laser scanner calibration through image alignment by mutual information","volume":"3","author":"Miled","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by maximization of mutual information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1080\/07038992.2020.1785282","article-title":"A New Tie Plane-Based Method for Fine Registration of Imagery and Point Cloud Dataset","volume":"46","author":"Eslami","year":"2020","journal-title":"Canadian Journal of Remote Sensing."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mastin, A., Kepner, J., and Fisher, J.J. (2009, January 20\u201325). Automatic registration of LIDAR and optical images of urban scenes. Proceedings of the 2009 IEEE ConferenceComputer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206539"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"559","DOI":"10.5194\/isprsarchives-XL-1-W5-559-2015","article-title":"Comparison of target-and mutual informaton based calibration of terrestrial laser scanner and digital camera for deformation monitoring","volume":"40","author":"Omidalizarandi","year":"2015","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2229","DOI":"10.1109\/JSTARS.2012.2237543","article-title":"Automatic co-registration of optical satellite images and airborne lidar data using relative and absolute orientations","volume":"6","author":"Teo","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","unstructured":"Chen, Y., and Medioni, G. (1992). Object Medeling by Registration os Multiple Range Images. IEEE Int. Conf. Robot. Autom., 2724\u20132729."},{"key":"ref_24","first-page":"229","article-title":"An Automatic Procedure for Combining Digital Images and Laser Scanner Data","volume":"XXXIX-B5","author":"Moussa","year":"2012","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1111\/j.1477-9730.2008.00464.x","article-title":"Photogrammetric and lidar data integration using the centroid of a rectangular roof as a control point","volume":"23","author":"Mitishita","year":"2008","journal-title":"Photogramm. Rec."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1007\/BF02830090","article-title":"Registration of aerial imagery and aerial LiDAR data using centroids of plane roof surfaces as control information","volume":"10","author":"Kwak","year":"2006","journal-title":"KSCE J. Civ. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"731","DOI":"10.14358\/PERS.79.8.731","article-title":"Registration of optical images with lidar data and its accuracy assessment","volume":"79","author":"Zheng","year":"2013","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Huang, R., Zheng, S., and Hu, K. (2018). Registration of Aerial Optical Images with LiDAR Data Using the Closest Point Principle and Collinearity Equations. Sensors, 18.","DOI":"10.3390\/s18061770"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"567","DOI":"10.5194\/isprs-annals-IV-2-W5-567-2019","article-title":"HYBRID ORIENTATION of AIRBORNE LIDAR POINT CLOUDS and AERIAL IMAGES","volume":"4","author":"Glira","year":"2019","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_30","unstructured":"Habib, A., Morgan, M., Kim, E.M., and Cheng, R. (2004, January 12\u201323). Linear features in photogrammetric activities. Proceedings of the ISPRS Congress, Istanbul, Turkey."},{"key":"ref_31","unstructured":"Aldelgawy, M., Detchev, I.D., and Habib, A.F. (May, January 28). Alternative procedures for the incorporation of LiDAR-derived linear and areal features for photogrammetric geo-referencing. Proceedings of the American Society for Photogrammetry and Remote Sensing (ASPRS) Annual Conference, Portland, OR, USA."},{"key":"ref_32","unstructured":"Srestasathiern, P. (2012). Line Based Estimation of Object Space Geometry and Camera Motion. [Doctoral Dissertation, The Ohio State University]."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"705","DOI":"10.14358\/PERS.83.10.705","article-title":"Registration of Images to Lidar and GIS Data Without Establishing Explicit Correspondences","volume":"83","author":"Barsai","year":"2017","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.isprsjprs.2017.12.005","article-title":"Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features","volume":"136","author":"Li","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Safdarinezhad, A., Mokhtarzade, M., and Valadan Zoej, M.J. (2016). Shadow-Based Hierarchical Matching for the Automatic Registration of Airborne LiDAR Data and Space Imagery. Remote Sens., 8.","DOI":"10.3390\/rs8060466"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1808","DOI":"10.1109\/JSTARS.2015.2489838","article-title":"Developing a Spectral-Based Strategy for Urban Object Detection from Airborne Hyperspectral TIR and Visible Data","volume":"9","author":"Eslami","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Goshtasby, A.A. (2012). Image Registration: Principles, Tools and Methods, Springer Science & Business Media.","DOI":"10.1007\/978-1-4471-2458-0_11"},{"key":"ref_39","unstructured":"Luhmann, T., Robson, S., Kyle, S., and Harley, I. (2011). Close Range Photogrammetry: Principles, Techniques and Applications, Whittles."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"053527","DOI":"10.1117\/1.3595265","article-title":"Iterative approach for efficient digital terrain model production from CARTOSAT-1 stereo images","volume":"5","author":"Arefi","year":"2011","journal-title":"J. Appl. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/317\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:07:15Z","timestamp":1760159235000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/317"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,5]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21010317"],"URL":"https:\/\/doi.org\/10.3390\/s21010317","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,5]]}}}