{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T21:29:13Z","timestamp":1781299753901,"version":"3.54.1"},"reference-count":56,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T00:00:00Z","timestamp":1684454400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["2018YFB0504500"],"award-info":[{"award-number":["2018YFB0504500"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["41101417"],"award-info":[{"award-number":["41101417"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&amp;D Program of China","doi-asserted-by":"publisher","award":["11-H37B02-9001-19\/22"],"award-info":[{"award-number":["11-H37B02-9001-19\/22"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Natural Science Foundation of China","award":["2018YFB0504500"],"award-info":[{"award-number":["2018YFB0504500"]}]},{"name":"National Natural Science Foundation of China","award":["41101417"],"award-info":[{"award-number":["41101417"]}]},{"name":"National Natural Science Foundation of China","award":["11-H37B02-9001-19\/22"],"award-info":[{"award-number":["11-H37B02-9001-19\/22"]}]},{"name":"National High Resolution Earth Observations Foundation","award":["2018YFB0504500"],"award-info":[{"award-number":["2018YFB0504500"]}]},{"name":"National High Resolution Earth Observations Foundation","award":["41101417"],"award-info":[{"award-number":["41101417"]}]},{"name":"National High Resolution Earth Observations Foundation","award":["11-H37B02-9001-19\/22"],"award-info":[{"award-number":["11-H37B02-9001-19\/22"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>With the continuous development of three-dimensional city modeling, traditional close-range photogrammetry is limited by complex processing procedures and incomplete 3D depth information, making it unable to meet high-precision modeling requirements. In contrast, the integration of light detection and ranging and cameras in mobile measurement systems provides a new and highly effective solution. Currently, integrated mobile measurement systems commonly require cameras, lasers, position and orientation system and inertial measurement units; thus, the hardware cost is relatively expensive, and the system integration is complex. Therefore, in this paper, we propose a ground mobile measurement system only composed of a LiDAR and a GoPro camera, providing a more convenient and reliable way to automatically obtain 3D point cloud data with spectral information. The automatic point cloud coloring based on video images mainly includes four aspects: (1) Establishing models for radial distortion and tangential distortion to correct video images. (2) Establishing a registration method based on normalized Zernike moments to obtain the exterior orientation elements. The error of the result is only 0.5\u20131 pixel, which is far higher than registration based on a collinearity equation. (3) Establishing relative orientation based on essential matrix decomposition and nonlinear optimization. This involves uniformly using the speeded-up robust features algorithm with distance restriction and random sample consensus to select corresponding points. The vertical parallax of the stereo image pair model is less than one pixel, indicating that the accuracy is high. (4) A point cloud coloring method based on Gaussian distribution with central region restriction is adopted. Only pixels within the central region are considered valid for coloring. Then, the point cloud is colored based on the mean of the Gaussian distribution of the color set. In the colored point cloud, the textures of the buildings are clear, and targets such as windows, grass, trees, and vehicles can be clearly distinguished. Overall, the result meets the accuracy requirements of applications such as tunnel detection, street-view modeling and 3D urban modeling.<\/jats:p>","DOI":"10.3390\/rs15102658","type":"journal-article","created":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T09:23:10Z","timestamp":1684488190000},"page":"2658","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Automatic Point Cloud Colorization of Ground-Based LiDAR Data Using Video Imagery without Position and Orientation System"],"prefix":"10.3390","volume":"15","author":[{"given":"Junhao","family":"Xu","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3360-9694","authenticated-orcid":false,"given":"Chunjing","family":"Yao","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongchao","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Qian","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,19]]},"reference":[{"key":"ref_1","first-page":"768","article-title":"Deformation Monitoring of Wooden Frame Relics Based on 3D Laser Scanning Technology","volume":"32","author":"Zhang","year":"2018","journal-title":"Beijing Surv. Mapp."},{"key":"ref_2","first-page":"528","article-title":"Registration between Laser Scanning Point Cloud and Optical Images: Status and Trends","volume":"19","author":"Zhang","year":"2017","journal-title":"J. Geo-Inf. Sci."},{"key":"ref_3","first-page":"269","article-title":"Overview of Nonlinear Distortion Correction of Camera Lens","volume":"10","author":"Yang","year":"2005","journal-title":"J. Image Graph."},{"key":"ref_4","first-page":"855","article-title":"Close-range camera calibration","volume":"37","author":"Duane","year":"1971","journal-title":"Photogramm. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1117\/12.182920","article-title":"Modeling and calibration of video cameras","volume":"2357","author":"Melen","year":"1994","journal-title":"Proc. SPIE"},{"key":"ref_6","unstructured":"Heikkil\u00e4, J., and Silv\u00e9n, O. (1997, January 17\u201319). A four-step camera calibration procedure with implicit image correction. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/S0924-2716(97)00005-1","article-title":"Digital camera self-calibration","volume":"52","author":"Fraser","year":"1997","journal-title":"Isprs J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"369","DOI":"10.3788\/OPE.20122002.0369","article-title":"Global calibration for muti-camera videogrammetric system with large-scale field-of-view","volume":"20","author":"Hu","year":"2012","journal-title":"Opt. Precis. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2532","DOI":"10.3788\/OPE.20172509.2532","article-title":"Self-calibration based on simplified brown non-linear camera model and modified BFGS algorithm","volume":"25","author":"Gao","year":"2017","journal-title":"Opt. Precis. Eng."},{"key":"ref_10","first-page":"244","article-title":"Binocular Camera Calibration Based on Collinear Vector and Plane Homography","volume":"37","author":"Zou","year":"2017","journal-title":"Acta Opt. Sin."},{"key":"ref_11","first-page":"182","article-title":"Calibration Method for Structure-Light Auto-Scanning Measurement System Based on Coplanarity","volume":"43","author":"Xie","year":"2016","journal-title":"Chin. J. Lasers"},{"key":"ref_12","first-page":"56","article-title":"A Comparative Study of Close-Range Image Feature Points Matching Method","volume":"35","author":"Yu","year":"2018","journal-title":"J. Guangdong Univ. Technol."},{"key":"ref_13","first-page":"10","article-title":"A Combined Corner and Edge Detector","volume":"15","author":"Harris","year":"1988","journal-title":"Alvey Vis. Conf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","first-page":"404","article-title":"SURF: Speeded Up Robust Features","volume":"3951","author":"Bay","year":"2006","journal-title":"Eur. Conf. Comput. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rahaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_17","first-page":"15","article-title":"Analysis and Comparison of several kinds of Feature Points Extraction Operator","volume":"38","author":"Zeng","year":"2015","journal-title":"Mod. Surv. Mapp."},{"key":"ref_18","first-page":"26","article-title":"Feature Point Extraction of Color Digital Image Based on Harris Algorithm","volume":"24","author":"Liu","year":"2008","journal-title":"J. Beijing Univ. Civ. Eng. Archit."},{"key":"ref_19","first-page":"2396","article-title":"Implementation and Analysis of Harris Algorithm and Susan Algorithm","volume":"47","author":"Cui","year":"2019","journal-title":"Comput. Digit. Eng."},{"key":"ref_20","first-page":"877","article-title":"A SIFT and Bayes Sampling method for Image Matching","volume":"42","author":"Jia","year":"2013","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_21","first-page":"9","article-title":"Research on Feature Point Automatic Matching Method for High-resolution Remote Sensing Images","volume":"20","author":"Cao","year":"2022","journal-title":"Geospat. Inf."},{"key":"ref_22","first-page":"102456","article-title":"Research on Point Feature Matching Algorithms of UAV Remote Sensing Images","volume":"102","author":"Zhang","year":"2015","journal-title":"PLA Inf. Eng. Univ."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 7\u201313). Machine learning for high-speed corner detection. Proceedings of the Computer Vision\u2013ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_34"},{"key":"ref_24","first-page":"43","article-title":"ORB feature point extraction and matching study","volume":"31","author":"Yao","year":"2023","journal-title":"Electron. Des. Eng."},{"key":"ref_25","first-page":"92","article-title":"Research on Laser Scanning Point Cloud Data and Digital Image Sequence Registration","volume":"4","author":"Liu","year":"2011","journal-title":"Urban Geotech. Investig. Surv."},{"key":"ref_26","first-page":"557","article-title":"Laser point cloud and image registration method based on 3D-SIFT and SICP","volume":"36","author":"Liu","year":"2022","journal-title":"Beijing Surv. Mapp."},{"key":"ref_27","first-page":"141","article-title":"Study on image registration and mosaic technology based on surf feature","volume":"39","author":"Ruan","year":"2011","journal-title":"Comput. Digit. Eng."},{"key":"ref_28","unstructured":"Fang, W. (2014). Research on Automatic Texture Mapping of Terrestrial Laser Scanning Data Combining Photogrammetry Techniques, Wuhan University."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9460","DOI":"10.1080\/01431161.2019.1633698","article-title":"An automatic method for precise 3D registration of high resolution satellite images and Airborne LiDAR Data","volume":"40","author":"Safdarinezhad","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.autcon.2012.04.011","article-title":"Coregistration of terrestrial lidar points by adaptive scale-invariant feature transformation with constrained geometry","volume":"25","author":"Eo","year":"2012","journal-title":"Autom. Constr."},{"key":"ref_31","first-page":"1207","article-title":"Automatic registration of airborne LiDAR data and aerial images constrained by point and line features","volume":"49","author":"Ding","year":"2020","journal-title":"J. China Univ. Min. Technol."},{"key":"ref_32","first-page":"157","article-title":"A simple automatic registration method for Lidar point cloud and optical image","volume":"42","author":"Fan","year":"2021","journal-title":"Laser J."},{"key":"ref_33","unstructured":"Zhang, P.Y. (2016). Research on Zernike Moment in Edge Detection of High-Resolution Remote Sensing Images, Kunming University of Science and Technology."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1016\/j.jpdc.2011.10.011","article-title":"Shot boundary detection using Zernike moments in multi-GPU multi-CPU architectures","volume":"72","author":"Toharia","year":"2012","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_35","first-page":"124","article-title":"Registration of LiDAR point cloud with optical images using Zernike polynomial","volume":"47","author":"Jin","year":"2022","journal-title":"Sci. Surv. Mapp."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/BF00137443","article-title":"Relative orientation","volume":"4","author":"Horn","year":"1990","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","first-page":"549","article-title":"Camera relative orientation in Large-scale photogrammetry","volume":"44","author":"Wang","year":"2018","journal-title":"Opt. Tech."},{"key":"ref_38","unstructured":"Luhmann, T., Robson, S., Kyle, S., and Harley, I. (2006). Close Range Photogrammetry: Principles, Techniques and Applications, Whittles Publishing."},{"key":"ref_39","first-page":"442","article-title":"Research on Dependent Relative Orientation in Multi-baseline Close range Photogrammetry","volume":"38","author":"Lu","year":"2010","journal-title":"J. Tongji Univ. Nat. Sci."},{"key":"ref_40","first-page":"670","article-title":"A New Method for Relative Orientation with Hybrid Genetic Algorithm and Unit Quaternion","volume":"36","author":"Zhou","year":"2011","journal-title":"Geomat. Inf. Sci. Wuhan Univ."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2053","DOI":"10.1007\/s11425-014-4839-6","article-title":"Relative orientation method for large-scale photogrammetry with local parameter optimization","volume":"35","author":"Li","year":"2014","journal-title":"Chin. J. Sci. Instrum."},{"key":"ref_42","first-page":"53","article-title":"Relative orientation algorithm based on essential matrix decomposition in close-range photogrammetry","volume":"29","author":"Li","year":"2015","journal-title":"J. Shandong Univ. Technol. (Nat. Sci. Ed.)"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3575","DOI":"10.1109\/LRA.2018.2854290","article-title":"Colourising Point Clouds Using Independent Cameras","volume":"3","author":"Vechersky","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1016\/S0031-8914(34)80259-5","article-title":"Beugungstheorie des schneidenver-fahrens und seiner verbesserten form, der phasenkontrastmethode","volume":"1","author":"Zernike","year":"1934","journal-title":"Physica"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Matas, J., and Chum, O. (2005, January 17\u201321). Randomized RANSAC with sequential probability ratio test. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV\u201905) Volume 1, Beijing, China.","DOI":"10.1109\/ICCV.2005.198"},{"key":"ref_46","unstructured":"Yu, Y., Huang, G.P., and Xing, K. (2009, January 19\u201322). Direct closed-form solution to general relative orientation. Proceedings of the 2009 Symposium on Advanced Optical Technologies and Their Applications, Shanghai, China."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Prerss.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (1999, January 21\u201322). Bundle adjustment\u2014A modern synthesis. Proceedings of the Vision Algorithms: Theory and Practice: International Workshop on Vision Algorithms Corfu, Corfu, Greece.","DOI":"10.1007\/3-540-44480-7"},{"key":"ref_50","unstructured":"Madsen, K., Nielsen, H.B., and Tingleff, O. (2004). Methods for Non-Linear Least Squares Problems, Technical University of Denmark. [2nd ed.]."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., and Rus, D. (2020\u201324, January 24). LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341176"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator","volume":"34","author":"Qin","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"2009","DOI":"10.1080\/13658816.2022.2048834","article-title":"Application of a graph convolutional network with visual and semantic features to classify urban scenes","volume":"36","author":"Xu","year":"2022","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_54","first-page":"345","article-title":"Joint calibration of sports camera and lidar based on LM algorithm","volume":"42","author":"Li","year":"2022","journal-title":"J. Guilin Univ. Electron. Technol."},{"key":"ref_55","first-page":"322","article-title":"A hybrid conjugate gradient algorithm for solving relative orientation of big rotation angle stereo pair","volume":"48","author":"Li","year":"2019","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_56","first-page":"19","article-title":"An absolute orientation method for close-rang images with line feature","volume":"44","author":"Deng","year":"2019","journal-title":"Sci. Surv. Mapp."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/10\/2658\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:38:36Z","timestamp":1760125116000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/10\/2658"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,19]]},"references-count":56,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["rs15102658"],"URL":"https:\/\/doi.org\/10.3390\/rs15102658","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,19]]}}}