{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T11:16:21Z","timestamp":1762341381448,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2020,1,18]],"date-time":"2020-01-18T00:00:00Z","timestamp":1579305600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010877","name":"Science, Technology and Innovation Commission of Shenzhen Municipality","doi-asserted-by":"publisher","award":["JCYJ20170818104822282"],"award-info":[{"award-number":["JCYJ20170818104822282"]}],"id":[{"id":"10.13039\/501100010877","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011650","name":"Research Institute for Sustainable Urban Development, Hong Kong Polytechnic University","doi-asserted-by":"publisher","award":["Research Fund"],"award-info":[{"award-number":["Research Fund"]}],"id":[{"id":"10.13039\/501100011650","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Hong Kong Research Grants Council (RGC) Competitive Earmarked Research Grant","award":["152223\/18E"],"award-info":[{"award-number":["152223\/18E"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Plane fitting is a fundamental operation for point cloud data processing. Most existing methods for point cloud plane fitting have been developed based on high-quality Lidar data giving equal weight to the point cloud data. In recent years, using low-quality RGB-Depth (RGB-D) sensors to generate 3D models has attracted much attention. However, with low-quality point cloud data, equal weight plane fitting methods are not optimal as the range errors of RGB-D sensors are distance-related. In this paper, we developed an accurate plane fitting method for a structured light (SL)-based RGB-D sensor. First, we derived an error model of a point cloud dataset from the SL-based RGB-D sensor through error propagation from the raw measurement to the point coordinates. A new cost function based on minimizing the radial distances with the derived rigorous error model was then proposed for the random sample consensus (RANSAC)-based plane fitting method. The experimental results demonstrated that our method is robust and practical for different operating ranges and different working conditions. In the experiments, for the operating ranges from 1.23 meters to 4.31 meters, the mean plane angle errors were about one degree, and the mean plane distance errors were less than six centimeters. When the dataset is of a large-depth-measurement scale, the proposed method can significantly improve the plane fitting accuracy, with a plane angle error of 0.5 degrees and a mean distance error of 4.7 cm, compared to 3.8 degrees and 16.8 cm, respectively, from the conventional un-weighted RANSAC method. The experimental results also demonstrate that the proposed method is applicable for different types of SL-based RGB-D sensor. The rigorous error model of the SL-based RGB-D sensor is essential for many applications such as in outlier detection and data authorization. Meanwhile, the precise plane fitting method developed in our research will benefit algorithms based on high-accuracy plane features such as depth calibration, 3D feature-based simultaneous localization and mapping (SLAM), and the generation of indoor building information models (BIMs).<\/jats:p>","DOI":"10.3390\/rs12020320","type":"journal-article","created":{"date-parts":[[2020,1,20]],"date-time":"2020-01-20T04:27:09Z","timestamp":1579494429000},"page":"320","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Improving Plane Fitting Accuracy with Rigorous Error Models of Structured Light-Based RGB-D Sensors"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5610-3223","authenticated-orcid":false,"given":"Yaxin","family":"Li","sequence":"first","affiliation":[{"name":"Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen 518057, China"},{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenbin","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0549-6052","authenticated-orcid":false,"given":"Walid","family":"Darwish","sequence":"additional","affiliation":[{"name":"Geomatics Engineering Lab, Civil Engineering Department, Faculty of Engineering, Cairo University, Cairo 12613, Egypt"},{"name":"Department of Electronic and Informatics, Faculty of Engineering, Vrije Universiteit Brussel, 1050 Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shengjun","family":"Tang","sequence":"additional","affiliation":[{"name":"Guangdong Key Laboratory of Urban Informatics &amp; Shenzhen Key Laboratory of Spatial Smart Sensing and Services &amp; Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) &amp; Research Institute for Smart Cities, School of Architecture and Urban Planning, Shenzhen University, Shenzhen 518050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuling","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wu","family":"Chen","sequence":"additional","affiliation":[{"name":"Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen 518057, China"},{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7323","DOI":"10.3390\/s8117323","article-title":"A comprehensive automated 3D approach for building extraction, reconstruction, and regularization from airborne laser scanning point clouds","volume":"8","author":"Dorninger","year":"2008","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2015.04.001","article-title":"Automatic BIM component extraction from point clouds of existing buildings for sustainability applications","volume":"56","author":"Wang","year":"2015","journal-title":"Autom. Constr."},{"key":"ref_3","first-page":"311","article-title":"High Resolution Point Cloud Generation from Kinect and HD Cameras using Graph Cut","volume":"12","author":"Patra","year":"2012","journal-title":"VISAPP"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/J.ENG.2016.02.010","article-title":"Autonomous driving in the iCity-HD maps as a key challenge of the automotive industry","volume":"2","author":"Seif","year":"2016","journal-title":"Engineering"},{"key":"ref_5","unstructured":"Yang, B., Liang, M., and Urtasun, R. (November, January 30). Hdnet: Exploiting hd maps for 3d object detection. Proceedings of the Conference on Robot Learning, Osaka, Japan."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Biswas, J., and Veloso, M. (2012, January 14\u201318). Depth camera based indoor mobile robot localization and navigation. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224766"},{"key":"ref_7","unstructured":"Whitty, M., Cossell, S., Dang, K.S., Guivant, J., and Katupitiya, J. (2010, January 1\u20133). Autonomous navigation using a real-time 3d point cloud. Proceedings of the Australasian Conference on Robotics and Automation, Brisbane, Australia."},{"key":"ref_8","unstructured":"Wang, C., Tanahashi, H., Hirayu, H., Niwa, Y., and Yamamoto, K. (2001, January 8\u201314). Comparison of local plane fitting methods for range data. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kim, K., and Davis, L.S. (2006, January 7\u201313). Multi-Camera tracking and segmentation of occluded people on ground plane using search-Guided particle filtering. Proceedings of the 9th European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744078_8"},{"key":"ref_10","unstructured":"Trevor, A.J., Gedikli, S., Rusu, R.B., and Christensen, H.I. (2013, January 5). Efficient Organized Point Cloud Segmentation with Connected Components. Proceedings of the 3rd Workshop on Semantic Perception Mapping and Exploration (SPME), Karlsruhe, Germany."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.autcon.2013.10.023","article-title":"Building Information Modeling (BIM) for existing buildings-Literature review and future needs","volume":"38","author":"Volk","year":"2014","journal-title":"Autom. Constr."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D mapping: Using Kinect-Style depth cameras for dense 3D modeling of indoor environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1318","DOI":"10.1109\/TCYB.2013.2265378","article-title":"Enhanced computer vision with microsoft kinect sensor: A review","volume":"43","author":"Han","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.jvcir.2013.04.001","article-title":"Continuous plane detection in point-Cloud data based on 3D Hough Transform","volume":"25","author":"Hulik","year":"2014","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Tang, S., Zhu, Q., Chen, W., Darwish, W., Wu, B., Hu, H., and Chen, M. (2016). Enhanced RGB-D mapping method for detailed 3D indoor and outdoor modeling. Sensors, 16.","DOI":"10.3390\/s16101589"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7\u201312). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE\/RSJ International Conference, Intelligent Robots and Systems (IROS), Algarve, Portuga.","DOI":"10.1109\/IROS.2012.6385773"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., and Fitzgibbon, A. (2011, January 26\u201329). KinectFusion: Real-Time dense surface mapping and tracking. Proceedings of the 2011 10th IEEE International Symposium, Mixed and Augmented Reality (ISMAR), Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Darwish, W., Tang, S., Li, W., and Chen, W. (2017). A new calibration method for commercial RGB-d sensors. Sensors, 17.","DOI":"10.3390\/s17061204"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chai, Z., Sun, Y., and Xiong, Z. (2018, January 9\u201312). A Novel Method for LiDAR Camera Calibration by Plane Fitting. Proceedings of the IEEE\/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Auckland, New Zealand.","DOI":"10.1109\/AIM.2018.8452339"},{"key":"ref_20","unstructured":"Xu, L., Au, O.C., Sun, W., Li, Y., and Li, J. (2012, January 3\u20136). Hybrid plane fitting for depth estimation. Proceedings of the 2012 Asia-Pacific, Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC), Hollywood, CA, USA."},{"key":"ref_21","unstructured":"Habbecke, M., and Kobbelt, L. (2006, January 22\u201324). Iterative multi-View plane fitting. Proceedings of the International Fall Workshop of Vision, Modeling, and Visualization, Aachen, Germany."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Habbecke, M., and Kobbelt, L. (2007, January 17\u201322). A surface-Growing approach to multi-View stereo reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383195"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1145\/2816795.2818075","article-title":"Autoscanning for coupled scene reconstruction and proactive object analysis","volume":"34","author":"Xu","year":"2015","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0262-8856(92)90066-C","article-title":"Object modelling by registration of multiple range images","volume":"10","author":"Chen","year":"1992","journal-title":"Image Vis. Comput."},{"key":"ref_25","unstructured":"Hong, L., and Chen, G. (July, January 27). Segment-Based stereo matching using graph cuts. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1172","DOI":"10.1109\/TVT.2009.2039718","article-title":"Processing dense stereo data using elevation maps: Road surface, traffic isle, and obstacle detection","volume":"59","author":"Oniga","year":"2010","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1080\/14786440109462720","article-title":"LIII. On lines and planes of closest fit to systems of points in space","volume":"2","author":"Pearson","year":"1901","journal-title":"Lond. Edinb. Dublin Philos. Mag. J. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/3DRes.02(2011)3","article-title":"The 3d hough transform for plane detection in point clouds: A review and a new accumulator design","volume":"2","author":"Borrmann","year":"2011","journal-title":"3D Res."},{"key":"ref_29","unstructured":"Bolles, R.C., and Fischler, M.A. (2019, January 10\u201316). A RANSAC-Based Approach to Model Fitting and Its Application to Finding Cylinders in Range Data. Proceedings of the International Joint Conference on Artificial Intelligence, Macao, China."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"8198","DOI":"10.3390\/s100908198","article-title":"Assessment of relative accuracy of AHN-2 laser scanning data using planar features","volume":"10","author":"Sande","year":"2010","journal-title":"Sensors"},{"key":"ref_31","unstructured":"Chum, O., and Matas, J. (2005, January 20\u201325). Matching with PROSAC-Progressive sample consensus. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1006\/cviu.1999.0832","article-title":"MLESAC: A new robust estimator with application to estimating image geometry","volume":"78","author":"Torr","year":"2000","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1282","DOI":"10.1016\/j.robot.2014.03.013","article-title":"Approximate triangulation and region growing for efficient segmentation and smoothing of range images","volume":"62","author":"Holz","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s00138-017-0901-z","article-title":"Geometric primitive refinement for structured light cameras","volume":"29","author":"Fuersattel","year":"2018","journal-title":"Mach. Vis. Appl."},{"key":"ref_35","unstructured":"Heikkila, J., and Silven, O. (1997, January 17\u201319). A four-Step camera calibration procedure with implicit image correction. Proceedings of the Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"8824","DOI":"10.1109\/ACCESS.2018.2890713","article-title":"A Robust Calibration Method for Consumer Grade RGB-D Sensors for Precise Indoor Reconstruction","volume":"7","author":"Darwish","year":"2019","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1111\/j.1467-8659.2007.01016.x","article-title":"Efficient RANSAC for point-Cloud shape detection","volume":"26","author":"Schnabel","year":"2007","journal-title":"Comput. Graph. Forum"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, L., Yang, F., Zhu, H., Li, D., Li, Y., and Tang, L. (2017). An improved RANSAC for 3D point cloud plane segmentation based on normal distribution transformation cells. Remote Sens., 9.","DOI":"10.3390\/rs9050433"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Miyagawa, S., Yoshizawa, S., and Yokota, H. (2018, January 7\u201310). Trimmed Median PCA for Robust Plane Fitting. Proceedings of the 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451752"},{"key":"ref_40","unstructured":"Occipital (2019, December 05). Structure Sensor. Available online: https:\/\/structure.io\/structure-sensor."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/2\/320\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:43:56Z","timestamp":1760363036000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/2\/320"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,18]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["rs12020320"],"URL":"https:\/\/doi.org\/10.3390\/rs12020320","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,1,18]]}}}