{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T18:40:46Z","timestamp":1761676846913,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,1,23]],"date-time":"2020-01-23T00:00:00Z","timestamp":1579737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010877","name":"Science, Technology and Innovation Commission of Shenzhen Municipality","doi-asserted-by":"publisher","award":["JCYJ20170818104822282"],"award-info":[{"award-number":["JCYJ20170818104822282"]}],"id":[{"id":"10.13039\/501100010877","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002920","name":"Research Grants Council, University Grants Committee","doi-asserted-by":"publisher","award":["152223\/18E"],"award-info":[{"award-number":["152223\/18E"]}],"id":[{"id":"10.13039\/501100002920","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011650","name":"Research Institute for Sustainable Urban Development, Hong Kong Polytechnic University","doi-asserted-by":"publisher","award":["Research Fund"],"award-info":[{"award-number":["Research Fund"]}],"id":[{"id":"10.13039\/501100011650","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Consumer-grade RGBD sensors that provide both colour and depth information have many potential applications, such as robotics control, localization, and mapping, due to their low cost and simple operation. However, the depth measurement provided by consumer-grade RGBD sensors is still inadequate for many high-precision applications, such as rich 3D reconstruction, accurate object recognition and precise localization, due to the fact that the systematic errors of RGB sensors increase exponentially with the ranging distance. Most existing calibration models for depth measurement must be carried out with different distances. In this paper, we reveal the mechanism of how an infrared (IR) camera and IR projector contribute to the overall non-centrosymmetric distortion of a structured light pattern-based RGBD sensor. Then, a new two-step calibration method for RGBD sensors based on the disparity measurement is proposed, which is range-independent and has full frame coverage. Three independent calibration models are used for the calibration for the three main components of the RGBD sensor errors: the infrared camera distortion, the infrared projection distortion, and the infrared cone-caused bias. Experiments show the proposed calibration method can provide precise calibration results in full-range and full-frame coverage of depth measurement. The offset in the edge area of long-range depth (8 m) is reduced from 86 cm to 30 cm, and the relative error is reduced from 11% to 3% of the range distance. Overall, at far range the proposed calibration method can improve the depth accuracy by 70% in the central region of depth frame and 65% in the edge region.<\/jats:p>","DOI":"10.3390\/s20030639","type":"journal-article","created":{"date-parts":[[2020,1,23]],"date-time":"2020-01-23T10:36:02Z","timestamp":1579775762000},"page":"639","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Range-Independent Disparity-Based Calibration Model for Structured Light Pattern-Based RGBD Sensor"],"prefix":"10.3390","volume":"20","author":[{"given":"Wenbin","family":"Li","sequence":"first","affiliation":[{"name":"Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen 518057, China"},{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5610-3223","authenticated-orcid":false,"given":"Yaxin","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0549-6052","authenticated-orcid":false,"given":"Walid","family":"Darwish","sequence":"additional","affiliation":[{"name":"Geomatics Engineering Lab, Civil Engineering Department, Faculty of Engineering, Cairo University, Cairo 12613, Egypt"},{"name":"Department of Electronic and Informatics, Faculty of Engineering, Vrije Universiteit Brussel, 1050 Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shengjun","family":"Tang","sequence":"additional","affiliation":[{"name":"Guangdong Key Laboratory of Urban Informatics &amp; Shenzhen Key Laboratory of Spatial Smart Sensing and Services &amp; Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) &amp; Research Institute for Smart Cities, School of Architecture and Urban Planning, Shenzhen University, Shenzhen 518050, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuling","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wu","family":"Chen","sequence":"additional","affiliation":[{"name":"Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen 518057, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohli, P., Shotton, J., Hodges, S., and Fitzgibbon, A.W. (2011, January 26\u201329). Kinectfusion: Real-time dense surface mapping and tracking. Proceedings of the 2011 10th ISMAR, Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6162880"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4893","DOI":"10.1109\/TIP.2014.2352851","article-title":"Robust 3D reconstruction with an RGB-D camera","volume":"23","author":"Wang","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Karaman, S., Anders, A., Boulet, M., Connor, J., Gregson, K., Guerra, W., Guldner, O., Mohamoud, M., Plancher, B., and Shin, R. (2017, January 11). Project-based, collaborative, algorithmic robotics for high school students: Programming self-driving race cars at MIT. Proceedings of the 2017 IEEE Integrated STEM Education Conference (ISEC), Princeton, NJ, USA.","DOI":"10.1109\/ISECon.2017.7910242"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Khan, A., Moideen, F., Lopez, J., Khoo, W.L., and Zhu, Z. (2012, January 11\u201313). KinDectect: Kinect detecting objects. Proceedings of the International Conference on Computers for Handicapped Persons, Linz, Austria.","DOI":"10.1007\/978-3-642-31534-3_86"},{"key":"ref_6","unstructured":"Wasenm\u00fcller, O., and Stricker, D. (2016, January 20\u201324). Comparison of kinect v1 and v2 depth images in terms of accuracy and precision. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan."},{"key":"ref_7","unstructured":"Occipital (2019, January 08). Structure Sensor. Available online: https:\/\/structure.io\/."},{"key":"ref_8","unstructured":"Asus (2019, June 05). Use Xtion PRO Developer Solution to Make Motion-Sensing Applications and Games. Available online: https:\/\/www.asus.com\/3D-Sensor\/Xtion_PRO\/."},{"key":"ref_9","unstructured":"(2019, January 08). Introducing Intel\u00ae RealSense\u2122 LiDAR Camera L515. Available online: https:\/\/www.intel.com\/content\/www\/us\/en\/architecture-and-technology\/realsense-overview.html."},{"key":"ref_10","unstructured":"ZED (2019, January 08). Meet ZED. Available online: https:\/\/www.stereolabs.com\/zed\/."},{"key":"ref_11","unstructured":"MIT (2019, October 28). PrimeSense-MIT Technology Review. Available online: http:\/\/www2.technologyreview.com\/tr50\/primesense\/."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zennaro, S., Munaro, M., Milani, S., Zanuttigh, P., Bernardi, A., Ghidoni, S., and Menegatti, E. (July, January 29). Performance evaluation of the 1st and 2nd generation Kinect for multimedia applications. Proceedings of the 2015 IEEE International Conference on Multimedia and Expo (ICME), Turin, Italy.","DOI":"10.1109\/ICME.2015.7177380"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2058","DOI":"10.1109\/TPAMI.2012.125","article-title":"Joint depth and colour camera calibration with distortion correction","volume":"34","author":"Herrera","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","unstructured":"Konolige, K., and Mihelich, P. (2019, January 08). Technical Description of Kinect Calibration. Available online: http:\/\/www.wiki.ros.org\/kinect_calibration\/technical."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Smisek, J., Jancosek, M., and Pajdla, T. (2013). 3D with Kinect. Consumer Depth Cameras for Computer Vision, Springer.","DOI":"10.1007\/978-1-4471-4640-7_1"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, C., and Zhang, Z. (2011). Calibration between depth and colour sensors for commodity depth cameras. Computer Vision and Machine Learning with RGB-D Sensors, Springer.","DOI":"10.1109\/ICME.2011.6012191"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.jvcir.2013.02.011","article-title":"Calibrated depth and colour cameras for accurate 3D interaction in a stereoscopic augmented reality environment","volume":"25","author":"Canessa","year":"2014","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Darwish, W., Tang, S., Li, W., and Chen, W. (2017). A new calibration method for commercial RGB-D sensors. Sensors, 17.","DOI":"10.3390\/s17061204"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1109\/ACCESS.2013.2271860","article-title":"Photogrammetric bundle adjustment with self-calibration of the PrimeSense 3D camera technology: Microsoft Kinect","volume":"1","author":"Chow","year":"2013","journal-title":"IEEE Access"},{"key":"ref_21","unstructured":"Darwish, W., Tang, S., Li, W., and Chen, W. (2016, January 24\u201326). Full Parameter Calibration for Low Cost Depth Sensors. Proceedings of the Melaha 2016 International Conference and Exhibition, Cairo, Egypt."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Darwish, W., Li, W., Tang, S., and Chen, W. (2017, January 27\u201329). Coarse to fine global RGB-D frames registration for precise indoor 3D model reconstruction. Proceedings of the 2017 International Conference on Localization and GNSS (ICL-GNSS), Nottingham, UK.","DOI":"10.1109\/ICL-GNSS.2017.8376250"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1731","DOI":"10.1109\/JSEN.2014.2309987","article-title":"Characterizations of noise in Kinect depth images: A review","volume":"14","author":"Mallick","year":"2014","journal-title":"IEEE Sensors J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MMUL.2012.24","article-title":"Microsoft kinect sensor and its effect","volume":"19","author":"Zhang","year":"2012","journal-title":"IEEE Multimed."},{"key":"ref_25","unstructured":"Zhang, Z. (1999, January 20\u201327). Flexible camera calibration by viewing a plane from unknown orientations. Proceedings of the 7th ICCV, Kerkyra, Greece."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Moreno, D., and Taubin, G. (2012, January 13\u201315). Simple, accurate, and robust projector-camera calibration. Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, Zurich, Switzerland.","DOI":"10.1109\/3DIMPVT.2012.77"},{"key":"ref_27","first-page":"181","article-title":"Calibration of projector lens distortions","volume":"54","author":"Johnson","year":"2005","journal-title":"J. Electron Microsc."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kimura, M., Mochimaru, M., and Kanade, T. (2007, January 17\u201322). Projector calibration using arbitrary planes and calibrated camera. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383477"},{"key":"ref_29","unstructured":"Qualisys (2019, January 08). Miqus Technical Specifications. Available online: https:\/\/cdn-content.qualisys.com\/2019\/07\/PI_Miqus_0.pdf."},{"key":"ref_30","unstructured":"Occipital (2019, January 08). Structure Sensor Sepcification. Available online: https:\/\/structure.io\/structure-core\/specs."},{"key":"ref_31","first-page":"444","article-title":"Decentering distortion of lenses","volume":"32","author":"Brown","year":"1966","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"083601","DOI":"10.1117\/1.2336196","article-title":"Novel method for structured light system calibration","volume":"45","author":"Zhang","year":"2006","journal-title":"Opt. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"13070","DOI":"10.3390\/rs71013070","article-title":"Assessment and calibration of a RGB-D camera (Kinect v2 Sensor) towards a potential use for close-range 3D modeling","volume":"7","author":"Lachat","year":"2015","journal-title":"Remote Sens."},{"key":"ref_35","unstructured":"Schmalz, C. (2012). Robust Single-Shot Structured Light 3D Scanning. [Ph.D. Thesis, Friedrich\u2013Alexander University Erlangen\u2013N\u00fcrnberg, Eralngena and Nuremberg]."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1137\/0715063","article-title":"Algorithms for the solution of the nonlinear least-squares problem","volume":"15","author":"Gill","year":"1978","journal-title":"SIAM J. Numer. Anal."},{"key":"ref_37","unstructured":"Mindru, F., Moons, T., and Van Gool, L. (1999, January 23\u201325). Recognizing colour patterns irrespective of viewpoint and illumination. Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), Fort Collins, CO, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/639\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:20:29Z","timestamp":1760361629000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/639"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,23]]},"references-count":37,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20030639"],"URL":"https:\/\/doi.org\/10.3390\/s20030639","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,1,23]]}}}