{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T16:10:03Z","timestamp":1762272603575,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2020,7,28]],"date-time":"2020-07-28T00:00:00Z","timestamp":1595894400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National Key R&amp;D Program of China","award":["2018YFB0505400 & 2016YFB0502202"],"award-info":[{"award-number":["2018YFB0505400 & 2016YFB0502202"]}]},{"name":"the National Natural Science Foundation of China (NSFC)","award":["41901407"],"award-info":[{"award-number":["41901407"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>Low-cost, commercial RGB-D cameras have become one of the main sensors for indoor scene 3D perception and robot navigation and localization. In these studies, the Intel RealSense R200 sensor (R200) is popular among many researchers, but its integrated commercial stereo matching algorithm has a small detection range, short measurement distance and low depth map resolution, which severely restrict its usage scenarios and service life. For these problems, on the basis of the existing research, a novel infrared stereo matching algorithm that combines the idea of the semi-global method and sliding window is proposed in this paper. First, the R200 is calibrated. Then, through Gaussian filtering, the mutual information and correlation between the left and right stereo infrared images are enhanced. According to mutual information, the dynamic threshold selection in matching is realized, so the adaptability to different scenes is improved. Meanwhile, the robustness of the algorithm is improved by the Sobel operators in the cost calculation of the energy function. In addition, the accuracy and quality of disparity values are improved through a uniqueness test and sub-pixel interpolation. Finally, the BundleFusion algorithm is used to reconstruct indoor 3D surface models in different scenarios, which proved the effectiveness and superiority of the stereo matching algorithm proposed in this paper.<\/jats:p>","DOI":"10.3390\/ijgi9080472","type":"journal-article","created":{"date-parts":[[2020,7,28]],"date-time":"2020-07-28T10:16:49Z","timestamp":1595931409000},"page":"472","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A Real-Time Infrared Stereo Matching Algorithm for RGB-D Cameras\u2019 Indoor 3D Perception"],"prefix":"10.3390","volume":"9","author":[{"given":"Jiageng","family":"Zhong","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0722-028X","authenticated-orcid":false,"given":"Ming","family":"Li","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"},{"name":"State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan","family":"Liao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"},{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiangying","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Qin, J., Li, M., Liao, X., and Zhong, J. (2019). Accumulative Errors Optimization for Visual Odometry of ORB-SLAM2 Based on RGB-D Cameras. Isprs Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8120581"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, M., Chen, R., Liao, X., Guo, B., Zhang, W., and Guo, G. (2020). A Precise Indoor Visual Positioning Approach Using a Built Image Feature Database and Single User Image from Smartphone Cameras. Remote Sens., 12.","DOI":"10.3390\/rs12050869"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.isprsjprs.2019.01.018","article-title":"Albedo estimation for real-time 3D reconstruction using RGB-D and IR data","volume":"150","author":"Stotko","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"B\u00e4uml, B., Schmidt, F., Wimb\u00f6ck, T., Birbach, O., Dietrich, A., Fuchs, M., Friedl, W., Frese, U., Borst, C., and Grebenstein, M. (2011, January 9\u201313). Catching flying balls and preparing coffee: Humanoid rollin\u2019justin performs dynamic and sensitive tasks. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980073"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/TRO.2013.2279412","article-title":"3-D mapping with an RGB-D camera","volume":"30","author":"Endres","year":"2013","journal-title":"IEEE Trans. Robot."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.3390\/rs3061104","article-title":"Heritage recording and 3D modeling with photogrammetry and 3D scanning","volume":"3","author":"Remondino","year":"2011","journal-title":"Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Singh, S. (2014, January 14\u201316). LOAM: Lidar Odometry and Mapping in Real-time. Proceedings of the Robotics: Science and Systems Conference (RSS), Berkeley, CA, USA.","DOI":"10.15607\/RSS.2014.X.007"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kuhnert, K.D., and Stommel, M. (2006, January 9\u201315). Fusion of Stereo-Camera and PMD-Camera Data for Real-Time Suited Precise 3D Environment Reconstruction. Proceedings of the 2006 IEEE\/RSJ International Conference on Intelligent Robots and Systems, IROS 2006, Beijing, China.","DOI":"10.1109\/IROS.2006.282349"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"8741","DOI":"10.1109\/JSEN.2019.2920976","article-title":"Comparative Study of Intel R200, Kinect v2, and Primesense RGB-D Sensors Performance Outdoors","volume":"19","author":"Kuan","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1917","DOI":"10.1109\/JSEN.2010.2101060","article-title":"Lock-in time-of-flight (ToF) cameras: A survey","volume":"11","author":"Foix","year":"2011","journal-title":"IEEE Sens. J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2086","DOI":"10.1109\/TCSVT.2016.2555678","article-title":"Depth Estimation Using an Infrared Dot Projector and an Infrared Color Stereo Camera","volume":"27","author":"Hisatomi","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_13","unstructured":"Shengjun, T. (2017). RGB-D Indoor High-Precision 3D Mapping Method for Multi-View Image Enhancement. [Ph.D. Thesis, Wuhan University]."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"349","DOI":"10.3390\/ijgi6110349","article-title":"A Post-Rectification Approach of Depth Images of Kinect v2 for 3D Reconstruction of Indoor Scenes","volume":"6","author":"Jiao","year":"2017","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chen, H., Wang, K., and Yang, K. (2018, January 20\u201322). Improving RealSense by Fusing Color Stereo Vision and Infrared Stereo Vision for the Visually Impaired. Proceedings of the 2018 International Conference on Information Science and System, Wuhan, China.","DOI":"10.1145\/3209914.3209944"},{"key":"ref_16","unstructured":"Hirschmuller, H. (2005, January 20). Accurate and efficient stereo processing by semi-global matching and mutual information. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), Washington, DC, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Keselman, L., Iselin, Woodfill, J., Grunnet-Jepsen, A., and Bhowmik, A. (2017, January 21\u201326). Intel RealSense Stereoscopic Depth Cameras. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.167"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TPAMI.2003.1217603","article-title":"Advances in computational stereo","volume":"25","author":"Brown","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zabih, R., and Woodfill, J. (1994). Non-parametric local transforms for computing visual correspondence. European Conference on Computer Vision, Springer.","DOI":"10.1007\/BFb0028345"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1016\/S0042-6989(99)00241-2","article-title":"Weighted directional energy model of human stereo correspondence","volume":"40","author":"Prince","year":"2000","journal-title":"Vis. Res."},{"key":"ref_21","unstructured":"Veksler, O. (2005, January 20). Stereo correspondence by dynamic programming on a tree. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_22","unstructured":"Kolmogorov, V., and Zabih, R. (2001, January 7\u201314). Computing visual correspondence with occlusions using graph cuts. Proceedings of the Eighth IEEE International Conference on Computer Vision, Vancouver, BC, Canada."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1109\/TPAMI.2003.1206509","article-title":"Stereo matching using belief propagation","volume":"25","author":"Sun","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1014573219977","article-title":"A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms","volume":"47","author":"Scharstein","year":"2002","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1109\/TPAMI.2008.221","article-title":"Evaluation of Stereo Matching Costs on Images with Radiometric Differences","volume":"31","author":"Hirschmuller","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo Processing by Semiglobal Matching and Mutual Information","volume":"30","author":"Hirschmuller","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","unstructured":"Fritsch, D. (2013). SURE\u2014The ifp Software for Dense Image Matching. Photogrammetric Week \u201913, Wichmann."},{"key":"ref_28","unstructured":"Rothermel, M., Wenzel, K., Fritsch, D., and Haala, N. (2012, January 4\u20135). SURE: Photogrammetric Surface Reconstruction from Imagery. Proceedings of the LC3D Workshop, Berlin, Germany."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yan, L., Fei, L., Chen, C., Ye, Z., and Zhu, R. (2016). A Multi-View Dense Image Matching Method for High-Resolution Aerial Imagery Based on a Graph Network. Remote Sens., 8.","DOI":"10.3390\/rs8100799"},{"key":"ref_30","unstructured":"Hirschmuller, H. (2006, January 17\u201322). Stereo vision in structured environments by consistent semi-global matching. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chai, Y., and Yang, F. (2018, January 25\u201327). Semi-Global Stereo Matching Algorithm Based on Minimum Spanning Tree. Proceedings of the 2018 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Xi\u2019an, China.","DOI":"10.1109\/IMCEC.2018.8469306"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Loghman, M., and Kim, J. (2013, January 2\u20136). SGM-based dense disparity estimation using adaptive Census transform. Proceedings of the International Conference on Connected Vehicles and Expo (ICCVE), Las Vegas, USA.","DOI":"10.1109\/ICCVE.2013.6799860"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Humenberger, M., Engelke, T., and Kubinger, W. (2010, January 13\u201318). A census-based stereo vision algorithm using modified semi-global matching and plane fitting to improve matching quality. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543769"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Seki, A., and Pollefeys, M. (2017, January 1). SGM-Nets: Semi-Global Matching with Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.703"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yang, W., Li, X., Yang, B., and Fu, Y. (2020). A Novel Stereo Matching Algorithm for Digital Surface Model (DSM) Generation in Water Areas. Remote Sens, 12.","DOI":"10.3390\/rs12050870"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3054739","article-title":"Bundlefusion: Real-time globally consistent 3d reconstruction using on-the-fly surface reintegration","volume":"36","author":"Dai","year":"2017","journal-title":"ACM Trans. Graph."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","unstructured":"Heikkila, J., and Silvcn, O. (1997, January 17\u201319). A Four Step Camera Calibration Procedure with Implicit Image Correction. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA."},{"key":"ref_39","unstructured":"(2019, December 11). Camera Calibration Toolbox for Matlab. Available online: http:\/\/www.vision.caltech.edu\/bouguetj\/calib-doc."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lu, J., Zhang, X., Dong, D., and Fang, Y. (2014, January 28\u201330). A stereo matching algorithm based on census transformation and dynamic programming. Proceedings of the 33rd Chinese Control Conference, Nanjing, China.","DOI":"10.1109\/ChiCC.2014.6896386"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/TCSVT.2009.2026831","article-title":"FPGA Design and Implementation of a Real-Time Stereo Vision System","volume":"20","author":"Jin","year":"2010","journal-title":"Ieee Trans. Circuits Syst. Video Technol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Fathi, M., Sheikhaei, S., and Tavakoli, J. (May, January 30). Low-cost and Real-time Hardware Implementation of Stereo Vision System on FPGA. Proceedings of the 2019 27th Iranian Conference on Electrical Engineering (ICEE), Yazd, Iran.","DOI":"10.1109\/IranianCEE.2019.8786410"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1023\/A:1008160311296","article-title":"Depth discontinuities by pixel-to-pixel stereo","volume":"35","author":"Birchfield","year":"1999","journal-title":"Int. J. Comput. Vis."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1049\/iet-ipr.2019.0144","article-title":"Stereo matching for infrared images using guided filtering weighted by exponential moving average","volume":"14","author":"Zhu","year":"2020","journal-title":"Iet Image Process."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., and Fitzgibbon, A.W. (2011, January 26\u201329). KinectFusion: Real-Time Dense Surface Mapping and Tracking. Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6162880"},{"key":"ref_46","unstructured":"Whelan, T., Kaess, M., Fallon, M., Johannsson, H., Leonard, J.J., and McDonald, J. (2012, January 9\u201310). Kintinuous: Spatially extended KinectFusion. Proceedings of the 3rd RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Sydney, Australia."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Whelan, T., Leutenegger, S., Salas-Moreno, R., Glocker, B., and Davison, A. (2015). ElasticFusion: Dense SLAM without a pose graph. Proc. Robot. Sci. Syst., 1\u20139.","DOI":"10.15607\/RSS.2015.XI.001"}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/8\/472\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:52:15Z","timestamp":1760176335000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/9\/8\/472"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,28]]},"references-count":47,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["ijgi9080472"],"URL":"https:\/\/doi.org\/10.3390\/ijgi9080472","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2020,7,28]]}}}