{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T16:23:11Z","timestamp":1783095791060,"version":"3.54.6"},"reference-count":28,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T00:00:00Z","timestamp":1692835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Research Project of the Henan Province","award":["222102220071"],"award-info":[{"award-number":["222102220071"]}]},{"name":"Science and Technology Research Project of the Henan Province","award":["232102321021"],"award-info":[{"award-number":["232102321021"]}]},{"name":"Science and Technology Research Project of the Henan Province","award":["232102211050"],"award-info":[{"award-number":["232102211050"]}]},{"name":"Science and Technology Research Project of the Henan Province","award":["2018BSJJ053"],"award-info":[{"award-number":["2018BSJJ053"]}]},{"name":"Research Fund of the Zhengzhou University of Light Industry","award":["222102220071"],"award-info":[{"award-number":["222102220071"]}]},{"name":"Research Fund of the Zhengzhou University of Light Industry","award":["232102321021"],"award-info":[{"award-number":["232102321021"]}]},{"name":"Research Fund of the Zhengzhou University of Light Industry","award":["232102211050"],"award-info":[{"award-number":["232102211050"]}]},{"name":"Research Fund of the Zhengzhou University of Light Industry","award":["2018BSJJ053"],"award-info":[{"award-number":["2018BSJJ053"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Thermal infrared imaging is less affected by lighting conditions and smoke compared to visible light imaging. However, thermal infrared images often have lower resolution and lack rich texture details, making them unsuitable for stereo matching and 3D reconstruction. To enhance the quality of infrared stereo imaging, we propose an advanced stereo matching algorithm. Firstly, the images undergo preprocessing using a non-local mean noise reduction algorithm to remove thermal noise and achieve a smoother result. Subsequently, we perform camera calibration using a custom-made chessboard calibration board and Zhang\u2019s camera calibration method to obtain accurate camera parameters. Finally, the disparity map is generated using the SGBM (semi-global block matching) algorithm based on the weighted least squares method, enabling the 3D point cloud reconstruction of the object. The experimental results demonstrate that the proposed algorithm performs well in objects with sufficient thermal contrast and relatively simple scenes. The proposed algorithm reduces the average error value by 10.9 mm and the absolute value of the average error by 1.07% when compared with the traditional SGBM algorithm, resulting in improved stereo matching accuracy for thermal infrared imaging. While ensuring accuracy, our proposed algorithm achieves the stereo reconstruction of the object with a good visual effect, thereby holding high practical value.<\/jats:p>","DOI":"10.3390\/s23177372","type":"journal-article","created":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T10:47:08Z","timestamp":1692874028000},"page":"7372","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2093-8229","authenticated-orcid":false,"given":"Huaizhou","family":"Li","sequence":"first","affiliation":[{"name":"College of Building Environmental Engineering, Zhengzhou University of Light Industry, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuaijun","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Building Environmental Engineering, Zhengzhou University of Light Industry, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenpeng","family":"Bai","sequence":"additional","affiliation":[{"name":"College of Building Environmental Engineering, Zhengzhou University of Light Industry, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Building Environmental Engineering, Zhengzhou University of Light Industry, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sen","family":"Li","sequence":"additional","affiliation":[{"name":"College of Building Environmental Engineering, Zhengzhou University of Light Industry, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shupei","family":"Wen","sequence":"additional","affiliation":[{"name":"College of Building Environmental Engineering, Zhengzhou University of Light Industry, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,24]]},"reference":[{"key":"ref_1","first-page":"299","article-title":"Binocular stereo matching algorithm based on multidimensional feature fusion","volume":"57","author":"Gong","year":"2020","journal-title":"Laser Optoelectron. Prog."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"138254","DOI":"10.1109\/ACCESS.2021.3118345","article-title":"Joint Dense 3D Reconstruction Method for Endoscopic Images of Weak Texture Scenes","volume":"9","author":"Gu","year":"2021","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"034515","DOI":"10.1117\/1.JRS.15.034515","article-title":"Quality analysis of Worldview-4 DSMs generated by least squares matching and semi-global matching","volume":"15","author":"Sefercik","year":"2021","journal-title":"J. Appl. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yun, S., Jung, M., Kim, J., Jung, S., Cho, Y., Jeon, M.H., Kim, G., and Kim, A. (2022, January 23\u201327). STheReO: Stereo Thermal Dataset for Research in Odometry and Mapping. Proceedings of the 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.","DOI":"10.1109\/IROS47612.2022.9981857"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lai, X., Yang, B., Ma, B., Liu, M., Yin, Z., Yin, L., and Zheng, W. (2023). An Improved Stereo Matching Algorithm Based on Joint Similarity Measure and Adaptive Weights. Appl. Sci., 13.","DOI":"10.3390\/app13010514"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, J., Wang, H., Zhang, L., Wang, Z., and Wang, M. (2019, January 3\u20135). The Research of Random Sample Consensus Matching Algorithm in PCA-SIFT Stereo Matching Method. Proceedings of the 2019 Chinese Control and Decision Conference (CCDC), Nanchang, China.","DOI":"10.1109\/CCDC.2019.8833239"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.3934\/mbe.2021160","article-title":"Binocular stereo matching algorithm based on MST cost aggregation","volume":"18","author":"Zhang","year":"2021","journal-title":"Math. Biosci. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G.R. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5406","DOI":"10.1109\/JSEN.2020.2969324","article-title":"Depth Information Enhancement Using Block Matching and Image Pyramiding Stereo Vision Enabled RGB-D Sensor","volume":"20","author":"Jacob","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8501312","DOI":"10.1109\/TIM.2022.3149334","article-title":"Optimization of 3-D Pose Measurement Method Based on Binocular Vision","volume":"71","author":"Wei","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"143","DOI":"10.5194\/isprs-annals-V-2-2020-143-2020","article-title":"Lock-free multithreaded semi-global matching with an arbitrary number of path directions","volume":"2","author":"Frommholz","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhu, C., and Chang, Y.-Z. (2019). Hierarchical Guided-Image-Filtering for Efficient Stereo Matching. Appl. Sci., 9.","DOI":"10.3390\/app9153122"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, Y., Gu, M., Zhu, Y., Chen, G., Xu, Z., and Guo, Y. (2022). Improvement of AD-Census Algorithm Based on Stereo Vision. Sensors, 22.","DOI":"10.3390\/s22186933"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1109\/TCSVT.2021.3061704","article-title":"A Resource-Efficient Pipelined Architecture for Real-Time Semi-Global Stereo Matching","volume":"32","author":"Lu","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_17","first-page":"139","article-title":"3D reconstruction based on SGBM semi-global stereo matching algorithm","volume":"42","author":"Zhao","year":"2021","journal-title":"Laser J."},{"key":"ref_18","first-page":"19","article-title":"Indoor positioning and reconstruction of the binocular measurement system","volume":"43","author":"Zhao","year":"2022","journal-title":"Laser J."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhou, L., Gao, S., Wang, S., Zhang, H., Liu, R., and Liu, J. (2022). IPD-Net: Infrared Pedestrian Detection Network via Adaptive Feature Extraction and Coordinate Information Fusion. Sensors, 22.","DOI":"10.3390\/s22228966"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Eltuhamy, R.A., Rady, M., Almatrafi, E., Mahmoud, H.A., and Ibrahim, K.H. (2023). Fault Detection and Classification of CIGS Thin-Film PV Modules Using an Adaptive Neuro-Fuzzy Inference Scheme. Sensors, 23.","DOI":"10.3390\/s23031280"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Abreu de Souza, M., Alka Cordeiro, D.C., Oliveira, J.d., Oliveira, M.F.A.d., and Bonafini, B.L. (2023). 3D Multi-Modality Medical Imaging: Combining Anatomical and Infrared Thermal Images for 3D Reconstruction. Sensors, 23.","DOI":"10.3390\/s23031610"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1049\/iet-ipr.2019.0144","article-title":"Stereo matching for infrared images using guided filtering weighted by exponential moving average","volume":"14","author":"Zhu","year":"2020","journal-title":"IET Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"208","DOI":"10.5201\/ipol.2011.bcm_nlm","article-title":"Non-local means denoising","volume":"1","author":"Buades","year":"2011","journal-title":"Image Process. Line"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"8667606","DOI":"10.1155\/2022\/8667606","article-title":"Research on Calibration Methods of Long-Wave Infrared Camera and Visible Camera","volume":"2022","author":"Sun","year":"2022","journal-title":"J. Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"107","DOI":"10.5194\/isprs-annals-V-2-2021-107-2021","article-title":"Real-Time Depth Map Estimation from Infrared Stereo Images of RGB-D Cameras","volume":"2","author":"Zhong","year":"2021","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1360612.1360666","article-title":"Edge-preserving decompositions for multi-scale tone and detail manipulation","volume":"27","author":"Farbman","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_27","first-page":"585","article-title":"Implementation of Stereo Vision Semi-Global Block Matching Methods for Distance Measurement","volume":"12","author":"Setyawan","year":"2018","journal-title":"Indones. J. Electr. Eng. Comput. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Venkatanath, N., Praneeth, D., Maruthi Chandrasekhar, B., Channappayya, S.S., and Medasani, S.S. (March, January 27). Blind image quality evaluation using perception based features. Proceedings of the 2015 Twenty First National Conference on Communications (NCC), Mumbai, India.","DOI":"10.1109\/NCC.2015.7084843"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7372\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:37:58Z","timestamp":1760128678000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7372"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,24]]},"references-count":28,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23177372"],"URL":"https:\/\/doi.org\/10.3390\/s23177372","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,24]]}}}