{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:47:52Z","timestamp":1760150872693,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,28]],"date-time":"2023-12-28T00:00:00Z","timestamp":1703721600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61871034","50914020206"],"award-info":[{"award-number":["61871034","50914020206"]}]},{"name":"14th Five-Year Plan Pre-study Foundation","award":["61871034","50914020206"],"award-info":[{"award-number":["61871034","50914020206"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, the range of applications that utilize multiband imaging has significantly expanded. However, it is difficult to utilize multichannel heterogeneous images to achieve a spectral complementarity advantage and obtain accurate depth prediction based on traditional systems. In this study, we investigate CFNet, an iterative prediction network, for disparity prediction with infrared and visible light images based on common features. CFNet consists of several components, including a common feature extraction subnetwork, context subnetwork, multimodal information acquisition subnetwork, and a cascaded convolutional gated recurrent subnetwork. It leverages the advantages of dual-band (infrared and visible light) imaging, considering semantic information, geometric structure, and local matching details within images to predict the disparity between heterogeneous image pairs accurately. CFNet demonstrates superior performance in recognized evaluation metrics and visual image observations when compared with other publicly available networks, offering an effective technical approach for practical heterogeneous image disparity prediction.<\/jats:p>","DOI":"10.3390\/s24010196","type":"journal-article","created":{"date-parts":[[2023,12,29]],"date-time":"2023-12-29T03:28:41Z","timestamp":1703820521000},"page":"196","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Iterative Network for Disparity Prediction with Infrared and Visible Light Images Based on Common Features"],"prefix":"10.3390","volume":"24","author":[{"given":"Ziang","family":"Zhang","sequence":"first","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Li","sequence":"additional","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiqi","family":"Jin","sequence":"additional","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zanxi","family":"Qu","sequence":"additional","affiliation":[{"name":"MOE Key Laboratory of Optoelectronic Imaging Technology and System, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1109\/TIV.2019.2904389","article-title":"Pedestrian Detection for Autonomous Vehicle Using Multi-Spectral Cameras","volume":"4","author":"Chen","year":"2019","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_2","first-page":"380","article-title":"Object detection from thermal infrared and visible light cameras in search and rescue scenes","volume":"Volume 2020","author":"Banuls","year":"2020","journal-title":"Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2331","DOI":"10.1007\/s11554-021-01111-0","article-title":"Embedded real-time infrared and visible image fusion for UAV surveillance","volume":"18","author":"Li","year":"2021","journal-title":"J. Real-Time Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhao, J., Zhou, B., Wang, G., Ying, J., Liu, J., and Chen, Q. (2022). Spectral Camouflage Characteristics and Recognition Ability of Targets Based on Visible\/Near-Infrared Hyperspectral Images. Photonics, 9.","DOI":"10.3390\/photonics9120957"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gao, Z., Li, D., Wen, G., Kuai, Y., and Chen, R. (2023). Drone Based RGBT Tracking with Dual-Feature Aggregation Network. Drones, 7.","DOI":"10.3390\/drones7090585"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"8188","DOI":"10.1364\/AO.432534","article-title":"Panoramic depth estimation via supervised and unsupervised learning in indoor scenes","volume":"60","author":"Zhou","year":"2021","journal-title":"Appl. Opt."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"26876","DOI":"10.1364\/OE.433247","article-title":"Binocular stereo matching of real scenes based on a convolutional neural network and computer graphics","volume":"29","author":"Kou","year":"2021","journal-title":"Opt. Express"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Li, H., Wang, S., Bai, Z., Wang, H., Li, S., and Wen, S. (2023). Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared. Sensors, 23.","DOI":"10.3390\/s23177372"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.sigpro.2015.07.005","article-title":"Adaptive fusion algorithm of heterogeneous sensor networks under different illumination conditions","volume":"126","author":"Tong","year":"2016","journal-title":"Signal Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1619","DOI":"10.1364\/JOSAA.435156","article-title":"Occlusion disparity refinement for stereo matching through the geometric prior-based adaptive label search","volume":"38","author":"Wang","year":"2021","journal-title":"J. Opt. Soc. Am. A Opt. Image Sci. Vis."},{"key":"ref_11","unstructured":"Kim, S., Min, D., Ham, B., Ryu, S., Do, M.N., and Sohn, K. (2015, January 7\u201312). DASC: Dense adaptive self-correlation descriptor for multi-modal and multi-spectral correspondence. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhi, T., Pires, B., Hebert, M., and Narasimhan, S. (2018, January 18\u201323). Deep material-aware cross-spectral stereo matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00205"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"8706","DOI":"10.1609\/aaai.v33i01.33018706","article-title":"Unsupervised cross-spectral stereo matching by learning to synthesize","volume":"Volume 33","author":"Liang","year":"2019","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5373","DOI":"10.1109\/LRA.2022.3155202","article-title":"Deep cross spectral stereo matching using multi-spectral image fusion","volume":"7","author":"Liang","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2019.12.014","article-title":"IVFuseNet: Fusion of infrared and visible light images for depth prediction","volume":"58","author":"Li","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_16","first-page":"218","article-title":"Raft-stereo: Multilevel recurrent field transforms for stereo matching","volume":"Volume 2021","author":"Lipson","year":"2021","journal-title":"Proceedings of the International Conference on 3D Vision"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xu, G., Wang, X., Ding, X., and Yang, X. (2023). Iterative geometry encoding volume for stereo matching. arXiv.","DOI":"10.1109\/CVPR52729.2023.02099"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, J., Wang, P., Xiong, P., Cai, T., Yan, Z., Yang, L., Liu, J., Fan, H., and Liu, S. (2022, January 18\u201324). Practical stereo matching via cascaded recurrent network with adaptive correlation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01578"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, B., Chen, K., Peng, S.-L., and Zhao, M. (2022). Adaptive Aggregate Stereo Matching Network with Depth Map Super-Resolution. Sensors, 22.","DOI":"10.3390\/s22124548"},{"key":"ref_20","unstructured":"Xu, G., Zhou, H., and Yang, X. (2023). CGI-stereo: Accurate and real-time stereo matching via context and geometry interaction. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Quan, Z., Wu, B., and Luo, L. (2023). An Image Stereo Matching Algorithm with Multi-Spectral Attention Mechanism. Sensors, 23.","DOI":"10.3390\/s23198179"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kim, N., Choi, Y., Hwang, S., and Kweon, I. (2018, January 2\u20137). Multispectral transfer network: Unsupervised depth estimation for all-day vision. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12297"},{"key":"ref_23","first-page":"2366","article-title":"Depth map prediction from a single image using a multi-scale deep network","volume":"2","author":"Eigen","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/196\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:43:49Z","timestamp":1760132629000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,28]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24010196"],"URL":"https:\/\/doi.org\/10.3390\/s24010196","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,12,28]]}}}