{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T03:24:57Z","timestamp":1784949897493,"version":"3.55.0"},"reference-count":28,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T00:00:00Z","timestamp":1719446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62163014"],"award-info":[{"award-number":["62163014"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual ranging technology holds great promise in various fields such as unmanned driving and robot navigation. However, complex dynamic environments pose significant challenges to its accuracy and robustness. Existing monocular visual ranging methods are susceptible to scale uncertainty, while binocular visual ranging is sensitive to changes in lighting and texture. To overcome the limitations of single visual ranging, this paper proposes a fusion method for monocular and binocular visual ranging based on an adaptive Unscented Kalman Filter (AUKF). The proposed method first utilizes a monocular camera to estimate the initial distance based on the pixel size, and then employs the triangulation principle with a binocular camera to obtain accurate depth. Building upon this foundation, a probabilistic fusion framework is constructed to dynamically fuse monocular and binocular ranging using the AUKF. The AUKF employs nonlinear recursive filtering to estimate the optimal distance and its uncertainty, and introduces an adaptive noise-adjustment mechanism to dynamically update the observation noise based on fusion residuals, thus suppressing outlier interference. Additionally, an adaptive fusion strategy based on depth hypothesis propagation is designed to autonomously adjust the noise prior of the AUKF by combining current environmental features and historical measurement information, further enhancing the algorithm\u2019s adaptability to complex scenes. To validate the effectiveness of the proposed method, comprehensive evaluations were conducted on large-scale public datasets such as KITTI and complex scene data collected in real-world scenarios. The quantitative results demonstrate that the fusion method significantly improves the overall accuracy and stability of visual ranging, reducing the average relative error within an 8 m range by 43.1% and 40.9% compared to monocular and binocular ranging, respectively. Compared to traditional methods, the proposed method significantly enhances ranging accuracy and exhibits stronger robustness against factors such as lighting changes and dynamic targets. The sensitivity analysis further confirmed the effectiveness of the AUKF framework and adaptive noise strategy. In summary, the proposed fusion method effectively combines the advantages of monocular and binocular vision, significantly expanding the application range of visual ranging technology in intelligent driving, robotics, and other fields while ensuring accuracy, robustness, and real-time performance.<\/jats:p>","DOI":"10.3390\/s24134178","type":"journal-article","created":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T08:57:50Z","timestamp":1719478670000},"page":"4178","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Robust Monocular and Binocular Visual Ranging Fusion Method Based on an Adaptive UKF"],"prefix":"10.3390","volume":"24","author":[{"given":"Jiake","family":"Wang","sequence":"first","affiliation":[{"name":"School of Intelligent Manufacturing, Taizhou University, Taizhou 318000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong","family":"Guan","sequence":"additional","affiliation":[{"name":"School of Intelligent Manufacturing, Taizhou University, Taizhou 318000, China"},{"name":"School of Electrical and Automation Engineering, East China Jiaotong University, Nanchang 330013, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenjia","family":"Kang","sequence":"additional","affiliation":[{"name":"School of Intelligent Manufacturing, Taizhou University, Taizhou 318000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengzhan","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Intelligent Manufacturing, Taizhou University, Taizhou 318000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4907","DOI":"10.1109\/TVT.2020.2977623","article-title":"Inter-Vehicle Distance Estimation Method Based on Monocular Vision Using 3D Detection","volume":"69","author":"Zhe","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"012063","DOI":"10.1088\/1742-6596\/1961\/1\/012063","article-title":"Research on location method based on monocular vision","volume":"1961","author":"Chen","year":"2021","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3584","DOI":"10.1109\/TITS.2018.2853579","article-title":"A Novel Resection\u2013Intersection Algorithm with Fast Triangulation Applied to Monocular Visual Odometry","volume":"19","author":"Pereira","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"46059","DOI":"10.1109\/ACCESS.2019.2907984","article-title":"Robust Inter-Vehicle Distance Estimation Method Based on Monocular Vision","volume":"7","author":"Huang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"012015","DOI":"10.1088\/1742-6596\/1607\/1\/012015","article-title":"Research on Robot Binocular Ranging Based on SIFT Feature Extraction Algorithm","volume":"1607","author":"Haifeng","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"012020","DOI":"10.1088\/1742-6596\/2284\/1\/012020","article-title":"Object Detection and Ranging System Based on Binocular Vision","volume":"2284","author":"Guo","year":"2022","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"93062","DOI":"10.1109\/ACCESS.2022.3203175","article-title":"HCVNet: Binocular Stereo Matching via Hybrid Cost Volume Computation Module With Attention","volume":"10","author":"Dai","year":"2022","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"012134","DOI":"10.1088\/1742-6596\/1544\/1\/012134","article-title":"Object Detection and Localization Based on Binocular Vision for Autonomous Vehicles","volume":"1544","author":"Feng","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"012001","DOI":"10.1088\/1742-6596\/2464\/1\/012001","article-title":"Plugging System of Rf Connector Based on the Fusion of Monocular and Binocular Vision","volume":"2464","author":"Lu","year":"2023","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1145\/3663570","article-title":"Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation Learning","volume":"20","author":"Peng","year":"2024","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.cag.2023.01.016","article-title":"DCU-NET: Self-supervised monocular depth estimation based on densely connected U-shaped convolutional neural networks","volume":"111","author":"Zheng","year":"2023","journal-title":"Comput. Graph."},{"key":"ref_12","first-page":"5017311","article-title":"CNN and Binocular Vision-Based Target Detection and Ranging Framework of Intelligent Railway System","volume":"73","author":"Liu","year":"2024","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"8470","DOI":"10.1109\/LRA.2023.3330054","article-title":"Edge Devices Friendly Self-Supervised Monocular Depth Estimation via Knowledge Distillation","volume":"8","author":"Gao","year":"2023","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhan, H., Garg, R., Weerasekera, C.S., Li, K., Agarwal, H., and Reid, I.M. (2018, January 18\u201322). Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00043"},{"key":"ref_15","first-page":"2502613","article-title":"Unsupervised Monocular Depth Estimation for Monocular Visual SLAM Systems","volume":"73","author":"Liu","year":"2024","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jin, Y., Shi, Z., Xu, X., Wu, G., Li, H., and Wen, S. (2023). Target Localization and Grasping of NAO Robot Based on YOLOv8 Network and Monocular Ranging. Electronics, 12.","DOI":"10.20944\/preprints202308.2157.v1"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3158","DOI":"10.1109\/TIP.2013.2259841","article-title":"Fast SIFT Design for Real-Time Visual Feature Extraction","volume":"22","author":"Chiu","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"012039","DOI":"10.1088\/1742-6596\/1267\/1\/012039","article-title":"Research and Optimization of Real-time Simultaneous Localization and Mapping of Indoor Robot Based on Binocular Vision","volume":"1267","author":"Zhang","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1109\/TVT.2012.2186836","article-title":"SORT-SGM: Subpixel Optimized Real-Time Semiglobal Matching for Intelligent Vehicles","volume":"61","author":"Pantilie","year":"2012","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Guo, Y.-Q., Gu, M., and Xu, Z.-D. (2023). Research on the Improvement of Semi-Global Matching Algorithm for Binocular Vision Based on Lunar Surface Environment. Sensors, 23.","DOI":"10.3390\/s23156901"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Huang, Z., Gu, J., Li, J., and Yu, X. (2021). A stereo matching algorithm based on the improved PSMNet. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0251657"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.3934\/mbe.2021160","article-title":"Binocular stereo matching algorithm based on MST cost aggregation","volume":"18","author":"Zhang","year":"2021","journal-title":"Math. Biosci. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"40987","DOI":"10.1007\/s11042-023-15183-6","article-title":"An improved binocular stereo matching algorithm based on AANet","volume":"82","author":"Yang","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"11328","DOI":"10.1109\/JSEN.2024.3359671","article-title":"Remote Distance Binocular Vision Ranging Method Based on Improved YOLOv5","volume":"24","author":"Wei","year":"2024","journal-title":"IEEE Sens. J."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jiang, X., Liu, Z., Liu, B., and Liu, J. (2022). Multi-Sensor Fusion for Lateral Vehicle Localization in Tunnels. Appl. Sci., 12.","DOI":"10.3390\/app12136634"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zeng, Q., Chen, W., Liu, J., and Wang, H. (2017). An Improved Multi-Sensor Fusion Navigation Algorithm Based on the Factor Graph. Sensors, 17.","DOI":"10.3390\/s17030641"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Meng, C., Bao, H., Ma, Y., Xu, X., and Li, Y. (2019). Visual Meterstick: Preceding Vehicle Ranging Using Monocular Vision Based on the Fitting Method. Symmetry, 11.","DOI":"10.3390\/sym11091081"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cai, L., Zhou, C., Wang, Y., Wang, H., and Liu, B. (2023). Binocular Vision-Based Pole-Shaped Obstacle Detection and Ranging Study. Appl. Sci., 13.","DOI":"10.3390\/app132312617"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4178\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:06:12Z","timestamp":1760108772000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4178"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,27]]},"references-count":28,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24134178"],"URL":"https:\/\/doi.org\/10.3390\/s24134178","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,27]]}}}