{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:00:27Z","timestamp":1760148027449,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T00:00:00Z","timestamp":1679616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science, Technology and Innovation Commission of Shenzhen Municipality","award":["JCYJ20220818101001003","WDZC20200820160650001","2019B010143003"],"award-info":[{"award-number":["JCYJ20220818101001003","WDZC20200820160650001","2019B010143003"]}]},{"name":"Guangdong Province Science and Technology Program","award":["JCYJ20220818101001003","WDZC20200820160650001","2019B010143003"],"award-info":[{"award-number":["JCYJ20220818101001003","WDZC20200820160650001","2019B010143003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Stereo matching in binocular endoscopic scenarios is difficult due to the radiometric distortion caused by restricted light conditions. Traditional matching algorithms suffer from poor performance in challenging areas, while deep learning ones are limited by their generalizability and complexity. We introduce a non-deep learning cost volume generation method whose performance is close to a deep learning algorithm, but with far less computation. To deal with the radiometric distortion problem, the initial cost volume is constructed using two radiometric invariant cost metrics, the histogram of gradient angle and amplitude descriptors. Then we propose a new cross-scale propagation framework to improve the matching reliability in small homogenous regions without increasing the running time. The experimental results on the Middlebury Version 3 Benchmark show that the performance of the combination of our method and Local-Expansion, an optimization algorithm, ranks top among non-deep learning algorithms. Other quantitative experimental results on a surgical endoscopic dataset and our binocular endoscope show that the accuracy of the proposed algorithm is at the millimeter level which is comparable to the accuracy of deep learning algorithms. In addition, our method is 65 times faster than its deep learning counterpart in terms of cost volume generation.<\/jats:p>","DOI":"10.3390\/s23073427","type":"journal-article","created":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T08:43:03Z","timestamp":1679647383000},"page":"3427","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Robust Cost Volume Generation Method for Dense Stereo Matching in Endoscopic Scenarios"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1089-5947","authenticated-orcid":false,"given":"Yucheng","family":"Jiang","sequence":"first","affiliation":[{"name":"Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China"},{"name":"Peng Cheng Laboratory, Shenzhen 518000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7323-8826","authenticated-orcid":false,"given":"Zehua","family":"Dong","sequence":"additional","affiliation":[{"name":"Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0572-9066","authenticated-orcid":false,"given":"Songping","family":"Mai","sequence":"additional","affiliation":[{"name":"Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Xu, B., Zhao, S., Sui, X., and Hua, C. (2018, January 16\u201318). High-speed Stereo Matching Algorithm for Ultra-high Resolution Binocular Image. Proceedings of the 2018 IEEE International Conference on Automation, Electronics and Electrical Engineering (AUTEEE), Shenyang, China.","DOI":"10.1109\/AUTEEE.2018.8720762"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Geiger, A., Ziegler, J., and Stiller, C. (2011, January 5\u20139). Stereoscan: Dense 3d reconstruction in real-time. Proceedings of the 2011 IEEE Intelligent Vehicles Symposium (IV), Baden-Baden, Germany.","DOI":"10.1109\/IVS.2011.5940405"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Parchami, M., Cadeddu, J.A., and Mariottini, G.L. (2014, January 26\u201330). Endoscopic stereo reconstruction: A comparative study. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.","DOI":"10.1109\/EMBC.2014.6944115"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"8742920","DOI":"10.1155\/2016\/8742920","article-title":"Literature Survey on Stereo Vision Disparity Map Algorithms","volume":"2016","author":"Hamzah","year":"2016","journal-title":"J. Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"8562323","DOI":"10.1155\/2020\/8562323","article-title":"Review of stereo matching algorithms based on deep learning","volume":"2020","author":"Zhou","year":"2020","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Scharstein, D., Hirschm\u00fcller, H., Kitajima, Y., Krathwohl, G., Ne\u0161i\u0107, N., Wang, X., and Westling, P. (2014, January 2\u20135). High-resolution stereo datasets with subpixel-accurate ground truth. Proceedings of the German conference on Pattern Recognition, M\u00fcnster, Germany.","DOI":"10.1007\/978-3-319-11752-2_3"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"27971","DOI":"10.1109\/ACCESS.2018.2838442","article-title":"Multiscale Feature Extractors for Stereo Matching Cost Computation","volume":"6","author":"Kim","year":"2018","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jang, M., Yoon, H., Lee, S., Kang, J., and Lee, S. (2022). A Comparison and Evaluation of Stereo Matching on Active Stereo Images. Sensors, 22.","DOI":"10.3390\/s22093332"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2725","DOI":"10.1109\/TPAMI.2017.2766072","article-title":"Continuous 3D label stereo matching using local expansion moves","volume":"40","author":"Taniai","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","first-page":"2287","article-title":"Stereo matching by training a convolutional neural network to compare image patches","volume":"17","author":"Zbontar","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_11","first-page":"1","article-title":"Optimization of 3-D Pose Measurement Method Based on Binocular Vision","volume":"71","author":"Wei","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"67","DOI":"10.5194\/isprs-annals-III-3-67-2016","article-title":"Image-guided non-local dense matching with three-steps optimization","volume":"3","author":"Huang","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"He, K., Sun, J., and Tang, X. (2010, January 5\u201311). Guided image filtering. Proceedings of the European Conference on Computer Vision, Crete, Greece.","DOI":"10.1007\/978-3-642-15549-9_1"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mei, X., Sun, X., Zhou, M., Jiao, S., Wang, H., and Zhang, X. (2011, January 6\u201313). On building an accurate stereo matching system on graphics hardware. Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130280"},{"key":"ref_15","unstructured":"Zhang, W., Fu, L., and Wang, X. (2021, January 17\u201319). Research and development of stereo matching algorithm, ICMLCA 2021. Proceedings of the 2nd International Conference on Machine Learning and Computer Application, Shenyang, China."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.1016\/j.patrec.2011.07.027","article-title":"Simple low-dimensional features approximating NCC-based image matching","volume":"32","author":"Satoh","year":"2011","journal-title":"Pattern Recognit. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"168186","DOI":"10.1016\/j.ijleo.2021.168186","article-title":"Stereo matching algorithm based on improved Census transform and texture filtering","volume":"249","author":"Hou","year":"2021","journal-title":"Optik"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.micpro.2017.07.009","article-title":"A low-cost and high-performance architecture for robust human detection using histogram of edge oriented gradients","volume":"53","author":"Sangeetha","year":"2017","journal-title":"Microprocess. Microsystems."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Batsos, K., Cai, C., and Mordohai, P. (2018, January 18\u201323). CBMV: A coalesced bidirectional matching volume for disparity estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00220"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1632","DOI":"10.1109\/TCSVT.2015.2473375","article-title":"Accurate image-guided stereo matching with efficient matching cost and disparity refinement","volume":"26","author":"Zhan","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"650","DOI":"10.1109\/TPAMI.2006.70","article-title":"Kweon Adaptive support-weight approach for correspondence search","volume":"28","author":"Yoon","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2014.2353642","article-title":"Stereo matching using tree filtering","volume":"37","author":"Yang","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2269","DOI":"10.1016\/j.patcog.2015.01.002","article-title":"Cross-trees, edge and superpixel priors-based cost aggregation for stereo matching","volume":"48","author":"Cheng","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1049\/iet-cvi.2011.0077","article-title":"Window-based approach for fast stereo correspondence","volume":"7","author":"Gupta","year":"2013","journal-title":"IET Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hosni, A., Bleyer, M., Rhemann, C., Gelautz, M., and Rother, C. (2011, January 11\u201315). Real-time local stereo matching using guided image filtering. Proceedings of the 2011 IEEE International Conference on Multimedia and Expo, Barcelona, Spain.","DOI":"10.1109\/ICME.2011.6012131"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3411","DOI":"10.1364\/AO.56.003411","article-title":"3D cost aggregation with multiple minim spanning trees for stereo matching","volume":"56","author":"Li","year":"2017","journal-title":"Appl. Opt."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1109\/TPAMI.2019.2928550","article-title":"Stereo matching using multi-level cost volume and multi-scale feature constancy","volume":"43","author":"Liang","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gu, X., Fan, Z., Zhu, S., Dai, Z., Tan, F., and Tan, P. (2020, January 13\u201319). Cascade cost volume for high-resolution multi-view stereo and stereo matching. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00257"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Shen, Z., Dai, Y., and Rao, Z. (2021, January 20\u201325). Cfnet: Cascade and fused cost volume for robust stereo matching. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01369"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xu, J., Ranftl, R., and Koltun, V. (2017, January 21\u201326). Accurate optical flow via direct cost volume processing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.615"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"112","DOI":"10.37936\/ecti-cit.2019132.194324","article-title":"A review on stereo vision algorithm: Challenges and solutions","volume":"13","author":"Kok","year":"2019","journal-title":"ECTI Trans. Comput. Inf. Technol. (ECTI-CIT)"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2121","DOI":"10.1109\/TPAMI.2012.46","article-title":"A quantitative evaluation of confidence measures for stereo vision","volume":"34","author":"Hu","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/TPAMI.2012.156","article-title":"Fast cost-volume filtering for visual correspondence and beyond","volume":"35","author":"Hosni","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","first-page":"1","article-title":"Patchmatch stereo-stereo matching with slanted support windows","volume":"11","author":"Bleyer","year":"2011","journal-title":"Bmvc"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, K., Fang, Y., Min, D., Sun, L., Yang, S., Yan, S., and Tian, Q. (2014, January 23\u201328). Cross-scale cost aggregation for stereo matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.206"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1722","DOI":"10.1049\/ipr2.12140","article-title":"An efficient local stereo matching method based on an adaptive exponentially weighted moving average filter in SLIC space","volume":"15","author":"Yang","year":"2021","journal-title":"IET Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"102302","DOI":"10.1016\/j.media.2021.102302","article-title":"SERV-CT: A disparity dataset from cone-beam CT for validation of endoscopic 3D reconstruction","volume":"76","author":"Edwards","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Guo, J., Gu, F., Ye, Y., and Song, Z. (2021, January 15\u201319). An Accurate Speckle 3D Reconstruction System Based on Binocular Endoscope. Proceedings of the 2021 IEEE International Conference on Real-Time Computing and Robotics (RCAR), Xining, China.","DOI":"10.1109\/RCAR52367.2021.9517489"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3427\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:02:26Z","timestamp":1760122946000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3427"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,24]]},"references-count":38,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073427"],"URL":"https:\/\/doi.org\/10.3390\/s23073427","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,3,24]]}}}