{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T20:14:23Z","timestamp":1772482463436,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,4,19]],"date-time":"2019-04-19T00:00:00Z","timestamp":1555632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NRF grant funded by the Korea government (MSIT) 360 (NRF-2018R1D1A1A09084148) and GIST Research Institute (GRI) grant funded by the GIST in 2019","award":["NRF-2018R1D1A1A09084148"],"award-info":[{"award-number":["NRF-2018R1D1A1A09084148"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Stereo matching has been under development for decades and is an important process for many applications. Difficulties in stereo matching include textureless regions, occlusion, illumination variation, the fattening effect, and discontinuity. These challenges are effectively solved in recently developed stereo matching algorithms. A new imperfect rectification problem has recently been encountered in stereo matching, and the problem results from the high resolution of stereo images. State-of-the-art stereo matching algorithms fail to exactly reconstruct the depth information using stereo images with imperfect rectification, as the imperfectly rectified image problems are not explicitly taken into account. In this paper, we solve the imperfect rectification problems, and propose matching stereo matching methods that based on absolute differences, square differences, normalized cross correlation, zero-mean normalized cross correlation, and rank and census transforms. Finally, we conduct experiments to evaluate these stereo matching methods using the Middlebury datasets. The experimental results show the proposed stereo matching methods can reduce error rate significantly for stereo images with imperfect rectification.<\/jats:p>","DOI":"10.3390\/sym11040570","type":"journal-article","created":{"date-parts":[[2019,4,22]],"date-time":"2019-04-22T03:15:53Z","timestamp":1555902953000},"page":"570","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Stereo Matching Methods for Imperfectly Rectified Stereo Images"],"prefix":"10.3390","volume":"11","author":[{"given":"Phuc Hong","family":"Nguyen","sequence":"first","affiliation":[{"name":"Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9902-5966","authenticated-orcid":false,"given":"Chang Wook","family":"Ahn","sequence":"additional","affiliation":[{"name":"Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,19]]},"reference":[{"key":"ref_1","unstructured":"Trucco, E., and Verri, A. (1998). Introductory Techniques For 3-D Computer Vision, Prentice Hall PTR."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Cyganek, B., and Siebert, J.P. (2009). Introduction to 3D Computer Vision Techniques and Algorithms, Wiley.","DOI":"10.1002\/9780470699720"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"021107","DOI":"10.1117\/1.OE.51.2.021107","article-title":"Outdoor stereo camera system for the generation of real-world benchmark data sets","volume":"51","author":"Meister","year":"2012","journal-title":"Opt. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). SURF: Speeded Up Robust Features. Proceedings of the Ninth European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/S0734-189X(85)80073-6","article-title":"Segment-based stereo matching","volume":"31","author":"Medioni","year":"1985","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_8","unstructured":"Robert, L., and Faugeras, O. (1991, January 3\u20136). Curve-based stereo: Figural continuity and curvature. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Lahaina, HI, USA."},{"key":"ref_9","unstructured":"Olson, C.F. (1999, January 10\u201315). Subpixel localization and uncertainty estimation using occupancy grids. Proceedings of the IEEE International Conference on Robotics and Automation, Detroit, MI, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sarkis, M., and Diepold, K. (2008, January 12\u201315). Sparse stereo matching using belief propagation. Proceedings of the IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4712121"},{"key":"ref_11","unstructured":"Geiger, A., Roser, M., and Urtasun, R. (2010, January 8\u201312). Efficient Large-Scale Stereo Matching. Proceedings of the Asian Conference on Computer Vision (ACCV), Queenstown, New Zealand."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1014573219977","article-title":"A taxonomy and evaluation of dense two-frame stereo correspondence algorithms","volume":"47","author":"Scharstein","year":"2002","journal-title":"Int. J. Comput. Vis."},{"key":"ref_13","first-page":"508","article-title":"Computing Visual Correspondence with Occlusions using Graph Cuts","volume":"2","author":"Kolmogorov","year":"2001","journal-title":"Proc. ICCV"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s11263-006-7899-4","article-title":"Efficient Belief Propagation for Early Vision","volume":"70","author":"Felzenszwalb","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1109\/TPAMI.2008.221","article-title":"Evaluation of stereo matching costs on images with radiometric differences","volume":"31","author":"Hirschmuller","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1109\/TCSVT.2013.2254898","article-title":"Support local pattern and its application to disparity improvement and texture classification","volume":"24","author":"Nguyen","year":"2014","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1109\/TPAMI.2010.136","article-title":"Robust Stereo Matching Using Adaptive Normalized Cross-Correlation","volume":"33","author":"Heo","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/TPAMI.2012.156","article-title":"Fast Cost-Volume Filtering for Visual Correspondence and Beyond","volume":"35","author":"Hosni","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Scharstein, D., Hirschm\u00fcller, H., Kitajima, Y., Krathwohl, G., Nesic, N., Wang, X., and Westling, P. (2014). High-resolution stereo datasets with subpixel-accurate ground truth. Conf. Pattern Recognit.","DOI":"10.1007\/978-3-319-11752-2_3"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wang, K., Dunn, E., and Frahm, J.-M. (2014, January 23\u201328). Stereo under sequential optimal sampling: A statistical analysis framework for search space reduction. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.","DOI":"10.1109\/CVPR.2014.69"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Luo, W., Schwing, A.G., and Urtasun, R. (2016, January 27\u201330). Efficient Deep Learning for Stereo Matching. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.614"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TCSVT.2012.2203200","article-title":"Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences","volume":"23","author":"Kowalczuk","year":"2013","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1023\/A:1014554110407","article-title":"Real-Time Correlation-Based Stereo Vision with Reduced Border Errors","volume":"47","author":"Innocent","year":"2002","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TCSVT.2016.2628782","article-title":"PMSC: PatchMatch-Based Superpixel Cut for Accurate Stereo Matching","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_25","first-page":"2219","article-title":"MAP Disparity Estimation Using Hidden Markov Trees","volume":"28","author":"Psota","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, L., Yu, X., Zhang, S., Zhao, X., and Zhang, L. (2019, April 19). 3D Cost Aggregation with Multiple Minimum Spanning Trees for Stereo Matching. Available online: http:\/\/ao.osa.org\/abstract.cfm?URI=ao-56-12-3411.","DOI":"10.1364\/AO.56.003411"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kim, K.R., and Kim, C.S. (2016, January 25\u201328). Adaptive smoothness constraints for efficient stereo matching using texture and edge information. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7532996"},{"key":"ref_28","first-page":"3429","article-title":"A learned sparseness and IGMRF-based regularization framework for dense disparity estimation using unsupervised feature learning","volume":"9","author":"Nahar","year":"2017","journal-title":"IPSJ Trans. Comput. Vis. Appl."},{"key":"ref_29","unstructured":"Kanade, T., Kano, H., Kimura, S., Yoshida, A., and Oda, K. (1995, January 5\u20139). Development of a video-rate stereo machine. Proceedings of the 1995 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Pittsburgh, PA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/s11263-014-0715-7","article-title":"SymStereo: Stereo Matching using Induced Symmetry","volume":"109","author":"Antunes","year":"2014","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/S0146-664X(81)80009-3","article-title":"Box-Filtering techniques","volume":"17","author":"McDonnell","year":"1981","journal-title":"Comput. Graph. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1145\/964965.808600","article-title":"Summed-area tables for texture mapping","volume":"18","author":"Crow","year":"1984","journal-title":"SIGGRAPH"},{"key":"ref_33","unstructured":"Scharstein, D., and Szeliski, R. (2019, April 19). Middlebury Online Stereo Evaluation. Available online: http:\/\/vision.middlebury.edu\/stereo."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1109\/TPAMI.2004.60","article-title":"An Experimental Comparison of Min-Cut\/Max-Flow Algorithms for Energy Minimization in Vision","volume":"26","author":"Boykov","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","unstructured":"Kolmogorov, V. (2019, April 19). Min-Cut\/Max-Flow Algorithm Source Code. Available online: http:\/\/pub.ist.ac.at\/vnk\/software.html."},{"key":"ref_36","unstructured":"Scharstein, D., and Szeliski, R. (2019, April 19). Middlebury Online Stereo Evaluation. Available online: http:\/\/vision.middlebury.edu\/stereo\/eval3."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/4\/570\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:46:49Z","timestamp":1760186809000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/4\/570"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,19]]},"references-count":36,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["sym11040570"],"URL":"https:\/\/doi.org\/10.3390\/sym11040570","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,19]]}}}