{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:30:37Z","timestamp":1760232637986,"version":"build-2065373602"},"reference-count":63,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2022,11,19]],"date-time":"2022-11-19T00:00:00Z","timestamp":1668816000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The accuracy of pose estimation from feature-based Visual Odometry (VO) algorithms is affected by several factors such as lighting conditions and outliers in the matched features. In this paper, a generic image processing pipeline is proposed to enhance the accuracy and robustness of feature-based VO algorithms. The pipeline consists of three stages, each addressing a problem that affects the performance of VO algorithms. The first stage tackles the lighting condition problem, where a filter called Contrast Limited Adaptive Histogram Equalization (CLAHE) is applied to the images to overcome changes in lighting in the environment. The second stage uses the Suppression via Square Covering (SSC) algorithm to ensure the features are distributed properly over the images. The last stage proposes a novel outliers rejection approach called the Angle-based Outlier Rejection (AOR) algorithm to remove the outliers generated in the feature matching process. The proposed pipeline is generic and modular and can be integrated with any type of feature-based VO (monocular, RGB-D, or stereo). The efficiency of the proposed pipeline is validated using sequences from KITTI (for stereo VO) and TUM (for RGB-D VO) datasets, as well as experimental sequences using an omnidirectional mobile robot (for monocular VO). The obtained results showed the performance gained by enhancing the accuracy and robustness of the VO algorithms without compromising on the computational cost using the proposed pipeline. The results are substantially better as opposed to not using the pipeline.<\/jats:p>","DOI":"10.3390\/s22228967","type":"journal-article","created":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T04:39:59Z","timestamp":1669005599000},"page":"8967","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Generic Image Processing Pipeline for Enhancing Accuracy and Robustness of Visual Odometry"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9721-6291","authenticated-orcid":false,"given":"Mohamed","family":"Sabry","sequence":"first","affiliation":[{"name":"Autonomous Mobility and Perception Lab (AMPL), Universidad Carlos III de Madrid (UC3M), 28911 Leganes, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6070-0610","authenticated-orcid":false,"given":"Mostafa","family":"Osman","sequence":"additional","affiliation":[{"name":"Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6621-4923","authenticated-orcid":false,"given":"Ahmed","family":"Hussein","sequence":"additional","affiliation":[{"name":"Intelligent Driving Function Department, IAV GmbH, 10587 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3119-1404","authenticated-orcid":false,"given":"Mohamed W.","family":"Mehrez","sequence":"additional","affiliation":[{"name":"Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3148-1658","authenticated-orcid":false,"given":"Soo","family":"Jeon","sequence":"additional","affiliation":[{"name":"Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William","family":"Melek","sequence":"additional","affiliation":[{"name":"Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Singh, S. (2014, January 13\u201315). LOAM: Lidar Odometry and Mapping in Real-time. Proceedings of the Robotics: Science and Systems Conference, Rome, Italy.","DOI":"10.15607\/RSS.2014.X.007"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1618","DOI":"10.1109\/TAES.2016.140829","article-title":"Radar odometry with recursive-RANSAC","volume":"52","author":"Quist","year":"2016","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1109\/TITS.2012.2213815","article-title":"GPS localization accuracy classification: A context-based approach","volume":"14","author":"Drawil","year":"2012","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","unstructured":"Yi, J., Zhang, J., Song, D., and Jayasuriya, S. (November, January 29). IMU-based localization and slip estimation for skid-steered mobile robots. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA."},{"key":"ref_5","unstructured":"Lee, S., and Song, J.B. (May, January 26). Robust mobile robot localization using optical flow sensors and encoders. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), New Orleans, LA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shim, J.H., and Cho, Y.I. (2016). A mobile robot localization via indoor fixed remote surveillance cameras. Sensors, 16.","DOI":"10.3390\/s16020195"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/MRA.2011.943233","article-title":"Visual odometry [tutorial]","volume":"18","author":"Scaramuzza","year":"2011","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MRA.2012.2182810","article-title":"Visual odometry: Part ii: Matching, robustness, optimization, and applications","volume":"19","author":"Fraundorfer","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_9","first-page":"7","article-title":"Scale drift-aware large scale monocular SLAM","volume":"2","author":"Strasdat","year":"2010","journal-title":"Robot. Sci. Syst. VI"},{"key":"ref_10","unstructured":"Engel, J., Schops, T., and Cremers, D. LSD-SLAM Large-scale direct monocular SLAM. Proceedings of the European Conference on Computer Vision."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM a versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robotics"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.isprsjprs.2017.09.010","article-title":"Landmark based localization in urban environment","volume":"140","author":"Qu","year":"2018","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_13","unstructured":"Yang, N., Wang, R., and Cremers, D. (2017). Feature-based or direct An evaluation of monocular visual odometry. arXiv."},{"key":"ref_14","unstructured":"Tomono, M. (2005, January 18\u201322). 3-D localization and mapping using a single camera based on structure-from-motion with automatic baseline selection. Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/0600000052","article-title":"Multi-view stereo: A tutorial","volume":"9","author":"Furukawa","year":"2015","journal-title":"Found. Trends Comput. Graph. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sabry, M., Al-Kaff, A., Hussein, A., and Abdennadher, S. (2019, January 27\u201330). Ground Vehicle Monocular Visual Odometry. Proceedings of the IEEE Intelligent Transportation Systems Conf. (ITSC), Auckland, NZ, USA.","DOI":"10.1109\/ITSC.2019.8917391"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1109\/TITS.2019.2900330","article-title":"Ground-Plane-Based Absolute Scale Estimation for Monocular Visual Odometry","volume":"21","author":"Zhou","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_19","unstructured":"Zhou, D., Dai, Y., and Li, H. (2016, January 19\u201322). Reliable scale estimation and correction for monocular visual odometry. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Gotenburg, Sweden."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, R., Wang, S., Long, Z., and Gu, D. (2018, January 21\u201325). Undeepvo Monocular visual odometry through unsupervised deep learning. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461251"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhan, H., Garg, R., Saroj Weerasekera, C., Li, K., Agarwal, H., and Reid, I. (2018, January 18\u201322). Unsupervised learning of monocular depth estimation and visual odometry with deep feature reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00043"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Steinbr\u00fccker, F., Sturm, J., and Cremers, D. (2011, January 7). Real-time visual odometry from dense RGB-D images. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130321"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, X., and Zhang, C. (2018, January 23\u201325). Robust RGB-D Visual Odometry Based on the Line Intersection Structure Feature in Low-Textured Scenes. Proceedings of the 5th IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS), Nanjing, China.","DOI":"10.1109\/CCIS.2018.8691213"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). Surf Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the IEEE International Conference on Computer Vision, Washington, DC, USA.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2444","DOI":"10.3906\/elk-1602-225","article-title":"Analysis of feature detector and descriptor combinations with a localization experiment for various performance metrics","volume":"25","author":"BAYRAKTAR","year":"2017","journal-title":"Turk. J. Electr. Eng. Comput. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2471","DOI":"10.1109\/TITS.2019.2919003","article-title":"Monocular visual-IMU odometry: A comparative evaluation of detector-descriptor-based methods","volume":"21","author":"Dong","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1109\/LRA.2016.2635686","article-title":"Direct visual odometry in low light using binary descriptors","volume":"2","author":"Alismail","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Engel, J., Sturm, J., and Cremers, D. (2013, January 1\u20138). Semi-dense visual odometry for a monocular camera. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.183"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2878","DOI":"10.1109\/LRA.2018.2846813","article-title":"Challenges in monocular visual odometry Photometric calibration, motion bias, and rolling shutter effect","volume":"3","author":"Yang","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.patrec.2018.02.020","article-title":"Efficient adaptive non-maximal suppression algorithms for homogeneous spatial keypoint distribution","volume":"106","author":"Bailo","year":"2018","journal-title":"Pattern Recognit. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The kitti vision benchmark suite. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7\u201312). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Algarve, Portugal.","DOI":"10.1109\/IROS.2012.6385773"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MSP.2005.1407713","article-title":"Color image processing pipeline","volume":"22","author":"Ramanath","year":"2005","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_37","unstructured":"Campbell, J., Sukthankar, R., Nourbakhsh, I., and Pahwa, A. (2005, January 18\u201322). A robust visual odometry and precipice detection system using consumer-grade monocular vision. Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1839","DOI":"10.1109\/TITS.2015.2511453","article-title":"Visual odometry drift reduction using SYBA descriptor and feature transformation","volume":"17","author":"Desai","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2987819","DOI":"10.1155\/2018\/2987819","article-title":"Image antiblurring and statistic filter of feature space displacement: Application to visual odometry for outdoor ground vehicle","volume":"2018","author":"Zhao","year":"2018","journal-title":"J. Sens."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yang, W., and Zhai, X. (2019, January 17\u201319). Contrast Limited Adaptive Histogram Equalization for an Advanced Stereo Visual SLAM System. Proceedings of the IEEE International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), Guilin, China.","DOI":"10.1109\/CyberC.2019.00030"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhang, J., Ila, V., and Kneip, L. (2018, January 28\u201331). Robust visual odometry in underwater environment. Proceedings of the IEEE OCEANS-MTS\/IEEE Kobe Techno-Oceans (OTO), Kobe, Japan.","DOI":"10.1109\/OCEANSKOBE.2018.8559452"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3433","DOI":"10.1109\/TITS.2017.2685433","article-title":"A framework for fast and robust visual odometry","volume":"18","author":"Wu","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/j.neucom.2012.06.055","article-title":"Performance evaluation of feature detection and matching in stereo visual odometry","volume":"120","author":"Jiang","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Mou, W., Wang, H., and Seet, G. (2014, January 6\u20139). Efficient visual odometry estimation using stereo camera. Proceedings of the 11th IEEE International Conference on Control & Automation (ICCA), Sapporo, Japan.","DOI":"10.1109\/ICCA.2014.6871128"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 23\u201327). Machine learning for high-speed corner detection. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/11744023_34"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Aladem, M., and Rawashdeh, S.A. (2018). Lightweight visual odometry for autonomous mobile robots. Sensors, 18.","DOI":"10.3390\/s18092837"},{"key":"ref_47","unstructured":"Brown, M., Szeliski, R., and Winder, S. (2005, January 20\u201325). Multi-image matching using multi-scale oriented patches. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1281","DOI":"10.1109\/TPAMI.2011.222","article-title":"BRIEF: Computing a local binary descriptor very fast","volume":"34","author":"Calonder","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Buczko, M., and Willert, V. (2016, January 19\u201322). How to distinguish inliers from outliers in visual odometry for high-speed automotive applications. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Gotenburg, Sweden.","DOI":"10.1109\/IVS.2016.7535429"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Fan, H., and Zhang, S. (2017, January 9\u201310). Stereo Odometry Based on Careful Frame Selection. Proceedings of the 10th IEEE International Symposium on Computational Intelligence and Design (ISCID), Hangzhou, China.","DOI":"10.1109\/ISCID.2017.88"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Kitt, B., Geiger, A., and Lategahn, H. (2010, January 21\u201324). Visual odometry based on stereo image sequences with ransac-based outlier rejection scheme. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), La Jolla, CA, USA.","DOI":"10.1109\/IVS.2010.5548123"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zuiderveld, K. (1994). Contrast limited adaptive histogram equalization. Proceedings of the Graphics Gems IV, Academic Press Professional, Inc.","DOI":"10.1016\/B978-0-12-336156-1.50061-6"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/S0031-3203(98)00086-7","article-title":"Efficient algorithms for robust feature matching","volume":"32","author":"Mount","year":"1999","journal-title":"Pattern Recognit."},{"key":"ref_54","unstructured":"Weisstein, E.W. (2020, June 10). Law of Cosines from MathWorld\u2014A Wolfram Web Resource. Available online: https:\/\/mathworld.wolfram.com\/LawofCosines.html."},{"key":"ref_55","unstructured":"Weisstein, E.W. (2020, June 10). Angular Distance from MathWorld\u2014A Wolfram Web Resource. Available online: https:\/\/mathworld.wolfram.com\/AngularDistance.html."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Lu, X., Yaoy, J., Li, H., Liu, Y., and Zhang, X. (2017, January 24\u201331). 2-line exhaustive searching for real-time vanishing point estimation in Manhattan world. Proceedings of the Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.45"},{"key":"ref_57","first-page":"1","article-title":"ROS an open-source Robot Operating System","volume":"3","author":"Quigley","year":"2009","journal-title":"ICRA Workshop Open Source Softw."},{"key":"ref_58","unstructured":"(2020, June 10). Robotnik. SUMMIT- XL STEEL Datasheet. Available online: www.robotnik.eu."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/TPAMI.2004.17","article-title":"An efficient solution to the five-point relative pose problem","volume":"26","author":"Nister","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1080\/01621459.1984.10477105","article-title":"Least median of squares regression","volume":"79","author":"Rousseeuw","year":"1984","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_61","unstructured":"Krejci, T. (2020, February 01). kitti2bag. Available online: https:\/\/github.com\/tomas789\/kitti2bag\/."},{"key":"ref_62","unstructured":"TUM (2020, June 10). Submission form for automatic evaluation of RGB-D SLAM results. Available online: https:\/\/vision.in.tum.de\/data\/datasets\/rgbd-dataset\/online_evaluation."},{"key":"ref_63","unstructured":"Achtelik, M., and vicon bridge (2020, October 01). GitHub Repository. Available online: https:\/\/github.com\/ethz-asl\/vicon_bridge."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8967\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:21:58Z","timestamp":1760145718000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8967"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,19]]},"references-count":63,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22228967"],"URL":"https:\/\/doi.org\/10.3390\/s22228967","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,11,19]]}}}