{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T17:52:57Z","timestamp":1760205177212,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,3,18]],"date-time":"2022-03-18T00:00:00Z","timestamp":1647561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Direction G\u00e9n\u00e9rale de l'Armement","award":["2019.65.0068.00.470.75.01","2021.65.0070.00.470.75.01"],"award-info":[{"award-number":["2019.65.0068.00.470.75.01","2021.65.0070.00.470.75.01"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>This work addressed the problem of miscalibration or decalibration of mobile stereo\/bi-monocular camera setups. We especially focused on the context of autonomous vehicles. In real-world conditions, any optical system is subject to various mechanical stresses, caused by vibration, rough handling, collisions, or even thermal expansion. Such mechanical stresses change the stereo pair geometry, and as a consequence, the pre-calculated epipolar geometry or any geometric-based approach is no longer valid. The standard method, which consists of estimating the calibration online, fails in such harsh conditions. The proposed method was based on a robust linearly constrained state estimation technique able to mitigate the model mismatch without estimating the model parameters. Therefore, our solution was able to mitigate the errors with negligible use of additional computing resources. We propose to use a linearly constrained extended Kalman filter for a stereo-based visual odometry or simultaneous localization and mapping approach. Simulations confirmed that the method kept the system (and objects of the map) localized in real-time even with huge miscalibration errors and parameter variations. The results confirmed that the method was robust to a miscalibration of all the extrinsic calibration parameters even when the standard online calibration procedure failed.<\/jats:p>","DOI":"10.3390\/rs14061470","type":"journal-article","created":{"date-parts":[[2022,3,20]],"date-time":"2022-03-20T21:37:17Z","timestamp":1647812237000},"page":"1470","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Robust Filter-Based Visual Navigation Solution with Miscalibrated Bi-Monocular or Stereo Cameras"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1909-5591","authenticated-orcid":false,"given":"Damien","family":"Vivet","sequence":"first","affiliation":[{"name":"ISAE-SUPAERO, University of Toulouse, 31055 Toulouse, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7858-4171","authenticated-orcid":false,"given":"Jordi","family":"Vil\u00e0-Valls","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, University of Toulouse, 31055 Toulouse, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8831-0684","authenticated-orcid":false,"given":"Ga\u00ebl","family":"Pages","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, University of Toulouse, 31055 Toulouse, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7029-3019","authenticated-orcid":false,"given":"Eric","family":"Chaumette","sequence":"additional","affiliation":[{"name":"ISAE-SUPAERO, University of Toulouse, 31055 Toulouse, France"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,18]]},"reference":[{"key":"ref_1","unstructured":"Szczepanski, M. (2019). Online Stereo Camera Calibration on Embedded Systems. [Ph.D. Thesis, Universit\u00e9 Clermont Auvergne]."},{"key":"ref_2","unstructured":"Blume, H. (2017). Towards a Common Software\/Hardware Methodology for Future Advanced Driver Assistance Systems, River Publishers."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1038\/293133a0","article-title":"A computer algorithm for reconstructing a scene from two projections","volume":"293","year":"1981","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1109\/34.601246","article-title":"In Defense of the 8-Point Algorithm","volume":"19","author":"Hartley","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/TPAMI.2004.17","article-title":"An efficient solution to the five-point relative pose problem","volume":"26","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/70.481754","article-title":"Motion of an uncalibrated stereo rig: Self-calibration and metric reconstruction","volume":"12","author":"Zhang","year":"1996","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","unstructured":"Takahashi, H., and Tomita, F. (1988). Self-Calibration of Stereo Cameras, ICCV."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sun, P., Lu, N.G., Dong, M.L., Yan, B.X., and Wang, J. (2018). Simultaneous all-parameters calibration and assessment of a stereo camera pair using a scale bar. Sensors, 18.","DOI":"10.3390\/s18113964"},{"key":"ref_10","unstructured":"Dang, T., and Hoffmann, C. (2004, January 14\u201317). Stereo calibration in vehicles. Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy."},{"key":"ref_11","unstructured":"Dang, T., Hoffmann, C., and Stiller, C. (2006, January 13\u201315). Self-calibration for active automotive stereo vision. Proceedings of the IEEE Intelligent Vehicles Symposium, Meguro-Ku, Japan."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.1109\/TIP.2009.2017824","article-title":"Continuous Stereo Self-Calibration by Camera Parameter Tracking","volume":"18","author":"Dang","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mueller, G.R., and Wuensche, H.J. (2016, January 19\u201322). Continuous extrinsic online calibration for stereo cameras. Proceedings of the IEEE Intelligent Vehicles Symposium, Gothenburg, Sweden.","DOI":"10.1109\/IVS.2016.7535505"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mueller, G.R., and Wuensche, H.J. (2017, January 16\u201319). Continuous stereo camera calibration in urban scenarios. Proceedings of the IEEE International Conference on Intelligent Transportation, Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317675"},{"key":"ref_15","unstructured":"Collado, J.M., Hilario, C., de la Escalera, A., and Armingol, J.M. (2016, January 19\u201322). Self-calibration of an on-board stereo-vision system for driver assistance systems. Proceedings of the IEEE Intelligent Vehicles Symposium, Gothenburg, Sweden."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1997","DOI":"10.1016\/j.eswa.2013.08.096","article-title":"Automatic on-the-fly extrinsic camera calibration of onboard vehicular cameras","volume":"41","author":"Jung","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Musleh, B., Mart\u00edn, D., Armingol, J.M., and De la Escalera, A. (2016). Pose self-calibration of stereo vision systems for autonomous vehicle applications. Sensors, 16.","DOI":"10.3390\/s16091492"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rehder, E., Kinzig, C., Bender, P., and Lauer, M. (2017, January 11\u201314). Online stereo camera calibration from scratch. Proceedings of the IEEE Intelligent Vehicles Symposium, Los Angeles, CA, USA.","DOI":"10.1109\/IVS.2017.7995952"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.imavis.2017.07.003","article-title":"3D visual perception for self-driving cars using a multi-camera system: Calibration, mapping, localization, and obstacle detection","volume":"68","author":"Heng","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Muhovi\u010d, J., and Per\u0161, J. (2020). Correcting Decalibration of Stereo Cameras in Self-Driving Vehicles. Sensors, 20.","DOI":"10.3390\/s20113241"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Konolige, K. (1998). Small vision systems: Hardware and implementation. Robotics Research, Springer.","DOI":"10.1007\/978-1-4471-1580-9_19"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Crassidis, J.L., and Junkins, J.L. (2011). Optimal Estimation of Dynamic Systems, CRC Press.","DOI":"10.1201\/b11154"},{"key":"ref_23","unstructured":"Poulo, S. (2008). Adaptive Filtering, Algorithms and Practical Implementations, Springer."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Simon, D. (2006). Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches, John Wiley & Sons.","DOI":"10.1002\/0470045345"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1981","DOI":"10.1080\/03610928408828808","article-title":"Asymptotic distribution theory for the Kalman filter state estimator","volume":"13","author":"Spall","year":"1984","journal-title":"Commun. Stat.-Theory Methods"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3264","DOI":"10.1016\/j.sigpro.2012.10.021","article-title":"Principles of minimum variance robust adaptive beamforming design","volume":"93","author":"Vorobyov","year":"2013","journal-title":"Signal Process."},{"key":"ref_27","first-page":"334","article-title":"Stochastic stability condition for the extended Kalman filter with intermittent observations","volume":"64","author":"Liu","year":"2016","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Vila-Valls, J., Chaumette, E., Vincent, F., and Closas, P. (2019, January 2\u20136). Modelling mismatch and noise statistics uncertainty in linear MMSE estimation. Proceedings of the European Signal Processing Conference, A Coruna, Spain.","DOI":"10.23919\/EUSIPCO.2019.8903118"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1002\/rnc.5305","article-title":"Robust linearly constrained extended Kalman filter for mismatched nonlinear systems","volume":"31","author":"Hrustic","year":"2021","journal-title":"Int. J. Robust Nonlinear Control"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/6\/1470\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:39:05Z","timestamp":1760135945000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/6\/1470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,18]]},"references-count":29,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["rs14061470"],"URL":"https:\/\/doi.org\/10.3390\/rs14061470","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,3,18]]}}}