{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T14:08:34Z","timestamp":1783606114387,"version":"3.55.0"},"reference-count":31,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,6,7]],"date-time":"2020-06-07T00:00:00Z","timestamp":1591488000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["J2-8175"],"award-info":[{"award-number":["J2-8175"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["P2-0095"],"award-info":[{"award-number":["P2-0095"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Camera systems in autonomous vehicles are subject to various sources of anticipated and unanticipated mechanical stress (vibration, rough handling, collisions) in real-world conditions. Even moderate changes in camera geometry due to mechanical stress decalibrate multi-camera systems and corrupt downstream applications like depth perception. We propose an on-the-fly stereo recalibration method applicable in real-world autonomous vehicles. The method is comprised of two parts. First, in optimization step, external camera parameters are optimized with the goal to maximise the amount of recovered depth pixels. In the second step, external sensor is used to adjust the scaling of the optimized camera model. The method is lightweight and fast enough to run in parallel with stereo estimation, thus allowing an on-the-fly recalibration. Our extensive experimental analysis shows that our method achieves stereo reconstruction better or on par with manual calibration. If our method is used on a sequence of images, the quality of calibration can be improved even further.<\/jats:p>","DOI":"10.3390\/s20113241","type":"journal-article","created":{"date-parts":[[2020,6,9]],"date-time":"2020-06-09T05:16:14Z","timestamp":1591679774000},"page":"3241","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Correcting Decalibration of Stereo Cameras in Self-Driving Vehicles"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4082-2506","authenticated-orcid":false,"given":"Jon","family":"Muhovi\u010d","sequence":"first","affiliation":[{"name":"Faculty of Electrical Engineering, University of Ljubljana, Tr\u017ea\u0161ka Cesta 25, SI-1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6039-6110","authenticated-orcid":false,"given":"Janez","family":"Per\u0161","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering, University of Ljubljana, Tr\u017ea\u0161ka Cesta 25, SI-1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Muhovi\u010d, J., Mandeljc, R., Bovcon, B., Kristan, M., and Per\u0161, J. (2019). Obstacle Tracking for Unmanned Surface Vessels Using 3-D Point Cloud. IEEE J. Ocean. Eng., 1\u201313.","DOI":"10.1109\/JOE.2019.2909507"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1038\/293133a0","article-title":"A computer algorithm for reconstructing a scene from two projections","volume":"293","year":"1981","journal-title":"Nature"},{"key":"ref_4","unstructured":"Hartley, R.I. (1995, January 20\u201323). In defence of the 8-point algorithm. Proceedings of the Fifth International Conference on Computer Vision, Cambridge, MA, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/TPAMI.2004.17","article-title":"An efficient solution to the five-point relative pose problem","volume":"26","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/70.481754","article-title":"Motion of an uncalibrated stereo rig: Self-calibration and metric reconstruction","volume":"12","author":"Zhang","year":"1996","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","unstructured":"Takahashi, H., and Tomita, F. (1988, January 5\u20138). Self-calibration of stereo cameras. Proceedings of the 1988 Second International Conference on Computer Vision, Tampa, FL, USA."},{"key":"ref_9","unstructured":"Dang, T., and Hoffmann, C. (2004, January 14\u201317). Stereo calibration in vehicles. Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy."},{"key":"ref_10","unstructured":"Dang, T., Hoffmann, C., and Stiller, C. (2006, January 13\u201315). Self-calibration for active automotive stereo vision. Proceedings of the Intelligent Vehicles Symposium, Tokyo, Japan."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.1109\/TIP.2009.2017824","article-title":"Continuous stereo self-calibration by camera parameter tracking","volume":"18","author":"Dang","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mueller, G.R., and Wuensche, H.J. (2016, January 19\u201322). Continuous extrinsic online calibration for stereo cameras. Proceedings of the 2016 IEEE Intelligent Vehicles Symposium (IV), Gothenburg, Sweden.","DOI":"10.1109\/IVS.2016.7535505"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mueller, G.R., and Wuensche, H.J. (2017, January 16\u201319). Continuous stereo camera calibration in urban scenarios. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317675"},{"key":"ref_14","unstructured":"Collado, J.M., Hilario, C., de la Escalera, A., and Armingol, J.M. (2006, January 13\u201315). Self-calibration of an on-board stereo-vision system for driver assistance systems. Proceedings of the Intelligent Vehicles Symposium, Tokyo, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1997","DOI":"10.1016\/j.eswa.2013.08.096","article-title":"Automatic on-the-fly extrinsic camera calibration of onboard vehicular cameras","volume":"41","author":"Jung","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Musleh, B., Mart\u00edn, D., Armingol, J.M., and De la Escalera, A. (2016). Pose self-calibration of stereo vision systems for autonomous vehicle applications. Sensors, 16.","DOI":"10.3390\/s16091492"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Rehder, E., Kinzig, C., Bender, P., and Lauer, M. (2017, January 11\u201314). Online stereo camera calibration from scratch. Proceedings of the 2017 IEEE Intelligent Vehicles Symposium (IV), Los Angeles, CA, USA.","DOI":"10.1109\/IVS.2017.7995952"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rathnayaka, P., and Baek, S.H.S.Y. (2017). An Efficient Calibration Method for a Stereo Camera System with Heterogeneous Lenses Using an Embedded Checkerboard Pattern. J. Sens., 2017.","DOI":"10.1155\/2017\/6742615"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, J., Benzeroual, K., and Allison, R.S. (2012, January 16\u201321). Calibration for high-definition camera rigs with marker chessboard. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238905"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sun, P., Lu, N.-G., Dong, M.-L., Yan, B.-X., and Wang, J. (2018). Simultaneous All-Parameters Calibration and Assessment of a Stereo Camera Pair Using a Scale Bar. Sensors, 18.","DOI":"10.3390\/s18113964"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.imavis.2017.07.003","article-title":"3D visual perception for self-driving cars using a multi-camera system: Calibration, mapping, localization, and obstacle detection","volume":"68","author":"Heng","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1142\/S230138501540004X","article-title":"An automatic self-calibration approach for wide baseline stereo cameras using sea surface images","volume":"3","author":"Wang","year":"2015","journal-title":"Unmanned Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Qingqing, L., Queralta, J.P., Gia, T.N., Zou, Z., Tenhunen, H., and Westerlund, T. (2019, January 25\u201327). Detecting Water Reflection Symmetries in Point Clouds for Camera Position Calibration in Unmanned Surface Vehicles. Proceedings of the 2019 19th International Symposium on Communications and Information Technologies (ISCIT), Ho Chi Minh City, Vietnam.","DOI":"10.1109\/ISCIT.2019.8905169"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, H., Liu, Y., Gu, X., Wu, Y., Qu, F., and Huang, L. (2018, January 13\u201316). A deep-learning based multi-modality sensor calibration method for usv. Proceedings of the 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM), Xi\u2019an, China.","DOI":"10.1109\/BigMM.2018.8499349"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mou, X., and Wang, H. (2018). Wide-baseline stereo-based obstacle mapping for unmanned surface vehicles. Sensors, 18.","DOI":"10.3390\/s18041085"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s00138-017-0878-7","article-title":"Vision-based navigation of an unmanned surface vehicle with object detection and tracking abilities","volume":"29","author":"Shin","year":"2018","journal-title":"Mach. Vis. Appl."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Guindel, C., Beltr\u00e1n, J., Mart\u00edn, D., and Garc\u00eda, F. (2017, January 16\u201319). Automatic extrinsic calibration for lidar-stereo vehicle sensor setups. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317829"},{"key":"ref_28","unstructured":"Moravec, J., and Sara, R. (2018, January 5\u20137). Robust Maximum-likelihood On-line LiDAR-to-Camera Calibration Monitoring and Refinement. Proceedings of the Computer Vision Winter Workshop 2018, \u010cesk\u00fd, Krumlov, Czech Republic."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Konolige, K. (1998). Small vision systems: Hardware and implementation. Robotics Research, Springer.","DOI":"10.1007\/978-1-4471-1580-9_19"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1109\/TCYB.2015.2412251","article-title":"Fast image-based obstacle detection from unmanned surface vehicles","volume":"46","author":"Kristan","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.robot.2018.02.017","article-title":"Stereo obstacle detection for unmanned surface vehicles by IMU-assisted semantic segmentation","volume":"104","author":"Bovcon","year":"2018","journal-title":"Robot. Auton. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3241\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:36:26Z","timestamp":1760175386000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3241"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,7]]},"references-count":31,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["s20113241"],"URL":"https:\/\/doi.org\/10.3390\/s20113241","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,7]]}}}