{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T22:16:05Z","timestamp":1784585765797,"version":"3.55.0"},"reference-count":59,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2014,12,15]],"date-time":"2014-12-15T00:00:00Z","timestamp":1418601600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2015,3]]},"abstract":"<jats:p>Combining visual and inertial measurements has become popular in mobile robotics, since the two sensing modalities offer complementary characteristics that make them the ideal choice for accurate visual\u2013inertial odometry or simultaneous localization and mapping (SLAM). While historically the problem has been addressed with filtering, advancements in visual estimation suggest that nonlinear optimization offers superior accuracy, while still tractable in complexity thanks to the sparsity of the underlying problem. Taking inspiration from these findings, we formulate a rigorously probabilistic cost function that combines reprojection errors of landmarks and inertial terms. The problem is kept tractable and thus ensuring real-time operation by limiting the optimization to a bounded window of keyframes through marginalization. Keyframes may be spaced in time by arbitrary intervals, while still related by linearized inertial terms. We present evaluation results on complementary datasets recorded with our custom-built stereo visual\u2013inertial hardware that accurately synchronizes accelerometer and gyroscope measurements with imagery. A comparison of both a stereo and monocular version of our algorithm with and without online extrinsics estimation is shown with respect to ground truth. Furthermore, we compare the performance to an implementation of a state-of-the-art stochastic cloning sliding-window filter. This competitive reference implementation performs tightly coupled filtering-based visual\u2013inertial odometry. While our approach declaredly demands more computation, we show its superior performance in terms of accuracy.<\/jats:p>","DOI":"10.1177\/0278364914554813","type":"journal-article","created":{"date-parts":[[2014,12,16]],"date-time":"2014-12-16T00:08:53Z","timestamp":1418688533000},"page":"314-334","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1476,"title":["Keyframe-based visual\u2013inertial odometry using nonlinear optimization"],"prefix":"10.1177","volume":"34","author":[{"given":"Stefan","family":"Leutenegger","sequence":"first","affiliation":[{"name":"Department of Computing, Imperial College London, London, UK"},{"name":"Autonomous Systems Laboratory (ASL), ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon","family":"Lynen","sequence":"additional","affiliation":[{"name":"Autonomous Systems Laboratory (ASL), ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Bosse","sequence":"additional","affiliation":[{"name":"Autonomous Systems Laboratory (ASL), ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roland","family":"Siegwart","sequence":"additional","affiliation":[{"name":"Autonomous Systems Laboratory (ASL), ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Furgale","sequence":"additional","affiliation":[{"name":"Autonomous Systems Laboratory (ASL), ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2014,12,15]]},"reference":[{"key":"bibr1-0278364914554813","unstructured":"Agarwal S, Mierle K, (2010) Ceres Solver. Available at: http:\/\/ceres-solver.org (accessed 27 November 2014)."},{"key":"bibr2-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1016\/j.actaastro.2010.06.049"},{"key":"bibr3-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ACC.2005.1470719"},{"key":"bibr4-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2009.5152678"},{"key":"bibr5-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1162\/105474602320935829"},{"key":"bibr6-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2003.1238654"},{"key":"bibr7-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980267"},{"key":"bibr8-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6386235"},{"key":"bibr9-0278364914554813","unstructured":"Ebcin S, Veth M (2007) Tightly-coupled image-aided inertial navigation using the unscented kalman filter. Technical report, DTIC Document."},{"key":"bibr10-0278364914554813","unstructured":"Furgale P (2011) Extensions to the Visual Odometry Pipeline for the Exploration of Planetary Surfaces. PhD Thesis, University of Toronto, Institute for Aerospace Studies."},{"key":"bibr11-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2013.6696514"},{"key":"bibr12-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"bibr13-0278364914554813","doi-asserted-by":"publisher","DOI":"10.5244\/C.2.23"},{"key":"bibr14-0278364914554813","volume-title":"Observability-constrained vision-aided inertial navigation","author":"Hesch JA","year":"2012"},{"key":"bibr15-0278364914554813","volume-title":"Proceedings of the international workshop on the algorithmic foundations of robotics (WAFR)","author":"Hesch JA","year":"2012"},{"key":"bibr16-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36279-8_34"},{"key":"bibr17-0278364914554813","doi-asserted-by":"crossref","unstructured":"Huang G, Kaess M, Leonard JJ (2013) Towards consistent visual-inertial navigation.\n                      Technical Report\n                      Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA.","DOI":"10.1109\/ICRA.2014.6907581"},{"key":"bibr18-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00196-3_43"},{"key":"bibr19-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2011.6095161"},{"key":"bibr20-0278364914554813","volume-title":"International conference on information fusion (FUSION)","author":"Indelman V","year":"2012"},{"key":"bibr21-0278364914554813","first-page":"203","author":"Jia C","year":"2012","journal-title":"MMSP"},{"key":"bibr22-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1177\/0278364910388963"},{"key":"bibr23-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2001.991037"},{"key":"bibr24-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911430419"},{"key":"bibr25-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1177\/0278364910382802"},{"key":"bibr26-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2006.06.006"},{"key":"bibr27-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"bibr28-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6906582"},{"key":"bibr29-0278364914554813","first-page":"201","volume-title":"Robotics Research","author":"Konolige K","year":"2011"},{"key":"bibr30-0278364914554813","volume-title":"Proceedings of the international symposium on experimental robotics (ISER)","author":"Kottas DG","year":"2012"},{"key":"bibr31-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"bibr32-0278364914554813","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2013.IX.037"},{"key":"bibr33-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6631248"},{"key":"bibr34-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2012.6225229"},{"key":"bibr35-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2012.6225229"},{"key":"bibr36-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6386223"},{"key":"bibr37-0278364914554813","doi-asserted-by":"crossref","first-page":"241","DOI":"10.7551\/mitpress\/9816.003.0036","author":"Li M","year":"2013","journal-title":"Robotics: Science and Systems"},{"key":"bibr38-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1177\/0278364907079276"},{"key":"bibr39-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2013.6696917"},{"key":"bibr40-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2011.2109210"},{"key":"bibr41-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6906979"},{"key":"bibr42-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0361-7"},{"key":"bibr43-0278364914554813","volume-title":"IMU\u2013camera Calibration: Bundle Adjustment Implementation","author":"Mirzaei FM","year":"2007"},{"key":"bibr44-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2008.2004486"},{"key":"bibr45-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"bibr46-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2009.2012342"},{"key":"bibr47-0278364914554813","volume-title":"Proceedings of the workshop on \u201cmulti-view geometry in robotics\u201d at the robotics: science and systems (RSS)","author":"Nerurkar ED","year":"2013"},{"key":"bibr48-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6906892"},{"key":"bibr49-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2007.4399318"},{"key":"bibr50-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2002.1014441"},{"key":"bibr51-0278364914554813","doi-asserted-by":"publisher","DOI":"10.2514\/2.4242"},{"key":"bibr52-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/PLANS.2004.1309005"},{"key":"bibr53-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1002\/rob.20360"},{"key":"bibr54-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2010.5509636"},{"key":"bibr55-0278364914554813","doi-asserted-by":"crossref","unstructured":"Strelow D, Singh S (2003) Online motion estimation from image and inertial measurements. Available at: https:\/\/www.frc.ri.cmu.edu\/projects\/buzzard\/publications\/inervis03.pdf","DOI":"10.1109\/CVPRW.2003.10073"},{"key":"bibr56-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1177\/0278364904045593"},{"key":"bibr57-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1177\/0278364906065387"},{"key":"bibr58-0278364914554813","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2012.6225147"},{"key":"bibr59-0278364914554813","unstructured":"Weiss SM (2012) Vision based navigation for micro helicopters. PhD Thesis, Eidgen\u00f6ssische Technische Hochschule, ETH Z\u00fcrich, 2012."}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364914554813","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0278364914554813","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364914554813","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:18:45Z","timestamp":1777457925000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364914554813"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,12,15]]},"references-count":59,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,3]]}},"alternative-id":["10.1177\/0278364914554813"],"URL":"https:\/\/doi.org\/10.1177\/0278364914554813","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,12,15]]}}}