{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T10:09:02Z","timestamp":1777716542772,"version":"3.51.4"},"reference-count":54,"publisher":"SAGE Publications","issue":"4-5","license":[{"start":{"date-parts":[[2015,3,25]],"date-time":"2015-03-25T00:00:00Z","timestamp":1427241600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2015,4]]},"abstract":"<jats:p>In this paper we present a new real-time image-based localization method for scenes that have been reconstructed offline using structure from motion. From input video, our method continuously computes six-degree-of-freedom camera pose estimates by efficiently tracking natural features and matching them to 3D points reconstructed by structure from motion. Our main contribution lies in efficiently interleaving a fast keypoint tracker that uses inexpensive binary feature descriptors with a new approach for direct 2D-to-3D matching. Our 2D-to-3D matching scheme avoids the need for online extraction of scale-invariant features. Instead, offline we construct an indexed database containing multiple DAISY descriptors per 3D point extracted at multiple scales. The key to the efficiency of our method is invoking DAISY descriptor extraction and matching sparingly during localization, and in distributing this computation over a temporal window of successive frames. This enables the system to run in real-time and achieve low per-frame latency over long durations. Our algorithm runs at over 30\u2009Hz on a laptop and at 12\u2009Hz on a low-power computer suitable for onboard computation on a mobile robot such as a micro-aerial vehicle. We have evaluated our method using ground truth and present results on several challenging indoor and outdoor sequences.<\/jats:p>","DOI":"10.1177\/0278364914561101","type":"journal-article","created":{"date-parts":[[2015,3,26]],"date-time":"2015-03-26T04:58:46Z","timestamp":1427345926000},"page":"476-492","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":46,"title":["Real-time monocular image-based 6-DoF localization"],"prefix":"10.1177","volume":"34","author":[{"given":"Hyon","family":"Lim","sequence":"first","affiliation":[{"name":"Department of Mechanical and Aerospace Engineering, Seoul National University, Seoul, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sudipta N.","family":"Sinha","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael F.","family":"Cohen","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matt","family":"Uyttendaele","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"H. Jin","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Aerospace Engineering, Seoul National University, Seoul, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2015,3,25]]},"reference":[{"key":"bibr1-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980343"},{"key":"bibr2-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2009.5336494"},{"key":"bibr3-0278364914561101","first-page":"271","volume-title":"Proceedings of the fourth annual ACM-SIAM symposium on discrete algorithms","author":"Arya S","year":"1993"},{"key":"bibr4-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2010.5509920"},{"key":"bibr5-0278364914561101","first-page":"1","author":"Boiman O","year":"2008","journal-title":"IEEE conference on computer vision and pattern recognition, 2008 (CVPR 2008)"},{"key":"bibr6-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"bibr7-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2011.05.002"},{"key":"bibr8-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2011.02.007"},{"key":"bibr9-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2006.78"},{"key":"bibr10-0278364914561101","unstructured":"Compulab (2011) fit-PC2i. http:\/\/www.fit-pc.com\/web\/fit-pc\/fit-pc2-i\/ (Accessed 7 August 2013)."},{"key":"bibr11-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1177\/0278364908090961"},{"key":"bibr12-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1049"},{"key":"bibr13-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459273"},{"key":"bibr14-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2012.6225199"},{"key":"bibr15-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1145\/358669.358692"},{"key":"bibr16-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539802"},{"key":"bibr17-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539788"},{"key":"bibr18-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911434148"},{"key":"bibr19-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.4.000629"},{"key":"bibr20-0278364914561101","volume-title":"International symposium on robotics research (ISRR)","author":"Huang AS","year":"2011"},{"key":"bibr21-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206587"},{"key":"bibr22-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.256"},{"key":"bibr23-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1115\/1.3662552"},{"key":"bibr24-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"bibr25-0278364914561101","volume-title":"The 7th international workshop on image analysis for multimedia interactive services","author":"Koch R","year":"2005"},{"key":"bibr26-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.188"},{"key":"bibr27-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33718-5_2"},{"key":"bibr28-0278364914561101","author":"Li Y","year":"2010","journal-title":"ECCV"},{"key":"bibr29-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2012.2205629"},{"key":"bibr30-0278364914561101","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1109\/CVPR.2012.6247782","volume-title":"2012 IEEE conference on computer vision and pattern recognition (CVPR)","author":"Lim H","year":"2012"},{"key":"bibr31-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"bibr32-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-012-9281-4"},{"key":"bibr33-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1177\/0278364913490323"},{"key":"bibr34-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.264"},{"key":"bibr35-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.23"},{"key":"bibr36-0278364914561101","first-page":"1","author":"Robertson DP","year":"2004","journal-title":"BMVC"},{"key":"bibr37-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-0023-y"},{"key":"bibr38-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.178"},{"key":"bibr39-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126302"},{"key":"bibr40-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33718-5_54"},{"key":"bibr41-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2007.383150"},{"key":"bibr42-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2004.839228"},{"key":"bibr43-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2004.53"},{"key":"bibr44-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0107-3"},{"key":"bibr45-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206831"},{"key":"bibr46-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2008.4587673"},{"key":"bibr47-0278364914561101","volume-title":"Detection and Tracking of Point Features","author":"Tomasi C","year":"1991"},{"key":"bibr48-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.99"},{"key":"bibr49-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1002\/rob.20412"},{"key":"bibr50-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980317"},{"key":"bibr51-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/3DIMPVT.2012.64"},{"key":"bibr52-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4409115"},{"key":"bibr53-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206839"},{"key":"bibr54-0278364914561101","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.2009.5346258"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364914561101","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0278364914561101","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0278364914561101","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:18:48Z","timestamp":1777457928000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0278364914561101"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,3,25]]},"references-count":54,"journal-issue":{"issue":"4-5","published-print":{"date-parts":[[2015,4]]}},"alternative-id":["10.1177\/0278364914561101"],"URL":"https:\/\/doi.org\/10.1177\/0278364914561101","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,3,25]]}}}