{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T23:05:43Z","timestamp":1778713543198,"version":"3.51.4"},"reference-count":58,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2009,9,30]],"date-time":"2009-09-30T00:00:00Z","timestamp":1254268800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Auton Robot"],"published-print":{"date-parts":[[2009,11]]},"DOI":"10.1007\/s10514-009-9155-6","type":"journal-article","created":{"date-parts":[[2009,9,29]],"date-time":"2009-09-29T17:29:48Z","timestamp":1254245388000},"page":"387-407","source":"Crossref","is-referenced-by-count":268,"title":["On measuring the accuracy of SLAM algorithms"],"prefix":"10.1007","volume":"27","author":[{"given":"Rainer","family":"K\u00fcmmerle","sequence":"first","affiliation":[]},{"given":"Bastian","family":"Steder","sequence":"additional","affiliation":[]},{"given":"Christian","family":"Dornhege","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Ruhnke","sequence":"additional","affiliation":[]},{"given":"Giorgio","family":"Grisetti","sequence":"additional","affiliation":[]},{"given":"Cyrill","family":"Stachniss","sequence":"additional","affiliation":[]},{"given":"Alexander","family":"Kleiner","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2009,9,30]]},"reference":[{"key":"9155_CR1","doi-asserted-by":"crossref","unstructured":"Amigoni, F., Gasparini, S., & \u00a0Gini, M. (2007). Good experimental methodologies for robotic mapping: A proposal. In Proc. of the IEEE int. conf. on robotics & automation (ICRA).","DOI":"10.1109\/ROBOT.2007.364121"},{"key":"9155_CR2","unstructured":"Balaguer, B., Carpin, S., & Balakirsky, S. (2007). Towards quantitative comparisons of robot algorithms: Experiences with SLAM in simulation and real world systems. In IROS 2007 workshop."},{"key":"9155_CR3","doi-asserted-by":"crossref","DOI":"10.1002\/0471221279","volume-title":"Estimation with application to tracking and navigation","author":"Y. Bar-Shalom","year":"2001","unstructured":"Bar-Shalom, Y., Li, X. R., & Kirubarajan, T. (2001). Estimation with application to tracking and navigation. New York: Wiley."},{"key":"9155_CR4","unstructured":"Bonarini, A., Burgard, W., Fontana, G., Matteucci, M., Sorrenti, D. G., & Tardos, J. D. (2006). Rawseeds a project on SLAM benchmarking. In Proceedings of the IROS\u201906 workshop on benchmarks in robotics research. Available online at http:\/\/www.robot.uji.es\/EURON\/pdfs\/LectureNotesIROS06.pdf ."},{"key":"9155_CR5","unstructured":"Bosse, M., Newman, P. M., Leonard, J. J., & Teller, S. (2003). An ALTAS framework for scalable mapping. In Proc. of the IEEE int. conf. on robotics & automation (ICRA) (pp. 1899\u20131906). Taipei, Taiwan."},{"key":"9155_CR6","doi-asserted-by":"crossref","unstructured":"Burgard, W., Stachniss, C., Grisetti, G., Steder, B., K\u00fcmmerle, R., Dornhege, C., Ruhnke, M., Kleiner, A., & Tard\u00f3s, J. D. (2009, to appear). A comparison of slam algorithms based on a graph of relations. In Proc. of the int. conf. on intelligent robots and systems (IROS).","DOI":"10.1109\/IROS.2009.5354691"},{"issue":"6","key":"9155_CR7","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","volume":"8","author":"J. Canny","year":"1986","unstructured":"Canny, J. (1986). A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6), 679\u2013698.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"9155_CR8","doi-asserted-by":"crossref","unstructured":"Censi, A. (2006). Scan matching in a probabilistic framework. In Proc. of the IEEE int. conf. on robotics & automation (ICRA) (pp. 2291\u20132296).","DOI":"10.1109\/ROBOT.2006.1642044"},{"key":"9155_CR9","unstructured":"Darpa (2007). Darpa Urban Challenge. http:\/\/www.darpa.mil\/grandchallenge\/ ."},{"key":"9155_CR10","doi-asserted-by":"crossref","unstructured":"Dellaert, F. (2005). Square Root SAM. In Proc. of robotics: science and systems (RSS) (pp. 177\u2013184). Cambridge, MA, USA.","DOI":"10.15607\/RSS.2005.I.024"},{"key":"9155_CR11","unstructured":"Dellaert, F., Fox, D., Burgard, W., & Thrun, S. (1998). Monte Carlo localization for mobile robots. In Proc. of the IEEE int. conf. on robotics & automation (ICRA). Leuven, Belgium."},{"key":"9155_CR12","doi-asserted-by":"crossref","unstructured":"Dissanayake, G., Durrant-Whyte, H., & Bailey, T. (2000). A computationally efficient solution to the simultaneous localisation and map building (SLAM) problem. In Proc. of the IEEE int. conf. on robotics & automation (ICRA) (pp. 1009\u20131014).","DOI":"10.1109\/ROBOT.2000.844732"},{"key":"9155_CR13","volume-title":"Sequential Monte-Carlo methods in practice","year":"2001","unstructured":"Doucet, A., de Freitas, N., & Gordan, N. (Eds.) (2001). Sequential Monte-Carlo methods in practice. Berlin: Springer."},{"issue":"3","key":"9155_CR14","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1023\/A:1015269615729","volume":"12","author":"T. Duckett","year":"2002","unstructured":"Duckett, T., Marsland, S., & Shapiro, J. (2002). Fast, on-line learning of globally consistent maps. Autonomous Robots, 12(3), 287\u2013300.","journal-title":"Autonomous Robots"},{"key":"9155_CR15","unstructured":"EPFL and IROS (2002). Cleaning Robot Contest. http:\/\/robotika.cz\/competitions\/cleaning2002\/en ."},{"key":"9155_CR16","unstructured":"ESA (2008). Lunar robotics challenge. http:\/\/www.esa.int\/esaCP\/SEM4GKRTKMF_index_0.html ."},{"issue":"4","key":"9155_CR17","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1109\/TRO.2005.844673","volume":"21","author":"C. Estrada","year":"2005","unstructured":"Estrada, C., Neira, J., & Tard\u00f3s, J. D. (2005). Hierarchical SLAM: Real-time accurate mapping of large environments. IEEE Transactions on Robotics, 21(4), 588\u2013596.","journal-title":"IEEE Transactions on Robotics"},{"key":"9155_CR18","doi-asserted-by":"crossref","unstructured":"Eustice, R., Singh, H., & Leonard, J. J. (2005a). Exactly sparse delayed-state filters. In Proc. of the IEEE int. conf. on robotics & automation (ICRA) (pp. 2428\u20132435).","DOI":"10.1109\/ROBOT.2005.1570475"},{"key":"9155_CR19","doi-asserted-by":"crossref","unstructured":"Eustice, R., Walter, M., & Leonard, J. J. (2005b). Sparse extended information filters: Insights into sparsification. In Proc. of the int. conf. on intelligent robots and systems (IROS) (pp. 641\u2013648). Edmonton, Canada.","DOI":"10.1109\/IROS.2005.1545053"},{"issue":"2","key":"9155_CR20","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/s10514-006-9043-2","volume":"21","author":"U. Frese","year":"2006","unstructured":"Frese, U. (2006). Treemap: An o(log\u2009n) algorithm for indoor simultaneous localization and mapping. Autonomous Robots, 21(2), 103\u2013122.","journal-title":"Autonomous Robots"},{"key":"9155_CR21","unstructured":"Frese, U. (2008). Dlr spatial cognition data set. http:\/\/www.informatik.uni-bremen.de\/agebv\/en\/DlrSpatialCognitionDataSet ."},{"issue":"2","key":"9155_CR22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TRO.2004.839220","volume":"21","author":"U. Frese","year":"2005","unstructured":"Frese, U., Larsson, P., & Duckett, T. (2005). A multilevel relaxation algorithm for simultaneous localisation and mapping. IEEE Transactions on Robotics, 21(2), 1\u201312.","journal-title":"IEEE Transactions on Robotics"},{"key":"9155_CR23","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/B:VISI.0000027787.82851.b6","volume":"60","author":"C. Fr\u00fch","year":"2004","unstructured":"Fr\u00fch, C., & Zakhor, A. (2004). An automated method for large-scale, ground-based city model acquisition. International Journal of Computer Vision, 60, 5\u201324.","journal-title":"International Journal of Computer Vision"},{"key":"9155_CR24","doi-asserted-by":"crossref","unstructured":"Grisetti, G., Grzonka, S., Stachniss, C., Pfaff, P., & Burgard, W. (2007a). Efficient estimation of accurate maximum likelihood maps in 3D. In Proc. of the int. conf. on intelligent robots and systems (IROS). San Diego, CA, USA.","DOI":"10.1109\/IROS.2007.4399030"},{"key":"9155_CR25","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/TRO.2006.889486","volume":"23","author":"G. Grisetti","year":"2007","unstructured":"Grisetti, G., Stachniss, C., & Burgard, W. (2007b). Improved techniques for grid mapping with Rao-Blackwellized particle filters. IEEE Transactions on Robotics, 23, 34\u201346.","journal-title":"IEEE Transactions on Robotics"},{"key":"9155_CR26","doi-asserted-by":"crossref","unstructured":"Grisetti, G., Stachniss, C., Grzonka, S., & Burgard, W. (2007c). A tree parameterization for efficiently computing maximum likelihood maps using gradient descent. In Proc. of robotics: science and systems (RSS).","DOI":"10.15607\/RSS.2007.III.009"},{"key":"9155_CR27","doi-asserted-by":"crossref","unstructured":"Gutmann, J.-S., & Konolige, K. (1999). Incremental mapping of large cyclic environments. In Proc. of the IEEE int. symposium on computational intelligence in robotics and automation (CIRA).","DOI":"10.1109\/CIRA.1999.810068"},{"key":"9155_CR28","doi-asserted-by":"crossref","unstructured":"H\u00e4hnel, D., Burgard, W., Fox, D., & Thrun, S. (2003). An efficient FastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements. In Proc. of the int. conf. on intelligent robots and systems (IROS) (pp. 206\u2013211).","DOI":"10.1109\/IROS.2003.1250629"},{"key":"9155_CR29","doi-asserted-by":"crossref","unstructured":"Hermosillo, J., Pradalier, C., Sekhavat, S., Laugier, C., & Baille, G. (2003). Towards motion autonomy of a bi-steerable car: Experimental issues from map-building to trajectory execution. In Proc. of the IEEE int. conf. on robotics & automation (ICRA).","DOI":"10.1109\/ROBOT.2003.1241957"},{"issue":"7","key":"9155_CR30","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1109\/34.506791","volume":"18","author":"A. Hoover","year":"1996","unstructured":"Hoover, A., Jean-Baptiste, G., Jiang, X., Flynn, P. J., Bunke, H., Goldgof, D. B., Bowyer, K. K., Eggert, D. W., Fitzgibbon, A. W., & Fisher, R. B. (1996). An experimental comparison of range image segmentation algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(7), 673\u2013689.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"9155_CR31","unstructured":"Howard, A., & Roy, N. (2003). Radish: The robotics data set repository, standard data sets for the robotics community. http:\/\/radish.sourceforge.net\/ ."},{"key":"9155_CR32","doi-asserted-by":"crossref","unstructured":"Julier, S., Uhlmann, J., & Durrant-Whyte, H. (1995). A new approach for filtering nonlinear systems. In Proc. of the American control conference (pp. 1628\u20131632).","DOI":"10.1109\/ACC.1995.529783"},{"key":"9155_CR33","doi-asserted-by":"crossref","unstructured":"Kaess, M., Ranganathan, A., & Dellaert, F. (2007). iSAM: Fast incremental smoothing and mapping with efficient data association. In Proc. of the IEEE int. conf. on robotics & automation (ICRA).","DOI":"10.1109\/ROBOT.2007.363563"},{"key":"9155_CR34","doi-asserted-by":"crossref","unstructured":"K\u00fcmmerle, R., Steder, B., Dornhege, C., Kleiner, A., Grisetti, G., & Burgard, W. (2009). Large scale graph-based SLAM using aerial images as prior information. In Proc. of robotics: science and systems (RSS).","DOI":"10.15607\/RSS.2009.V.038"},{"issue":"4","key":"9155_CR35","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1109\/70.88147","volume":"7","author":"J. J. Leonard","year":"1991","unstructured":"Leonard, J. J., & Durrant-Whyte, H. F. (1991). Mobile robot localization by tracking geometric beacons. IEEE Transactions on Robotics and Automation, 7(4), 376\u2013382.","journal-title":"IEEE Transactions on Robotics and Automation"},{"key":"9155_CR36","unstructured":"Lu, F., & Milios, E. (1994). Robot pose estimation in unknown environments by matching 2d range scans. In IEEE computer vision and pattern recognition conference (CVPR) (pp. 935\u2013938)."},{"key":"9155_CR37","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1023\/A:1008854305733","volume":"4","author":"F. Lu","year":"1997","unstructured":"Lu, F., & Milios, E. (1997). Globally consistent range scan alignment for environment mapping. Autonomous Robots, 4, 333\u2013349.","journal-title":"Autonomous Robots"},{"key":"9155_CR38","unstructured":"Montemerlo, M., Thrun, S., Koller, D., & Wegbreit, B. (2003). FastSLAM 2.0: An improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In Proc. of the int. conf. on artificial intelligence (IJCAI) (pp. 1151\u20131156)."},{"key":"9155_CR39","doi-asserted-by":"crossref","unstructured":"N\u00fcchter, A., Lingemann, K., Hertzberg, J., & Surmann, H. (2005). 6d SLAM with approximate data association. In Proc. of the 12th int. conference on advanced robotics (ICAR) (pp. 242\u2013249).","DOI":"10.1109\/ICAR.2005.1507419"},{"key":"9155_CR40","unstructured":"Olson, E. (2008). Robust and efficient robotic mapping. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, USA."},{"key":"9155_CR41","unstructured":"Olson, E., Leonard, J., & Teller, S. (2006). Fast iterative optimization of pose graphs with poor initial estimates. In Proc. of the IEEE int. conf. on robotics & automation (ICRA) (pp. 2262\u20132269)."},{"key":"9155_CR42","series-title":"STAR Springer tracts in advanced robotics","volume-title":"European robotics symposium 2006","author":"P. Pfaff","year":"2006","unstructured":"Pfaff, P., Burgard, W., & Fox, D. (2006). Robust Monte-Carlo localization using adaptive likelihood models. In H.I. Christiensen (Ed.), STAR Springer tracts in advanced robotics : Vol.\u00a022. European robotics symposium 2006 (pp. 181\u2013194). Berlin: Springer."},{"key":"9155_CR43","unstructured":"Ranganathan, A., Kaess, M., & Dellaert, F. (2007). Loopy sam. In Proc. of the int. conf. on artificial intelligence (IJCAI)."},{"key":"9155_CR44","unstructured":"RoboCup Federation (2009). RoboCup Competitions. http:\/\/www.robocup.org ."},{"key":"9155_CR45","unstructured":"Scharstein, D., & Szeliski, R. (2002). Middlebury stereo vision page. http:\/\/www.middlebury.edu\/stereo ."},{"issue":"4","key":"9155_CR46","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1177\/027836498600500404","volume":"5","author":"R. C. Smith","year":"1986","unstructured":"Smith, R. C., & Cheeseman, P. (1986). On the representation and estimation of spatial uncertainty. International Journal of Robotics Research, 5(4), 56\u201368.","journal-title":"International Journal of Robotics Research"},{"key":"9155_CR47","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1007\/978-1-4613-8997-2_14","volume-title":"Autonomous robot vehicles","author":"R. Smith","year":"1990","unstructured":"Smith, R., Self, M., & Cheeseman, P. (1990). Estimating uncertain spatial relationships in robotics. In I. Cox & G. Wilfong (Eds.), Autonomous robot vehicles (pp. 167\u2013193). Berlin: Springer."},{"key":"9155_CR48","unstructured":"Stachniss, C., Frese, U., & Grisetti, G. (2007a). OpenSLAM. org\u2014give your algorithm to the community. http:\/\/www.openslam.org ."},{"key":"9155_CR49","doi-asserted-by":"crossref","unstructured":"Stachniss, C., Grisetti, G., Roy, N., & Burgard, W. (2007b). Evaluation of Gaussian proposal distributions for mapping with Rao-Blackwellized particle filters. In Proc. of the int. conf. on intelligent robots and systems (IROS).","DOI":"10.1109\/IROS.2007.4399005"},{"key":"9155_CR50","unstructured":"Symeo GmbH (2008). http:\/\/www.symeo.de ."},{"issue":"5","key":"9155_CR51","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1177\/02783640122067435","volume":"20","author":"S. Thrun","year":"2001","unstructured":"Thrun, S. (2001). An online mapping algorithm for teams of mobile robots. International Journal of Robotics Research, 20(5), 335\u2013363.","journal-title":"International Journal of Robotics Research"},{"issue":"7\/8","key":"9155_CR52","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1177\/0278364904045479","volume":"23","author":"S. Thrun","year":"2004","unstructured":"Thrun, S., Liu, Y., Koller, D., Ng, A. Y., Ghahramani, Z., & Durrant-Whyte, H. (2004). Simultaneous localization and mapping with sparse extended information filters. International Journal of Robotics Research, 23(7\/8), 693\u2013716.","journal-title":"International Journal of Robotics Research"},{"key":"9155_CR53","volume-title":"Probabilistic robotics","author":"S. Thrun","year":"2005","unstructured":"Thrun, S., Burgard, W., & Fox, D. (2005). Probabilistic robotics. Cambridge: MIT Press."},{"key":"9155_CR54","doi-asserted-by":"crossref","unstructured":"Thrun, S. et al. (2006). Winning the Darpa grand challenge. Journal on Field Robotics.","DOI":"10.1002\/rob.20147"},{"key":"9155_CR55","unstructured":"Torralba, A., Murphy, K. P., & Freeman, W. T. (2007). Labelme: the open annotation tool. http:\/\/labelme.csail.mit.edu\/ ."},{"key":"9155_CR56","unstructured":"Uhlmann, J. (1995). Dynamic map building and localization: New theoretical foundations. PhD thesis, University of Oxford."},{"issue":"3","key":"9155_CR57","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1002\/rob.20234","volume":"25","author":"O. Wulf","year":"2008","unstructured":"Wulf, O., N\u00fcchter, A., Hertzberg, J., & Wagner, B. (2008). Benchmarking urban six-degree-of-freedom simultaneous localization and mapping. Journal of Field Robotics, 25(3), 148\u2013163.","journal-title":"Journal of Field Robotics"},{"key":"9155_CR58","doi-asserted-by":"crossref","unstructured":"Yguel, M., Keat, C. T. M., Braillon, C., Laugier, C., & Aycard, O. (2007). Dense mapping for range sensors: Efficient algorithms and sparse representations. In Proc. of robotics: science and systems (RSS).","DOI":"10.15607\/RSS.2007.III.017"}],"container-title":["Autonomous Robots"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-009-9155-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10514-009-9155-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-009-9155-6","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,29]],"date-time":"2019-05-29T19:13:32Z","timestamp":1559157212000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10514-009-9155-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,9,30]]},"references-count":58,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2009,11]]}},"alternative-id":["9155"],"URL":"https:\/\/doi.org\/10.1007\/s10514-009-9155-6","relation":{},"ISSN":["0929-5593","1573-7527"],"issn-type":[{"value":"0929-5593","type":"print"},{"value":"1573-7527","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,9,30]]}}}