{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T12:46:00Z","timestamp":1778071560915,"version":"3.51.4"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2009,8,19]],"date-time":"2009-08-19T00:00:00Z","timestamp":1250640000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Auton Robot"],"published-print":{"date-parts":[[2009,11]]},"DOI":"10.1007\/s10514-009-9137-8","type":"journal-article","created":{"date-parts":[[2009,8,18]],"date-time":"2009-08-18T14:35:02Z","timestamp":1250606102000},"page":"313-325","source":"Crossref","is-referenced-by-count":41,"title":["An insightful comparison between experiments in mobile robotics and in science"],"prefix":"10.1007","volume":"27","author":[{"given":"Francesco","family":"Amigoni","sequence":"first","affiliation":[]},{"given":"Monica","family":"Reggiani","sequence":"additional","affiliation":[]},{"given":"Viola","family":"Schiaffonati","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2009,8,19]]},"reference":[{"key":"9137_CR1","doi-asserted-by":"crossref","unstructured":"Amigoni, F. (2008). Experimental evaluation of some exploration strategies for mobile robots. In IEEE int. conf. on robotics and automation (pp. 2818\u20132823).","DOI":"10.1109\/ROBOT.2008.4543637"},{"key":"9137_CR2","doi-asserted-by":"crossref","unstructured":"Amigoni, F., Gasparini, S., & Gini, M. (2007). Good experimental methodologies for robotic mapping: A proposal. In IEEE int. conf. on robotics and automation (pp. 4176\u20134181).","DOI":"10.1109\/ROBOT.2007.364121"},{"key":"9137_CR3","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/BF02430363","volume":"1","author":"R. S. Barr","year":"1995","unstructured":"Barr, R. S., Golden, B. L., Kelly, J. P., Resende, M. G. C., & Stewart, W. R. (1995). Designing and reporting on computational experiments with heuristic methods. Journal of Heuristics, 1, 9\u201332.","journal-title":"Journal of Heuristics"},{"key":"9137_CR4","unstructured":"Bonsignorio, F., Hallam, J., & del\u00a0Pobil, A.P. (2007). Good experimental methodology\u2014GEM guidelines. http:\/\/www.heronrobots.com\/EuronGEMSig\/Downloads\/GemSigGuidelinesBeta.pdf ."},{"key":"9137_CR5","doi-asserted-by":"crossref","unstructured":"Comport, A. I., Malis, E., & Rives, P. (2007). Accurate quadrifocal tracking for robust 3d visual odometry. In IEEE int. conf. on robotics and automation (pp. 40\u201345).","DOI":"10.1109\/ROBOT.2007.363762"},{"key":"9137_CR6","volume-title":"Uncommon sense","author":"A. Cromer","year":"1993","unstructured":"Cromer, A. (1993). Uncommon sense. New York: Oxford University Press."},{"key":"9137_CR7","doi-asserted-by":"crossref","unstructured":"Davison, A. J. (2003). Real-time simultaneous localisation and mapping with a single camera. In IEEE int. conf. on computer vision (pp. 1403\u20131410).","DOI":"10.1109\/ICCV.2003.1238654"},{"issue":"6","key":"9137_CR8","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TPAMI.2007.1049","volume":"29","author":"A. J. Davison","year":"2007","unstructured":"Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007). Monoslam: real-time single camera slam. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(6), 1052\u20131067.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"9137_CR9","unstructured":"EURON GEM Sig (2007). http:\/\/www.heronrobots.com\/EuronGEMSig\/ ."},{"issue":"4","key":"9137_CR10","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1093\/bjps\/32.4.367","volume":"32","author":"A. Franklin","year":"1981","unstructured":"Franklin, A. (1981). What makes a \u2018good\u2019 experiment? British Journal for the Philosophy of Science, 32(4), 367\u2013379.","journal-title":"British Journal for the Philosophy of Science"},{"key":"9137_CR11","unstructured":"Franklin, A. (2009). Experiment in physics. In E.\u00a0N. Zalta (Ed.), The Stanford encyclopedia of philosophy. http:\/\/plato.stanford.edu\/archives\/spr2009\/entries\/physics-experiment\/ ."},{"issue":"2","key":"9137_CR12","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1109\/TRO.2004.839220","volume":"21","author":"U. Frese","year":"2005","unstructured":"Frese, U., Larsson, P., & Duckett, T. (2005). A multilevel relaxation algorithm for simultaneous localization and mapping. IEEE Transactions on Robotics, 21(2), 196\u2013207.","journal-title":"IEEE Transactions on Robotics"},{"issue":"1","key":"9137_CR13","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/TRO.2006.889486","volume":"23","author":"G. Grisetti","year":"2007","unstructured":"Grisetti, G., Stachniss, C., & Burgard, W. (2007). Improved techniques for grid mapping with rao-blackwellized particle filters. IEEE Transactions on Robotics, 23(1), 34\u201346.","journal-title":"IEEE Transactions on Robotics"},{"key":"9137_CR14","volume-title":"The discovery of Neptune","author":"M. Grosser","year":"1962","unstructured":"Grosser, M. (1962). The discovery of Neptune. Cambridge: Harvard University Press."},{"issue":"10","key":"9137_CR15","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1002\/1097-4563(200010)17:10<565::AID-ROB4>3.0.CO;2-6","volume":"17","author":"J. Guivant","year":"2000","unstructured":"Guivant, J., Nebot, E., & Baiker, S. (2000). Autonomous navigation and map building using laser range sensors in outdoor applications. Journal of Robotic Systems, 17(10), 565\u2013583.","journal-title":"Journal of Robotic Systems"},{"key":"9137_CR16","doi-asserted-by":"crossref","unstructured":"Gutmann, J. S., & Konolige, K. (1999). Incremental mapping of large cyclic environments. In IEEE int. symp. on computational intelligence in robotics and automation (pp. 318\u2013325).","DOI":"10.1109\/CIRA.1999.810068"},{"key":"9137_CR17","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1111\/j.1468-0114.1981.tb00070.x","volume":"62","author":"I. Hacking","year":"1981","unstructured":"Hacking, I. (1981). Do we see through a microscope? Pacific Philosophical Quarterly, 62, 305\u2013322.","journal-title":"Pacific Philosophical Quarterly"},{"key":"9137_CR18","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511814563","volume-title":"Representing and intervening. Introductory topics in the philosophy of natural science","author":"I. Hacking","year":"1983","unstructured":"Hacking, I. (1983). Representing and intervening. Introductory topics in the philosophy of natural science. Cambridge: Cambridge University Press."},{"key":"9137_CR19","doi-asserted-by":"crossref","unstructured":"Hahnel, D., Burgard, W., Fox, D., & Thrun, S. (2003). An efficient fastslam algorithm for generating maps of large-scale cyclic environments from raw laser range measurements. In IEEE\/RSJ int. conf. on intelligent robots and systems (pp. 206\u2013211).","DOI":"10.1109\/IROS.2003.1250629"},{"issue":"4","key":"9137_CR20","first-page":"17","volume":"14","author":"S. Hanks","year":"1993","unstructured":"Hanks, S., Pollack, M. E., & Cohen, P. R. (1993). Benchmarks, test beds, controlled experimentation, and the design of agent architectures. AI Magazine, 14(4), 17\u201342.","journal-title":"AI Magazine"},{"key":"9137_CR21","unstructured":"Howard, A., & Roy, N. (2003). The robotics data set repository (radish). http:\/\/radish.sourceforge.net\/ ."},{"key":"9137_CR22","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1090\/dimacs\/059\/11","volume-title":"Data structures, near neighbor searches, and methodology: fifth and sixth dimacs implementation challenges","author":"D. Johnson","year":"2002","unstructured":"Johnson, D. (2002). A theoretician\u2019s guide to the experimental analysis of algorithms. In M. H. Goldwasser, D. S. Johnson, & C. C. McGeoch (Eds.), Data structures, near neighbor searches, and methodology: fifth and sixth dimacs implementation challenges (pp. 215\u2013250). Providence: American Mathematical Society."},{"key":"9137_CR23","doi-asserted-by":"crossref","unstructured":"Leonard, J. J., & Durrant-Whyte, H. F. (1991). Simultaneous map building and localization for an autonomous mobile robot. In IEEE\/RSJ int. conf. on intelligent robots and systems (pp. 1442\u20131447).","DOI":"10.1109\/IROS.1991.174711"},{"key":"9137_CR24","unstructured":"Liu, Y., & Thrun, S. (2003). Results for outdoor-slam using sparse extended information filters. In IEEE int. conf. on robotics and automation (pp. 1227\u20131233)."},{"issue":"4","key":"9137_CR25","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1023\/A:1008854305733","volume":"4","author":"F. Lu","year":"1997","unstructured":"Lu, F., & Milios, E. (1997). Globally consistent range scan alignment for environment mapping. Autonomous Robots, 4(4), 333\u2013349.","journal-title":"Autonomous Robots"},{"issue":"5","key":"9137_CR26","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1109\/TRO.2006.878961","volume":"22","author":"J. Minguez","year":"2006","unstructured":"Minguez, J., Montesano, L., & Lamiraux, F. (2006). Metric-based iterative closest point scan matching for sensor displacement estimation. IEEE Transactions on Robotics, 22(5), 1047\u20131054.","journal-title":"IEEE Transactions on Robotics"},{"key":"9137_CR27","unstructured":"Montemerlo, M., Thrun, S., Koller, D., & Wegbreit, B. (2003). Fastslam 2.0: An improved particle filtering algorithm for simultaneous localization and mapping that provably converges. In Int. joint conf. on artificial intelligence (pp. 1151\u20131156)."},{"key":"9137_CR28","volume-title":"Design and analysis of experiments","author":"D. Montgomery","year":"2005","unstructured":"Montgomery, D. (2005). Design and analysis of experiments. New York: Wiley."},{"issue":"6","key":"9137_CR29","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1109\/70.976019","volume":"17","author":"J. Neira","year":"2001","unstructured":"Neira, J., & Tardos, J. D. (2001). Data association in stochastic mapping using the joint compatibility test. IEEE Transactions on Robotics and Automation, 17(6), 890\u2013897.","journal-title":"IEEE Transactions on Robotics and Automation"},{"key":"9137_CR30","doi-asserted-by":"crossref","unstructured":"Newman, P., Leonard, J., Tardos, J. D., & Neira, J. (2002). Explore and return: experimental validation of real-time concurrent mapping and localization. In IEEE int. conf. on robotics and automation (pp. 1802\u20131809).","DOI":"10.1109\/ROBOT.2002.1014803"},{"key":"9137_CR31","doi-asserted-by":"crossref","unstructured":"Newman, P., Cole, D., & Ho, K. (2006). Outdoor slam using visual appearance and laser ranging. In IEEE int. conf. on robotics and automation (pp. 1180\u20131187).","DOI":"10.1109\/ROBOT.2006.1641869"},{"issue":"5","key":"9137_CR32","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1109\/TRO.2008.2004637","volume":"24","author":"L. M. Paz","year":"2008","unstructured":"Paz, L. M., Pinies, P., Tardos, J. D., & Neira, J. (2008). Large-scale 6-dof slam with stereo-in-hand. IEEE Transactions on Robotics, 24(5), 946\u2013957.","journal-title":"IEEE Transactions on Robotics"},{"key":"9137_CR33","unstructured":"Permis (2000). Performance metrics for intelligent systems. http:\/\/www.isd.mel.nist.gov\/research_areas\/research_engineering\/Performance_Metrics\/index.htm ."},{"key":"9137_CR34","unstructured":"Rawseeds (2006). http:\/\/rawseeds.elet.polimi.it\/ ."},{"key":"9137_CR35","unstructured":"RoSta (2007). Robot standards and reference architectures. http:\/\/www.robot-standards.eu\/ ."},{"key":"9137_CR36","unstructured":"Stachniss, C., Frese, U., & Grisetti, G. (2007). Openslam.org. http:\/\/www.openslam.org\/ ."},{"key":"9137_CR37","volume-title":"Probabilistic robotics","author":"S. Thrun","year":"2005","unstructured":"Thrun, S., Burgard, W., & Fox, D. (2005). Probabilistic robotics. Cambridge: The MIT Press."},{"key":"9137_CR38","volume-title":"The construction of modern science. Mechanisms and mechanics","author":"R. Westfall","year":"1971","unstructured":"Westfall, R. (1971). The construction of modern science. Mechanisms and mechanics. New York: Wiley."}],"container-title":["Autonomous Robots"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-009-9137-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10514-009-9137-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-009-9137-8","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,29]],"date-time":"2019-05-29T19:13:32Z","timestamp":1559157212000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10514-009-9137-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,8,19]]},"references-count":38,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2009,11]]}},"alternative-id":["9137"],"URL":"https:\/\/doi.org\/10.1007\/s10514-009-9137-8","relation":{},"ISSN":["0929-5593","1573-7527"],"issn-type":[{"value":"0929-5593","type":"print"},{"value":"1573-7527","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,8,19]]}}}