{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T05:49:00Z","timestamp":1781329740459,"version":"3.54.1"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2011,10,28]],"date-time":"2011-10-28T00:00:00Z","timestamp":1319760000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Comput Math Organ Theory"],"published-print":{"date-parts":[[2012,3]]},"DOI":"10.1007\/s10588-011-9098-2","type":"journal-article","created":{"date-parts":[[2011,10,27]],"date-time":"2011-10-27T08:56:13Z","timestamp":1319705773000},"page":"63-90","source":"Crossref","is-referenced-by-count":16,"title":["Effectively combining experimental economics and multi-agent simulation: suggestions for a procedural integration with an example from prediction markets research"],"prefix":"10.1007","volume":"18","author":[{"given":"Frank M. A.","family":"Klingert","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Meyer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2011,10,28]]},"reference":[{"key":"9098_CR1","volume-title":"Design of experiments for engineers and scientists","author":"J Antony","year":"2003","unstructured":"Antony J (2003) Design of experiments for engineers and scientists. Butterworth\u2013Heinemann, Amsterdam"},{"key":"9098_CR2","volume-title":"The evolution of cooperation","author":"RM Axelrod","year":"1984","unstructured":"Axelrod RM (1984) The evolution of cooperation. Basic Books, New York"},{"key":"9098_CR3","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/978-3-662-03366-1_2","volume-title":"Simulating social phenomena","author":"RM Axelrod","year":"1997","unstructured":"Axelrod RM (1997a) Advancing the art of simulation in the social sciences. In: Conte R, Hegselmann R, Terna P (eds) Simulating social phenomena. Springer, Berlin, pp\u00a021\u201340"},{"key":"9098_CR4","doi-asserted-by":"crossref","DOI":"10.1515\/9781400822300","volume-title":"The complexity of cooperation: agent-based models of competition and collaboration","author":"RM Axelrod","year":"1997","unstructured":"Axelrod RM (1997b) The complexity of cooperation: agent-based models of competition and collaboration. Princeton University Press, Princeton"},{"key":"9098_CR5","first-page":"1647","volume-title":"Handbook of computational economics: agent-based computational economics","author":"RM Axelrod","year":"2006","unstructured":"Axelrod RM, Tesfatsion L (2006) A guide for newcomers to agent-based modeling in the social sciences. In: Tesfatsion L, Judd KL (eds) Handbook of computational economics: agent-based computational economics. Amsterdam, Elsevier, pp 1647\u20131659"},{"key":"9098_CR6","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/2.59","volume":"21","author":"BW Boehm","year":"1988","unstructured":"Boehm BW (1988) A spiral model of software development and enhancement. IEEE Comput 21:61\u201372","journal-title":"IEEE Comput"},{"key":"9098_CR7","doi-asserted-by":"crossref","unstructured":"Boero R, Bravo G, Castellani M, Squazzoni F (2010) Why bother with what others tell you? An experimental data-driven agent-based model. J Artif Soc Soc Simul 13","DOI":"10.18564\/jasss.1620"},{"key":"9098_CR8","unstructured":"Dal Forno A, Merlone U (2004) From classroom experiments to computer code. J Artif Soc Soc Simul 7"},{"key":"9098_CR9","doi-asserted-by":"crossref","DOI":"10.1515\/9780691233376","volume-title":"Experimental economics","author":"DD Davis","year":"1993","unstructured":"Davis DD, Holt CA (1993) Experimental economics. Princeton University Press, Princeton"},{"key":"9098_CR10","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1057\/9780230226203.1162","volume-title":"The new Palgrave dictionary of economics","author":"J DiNardo","year":"2008","unstructured":"DiNardo J (2008) Natural experiments and quasi-natural experiments. In: Durlauf SN, Blume LE (eds) The new Palgrave dictionary of economics, 2nd edn. Palgrave Macmillan, Basingstoke, pp 856\u2013864","edition":"2"},{"key":"9098_CR11","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/S0165-1889(00)00028-2","volume":"25","author":"J Duffy","year":"2001","unstructured":"Duffy J (2001) Learning to speculate: experiments with artificial and real agents. J Econ Dyn Control 25:295\u2013319","journal-title":"J Econ Dyn Control"},{"key":"9098_CR12","first-page":"949","volume-title":"Handbook of computational economics: agent-based computational economics","author":"J Duffy","year":"2006","unstructured":"Duffy J (2006) Agent-based models and human subject experiments. In: Tesfatsion L, Judd KL (eds) Handbook of computational economics: agent-based computational economics. Amsterdam, Elsevier, pp\u00a0949\u20131011"},{"key":"9098_CR13","volume-title":"Economics lab: an intensive course in experimental economics","author":"D Friedman","year":"2009","unstructured":"Friedman D, Cassar A (2009) Economics lab: an intensive course in experimental economics. Routledge, London"},{"key":"9098_CR14","doi-asserted-by":"crossref","unstructured":"Gaechter S (2009) Improvements and future challenges for the research infrastructure in the field \u2018experimental economics\u2019. RatSWD Working Paper No. 56, Berlin","DOI":"10.2139\/ssrn.1445359"},{"key":"9098_CR15","doi-asserted-by":"crossref","DOI":"10.4135\/9781412983259","volume-title":"Agent-based models","author":"N Gilbert","year":"2008","unstructured":"Gilbert N (2008) Agent-based models. Sage, Los Angeles"},{"key":"9098_CR16","volume-title":"Simulation for the social scientist","author":"N Gilbert","year":"2005","unstructured":"Gilbert N, Troitzsch KG (2005) Simulation for the social scientist. 2nd edn. Open University Press, Maidenhead","edition":"2"},{"key":"9098_CR17","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1086\/261868","volume":"101","author":"DK Gode","year":"1993","unstructured":"Gode DK, Sunder S (1993) Allocative efficiency of markets with zero-intelligence traders: market as a partial substitute for individual rationality. J Polit Econ 101:119\u2013137","journal-title":"J Polit Econ"},{"key":"9098_CR18","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.ecolmodel.2006.04.023","volume":"198","author":"V Grimm","year":"2006","unstructured":"Grimm V, Berger U, Bastiansen F, Eliassen S, Ginot V, Giske J, Goss-Custard J, Grand T, Heinz SK, Huse G, Huth A, Jepsen JU, J\u00f8rgensen C, Mooij WM, M\u00fcller B, Pe\u2019er G, Piou C, Railsback SF, Robbins AM, Robbins MM, Rossmanith E, R\u00fcger N, Strand E, Souissi S, Stillman RA, Vab\u00f8 R, Visser U, DeAngelis DL (2006) A standard protocol for describing individual-based and agent-based models. Ecol Model 198:115\u2013126","journal-title":"Ecol Model"},{"key":"9098_CR19","doi-asserted-by":"crossref","first-page":"2760","DOI":"10.1016\/j.ecolmodel.2010.08.019","volume":"221","author":"V Grimm","year":"2010","unstructured":"Grimm V, Berger U, DeAngelis DL, Polhill JG, Giske J, Railsback SF (2010) The ODD protocol for describing individual-based and agent-based models: a first update. Ecol Model 221:2760\u20132768","journal-title":"Ecol Model"},{"key":"9098_CR20","doi-asserted-by":"crossref","first-page":"3","DOI":"10.5750\/jpm.v1i1.417","volume":"1","author":"R Hanson","year":"2007","unstructured":"Hanson R (2007) Logarithmic market scoring rules for modular combinatorial information aggregation. J\u00a0Predict Mark 1:3\u201315","journal-title":"J\u00a0Predict Mark"},{"key":"9098_CR21","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1016\/j.jebo.2004.09.011","volume":"60","author":"R Hanson","year":"2006","unstructured":"Hanson R, Oprea R, Porter D (2006) Information aggregation and manipulation in an experimental market. J Econ Behav Organ 60:449\u2013459","journal-title":"J Econ Behav Organ"},{"key":"9098_CR22","first-page":"519","volume":"35","author":"FA Hayek","year":"1945","unstructured":"Hayek FA (1945) The use of knowledge in society. Am Econ Rev 35:519\u2013530","journal-title":"Am Econ Rev"},{"key":"9098_CR23","first-page":"9","volume":"12","author":"B Heath","year":"2009","unstructured":"Heath B, Hill R, Ciarallo F (2009) A survey of agent-based modeling practices (january 1998 to july 2008). J Artif Soc Soc Simul 12:9","journal-title":"J Artif Soc Soc Simul"},{"key":"9098_CR24","doi-asserted-by":"crossref","first-page":"5265","DOI":"10.1073\/pnas.1000140107","volume":"107","author":"D Helbing","year":"2010","unstructured":"Helbing D, Yu W (2010) The future of social experimenting. Proc Natl Acad Sci USA 107:5265\u20135266","journal-title":"Proc Natl Acad Sci USA"},{"key":"9098_CR25","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1111\/j.1468-0262.2004.00512.x","volume":"72","author":"D Houser","year":"2004","unstructured":"Houser D, Keane M, McCabe K (2004) Behavior in a dynamic decision problem: an analysis of experimental evidence using a bayesian type classification algorithm. Econometrica 72:781\u2013822","journal-title":"Econometrica"},{"key":"9098_CR26","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1287\/ijoc.1050.0136","volume":"17","author":"J Kleijnen","year":"2005","unstructured":"Kleijnen J, Sanchez S, Lucas T, Cioppa T (2005) A user\u2019s guide to the brave new world of designing simulation experiments. INFORMS J Comput 17:263\u2013289","journal-title":"INFORMS J Comput"},{"key":"9098_CR27","volume-title":"The rational unified process: an introduction","author":"P Kruchten","year":"2000","unstructured":"Kruchten P (2000) The rational unified process: an introduction. 2nd edn. Addison-Wesley, Boston","edition":"2"},{"key":"9098_CR28","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511994944","volume-title":"A guide to Monte Carlo simulations in statistical physics","author":"D Landau","year":"2009","unstructured":"Landau D, Binder K (2009) A guide to Monte Carlo simulations in statistical physics, 3rd edn. Cambridge University Press, Cambridge","edition":"3"},{"key":"9098_CR29","volume-title":"Simulation modeling and analysis","author":"A Law","year":"2006","unstructured":"Law A (2006) Simulation modeling and analysis. McGraw-Hill, Boston"},{"key":"9098_CR30","doi-asserted-by":"crossref","unstructured":"Lorscheid I, Meyer M, Heine B-O (2011) Opening the \u2018black box\u2019 of simulations: increased transparency and effective communication through the systematic design of experiments. Comput Math Organ Theory (this issue)","DOI":"10.1007\/s10588-011-9097-3"},{"key":"9098_CR31","unstructured":"Meyer M, Lorscheid I, Troitzsch KG (2009) The development of social simulation as reflected in the first ten years of JASSS: a citation and co-citation analysis. J Artif Soc Soc Simul 12"},{"key":"9098_CR32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10588-010-9076-0","volume":"17","author":"M Meyer","year":"2011","unstructured":"Meyer M, Zaggl MA, Carley KM (2011) Measuring CMOT\u2019s intellectual structure and its development. Comput Math Organ Theory 17:1\u201334","journal-title":"Comput Math Organ Theory"},{"key":"9098_CR33","volume-title":"Design and analysis of experiments","author":"D Montgomery","year":"2009","unstructured":"Montgomery D (2009) Design and analysis of experiments. Wiley, Hoboken"},{"key":"9098_CR34","unstructured":"Oprea R, Porter D, Hibbert C, Hanson R, Tila D (2007) Can manipulators mislead market observers? Working Paper"},{"key":"9098_CR35","volume-title":"A guide to the project management body of knowledge: PMBOK guide","author":"PMI","year":"2004","unstructured":"PMI (2004) A guide to the project management body of knowledge: PMBOK guide, 3rd edn. Project Management Institute, Newtown Square","edition":"3"},{"key":"9098_CR36","first-page":"43","volume-title":"Conjectures and refutations: the growth of scientific knowledge","author":"KR Popper","year":"2002","unstructured":"Popper KR (2002) Science: conjectures and refutations. In: Popper KR (ed) Conjectures and refutations: the growth of scientific knowledge. Routledge, London, pp 43\u201377"},{"key":"9098_CR37","unstructured":"Rauhut H, Junker M (2009) Punishment deters crime because humans are bounded in their strategic decision-making. J Artif Soc Soc Simul 12"},{"key":"9098_CR38","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1177\/1046878110393941","volume":"42","author":"J Reiss","year":"2011","unstructured":"Reiss J (2011) A plea for (good) simulations: nudging economics toward an experimental science. Simul Gaming 42:243\u2013264","journal-title":"Simul Gaming"},{"key":"9098_CR39","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1177\/1046878106287947","volume":"37","author":"J Rouchier","year":"2006","unstructured":"Rouchier J, Robin S (2006) Information perception and price dynamics in a continuous double auction. Simul Gaming 37:195\u2013208","journal-title":"Simul Gaming"},{"key":"9098_CR40","first-page":"923","volume":"72","author":"VL Smith","year":"1982","unstructured":"Smith VL (1982) Microeconomic systems as an experimental science. Am Econ Rev 72:923\u2013955","journal-title":"Am Econ Rev"},{"key":"9098_CR41","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1257\/jep.8.1.113","volume":"8","author":"VL Smith","year":"1994","unstructured":"Smith VL (1994) Economics in the laboratory. J Econ Perspect 8:113\u2013131","journal-title":"J Econ Perspect"},{"key":"9098_CR42","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1057\/9780230226203.0531","volume-title":"The new Palgrave dictionary of economics","author":"VL Smith","year":"2008","unstructured":"Smith VL (2008) Experimental methods in economics. In: Durlauf SN, Blume LE (eds). The new Palgrave dictionary of economics, 2nd edn. Palgrave Macmillan, Basingstoke, pp 163\u2013173","edition":"2"},{"key":"9098_CR43","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1515\/9780691213255-008","volume-title":"The handbook of experimental economics","author":"S Sunder","year":"1995","unstructured":"Sunder S (1995) Experimental asset markets: a survey. In: Kagel JH, Roth AE (eds) The handbook of experimental economics. Princeton University Press, Princeton, pp 445\u2013498"},{"key":"9098_CR44","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/978-94-009-8394-6_9","volume-title":"Philosophy in economics","author":"LL Wilde","year":"1981","unstructured":"Wilde LL (1981) On the use of laboratory experiments in economics. In: Pitt JC (ed) Philosophy in economics. Reidel, Dordrecht, pp\u00a0137\u2013148"},{"key":"9098_CR45","doi-asserted-by":"crossref","unstructured":"Wolfers J, Zitzewitz E (2006) Five open questions about prediction markets. NBER Working Paper","DOI":"10.3386\/w12060"},{"key":"9098_CR46","volume-title":"An introduction to multiagent systems","author":"M Wooldridge","year":"2002","unstructured":"Wooldridge M (2002) An introduction to multiagent systems. Wiley, Chichester"},{"key":"9098_CR47","volume-title":"Experiments: planning, analysis, and parameter design optimization","author":"C-FJ Wu","year":"2000","unstructured":"Wu C-FJ, Hamada M (2000) Experiments: planning, analysis, and parameter design optimization. Wiley, New York"}],"container-title":["Computational and Mathematical Organization Theory"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10588-011-9098-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10588-011-9098-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10588-011-9098-2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T09:39:19Z","timestamp":1741858759000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10588-011-9098-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,10,28]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,3]]}},"alternative-id":["9098"],"URL":"https:\/\/doi.org\/10.1007\/s10588-011-9098-2","relation":{},"ISSN":["1381-298X","1572-9346"],"issn-type":[{"value":"1381-298X","type":"print"},{"value":"1572-9346","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,10,28]]}}}