{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T23:31:34Z","timestamp":1785540694323,"version":"3.56.0"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2011,10,27]],"date-time":"2011-10-27T00:00:00Z","timestamp":1319673600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Comput Math Organ Theory"],"published-print":{"date-parts":[[2012,3]]},"DOI":"10.1007\/s10588-011-9097-3","type":"journal-article","created":{"date-parts":[[2011,10,26]],"date-time":"2011-10-26T11:53:57Z","timestamp":1319630037000},"page":"22-62","source":"Crossref","is-referenced-by-count":186,"title":["Opening the \u2018black box\u2019 of simulations: increased transparency and effective communication through the systematic design of experiments"],"prefix":"10.1007","volume":"18","author":[{"given":"Iris","family":"Lorscheid","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernd-Oliver","family":"Heine","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Meyer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2011,10,27]]},"reference":[{"key":"9097_CR1","volume-title":"Design of experiments for engineers and scientists","author":"J Antony","year":"2003","unstructured":"Antony J (2003) Design of experiments for engineers and scientists. Butterworth-Heinemann, Amsterdam"},{"key":"9097_CR2","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1111\/j.1467-9779.2004.00165.x","volume":"6","author":"J Arifovic","year":"2004","unstructured":"Arifovic J, Ledyard J (2004) Scaling up learning models in public good games. J Public Econ Theory 6:203\u2013238","journal-title":"J Public Econ Theory"},{"key":"9097_CR3","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1080\/09638180701819980","volume":"17","author":"M Arnold","year":"2008","unstructured":"Arnold M, Ponick E, Schenk-Mathes H (2008) Groves mechanism vs. profit sharing for corporate budgeting: An experimental analysis with preplay communication. Eur Account Rev 17:37\u201363","journal-title":"Eur Account Rev"},{"key":"9097_CR4","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/978-3-662-03366-1_2","volume-title":"Simulating social phenomena","author":"R Axelrod","year":"1997","unstructured":"Axelrod R (1997) Advancing the art of simulation in the social sciences. In: Conte R, Hegselmann R, Terna P (eds) Simulating social phenomena. Springer, Berlin, pp 21\u201340"},{"key":"9097_CR5","volume-title":"Proceedings of the winter simulation conference","author":"R Barton","year":"2004","unstructured":"Barton R (2004) Designing simulation experiments. In: Proceedings of the winter simulation conference, Washington DC"},{"key":"9097_CR6","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/S0377-2217(96)00156-7","volume":"96","author":"B Bettonvil","year":"1996","unstructured":"Bettonvil B, Kleijnen JPC (1996) Searching for important factors in simulation models with many factors: Sequential bifurcation. Eur J Oper Res 96:180\u2013194","journal-title":"Eur J Oper Res"},{"key":"9097_CR7","volume-title":"Statistics for experimenters: design, innovation, and discovery","author":"GEP Box","year":"2005","unstructured":"Box GEP, Hunter JS, Hunter WG (2005) Statistics for experimenters: design, innovation, and discovery. Wiley-Interscience, Hoboken"},{"key":"9097_CR8","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1111\/1468-0262.00054","volume":"67","author":"C Camerer","year":"1999","unstructured":"Camerer C, Ho T (1999) Experience-weighted attraction learning in normal form games. Econometrica 67:827\u2013874","journal-title":"Econometrica"},{"key":"9097_CR9","volume-title":"Strategies and games: theory and practice","author":"P Dutta","year":"1999","unstructured":"Dutta P (1999) Strategies and games: theory and practice. MIT Press, Cambridge"},{"key":"9097_CR10","volume-title":"Interne Unternehmensrechnung","author":"R Ewert","year":"2008","unstructured":"Ewert R, Wagenhofer A (2008) Interne Unternehmensrechnung. Springer, Berlin"},{"key":"9097_CR11","volume-title":"How to design and report experiments","author":"A Field","year":"2003","unstructured":"Field A, Hole G (2003) How to design and report experiments. SAGE, London"},{"key":"9097_CR12","volume-title":"The design of experiments","author":"RA Fisher","year":"1971","unstructured":"Fisher RA (1971) The design of experiments. Hafner, New York"},{"key":"9097_CR13","volume-title":"Simulation for the social scientist","author":"N Gilbert","year":"2005","unstructured":"Gilbert N, Troitzsch K (2005) Simulation for the social scientist. Open University Press, Maidenhead"},{"key":"9097_CR14","doi-asserted-by":"crossref","DOI":"10.4135\/9781412983259","volume-title":"Agent-Based Models","author":"N Gilbert","year":"2008","unstructured":"Gilbert N (2008) Agent-Based Models. SAGE, London"},{"key":"9097_CR15","first-page":"602","volume":"112","author":"DK Gode","year":"1997","unstructured":"Gode DK, Sunder S (1997) What makes markets allocationally efficient? Q J Econ 112:602","journal-title":"Q J Econ"},{"key":"9097_CR16","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.ecolmodel.2006.04.023","volume":"198","author":"V Grimm","year":"2006","unstructured":"Grimm V, Berger U, Bastiansen F, Eliassen S, Ginot V, Giske J, Goss-Custard J, Grand T, Heinz SK, Huse G, Huth A, Jepsen JU, J\u00f8rgensen C, Mooij WM, M\u00fcller B, Pe\u2019er G, Piou C, Railsback SF, Robbins AM, Robbins MM, Rossmanith E, R\u00fcger N, Strand E, Souissi S, Stillman RA, Vab\u00f8R, Visser U, DeAngelis DL (2006) A standard protocol for describing individual-based and agent-based models. Ecol Model 198:115\u2013126","journal-title":"Ecol Model"},{"key":"9097_CR17","doi-asserted-by":"crossref","first-page":"2760","DOI":"10.1016\/j.ecolmodel.2010.08.019","volume":"221","author":"V Grimm","year":"2010","unstructured":"Grimm V, Berger U, DeAngelis DL, Polhill G, Giske J, Railsback SF (2010) The ODD protocol: a review and first update. Ecol Model 221:2760\u20132768","journal-title":"Ecol Model"},{"key":"9097_CR18","doi-asserted-by":"crossref","first-page":"617","DOI":"10.2307\/1914085","volume":"41","author":"T Groves","year":"1973","unstructured":"Groves T (1973) Incentives in teams. Econometrica 41:617\u2013631","journal-title":"Econometrica"},{"key":"9097_CR19","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1287\/mnsc.25.3.221","volume":"25","author":"T Groves","year":"1979","unstructured":"Groves T, Loeb M (1979) Incentives in a divisionalized firm. Manag Sci 25:221\u2013230","journal-title":"Manag Sci"},{"key":"9097_CR20","doi-asserted-by":"crossref","first-page":"1229","DOI":"10.5465\/AMR.2007.26586485","volume":"32","author":"J Harrison","year":"2007","unstructured":"Harrison J, Lin Z, Carroll G, Carley K (2007) Simulation modeling in organizational and management research. Acad Manag Rev 32:1229\u20131245","journal-title":"Acad Manag Rev"},{"key":"9097_CR21","unstructured":"Heine B-O, Meyer M, Strangfeld O (2005) Stylised facts and the contribution of simulation to the economic analysis of budgeting. J Artif Soc Simul 8(4)"},{"key":"9097_CR22","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1214\/aoms\/1177732503","volume":"7","author":"W Hendricks","year":"1936","unstructured":"Hendricks W, Robey K (1936) The sampling distribution of the coefficient of variation. Ann Math Stat 7:129\u2013132","journal-title":"Ann Math Stat"},{"key":"9097_CR23","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/978-3-322-81609-2_4","volume-title":"Zur Zukunft der Controllingforschung","author":"C Homburg","year":"2003","unstructured":"Homburg C, Klarmann M (2003) Empirische Controllingforschung \u2013 Anmerkungen aus der\u00a0Perspektive des Marketing. In: Weber J, Hirsch B (eds) Zur Zukunft der Controllingforschung, Wiesbaden, pp 65\u201388"},{"key":"9097_CR24","volume-title":"Proceedings of the 2003 winter simulation conference","author":"WD Kelton","year":"2003","unstructured":"Kelton WD, Barton RR (2003) Experimental design for simulation. In: Proceedings of the 2003 winter simulation conference, New Orleans, Louisiana"},{"key":"9097_CR25","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1002\/9780470172445.ch6","volume-title":"Handbook of simulation: principles, methodology, advances, applications and practice","author":"JPC Kleijnen","year":"1998","unstructured":"Kleijnen JPC (1998) Experimental design for sensitivity analysis, optimization, and validation of simulation models. In: Banks J (ed) Handbook of simulation: principles, methodology, advances, applications and practice, New York, pp 173\u2013224"},{"key":"9097_CR26","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1287\/ijoc.1050.0136","volume":"17","author":"JPC Kleijnen","year":"2005","unstructured":"Kleijnen JPC, Sanchez S, Lucas T, Cioppa T (2005) A user\u2019s guide to the brave new world of designing simulation experiments. INFORMS J Comput 17:263\u2013289","journal-title":"INFORMS J Comput"},{"key":"9097_CR27","volume-title":"Design and analysis of simulation experiments","author":"JPC Kleijnen","year":"2008","unstructured":"Kleijnen JPC (2008) Design and analysis of simulation experiments. Springer, New York"},{"key":"9097_CR28","volume-title":"Simulation modeling and analysis","author":"A Law","year":"2007","unstructured":"Law A (2007) Simulation modeling and analysis. McGraw-Hill, Boston"},{"issue":"1","key":"9097_CR29","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1093\/icc\/8.1.3","volume":"8","author":"F Malerba","year":"1999","unstructured":"Malerba F, Nelson R, Orsenigo L, Winter S (1999) History-friendly models of industry evolution: the computer industry. Ind Corp Change 8(1):3\u201340","journal-title":"Ind Corp Change"},{"key":"9097_CR30","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1108\/09600030910951692","volume":"39","author":"I Manuj","year":"2009","unstructured":"Manuj I, Mentzer JT, Bowers MR (2009) Improving the rigor of discrete-event simulation in logistics and supply chain research. Int J Phys Distrib Logist Manag 39:172\u2013201","journal-title":"Int J Phys Distrib Logist Manag"},{"key":"9097_CR31","unstructured":"M\u00e5rtensson A (2003) Managing mission-critical IT in the financial industry. Economic Research Institute, Stockholm School of Economics"},{"key":"9097_CR32","volume-title":"Proceedings of the 15th European conference on information systems","author":"A M\u00e5rtensson","year":"2007","unstructured":"M\u00e5rtensson A, M\u00e5rtensson P (2007) Extending rigor and relevance: towards credible, contributory and communicable research. In: Proceedings of the 15th European conference on information systems, St Gallen"},{"key":"9097_CR33","volume-title":"Design and analysis of experiments","author":"DC Montgomery","year":"2009","unstructured":"Montgomery DC (2009) Design and analysis of experiments. Wiley, Hoboken"},{"key":"9097_CR34","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1257\/jel.37.3.1067","volume":"37","author":"R Myerson","year":"1999","unstructured":"Myerson R (1999) Nash equilibrium and the history of economic theory. J Econ Lit 37:1067\u20131082","journal-title":"J Econ Lit"},{"key":"9097_CR35","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780195172119.001.0001","volume-title":"Managing business complexity: discovering strategic solutions with agent-based modeling and simulation","author":"MJ North","year":"2007","unstructured":"North MJ, Macal CM (2007) Managing business complexity: discovering strategic solutions with agent-based modeling and simulation. Oxford University Press, Oxford"},{"key":"9097_CR36","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s10588-009-9059-1","volume":"15","author":"RPT Oh","year":"2009","unstructured":"Oh RPT, Sanchez SM, Lucas TW, Wan H, Nissen ME (2009) Efficient experimental design tools for exploring large simulation models. Comput Math Organ Theory 15:237\u2013257","journal-title":"Comput Math Organ Theory"},{"key":"9097_CR37","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1016\/j.tree.2004.07.019","volume":"19","author":"SL Peck","year":"2004","unstructured":"Peck SL (2004) Simulation as experiment: a philosophical reassessment for biological modeling. Trends Ecol Evol 19:530\u2013534","journal-title":"Trends Ecol Evol"},{"key":"9097_CR38","unstructured":"Polhill JG, Parker D, Brown D, Grimm V (2008) Using the ODD protocol for describing three agent-based social simulation models of land-use change. J Artif Soc Simul 11(2). http:\/\/jasss.soc.surrey.ac.uk\/11\/2\/3.html"},{"key":"9097_CR39","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1287\/mnsc.49.2.160.12742","volume":"49","author":"TS Raghu","year":"2003","unstructured":"Raghu TS, Sen PK, Rao HR (2003) Relative performance of incentive mechanisms: computational modeling and simulation of delegated investment decisions. Manag Sci 49:160\u2013178","journal-title":"Manag Sci"},{"key":"9097_CR40","volume-title":"Agent-based and individual-based modeling: a practical introduction","author":"SF Railsback","year":"2011","unstructured":"Railsback SF, Grimm V (2011) Agent-based and individual-based modeling: a practical introduction. Princeton University Press, Princeton"},{"key":"9097_CR41","unstructured":"Richiardi M, Leombruni R, Saam NJ, Sonnessa M (2006) A common protocol for agent-based social simulation. J Artif Soc Simul 9(1). http:\/\/jasss.soc.surrey.ac.uk\/9\/1\/15.html"},{"key":"9097_CR42","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1177\/1046878110393941","volume":"42","author":"J Reiss","year":"2011","unstructured":"Reiss J (2011) A plea for (good) simulations: Nudging economics toward an experimental science. Simul Games 42:243\u2013264","journal-title":"Simul Games"},{"key":"9097_CR43","volume-title":"Proceedings of the 2006 winter simulation conference","author":"SM Sanchez","year":"2006","unstructured":"Sanchez SM (2006) Work smarter, not harder: Guidelines for designing simulation experiments. In: Proceedings of the 2006 winter simulation conference, Monterey"},{"key":"9097_CR44","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1006\/game.1998.0702","volume":"28","author":"R Sarin","year":"1999","unstructured":"Sarin R, Vahid F (1999) Payoff assessments without probabilities: a simple dynamic model of choice. Games Econ Behav 28:294\u2013309","journal-title":"Games Econ Behav"},{"key":"9097_CR45","volume-title":"Sensitivity analysis","author":"A Saltelli","year":"2000","unstructured":"Saltelli A, Chan K, Scott EM (2000) Sensitivity analysis. Wiley, New York"},{"key":"9097_CR46","volume-title":"Sensitivity analysis in practice","author":"A Saltelli","year":"2004","unstructured":"Saltelli A, Tarantola S, Campolongo F, Ratto M (2004) Sensitivity analysis in practice. Wiley, Chichester"},{"key":"9097_CR47","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1016\/j.tree.2010.05.001","volume":"25","author":"A Schmolke","year":"2010","unstructured":"Schmolke A, Thorbek P, DeAngelis DL, Grimm V (2010) Ecological modeling supporting environmental decision making: a strategy for the future. Trends Ecol Evol 25:479\u2013486","journal-title":"Trends Ecol Evol"},{"key":"9097_CR48","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-05493-8","volume-title":"Statistische Versuchsplanung: Design of Experiments (DoE)","author":"K Siebertz","year":"2010","unstructured":"Siebertz K, Bebber Dv, Hochkirchen T (2010) Statistische Versuchsplanung: Design of Experiments (DoE). Springer, Heidelberg"},{"key":"9097_CR49","first-page":"1","volume-title":"Hierarchy theory: the challenge of complex systems","author":"H Simon","year":"1973","unstructured":"Simon H (1973) The organization of complex systems. In: Pattee HH (ed) Hierarchy theory: the challenge of complex systems. Braziller, New York, pp 1\u201327"},{"key":"9097_CR50","doi-asserted-by":"crossref","DOI":"10.4135\/9781412983716","volume-title":"Computational modeling","author":"CS Taber","year":"1996","unstructured":"Taber CS, Timpone RJ (1996) Computational modeling. SAGE, Thousand Oaks"},{"key":"9097_CR51","volume-title":"Proceedings of the 2001 winter simulation conference","author":"L Trocine","year":"2001","unstructured":"Trocine L, Malone LC (2001) An overview of newer, advanced screening methods for the initial phase in an experimental design. In: Proceedings of the 2001 winter simulation conference, Arlington"},{"key":"9097_CR52","volume-title":"Experiments: planning, analysis, and parameter design optimization","author":"CFJ Wu","year":"2000","unstructured":"Wu CFJ, Hamada M (2000) Experiments: planning, analysis, and parameter design optimization. Wiley, New York"}],"container-title":["Computational and Mathematical Organization Theory"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10588-011-9097-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10588-011-9097-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10588-011-9097-3","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,18]],"date-time":"2019-06-18T16:28:18Z","timestamp":1560875298000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10588-011-9097-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,10,27]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,3]]}},"alternative-id":["9097"],"URL":"https:\/\/doi.org\/10.1007\/s10588-011-9097-3","relation":{},"ISSN":["1381-298X","1572-9346"],"issn-type":[{"value":"1381-298X","type":"print"},{"value":"1572-9346","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,10,27]]}}}