{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:45:46Z","timestamp":1781106346895,"version":"3.54.1"},"reference-count":75,"publisher":"IGI Global Scientific Publishing","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,1,1]]},"abstract":"<p>The objective of this study is to understand the nature and role of complexity in simulation performance. In order to do this, a system dynamics model of the product development pipeline was developed, and an online game based on that model was created. An experiment was run where subject made a series of decisions on one or two variables for many periods, with different levels of information available to them (attribute complexity). Hypotheses were proposed based on the literature. The results confirmed the hypotheses relating degree of difficulty to distance from optimality. Two factors adversely affected the subjects' performance: dealing with more complex information on performance (more than one attribute) and having to make more than one simultaneous decision, i.e. more than one decision per period. The latter condition was more detrimental to performance than the former.<\/p>","DOI":"10.4018\/ijsda.2014010102","type":"journal-article","created":{"date-parts":[[2014,6,11]],"date-time":"2014-06-11T08:02:35Z","timestamp":1402473755000},"page":"21-46","source":"Crossref","is-referenced-by-count":2,"title":["The Nature and Role of Complexity in Simulation Performance"],"prefix":"10.4018","volume":"3","author":[{"given":"Paulo","family":"Figueiredo","sequence":"first","affiliation":[{"name":"SENAI CIMATEC, Salvador, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisabeth","family":"Loiola","sequence":"additional","affiliation":[{"name":"UFBA \/ NPGA, Salvador, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"ijsda.2014010102-0","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.41.3.458"},{"key":"ijsda.2014010102-1","doi-asserted-by":"publisher","DOI":"10.1504\/IJISE.2012.046298"},{"key":"ijsda.2014010102-2","author":"S.Banerjee","year":"2001","journal-title":"The project portfolio management problem"},{"key":"ijsda.2014010102-3","doi-asserted-by":"publisher","DOI":"10.1287\/msom.1080.0229"},{"key":"ijsda.2014010102-4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jom.2005.10.001"},{"key":"ijsda.2014010102-5","doi-asserted-by":"publisher","DOI":"10.4018\/ijsda.2012070103"},{"key":"ijsda.2014010102-6","doi-asserted-by":"publisher","DOI":"10.4018\/ijsda.2013010104"},{"key":"ijsda.2014010102-7","unstructured":"Bloomfield, R. J., Gino, F., & Kulp, S. L. (2007). Behavioral causes of the bullwhip effect in a single echelon. Cornell University, working paper."},{"key":"ijsda.2014010102-8","doi-asserted-by":"publisher","DOI":"10.2466\/pr0.1996.79.1.67"},{"key":"ijsda.2014010102-9","doi-asserted-by":"publisher","DOI":"10.1177\/1046878195263008"},{"key":"ijsda.2014010102-10","first-page":"96","article-title":"Dealing with the complexity paradox in business simulation games.","volume":"22","author":"H. M.Cannon","year":"1995","journal-title":"Developments In Business Simulation & Experiential Exercises"},{"key":"ijsda.2014010102-11","doi-asserted-by":"publisher","DOI":"10.1007\/BF01307827"},{"key":"ijsda.2014010102-12","article-title":"Computational organization theory","author":"K. M.Carley","year":"1999","journal-title":"Multiagent systems: A modern approach to distributed artificial intelligence"},{"key":"ijsda.2014010102-13","doi-asserted-by":"publisher","DOI":"10.1177\/0049124196025001005"},{"key":"ijsda.2014010102-14","first-page":"145","article-title":"Consumer biases in estimations of product quantity, distance, and currency value.","volume":"31","author":"P.Chandon","year":"2004","journal-title":"Advances in Consumer Research. Association for Consumer Research (U. S.)"},{"key":"ijsda.2014010102-15","author":"K. B.Clark","year":"1993","journal-title":"Managing new product and process development"},{"key":"ijsda.2014010102-16","author":"T. D.Cook","year":"1979","journal-title":"Quasi-experimentation design and analysis issues for field settings"},{"key":"ijsda.2014010102-17","author":"R. G.Cooper","year":"1998","journal-title":"Portfolio management for new products"},{"key":"ijsda.2014010102-18","doi-asserted-by":"publisher","DOI":"10.1002\/sdr.320"},{"key":"ijsda.2014010102-19","doi-asserted-by":"crossref","unstructured":"Croson, R., Katok, E., Donohue, K., & Sterman, J. (2005). Supply chain management: A teaching experiment. In Zwick (Ed.), Experimental business research III (pp. 285-296). Springer.","DOI":"10.1007\/0-387-24244-9_13"},{"key":"ijsda.2014010102-20","author":"M.Cusumano","year":"1998","journal-title":"Thinking beyond lean"},{"key":"ijsda.2014010102-21","doi-asserted-by":"publisher","DOI":"10.1126\/science.2648573"},{"issue":"2","key":"ijsda.2014010102-22","first-page":"67","article-title":"Evaluating two online simulation games in an undergraduate supply chain management course.","volume":"9","author":"K.Feng","year":"2009","journal-title":"Review of Business Research"},{"key":"ijsda.2014010102-23","unstructured":"Figueiredo, P., & Joglekar, N. (2007). Dynamics of project screening in a product development pipeline. In Proceedings of the 25th International Conference of The System Dynamics Society, Boston, MA. Retrieved from http:\/\/www.systemdynamics.org\/conferences\/2007\/proceed\/papers\/JOGLE201.pdf"},{"issue":"4","key":"ijsda.2014010102-24","article-title":"Enhancing NPD portfolio performance by shaping the development funnel.","volume":"7","author":"P.Figueiredo","year":"2012","journal-title":"Journal of Technology Management & Innovation"},{"key":"ijsda.2014010102-25","author":"D.Gentner","year":"1983","journal-title":"Mental models"},{"key":"ijsda.2014010102-26","unstructured":"Gino, F., & Pisano, G. (2005a). Do managers\u2019 heuristics affect R&D performance volatility? A simulation informed by the pharmaceutical industry. Harvard Business School Working Paper."},{"key":"ijsda.2014010102-27","unstructured":"Gino, F., & Pisano, G. (2005b). R&D portfolio strategy and performance: A behavioral model. Harvard Business School Working Paper."},{"key":"ijsda.2014010102-28","author":"K.Girotra","year":"2005","journal-title":"Managing the risk of development failures: A study of late-stage failures in the pharmaceutical industry"},{"key":"ijsda.2014010102-29","doi-asserted-by":"publisher","DOI":"10.1108\/02621719410071937"},{"key":"ijsda.2014010102-30","doi-asserted-by":"publisher","DOI":"10.1016\/S0737-6782(97)00061-1"},{"key":"ijsda.2014010102-31","first-page":"2","article-title":"Managing complexity.","author":"J.Hagel","year":"1998","journal-title":"The McKinsey Quarterly"},{"key":"ijsda.2014010102-32","doi-asserted-by":"publisher","DOI":"10.1037\/h0040736"},{"key":"ijsda.2014010102-33","doi-asserted-by":"publisher","DOI":"10.1016\/S0048-7333(97)00044-9"},{"key":"ijsda.2014010102-34","author":"P.Johnson-Laird","year":"1983","journal-title":"Mental models"},{"key":"ijsda.2014010102-35","doi-asserted-by":"publisher","DOI":"10.1287\/msom.1070.0188"},{"key":"ijsda.2014010102-36","doi-asserted-by":"publisher","DOI":"10.1086\/209106"},{"issue":"2","key":"ijsda.2014010102-37","first-page":"85","article-title":"Managing complex production processes.","volume":"40","author":"A.Khurana","year":"1999","journal-title":"Sloan Management Review"},{"key":"ijsda.2014010102-38","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8535.2007.00704.x"},{"key":"ijsda.2014010102-39","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9310.00278"},{"key":"ijsda.2014010102-40","doi-asserted-by":"publisher","DOI":"10.1177\/1046878196271004"},{"key":"ijsda.2014010102-41","doi-asserted-by":"crossref","unstructured":"Klayman, J., & Schoemaker, P. J. H. (n.d.). Thinking about the future: A cognitive perspective. Journal of Forecasting, 12, 161-186.","DOI":"10.1002\/for.3980120208"},{"key":"ijsda.2014010102-42","doi-asserted-by":"crossref","unstructured":"Koehler, D. J., & Harvey, N. (2004). Blackwell handbook of judgement and decision making (Blackwell Handbooks Of Experimental Psychology). Wiley-Blackwell.","DOI":"10.1002\/9780470752937"},{"key":"ijsda.2014010102-43","article-title":"Computer simulations of organizations as experimental learning systems: Implications for organization theory","author":"T. K.Lant","year":"1994","journal-title":"Computational organization theory"},{"key":"ijsda.2014010102-44","author":"C. H.Loch","year":"2007","journal-title":"Behavioral operations management"},{"key":"ijsda.2014010102-45","doi-asserted-by":"publisher","DOI":"10.1177\/104687810003100207"},{"key":"ijsda.2014010102-46","doi-asserted-by":"publisher","DOI":"10.1016\/0737-6782(94)90029-9"},{"key":"ijsda.2014010102-47","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.47.8.1029.10228"},{"key":"ijsda.2014010102-48","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(79)90032-1"},{"key":"ijsda.2014010102-49","first-page":"14","article-title":"Individual differences in the use of simplification strategies in a complex decision making task.","volume":"11","author":"J.Onken","year":"1985","journal-title":"Journal of Experimental Psychology"},{"key":"ijsda.2014010102-50","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(76)90022-2"},{"key":"ijsda.2014010102-51","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.14.3.534"},{"key":"ijsda.2014010102-52","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1978.231521"},{"key":"ijsda.2014010102-53","doi-asserted-by":"publisher","DOI":"10.4324\/9780203444399"},{"key":"ijsda.2014010102-54","author":"D. G.Reinertsen","year":"1997","journal-title":"Managing the design factory"},{"key":"ijsda.2014010102-55","author":"B.Reyck","year":"2004","journal-title":"Project portfolio management at NovartisPharma"},{"key":"ijsda.2014010102-56","unstructured":"Rudi, N., & Drake, D. (2009). Level, adjustment and observation biases in the Newsvendor model. Working Paper: INSEAD, France"},{"key":"ijsda.2014010102-57","doi-asserted-by":"publisher","DOI":"10.1177\/03079459994362"},{"key":"ijsda.2014010102-58","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1070.0797"},{"issue":"Part 2","key":"ijsda.2014010102-59","first-page":"229","article-title":"Discussion: Problems of methodology.","volume":"53","author":"H. A.Simon","year":"1962","journal-title":"The American Economic Review"},{"key":"ijsda.2014010102-60","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/4711.001.0001","author":"H. A.Simon","year":"1997","journal-title":"Models of bounded rationality: Empirically grounded economic reason"},{"key":"ijsda.2014010102-61","doi-asserted-by":"publisher","DOI":"10.2307\/3172740"},{"key":"ijsda.2014010102-62","author":"J.Sterman","year":"2000","journal-title":"Business dynamics: Systems thinking and modeling for a complex world"},{"key":"ijsda.2014010102-63","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.35.3.321"},{"key":"ijsda.2014010102-64","author":"N. P.Suh","year":"1990","journal-title":"The principles of design"},{"key":"ijsda.2014010102-65","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2012.06.003"},{"key":"ijsda.2014010102-66","first-page":"205","article-title":"Are the business simulations we play too complex.","volume":"35","author":"R.Tech","year":"2008","journal-title":"Developments in Business Simulation & Experiential Exercises"},{"key":"ijsda.2014010102-67","doi-asserted-by":"publisher","DOI":"10.1177\/1046878104263545"},{"key":"ijsda.2014010102-68","doi-asserted-by":"publisher","DOI":"10.1126\/science.185.4157.1124"},{"key":"ijsda.2014010102-69","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1992.tb00047.x"},{"key":"ijsda.2014010102-70","author":"K. T.Ulrich","year":"2004","journal-title":"Product design and development"},{"key":"ijsda.2014010102-71","author":"S. C.Wheelwright","year":"1992","journal-title":"Revolutionizing product development: Quantum leaps in speed, efficiency and quality"},{"key":"ijsda.2014010102-72","doi-asserted-by":"crossref","DOI":"10.4135\/9781412983297","author":"A. R.Wildt","year":"1978","journal-title":"Analysis of covariance"},{"issue":"4","key":"ijsda.2014010102-73","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1002\/cplx.20292","article-title":"Improving understanding, learning, and performances of novices in dynamic managerial simulation games: A gradual-increase-in-complexity approach.","volume":"15","author":"H.Yasarcan","year":"2010","journal-title":"Complexity"},{"key":"ijsda.2014010102-74","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5885.2010.00713.x"}],"container-title":["International Journal of System Dynamics Applications"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=109064","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,27]],"date-time":"2024-05-27T13:15:00Z","timestamp":1716815700000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/ijsda.2014010102"}},"subtitle":["The Case of Multi-Stage New Product Screening"],"short-title":[],"issued":{"date-parts":[[2014,1,1]]},"references-count":75,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,1]]}},"URL":"https:\/\/doi.org\/10.4018\/ijsda.2014010102","relation":{},"ISSN":["2160-9772","2160-9799"],"issn-type":[{"value":"2160-9772","type":"print"},{"value":"2160-9799","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,1,1]]}}}