{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T16:36:27Z","timestamp":1774456587055,"version":"3.50.1"},"reference-count":80,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T00:00:00Z","timestamp":1700352000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Erasmus+ KA project","award":["2020-1-IT02-KA204-079724"],"award-info":[{"award-number":["2020-1-IT02-KA204-079724"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>This study aims to explore and discuss the role of systems thinking and system dynamics-assisted games in enhancing critical thinking skills in learners. In more detail, the study relies on the use of a system dynamics-based interactive learning environment related to project management issues, followed by systems thinking-supported debriefing sessions. The interactive learning environment was developed and used in the form of a single-player, online, computer-based game. The game was designed to mimic all the necessary planning and operational activities needed to organize a wedding ceremony. The acquisition of critical thinking skills in learners was evaluated in three main ways: (1) players\u2019 performances were analyzed through a scoring system embedded in the game that considers several performance dimensions; (2) feedback from the players was collected and analyzed by using basic content analysis; (3) players\u2019 performances were analyzed using five main categories of structures that are typical of project management domains, i.e., project features, the rework cycle, project control, ripple effects, and knock-on effects. The findings show that the joint use of system dynamics and systems thinking tools and principles within a gaming environment has the potential to facilitate and enhance the acquisition of critical thinking skills in learners and may also provide valid support for educators and practitioners interested in the enhancement of project management skills.<\/jats:p>","DOI":"10.3390\/systems11110554","type":"journal-article","created":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T01:54:12Z","timestamp":1700445252000},"page":"554","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Critical Thinking Skills Enhancement through System Dynamics-Based Games: Insights from the Project Management Board Game Project"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4014-7395","authenticated-orcid":false,"given":"Federico","family":"Barnab\u00e8","sequence":"first","affiliation":[{"name":"Dipartimento di Studi Aziendali e Giuridici, University of Siena, 53100 Siena, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0777-4004","authenticated-orcid":false,"given":"Stefano","family":"Armenia","sequence":"additional","affiliation":[{"name":"Dipartimento di Scienze Umane, IUL of Florence, 50122 Firenze, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7925-8597","authenticated-orcid":false,"given":"Sarfraz","family":"Nazir","sequence":"additional","affiliation":[{"name":"Dipartimento di Scienze Economico-Aziendali e Diritto per l\u2019Economia, University of Milano-Bicocca, 20126 Milano, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7481-0979","authenticated-orcid":false,"given":"Alessandro","family":"Pompei","sequence":"additional","affiliation":[{"name":"School of Advanced Defense Studies (CASD), Defense Analysis and Research Institute, 00165 Rome, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dewey, J. (1910). How We Think, D.C. Heat & Co. Publishers.","DOI":"10.1037\/10903-000"},{"key":"ref_2","first-page":"34","article-title":"Critical thinking: An overview","volume":"3","author":"Huitt","year":"1998","journal-title":"Educ. Psychol. Interact."},{"key":"ref_3","unstructured":"Halpern, D.F. (2013). Thought and Knowledge: An Introduction to Critical Thinking, Psychology Press, Taylor & Francis Group."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1111\/j.1469-5812.2008.00483.x","article-title":"Philosophy, critical thinking and philosophy for children","volume":"43","author":"Daniel","year":"2011","journal-title":"Educ. Philos. Theory"},{"key":"ref_5","unstructured":"Scriven, M., and Paul, R. Critical thinking. Proceedings of the 8th Annual International Conference on Critical Thinking and Education Reform, Summer, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100584","DOI":"10.1016\/j.tsc.2019.100584","article-title":"Methodologies for teaching-learning critical thinking in higher education: The teacher\u2019s view","volume":"33","author":"Bezanilla","year":"2019","journal-title":"Think. Ski. Creat."},{"key":"ref_7","unstructured":"Gosner, W. (2023, November 01). \u201cCritical Thinking\u201d. Encyclopedia Britannica, 21 September 2023. Available online: https:\/\/www.britannica.com\/topic\/critical-thinking."},{"key":"ref_8","unstructured":"Kolb, D.A. (1984). Experiential Learning: Experience as the Source of Learning and Development, Prentice-Hall."},{"key":"ref_9","first-page":"1","article-title":"Experiential learning: A course design process for critical thinking","volume":"4","author":"Hamilton","year":"2011","journal-title":"Am. J. Bus. Educ."},{"key":"ref_10","first-page":"3","article-title":"Strategies for teaching critical thinking","volume":"4","author":"Potts","year":"1994","journal-title":"Pract. Assess. Res. Eval."},{"key":"ref_11","first-page":"1","article-title":"A strategy for teaching critical thinking: The sellmore case","volume":"18","author":"Castellano","year":"2017","journal-title":"Manag. Account. Q."},{"key":"ref_12","first-page":"4","article-title":"Using game-based learning to foster critical thinking in student discourse","volume":"9","author":"Cicchino","year":"2015","journal-title":"Interdiscip. J. Probl.-Based Learn."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"79","DOI":"10.28945\/3711","article-title":"Enhanced critical thinking skills through problem-solving games in secondary schools","volume":"13","author":"McDonald","year":"2017","journal-title":"Interdiscip. J. E-Ski. Lifelong Learn."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"521","DOI":"10.23887\/jet.v6i3.48637","article-title":"Improve critical thinking skills with informatics educational games","volume":"6","author":"Efendi","year":"2022","journal-title":"J. Educ. Technol."},{"key":"ref_15","first-page":"559","article-title":"Using simulation-based training to enhance management education","volume":"8","author":"Salas","year":"2009","journal-title":"Acad. Manag. Learn. Educ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1057\/jors.1995.86","article-title":"On a resurgence of management simulations and games","volume":"46","author":"Lane","year":"1995","journal-title":"J. Oper. Res. Soc."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"15","DOI":"10.5539\/ijbm.v11n12p15","article-title":"Policy Deployment and Learning in Complex Business Domains: The Potentials of Role Playing","volume":"11","year":"2016","journal-title":"Int. J. Bus. Manag."},{"key":"ref_18","unstructured":"Armenia, S., Barnab\u00e9, F., Ciobanu, N., and Kulakowska, M. (2023, November 13). Interactive \u201cBoardgame-Based\u201d Learning Environments for Decision-makers\u2019 Training in Managerial Education, 2020 White Paper. Available online: https:\/\/www.pmbog.eu\/wp-content\/uploads\/2021\/10\/Interactive-Learning-Environments-for-education.pdf."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1007\/s10648-007-9055-2","article-title":"Interactive example-based learning environments: Using 6 interactive elements to encourage effective processing of worked examples","volume":"19","author":"Atkinson","year":"2007","journal-title":"Educ. Psychol. Rev."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1177\/104687810003100204","article-title":"Issues in the design and use of system-dynamics-based interactive learning environments","volume":"31","author":"Davidsen","year":"2000","journal-title":"Simul. Gaming"},{"key":"ref_21","first-page":"5","article-title":"Constructing learning environments using system dynamics","volume":"1","author":"Spector","year":"1998","journal-title":"J. Coursew. Eng."},{"key":"ref_22","unstructured":"Papert, S. (1980). Mindstorms, Basic Books Inc."},{"key":"ref_23","unstructured":"Sch\u00f6n, D. (1983). The Reflective Practitioner, Basic Books Inc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1177\/1046878115596390","article-title":"System dynamics and simulation\/gaming: Overview","volume":"46","author":"Alessi","year":"2015","journal-title":"Simul. Gaming"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"152","DOI":"10.3390\/systems3040152","article-title":"Effects of structural transparency in system dynamics simulators on performance and understanding","volume":"3","author":"Kopainsky","year":"2015","journal-title":"Systems"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/0377-2217(88)90221-4","article-title":"System dynamics and microworlds for policymakers","volume":"35","author":"Morecroft","year":"1988","journal-title":"Eur. J. Oper. Res."},{"key":"ref_27","first-page":"40","article-title":"Teaching Takes Off: Flight Simulators for Management Education","volume":"19","author":"Sterman","year":"1992","journal-title":"OR\/MS Today"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1177\/1046878115596526","article-title":"Critical reflections on system dynamics and simulation\/gaming","volume":"46","author":"Davidsen","year":"2015","journal-title":"Simul. Gaming"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/j.jom.2015.07.002","article-title":"\u201cI\u2019m not hoarding, I\u2019m just stocking up before the hoarders get here.\u201d: Behavioral causes of phantom ordering in supply chains","volume":"39","author":"Sterman","year":"2015","journal-title":"J. Oper. Manag."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kunc, M., Malpass, J., and White, L. (2016). Behavioral Operational Research: Theory, Methodology and Practice, Palgrave Macmillan.","DOI":"10.1057\/978-1-137-53551-1"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1002\/sres.2465","article-title":"\u2018Behavioural System Dynamics\u2019: A very tentative and slightly sceptical map of the territory","volume":"34","author":"Lane","year":"2017","journal-title":"Syst. Res. Behav. Sci."},{"key":"ref_32","first-page":"339","article-title":"Exploring the potentials of behavioral system dynamics: Insights from the field","volume":"15","author":"Davidsen","year":"2020","journal-title":"J. Model. Manag."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1016\/j.ejor.2022.08.017","article-title":"Towards a behavioural system dynamics: Exploring its scope and delineating its promise","volume":"306","author":"Lane","year":"2023","journal-title":"Eur. J. Oper. Res."},{"key":"ref_34","unstructured":"Forrester, J.W. (1961). Industrial Dynamics, The MIT Press."},{"key":"ref_35","unstructured":"Forrester, J.W. (1968). Principle of Systems, The MIT Press."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1002\/sdr.377","article-title":"System dynamics applied to project management: A survey, assessment, and directions for future research","volume":"23","author":"Lyneis","year":"2007","journal-title":"Syst. Dyn. Rev."},{"key":"ref_37","first-page":"272","article-title":"Critical thinking in nursing education and practice as defined in the literature","volume":"26","author":"Turner","year":"2005","journal-title":"Nurs. Educ. Perspect."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1002\/cc.192","article-title":"Assessing critical thinking in community colleges","volume":"130","author":"Bers","year":"2005","journal-title":"New Dir. Community Coll."},{"key":"ref_39","first-page":"1","article-title":"Critical thinking: What it is and why it counts","volume":"1","author":"Facione","year":"2011","journal-title":"Insight Assess."},{"key":"ref_40","first-page":"25","article-title":"Teaching critical thinking skills in higher education: A review of the literature","volume":"8","author":"Niu","year":"2011","journal-title":"J. Coll. Teach. Learn."},{"key":"ref_41","first-page":"21","article-title":"Teaching Critical Thinking Skills: Literature Review","volume":"19","author":"Alsaleh","year":"2020","journal-title":"Turk. Online J. Educ. Technol.-TOJET"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.tsc.2007.11.001","article-title":"Exploring the structure of the Watson\u2013Glaser Critical Thinking Appraisal: One scale or many subscales?","volume":"3","author":"Bernard","year":"2008","journal-title":"Think. Ski. Creat."},{"key":"ref_43","first-page":"491","article-title":"Predicting Critical Thinking Ability of Sultan Qaboos University Students","volume":"12","author":"Alkharusi","year":"2019","journal-title":"Int. J. Instr."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1080\/0261547022000015258","article-title":"Using portfolios to stimulate critical thinking in social work education","volume":"21","author":"Coleman","year":"2002","journal-title":"Soc. Work Educ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.nedt.2016.07.005","article-title":"Self-assessment, reflection on practice and critical thinking in nursing students","volume":"45","year":"2016","journal-title":"Nurse Educ. Today"},{"key":"ref_46","unstructured":"Kankara\u0161, M., and Suarez-Alvarez, J. (2019). Assessment Framework of the OECD Study on Social and Emotional Skills, OECD Publishing."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/S40037-019-00536-5","article-title":"Clear skies ahead: Optimizing the learning environment for critical thinking from a qualitative analysis of interviews with expert teachers","volume":"8","author":"Jaffe","year":"2019","journal-title":"Perspect. Med. Educ."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1111\/j.1365-2929.2006.02481.x","article-title":"A comparison of the effects of problem-based learning and lecturing on the development of students\u2019 critical thinking","volume":"40","author":"Tiwari","year":"2006","journal-title":"Med. Educ."},{"key":"ref_49","unstructured":"Zepeda, S.J. (2006). Evaluating Teaching: A Guide to Current Thinking and Best Practice, Corwin Press, Sage."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1002\/sdr.4260090203","article-title":"Systems thinking: Critical thinking skills for the 1990s and beyond","volume":"9","author":"Richmond","year":"1993","journal-title":"Syst. Dyn. Rev."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1177\/1046878198293002","article-title":"Business simulation games: Current usage levels\u2014An update","volume":"29","author":"Faria","year":"1998","journal-title":"Simul. Gaming"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1177\/1046878108327585","article-title":"Developments in business gaming: A review of the past 40 years","volume":"40","author":"Faria","year":"2009","journal-title":"Simul. Gaming"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Jason Papathanasiou, J., Zarat\u00e9, P., and Freire de Sousa, J. (2021). EURO Working Group on DSS: A Tour of the DSS Developments over the Last 30 Years, Springer International Publishing.","DOI":"10.1007\/978-3-030-70377-6"},{"key":"ref_54","unstructured":"Duke, R.D., and Kriz, W.C. (2014). Back to the Future of Gaming, Bertelsmann Verlag GmbH & Co. KG."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1177\/1046878113513532","article-title":"Formation of novice business students\u2019 mental models through simulation gaming","volume":"44","author":"Palmunen","year":"2013","journal-title":"Simul. Gaming"},{"key":"ref_56","first-page":"246","article-title":"Holistic cognitive strategy in a computer-based marketing simulation game: An investigation of attitudes towards the decision-making process","volume":"Volume 25","author":"Wellington","year":"1998","journal-title":"Developments in Business Simulation and Experiential Learning: Proceedings of the Annual ABSEL Conference, Hawaii"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1002\/sdr.372","article-title":"A brief and incomplete history of operational gaming in system dynamics","volume":"23","author":"Meadows","year":"2007","journal-title":"Syst. Dyn. Rev."},{"key":"ref_58","unstructured":"Vennix, J.A.M. (1996). Group Model Building: Facilitating Team Learning Using System Dynamics, Wiley."},{"key":"ref_59","unstructured":"Sterman, J.D. (2000). Business Dynamics: Systems Thinking and Modeling for a Complex World, Irwin McGraw-Hill."},{"key":"ref_60","unstructured":"Sterman, J.D. (1992). System Dynamics Modeling for Project Management, System Dynamics Group, Sloan School of Management, Massachusetts Institute of Technology. Unpublished manuscript."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1002\/(SICI)1099-1727(199622)12:2<121::AID-SDR99>3.0.CO;2-X","article-title":"System dynamics in project management: A comparative analysis with traditional methods","volume":"12","author":"Rodrigues","year":"1996","journal-title":"Syst. Dyn. Rev."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/0263-7863(95)00075-5","article-title":"The role of system dynamics in project management","volume":"14","author":"Rodrigues","year":"1996","journal-title":"Int. J. Proj. Manag."},{"key":"ref_63","unstructured":"Dangerfield, B. (2020). System Dynamics, Springer. Encyclopedia of Complexity and Systems Science Series."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Turner, R. (2016). Gower Handbook of Project Management, Routledge.","DOI":"10.4324\/9781315585741"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"101","DOI":"10.3280\/MACO2015-002005","article-title":"Capitalizing and controlling development project as joint traslations. The mediating role of the information technology","volume":"2","author":"Leotta","year":"2015","journal-title":"Manag. Control"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Lock, D. (2020). Project Management, Routledge.","DOI":"10.4324\/9781315245911"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/17.62322","article-title":"The causes of project failure","volume":"37","author":"Pinto","year":"1990","journal-title":"IEEE Trans. Eng. Manag."},{"key":"ref_68","first-page":"93","article-title":"A taxonomy of an IT project failure: Root causes","volume":"5","author":"Khanfar","year":"2009","journal-title":"Int. Manag. Rev."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1002\/sdr.213","article-title":"Strategic management of complex projects: A case study using system dynamics","volume":"17","author":"Lyneis","year":"2001","journal-title":"Syst. Dyn. Rev."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.sbspro.2016.09.004","article-title":"Key challenges of system dynamics implementation in project management","volume":"230","author":"Rumeser","year":"2016","journal-title":"Procedia-Soc. Behav. Sci."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1057\/palgrave.jors.2600490","article-title":"System dynamics in project management: Assessing the impacts of client behaviour on project performance","volume":"49","author":"Rodrigues","year":"1998","journal-title":"J. Oper. Res. Soc."},{"key":"ref_72","unstructured":"Van Daalen, C., Schaffernicht, M., and Mayer, I. (2014, January 20\u201324). System dynamics and serious games. Proceedings of the 32nd International Conference of the System Dynamics Society, Delft, The Netherlands."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Schaller, M.D., Gencheva, M., Gunther, M.R., and Weed, S.A. (2023). Training doctoral students in critical thinking and experimental design using problem-based learning. BMC Med. Educ., 23.","DOI":"10.1186\/s12909-023-04569-7"},{"key":"ref_74","unstructured":"Krippendorff, K. (1980). Content Analysis: An Introduction to Its Methodology, SAGE Publications."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Novak, J.D., and Gowin, D.B. (1984). Learning How to Learn, Cambridge University Press.","DOI":"10.1017\/CBO9781139173469"},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1002\/sres.1041","article-title":"A participatory modelling approach to support integrated sustainability assessment processes","volume":"27","author":"Videira","year":"2010","journal-title":"Syst. Res. Behav. Sci."},{"key":"ref_77","first-page":"209","article-title":"Tests for building confidence in system dynamics models","volume":"14","author":"Senge","year":"1980","journal-title":"Syst. Dyn. TIMS Stud. Manag. Sci."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1002\/(SICI)1099-1727(199623)12:3<183::AID-SDR103>3.0.CO;2-4","article-title":"Formal aspects of model validity and validation in system dynamics","volume":"12","author":"Barlas","year":"1996","journal-title":"Syst. Dyn. Rev."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1002\/sdr.1641","article-title":"A System Dynamics Glossary","volume":"35","author":"Ford","year":"2019","journal-title":"Syst. Dyn. Rev."},{"key":"ref_80","unstructured":"Campbell, D.T., Stanley, J.C., and Gage, N.L. (1963). Experimental and Quasi-Experimental Designs for Research, Houghton Mifflin."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/11\/554\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:25:35Z","timestamp":1760131535000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/11\/554"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,19]]},"references-count":80,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["systems11110554"],"URL":"https:\/\/doi.org\/10.3390\/systems11110554","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,19]]}}}