{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T03:00:09Z","timestamp":1773543609726,"version":"3.50.1"},"reference-count":46,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T00:00:00Z","timestamp":1596412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Capability-based planning as an approach to defense planning is an almost infinitely complex engineered system with countless nodes and layers of interdependency, influenced by state and non-state diplomatic activities, information, military and economic actions creating secondary and third order effects. The main output of capability-based planning is the set of capability requirements needed to achieve the expected end-state. One revitalized qualitative technique that allows us to gain insights into unstructured and fuzzy problems in the military is wargaming\u2014in its simplest form this involves manual wargaming. At the same time, there has been a push to bring computer assistance to such wargaming, especially to support umpire adjudication and move more generally towards full automation of human elements in wargames. However, computer assistance in wargaming should not be pushed, regardless of cost, towards quantitative techniques. The objective complexity of a problem often does not allow us to replicate the operational environment with the required fidelity to get credible experimental results. This paper discusses a discovery experiment aiming to verify the concept of applying a qualitative expert system within computer assisted wargaming for developing capability requirements in order to reduce umpire bias and risk associated with their decisions. The innovation here lies in applying system dynamics modelling and simulation paradigms when designing the theoretical model of capability development, which forms the core of the expert system. This new approach enables qualitative comparisons between different sets of proposed capability requirements. Moreover, the expert system allows us to reveal the effects of budget cuts on proposed capability requirement solutions, which the umpire was previously unable to articulate when comparing individual solutions by relying solely on his own knowledge. Players in the wargame validated the proposed concept and suggested how the study might be developed going forward: namely, by enabling users to define their own capabilities and not being limited by a predefined set of capabilities.<\/jats:p>","DOI":"10.3390\/e22080861","type":"journal-article","created":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T06:16:47Z","timestamp":1596435407000},"page":"861","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Computer Assisted Wargame for Military Capability-Based Planning"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3396-6285","authenticated-orcid":false,"given":"Jan","family":"Hodick\u00fd","sequence":"first","affiliation":[{"name":"NATO Headquarters Supreme Allied Commander Transformation, Norfolk, VA 23551, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6601-0012","authenticated-orcid":false,"given":"Dalibor","family":"Proch\u00e1zka","sequence":"additional","affiliation":[{"name":"Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabian","family":"Baxa","sequence":"additional","affiliation":[{"name":"Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Josef","family":"Melichar","sequence":"additional","affiliation":[{"name":"Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Milan","family":"Krej\u010d\u00edk","sequence":"additional","affiliation":[{"name":"Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Petr","family":"K\u0159\u00ed\u017eek","sequence":"additional","affiliation":[{"name":"Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2251-8711","authenticated-orcid":false,"given":"Petr","family":"Stodola","sequence":"additional","affiliation":[{"name":"Department of Intelligence Support, University of Defence, 66210 Brno, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3257-0473","authenticated-orcid":false,"given":"Jan","family":"Drozd","sequence":"additional","affiliation":[{"name":"Department of Tactics, University of Defence, 66210 Brno, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,3]]},"reference":[{"key":"ref_1","unstructured":"Kaplow, L., and Shavell, S. (2004). Decision Analysis, Game Theory, and Information, Foundation Press."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Raiffa, H. (1970). Decision Analysis, Introductory Letters on Choices and Uncertainty, Addison-Wesley Publishing Company.","DOI":"10.2307\/2987280"},{"key":"ref_3","unstructured":"Watts, B.D. (1996). Clausewitzian Friction and Future War, INSS."},{"key":"ref_4","unstructured":"Box, G.E.P., Hunter, J.S., and Hunter, W.G. (2005). Statistics for Experimenters: Design, Innovation, and Discovery, John Wiley & Sons, Inc."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Worley, D.R. (1999). Defining Military Experiments, Institute for Defense Analysis.","DOI":"10.21236\/ADA375425"},{"key":"ref_6","unstructured":"Creswell, J.W. (2014). Research Design, Qualitative, Quantitative, and Mixed Methods Approaches, Sage Publication, Inc."},{"key":"ref_7","unstructured":"Goure, D. (2013). The Measure of a Superpower: A Two Major Regional Contingency Military for the 21st Century, The Heritage Foundation. Available online: https:\/\/www.heritage.org\/defense\/report\/the-measure-superpower-two-major-regional-contingency-military-the-21st-century."},{"key":"ref_8","unstructured":"(2020, June 17). The Defence Planning Committee. Available online: http:\/\/nato.int\/cps\/en\/natohq\/topics_49201.htm?selectedLocale=en."},{"key":"ref_9","unstructured":"(2020, June 17). Handbook on Long Term Defence Planning: RTO Technical Report\u201469; St. Joseph Print Group. Available online: https:\/\/apps.dtic.mil\/dtic\/tr\/fulltext\/u2\/a414193.pdf."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Breitenbauch, H., and Jakobsson, A. (2018). Defence planning as strategic fact: Introduction. Defence Studies, Informa UK Limited.","DOI":"10.1080\/14702436.2018.1497443"},{"key":"ref_11","unstructured":"Stojkovic, D., and Dahl, R.B. (2007). Methodology for Long Term Defence Planning, Norwegian Defence Research Establishment."},{"key":"ref_12","unstructured":"Thaba, J.M. (2017). Technology support for military capability based acquisition. Proceedings of the IAMOT 2017, IAMOT."},{"key":"ref_13","unstructured":"(2020, June 17). NATO Defence Planning Process. Available online: https:\/\/www.nato.int\/cps\/en\/natohq\/topics_49202.htm."},{"key":"ref_14","unstructured":"Davis, K.P. (2002). Analytic Architecture for Capabilites-Based Planning, Mission-System Analysis, and Transformation, RAND Corporation."},{"key":"ref_15","unstructured":"Bucur-Marcu, H., Fluri, P., and Tagarev, T. (2020, June 17). Defence Management: An introduction: Security and Defence Management Series No. 1. Available online: https:\/\/it4sec.org\/system\/files\/defense_management_chapter_2.pdf."},{"key":"ref_16","unstructured":"(2018). AAP-06: NATO Glossary of Terms and Definitions, NATO Standardization Office."},{"key":"ref_17","unstructured":"Hinge, A. (2000). Australian Defence Preparedness: Principles, Problems and Prospects: Introducing Repertoire of Missions (ROMINS) a Practical Path to Australian Defence Preparedness, Australian Defence Studies Centre."},{"key":"ref_18","unstructured":"Hodicky, J., and Melichar, J. (2017). Role and Place of Modelling and Simulation in Wargaming. Proccedings of the MSG-149 Symposium on M&S Technologies and Standards for Enabling Alliance Interoperability and Pervasive M&S Applications, NATO Science and Technology Organization."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1080\/03071847.2011.626270","article-title":"Ten Trends in Capability Planning for Defence and Security","volume":"156","year":"2011","journal-title":"Rusi J."},{"key":"ref_20","first-page":"20","article-title":"Wargame as a Combined Method of Qualitative and Quantitative Studies","volume":"5","author":"Hamalainen","year":"2014","journal-title":"J. Slav. Mil. Stud."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hodicky, J., and Hernandez, A. (2020). Wargaming, Automation, and Military Experimentation to Quantitatively and Qualitatively Inform Decision Making. Simulation and Wargaming, Wiley. in press.","DOI":"10.1002\/9781119604815.ch5"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, P., Zhang, J., Sun, Y., and Liu, X. (2016). Wargame Simulation Theory and Evaluation Method for Emergency Evacuation of Residents from Urban Waterlogging Disaster Area. Int. J. Environ. Public Health, 13.","DOI":"10.3390\/ijerph13121260"},{"key":"ref_23","unstructured":"Perla, P.P., and Curry, J. (2011). The Art of Wargaming: A Guide for Professionals and Hobbyists, U.S. Naval Institute Press."},{"key":"ref_24","unstructured":"(2020, June 17). NATO Glosssary of Terms and Definitions. Available online: https:\/\/nso.nato.int\/natoterm\/Web.mvc."},{"key":"ref_25","unstructured":"(2013). Red Teaming Guide, UK Development Concepts and Doctrine Centre."},{"key":"ref_26","unstructured":"(2017). Wargaming Handbook, UK Development, Concepts and Doctrine Centre (DCDC)."},{"key":"ref_27","unstructured":"Adams, E., and Dormans, J. (2012). Game Mechanics: Advanced Game Design, New Riders Gamers."},{"key":"ref_28","unstructured":"(2006). Guide for Understanding and Implementing Defense Experimentation, The Technical Cooperation Programme (TTCP)."},{"key":"ref_29","unstructured":"Pournelle, P.E. (2017). Designing Wargames for the Analytic Purpose, Phalanx."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1002\/cplx.21767","article-title":"A general framework for measuring system complexity","volume":"21","author":"Efatmaneshnik","year":"2016","journal-title":"Complexity"},{"key":"ref_31","first-page":"329","article-title":"Weapon system of systems capability planning model based on expected effectiveness","volume":"39","author":"Gu","year":"2017","journal-title":"Syst. Eng. Electron"},{"key":"ref_32","unstructured":"H\u00e5kenstad, M., and Larsen, K.K. (2012). Long-Term Defence Planning: A Comparative Study of Seven Countries, Institutt for Forsvarsstudier."},{"key":"ref_33","first-page":"16","article-title":"Capability requirements oriented weapons portfolio planning model and algorithm","volume":"1","author":"Zhang","year":"2017","journal-title":"J. Natl. Univ. Def. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Wan, C., Zhang, X., Zhao, Q., and Yang, K. (2018). Operation Loop-Based Optimization Model for Resource Allocation to Military Countermeasures versus Probabilistic Threat. Appl. Sci., 8.","DOI":"10.3390\/app8020214"},{"key":"ref_35","unstructured":"Zhuang, J., Hsu, W., Newell, E.A., and Ross, D.O. (2012). Heuristics, Optimization, and Equilibrium Analysis for Automated Wargames, Homeland Security Center. non-published Research Reports."},{"key":"ref_36","first-page":"19","article-title":"Post Wargame Experimentation and Analysis: Re-Examining Executed Computer Assisted Wargames for New Insights","volume":"20","author":"Hernandez","year":"2015","journal-title":"Mil. Oper. Res. J."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Najgebauer, A., Antkiewicz, R., Chmielewski, M., Dyk, M., Kasprzyk, R., Pierzcha\u0142a, D., Rulka, J., and Tarapata, Z. (2015). The Qualitative and Quantitative Support Method for Capability Based Planning of Armed Forces Development. Intelligent Information and Database Systems, Springer.","DOI":"10.1007\/978-3-319-15705-4_21"},{"key":"ref_38","unstructured":"Gl\u00e6rum, S., and Hennum, A.C. (2010). J-DARTS\u2014An End-to-End Defence Planning Tool Set, Norwegian Defence Research Establishment."},{"key":"ref_39","first-page":"78","article-title":"Analytical Support to Norwegian Long-Term Defence Planning","volume":"25","author":"Glaerum","year":"2016","journal-title":"Czech Mil. Rev."},{"key":"ref_40","first-page":"33","article-title":"Assessment of capabilities of military groupings (forces) based on the functional group \u201cengage\u201d","volume":"5","author":"Bychenkov","year":"2018","journal-title":"East. Eur. J. Enterp. Technol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gallego-Garc\u00eda, S., Reschke, J., and Garc\u00eda-Garc\u00eda, M. (2019). Design and Simulation of a Capacity Management Model Using a Digital Twin Approach Based on the Viable System Model: Case Study of an Automotive Plant. Appl. Sci., 9.","DOI":"10.3390\/app9245567"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5068","DOI":"10.3390\/e16095068","article-title":"Editorial Comment on the Special Issue of \u201cInformation in Dynamical Systems and Complex Systems\u201d","volume":"16","author":"Bollt","year":"2014","journal-title":"Entropy"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Tang, Y., and Zhao, X. (2019). A Novel Uncertainty Management Approach for Air Combat Situation Assessment Based on Improved Belief Entropy. Entropy, 21.","DOI":"10.3390\/e21050495"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Gottwald, S., and Braun, D.A. (2019). Bounded Rational Decision-Making from Elementary Computations That Reduce Uncertainty. Entropy, 21.","DOI":"10.3390\/e21040375"},{"key":"ref_45","unstructured":"(2010). Experimentation Directive (Bi-SC 75-4), NATO. Available online: https:\/\/www.act.nato.int\/images\/stories\/events\/2011\/cde\/rr_bi-sc_exp_dir.pdf."},{"key":"ref_46","unstructured":"Gassner, R., and Kosow, H. (2008). Methods of Future and Scenario Analysis, German Development Institute."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/8\/861\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:53:53Z","timestamp":1760176433000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/8\/861"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,3]]},"references-count":46,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["e22080861"],"URL":"https:\/\/doi.org\/10.3390\/e22080861","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,3]]}}}