{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:39:34Z","timestamp":1760236774762,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,12,19]],"date-time":"2021-12-19T00:00:00Z","timestamp":1639872000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>This paper describes an approach to blend several qualitative and quantitative methods to establish the boundaries of complex systems in terms of uncontrollable, non-numeric variables. Decision makers increasingly encounter layered, multidimensional, interconnected issues that contain unknown unknowns, vast uncertainties, and ill-defined lines of demarcation between the beginning and the end of the problem. The inexactness of boundaries in a systems problem is a result of not knowing important variables, existence of uncontrollable variables, and near-uncountable significant interactions among the variables. Furthermore, complexities and systems challenges arise from unexpected emergent behavior(s) that are often the primary concerns of systems engineers. The ability to investigate uncontrollable variables and their interactions with the system of interest is a critical step for bounding the system problem and defining the solution space. Thus, this paper focuses on developing a means for systematically examining these variables. By incorporating scenario-based computer simulations, scenario discretization, and customized designs of experiments, the authors offer systems engineers and scientists an approach for defining a viable solution space of a complex problem by developing constraint equations from uncontrollable, non-numeric variables.<\/jats:p>","DOI":"10.3390\/systems9040089","type":"journal-article","created":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T02:40:32Z","timestamp":1639968032000},"page":"89","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Bounding the Solution Space of Complex Systems in Terms of Non-Numeric and\\or Uncontrollable Scenario Variables"],"prefix":"10.3390","volume":"9","author":[{"given":"Alejandro","family":"Hernandez","sequence":"first","affiliation":[{"name":"Systems Engineering Department, Naval Postgraduate School, Monterey, CA 93943, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony","family":"Pollman","sequence":"additional","affiliation":[{"name":"Systems Engineering Department, Naval Postgraduate School, Monterey, CA 93943, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,19]]},"reference":[{"key":"ref_1","unstructured":"Andrew, P., and James, E. (2000). Introduction to Systems Engineering, Wiley."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kossiakoff, A., Sweet, W.N., Seymour, S.J., and Biemer, S.M. (2011). Systems Engineering Principles and Practice, Wiley.","DOI":"10.1002\/9781118001028"},{"key":"ref_3","unstructured":"Vanderbei, R.J. (2001). Linear Programming: Foundations and Extensions, Springer. [2nd ed.]."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Summers, J. (2005). Reasoning in Engineering Design. Proceedings of the Volume 5a: 17th International Conference on Design Theory and Methodology, American Society of Mechanical Engineers.","DOI":"10.1115\/DETC2005-85334"},{"key":"ref_5","unstructured":"INCOSE (2015). Systems Engineering Handbook, Wiley. [4th ed.]."},{"key":"ref_6","unstructured":"Wasson, C.S. (2016). Systems Engineering Analysis, Design, and Development, John Wiley & Sons. [2nd ed.]."},{"key":"ref_7","unstructured":"Langford, G.O. (2012). Engineering Systems Integration: Theory, Metrics, and Methods, CRC Press."},{"key":"ref_8","unstructured":"ANSI\/EIA (2003). Processes for Engineering A System, ANSI\/EIA 632-2003American National Standards Institute (ANSI)\/Electronic Industries Association (EIA)."},{"key":"ref_9","unstructured":"Winston, W.L. (2004). Operations Research: Applications and Algorithms, Brooks-Cole."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1287\/isre.12.3.240.9709","article-title":"Combining IS Research Methods: Towards a Pluralist Methodology","volume":"12","author":"Mingers","year":"2001","journal-title":"Inf. Syst. Res."},{"key":"ref_11","unstructured":"Creswell, J.W., and Creswell, J.D. (2018). Research Design, SAGE Publication Inc.. [5th ed.]."},{"key":"ref_12","unstructured":"Bazaraa, M.S., Jarvis, J.J., and Sherali, H.D. (2004). Linear Programming and Network Flows, John Wiley & Sons. [4th ed.]."},{"key":"ref_13","unstructured":"Zwicky, F. (1969). Discovery, Invention, Research\u2014Through the Morphological Approach, The Macmillan Company."},{"key":"ref_14","unstructured":"Ritchey, T. (, January September). Fritz Zwicky, \u2018Morphologie\u2019 and Policy Analysis. Proceedings of the 16th EURO Conference on Operational Analysis, Brussels, Belgium. Available online: https:\/\/www.researchgate.net\/profile\/Tom-Ritchey\/publication\/267794873_Fritz_Zwicky_Morphologie_and_Policy_Analysis\/links\/551aaa400cf2bb754076a92d\/Fritz-Zwicky-Morphologie-and-Policy-Analysis.pdf."},{"key":"ref_15","first-page":"1","article-title":"Application of General Morphological Analysis from Engineering Design to Policy Analysis","volume":"4","author":"Alvarez","year":"2015","journal-title":"Acta Morphol. Gen."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1177\/194675671100300105","article-title":"Modeling Alternative Futures with General Morphological Analysis","volume":"3","author":"Ritchey","year":"2011","journal-title":"World Futur. Rev."},{"key":"ref_17","unstructured":"Buede, D.M. (2016). The Engineering Design of Systems, Models and Methods, John Wiley & Sons, Inc."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1068\/a4099","article-title":"Computer-Supported Cognitive Mapping for Participatory Problem Structuring","volume":"41","author":"Dieperink","year":"2009","journal-title":"Environ. Plan. A"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1057\/palgrave.jors.2602177","article-title":"Problem Structuring Using Computer-Aided Morphological Analysis","volume":"57","author":"Ritchey","year":"2006","journal-title":"J. Oper. Res. Soc."},{"key":"ref_20","unstructured":"Badal, M.A. (2006). Strategic Management: Methods and Models. [Master\u2019s Thesis, DTU, Technical University of Denmark]."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1002\/nav.21628","article-title":"Changing the Paradigm: Simulation, Now a Method of First Resort","volume":"62","author":"Lucas","year":"2015","journal-title":"Naval Res. Logist."},{"key":"ref_22","unstructured":"Girouard, C., Pollman, A.G., and Hernandez, A.S. (2019, January 17\u201320). Modeling and Simulation Informed Conceptual Design, Analysis, and Initial Component Selection of a Supply-Side Building Scale LAES System for Renewable, Islanded Microgrid Resiliency. Proceedings of the 87th Military Operations Society Symposium, Colorado Springs, CO, USA."},{"key":"ref_23","unstructured":"Chermak, T.J. (2011). Scenario Planning in Organizations: How to Create, Use, and Assess Scenarios, Berrett-Koehler Publishers, Inc."},{"key":"ref_24","unstructured":"Lindren, M., and Bandhold, H. (2009). Scenario Planning: The Link between Future and Strategy, Palgrave McMillan."},{"key":"ref_25","unstructured":"von Reibnitz, U. (1988). Scenario Techniques, McGraw-Hill Publishing Co."},{"key":"ref_26","first-page":"220","article-title":"Advantages and Disadvantages of Scenario Approaches for Strategic Foresight","volume":"1","author":"Mietzner","year":"2005","journal-title":"Int. J. Technol. Intell. Plan."},{"key":"ref_27","unstructured":"Perla, P.P., and Curry, J. (2011). The Art of Wargaming: A Guide for Professionals and Hobbyists, U.S. Naval Institute Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1198\/004017006000000453","article-title":"Efficient Nearly Orthogonal and Space-Filling Latin Hypercubes","volume":"49","author":"Cioppa","year":"2007","journal-title":"Technometrics"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Watson, S.R., and Buede, D.M. (1987). Decision Synthesis: The Principles and Practice of Decision Analysis, Cambridge University Press.","DOI":"10.1017\/CBO9780511520716"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Saaty, T.L. (1980). The Analytic Hierarchy Process: Planning, Priority Setting, Resources Allocation, McGraw-Hill.","DOI":"10.21236\/ADA214804"},{"key":"ref_31","first-page":"244","article-title":"Decision Making Using the Analytic Hierarchy Process (AHP); A Step by Step Approach","volume":"2","author":"Taherdoost","year":"2017","journal-title":"Int. J. Econ. Manag. Syst."},{"key":"ref_32","unstructured":"Leon, S.J. (2002). Linear Algebra with Applications, Prentice Hall."},{"key":"ref_33","unstructured":"Blanchard, B.S., and Fabrycky, W.J. (2011). Systems Engineering and Analysis, Pearson Prentice Hall. [5th ed.]."},{"key":"ref_34","first-page":"263","article-title":"A User\u2019s Guide to the Brave New World of Designing Simulation Experiments, INFORMS","volume":"18","author":"Kleijnen","year":"2005","journal-title":"J. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hernandez, A.S., Lucas, T.W., and Sanchez, P.J. (2012, January 9\u201313). Selecting random Latin hypercubes dimensions and designs through estimation of maximum absolute pairwise correlation. Proceedings of the 2012 Winter Simulation Conference, Berlin, Germany.","DOI":"10.1109\/WSC.2012.6465112"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1111\/j.2517-6161.1954.tb00156.x","article-title":"The Errors of Lattice Sampling","volume":"17","author":"Patterson","year":"1954","journal-title":"J. R. Stat. Society Series B Methodol."},{"key":"ref_37","first-page":"261","article-title":"Computer Experiments","volume":"Volume 14","author":"Ghosh","year":"1996","journal-title":"Handbook Statistics"},{"key":"ref_38","unstructured":"Law, A.M. (2015). Simulation Modeling and Analysis, McGraw-Hill Education. [5th ed.]."},{"key":"ref_39","first-page":"239","article-title":"A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code","volume":"22","author":"McKay","year":"1979","journal-title":"Technometrics"},{"key":"ref_40","unstructured":"Wolsey, L.A. (1998). Integer Programming, John Wiley& Sons Inc."},{"key":"ref_41","unstructured":"Montgomery, D.C. (2005). Design and Analysis of Experiments, Wiley. [5th ed.]."},{"key":"ref_42","unstructured":"Willis, R., Pollman, A.G., Gannon, A.J., and Hernandez, A.S. (2019, January 20\u201323). Modeling a Building Scale Liquid Ari Energy Storage and Expansion System with ASPEN HYSYS. Proceedings of the 3rd IEEE International Conference on DC Microgrids (ICDCM), Matsue, Shimane, Japan."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Howe, T., Pollman, A.G., and Gannon, A.J. (2018). Operating Range for a Combined, Building-scale Liquid Air Energy Storage and Expansion System: Energy and Exergy Analysis. Entropy, 20.","DOI":"10.3390\/e20100770"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/9\/4\/89\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:51:56Z","timestamp":1760169116000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/9\/4\/89"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,19]]},"references-count":43,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["systems9040089"],"URL":"https:\/\/doi.org\/10.3390\/systems9040089","relation":{},"ISSN":["2079-8954"],"issn-type":[{"type":"electronic","value":"2079-8954"}],"subject":[],"published":{"date-parts":[[2021,12,19]]}}}