{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T03:07:32Z","timestamp":1777777652715,"version":"3.51.4"},"reference-count":95,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T00:00:00Z","timestamp":1633996800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T00:00:00Z","timestamp":1633996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Karlsruher Institut f\u00fcr Technologie (KIT)"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ann Oper Res"],"published-print":{"date-parts":[[2026,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Whenever a system needs to be operated by a central decision making authority in the presence of two or more conflicting goals, methods from multi-criteria decision making can help to resolve the trade-offs between these goals. In this work, we devise an interactive simulation-based methodology for planning and deciding in complex dynamic systems subject to multiple objectives and parameter uncertainty. The outline intermittently employs simulation models and global sensitivity analysis methods in order to facilitate the acquisition of system-related knowledge throughout the iterations. Moreover, the decision maker participates in the decision making process by interactively adjusting control variables and system parameters according to a guiding analysis question posed for each iteration. As a result, the overall decision making process is backed up by sensitivity analysis results providing increased confidence in terms of reliability of considered decision alternatives. Using the efficiency concept of Pareto optimality and the sensitivity analysis method of Sobol\u2019 sensitivity indices, the methodology is then instantiated in a case study on planning and deciding in an infectious disease epidemic situation similar to the 2020 coronavirus pandemic. Results show that the presented simulation-based methodology is capable of successfully addressing issues such as system dynamics, parameter uncertainty, and multi-criteria decision making. Hence, it represents a viable tool for supporting decision makers in situations characterized by time dynamics, uncertainty, and multiple objectives.<\/jats:p>","DOI":"10.1007\/s10479-021-04321-8","type":"journal-article","created":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T20:57:21Z","timestamp":1634072241000},"page":"67-96","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Simulation-based multi-criteria decision making: an interactive method with a case study on infectious disease epidemics"],"prefix":"10.1007","volume":"360","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4805-9576","authenticated-orcid":false,"given":"Fabian","family":"Dunke","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"Nickel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,12]]},"reference":[{"issue":"3","key":"4321_CR1","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1023\/A:1005102326115","volume":"47","author":"FB Abdelaziz","year":"1999","unstructured":"Abdelaziz, F. B., Lang, P., & Nadeau, R. (1999). Dominance and efficiency in multicriteria decision under uncertainty. Theory and Decision, 47(3), 191\u2013211.","journal-title":"Theory and Decision"},{"issue":"7","key":"4321_CR2","doi-asserted-by":"publisher","first-page":"1021","DOI":"10.1080\/01605682.2017.1410010","volume":"69","author":"U Aickelin","year":"2018","unstructured":"Aickelin, U., Reps, J. M., Siebers, P.-O., & Li, P. (2018). Using simulation to incorporate dynamic criteria into multiple criteria decision-making. Journal of the Operational Research Society, 69(7), 1021\u20131032.","journal-title":"Journal of the Operational Research Society"},{"key":"4321_CR3","doi-asserted-by":"crossref","unstructured":"Al-Aomar, R. (2002). A robust simulation-based multicriteria optimization methodology. In Proceedings of the 2002 winter simulation conference (pp. 1931\u20131939).","DOI":"10.1109\/WSC.2002.1166492"},{"issue":"1","key":"4321_CR4","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1007\/s10479-015-2019-x","volume":"240","author":"S Amaran","year":"2016","unstructured":"Amaran, S., Sahinidis, N. V., Sharda, B., & Bury, S. J. (2016). Simulation optimization: A review of algorithms and applications. Annals of Operations Research, 240(1), 351\u2013380.","journal-title":"Annals of Operations Research"},{"issue":"3","key":"4321_CR5","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1287\/orsc.10.3.216","volume":"10","author":"P Anderson","year":"1999","unstructured":"Anderson, P. (1999). Perspective: Complexity theory and organization science. Organization Science, 10(3), 216\u2013232.","journal-title":"Organization Science"},{"issue":"2","key":"4321_CR6","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1080\/00949659708811825","volume":"58","author":"G Archer","year":"1997","unstructured":"Archer, G., Saltelli, A., & Sobol, I. (1997). Sensitivity measures, ANOVA-like techniques and the use of bootstrap. Journal of Statistical Computation and Simulation, 58(2), 99\u2013120.","journal-title":"Journal of Statistical Computation and Simulation"},{"key":"4321_CR7","unstructured":"Banks, J. (Ed.). (2010). Discrete-event system simulation (5th ed.). Pearson."},{"issue":"C","key":"4321_CR8","first-page":"535","volume":"13","author":"R Barton","year":"2006","unstructured":"Barton, R., & Meckesheimer, M. (2006). Metamodel-based simulation optimization. Handbooks in Operations Research and Management. Science, 13(C), 535\u2013574.","journal-title":"Science"},{"issue":"3","key":"4321_CR9","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1016\/j.ejor.2015.06.032","volume":"248","author":"E Borgonovo","year":"2016","unstructured":"Borgonovo, E., & Plischke, E. (2016). Sensitivity analysis: A review of recent advances. European Journal of Operational Research, 248(3), 869\u2013887.","journal-title":"European Journal of Operational Research"},{"key":"4321_CR10","doi-asserted-by":"crossref","unstructured":"Brailsford, S.\u00a0C., Desai, S.\u00a0M., & Viana, J. (2010). Towards the holy grail: Combining system dynamics and discrete-event simulation in healthcare. In Proceedings of the 2010 winter simulation conference (pp. 2293\u20132303).","DOI":"10.1109\/WSC.2010.5678927"},{"key":"4321_CR11","doi-asserted-by":"crossref","unstructured":"Brauer, F., van den Driessche, P., & Wu, J. (2008). Mathematical Epidemiology. Springer.","DOI":"10.1007\/978-3-540-78911-6"},{"key":"4321_CR12","doi-asserted-by":"crossref","unstructured":"Broekhuizen, H., Groothuis-Oudshoorn, C. G., van Til, J. A., Hummel, J. M., & IJzerman, M. J. (2015). A review and classification of approaches for dealing with uncertainty in multi-criteria decision analysis for healthcare decisions. Pharmacoeconomics,33(5), 445\u2013455.","DOI":"10.1007\/s40273-014-0251-x"},{"issue":"3","key":"4321_CR13","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1016\/S0377-2217(96)00307-4","volume":"103","author":"J Butler","year":"1997","unstructured":"Butler, J., Jia, J., & Dyer, J. (1997). Simulation techniques for the sensitivity analysis of multi-criteria decision models. European Journal of Operational Research, 103(3), 531\u2013546.","journal-title":"European Journal of Operational Research"},{"key":"4321_CR14","doi-asserted-by":"crossref","unstructured":"Carson, Y., & Maria, A. (1997). Simulation optimization: Methods and applications. In Proceedings of the 1997 winter simulation conference (pp. 118\u2013126).","DOI":"10.1145\/268437.268460"},{"key":"4321_CR15","unstructured":"Cassandras, C. G., & Lafortune, S. (2010). Introduction to Discrete Event Systems (3rd ed.). Springer."},{"key":"4321_CR16","doi-asserted-by":"crossref","unstructured":"Chan, K., Saltelli, A., & Tarantola, S. (1997). Sensitivity analysis of model output: Variance-based methods make the difference. In Proceedings of the 1997 winter simulation conference (pp. 261\u2013268).","DOI":"10.1145\/268437.268489"},{"issue":"12","key":"4321_CR17","doi-asserted-by":"publisher","first-page":"1969","DOI":"10.1243\/09544054JEM539","volume":"220","author":"K Chatha","year":"2006","unstructured":"Chatha, K., & Weston, R. (2006). Combined discrete event simulation and systems thinking-based framework for management decision support. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering, 220(12), 1969\u20131981.","journal-title":"Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering"},{"issue":"3","key":"4321_CR18","doi-asserted-by":"publisher","first-page":"654","DOI":"10.1016\/j.dss.2004.06.012","volume":"41","author":"L-C Chen","year":"2006","unstructured":"Chen, L.-C., Carley, K. M., Fridsma, D., Kaminsky, B., & Yahja, A. (2006). Model alignment of anthrax attack simulations. Decision Support Systems, 41(3), 654\u2013668.","journal-title":"Decision Support Systems"},{"issue":"5","key":"4321_CR19","doi-asserted-by":"publisher","first-page":"875","DOI":"10.1115\/1.1904642","volume":"127","author":"W Chen","year":"2005","unstructured":"Chen, W., Jin, R., & Sudjianto, A. (2005). Analytical variance-based global sensitivity analysis in simulation-based design under uncertainty. Journal of Mechanical Design, 127(5), 875\u2013886.","journal-title":"Journal of Mechanical Design"},{"key":"4321_CR20","doi-asserted-by":"publisher","first-page":"1068","DOI":"10.1016\/j.scitotenv.2013.10.069","volume":"470","author":"A Cosenza","year":"2014","unstructured":"Cosenza, A., Mannina, G., Vanrolleghem, P. A., & Neumann, M. B. (2014). Variance-based sensitivity analysis for wastewater treatment plant modelling. Science of the Total Environment, 470, 1068\u20131077.","journal-title":"Science of the Total Environment"},{"key":"4321_CR21","doi-asserted-by":"crossref","unstructured":"Delen, D., & Sharda, R. (2008). Artificial neural networks in decision support systems. In Handbook on decision support systems 1 (pp. 557\u2013580). Springer.","DOI":"10.1007\/978-3-540-48713-5_26"},{"key":"4321_CR22","doi-asserted-by":"crossref","unstructured":"Dellino, G., & Meloni, C. (2015). Uncertainty management in simulation-optimization of complex systems. Springer.","DOI":"10.1007\/978-1-4899-7547-8"},{"key":"4321_CR23","doi-asserted-by":"crossref","unstructured":"Djanatliev, A., & German, R. (2013). Prospective healthcare decision-making by combined system dynamics, discrete-event and agent-based simulation. In Proceedings of the 2013 winter simulation conference (pp. 270\u2013281).","DOI":"10.1109\/WSC.2013.6721426"},{"issue":"1","key":"4321_CR24","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1016\/j.ejor.2013.06.041","volume":"232","author":"IN Durbach","year":"2014","unstructured":"Durbach, I. N. (2014). Outranking under uncertainty using scenarios. European Journal of Operational Research, 232(1), 98\u2013108.","journal-title":"European Journal of Operational Research"},{"key":"4321_CR25","unstructured":"Ehrgott, M. (2005). Multicriteria optimization (2nd ed.). Springer."},{"issue":"2","key":"4321_CR26","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1023\/A:1014468613635","volume":"5","author":"JE Everett","year":"2002","unstructured":"Everett, J. E. (2002). A decision support simulation model for the management of an elective surgery waiting system. Health Care Management Science, 5(2), 89\u201395.","journal-title":"Health Care Management Science"},{"issue":"2","key":"4321_CR27","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1080\/07011784.2019.1566026","volume":"44","author":"B Fajdek","year":"2019","unstructured":"Fajdek, B., Pytlak, R., Stachura, M., & Tarnawski, T. (2019). An approach to modelling and simulation of epidemics of diseases from pathogens spreading over water distribution systems. Canadian Water Resources Journal, 44(2), 174\u2013192.","journal-title":"Canadian Water Resources Journal"},{"key":"4321_CR28","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.jocs.2014.10.003","volume":"10","author":"MP Fanti","year":"2015","unstructured":"Fanti, M. P., Iacobellis, G., Ukovich, W., Boschian, V., Georgoulas, G., & Stylios, C. (2015). A simulation based decision support system for logistics management. Journal of Computer Science, 10, 86\u201396.","journal-title":"Journal of Computer Science"},{"issue":"1","key":"4321_CR29","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1007\/BF02136830","volume":"53","author":"MC Fu","year":"1994","unstructured":"Fu, M. C. (1994). Optimization via simulation: A review. Annals of Operations Research, 53(1), 199\u2013247.","journal-title":"Annals of Operations Research"},{"key":"4321_CR30","doi-asserted-by":"crossref","unstructured":"Gosavi, A. (2015). Simulation-based optimization: Parametric optimization techniques and reinforcement learning (2nd ed.). Springer.","DOI":"10.1007\/978-1-4899-7491-4"},{"key":"4321_CR31","doi-asserted-by":"crossref","unstructured":"Greco, S., Figueira, J., & Ehrgott, M. (2016). Multiple criteria decision analysis: State of the art surveys. Springer.","DOI":"10.1007\/978-1-4939-3094-4"},{"key":"4321_CR32","doi-asserted-by":"crossref","unstructured":"Gr\u00f6sser, S. N. (2017). Complexity management and system dynamics thinking. In S. N. Gr\u00f6sser, A. Reyes-Lecuona, & G. Granholm (Eds.), Dynamics of long-life assets: From technology adaptation to upgrading the business model (pp. 69\u201392). Springer.","DOI":"10.1007\/978-3-319-45438-2_5"},{"issue":"2","key":"4321_CR33","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/0167-9236(94)00058-1","volume":"16","author":"G Guariso","year":"1996","unstructured":"Guariso, G., Hitz, M., & Werthner, H. (1996). An integrated simulation and optimization modelling environment for decision support. Decision Support Systems, 16(2), 103\u2013117.","journal-title":"Decision Support Systems"},{"issue":"1","key":"4321_CR34","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1057\/hs.2012.8","volume":"1","author":"MM Gunal","year":"2012","unstructured":"Gunal, M. M. (2012). A guide for building hospital simulation models. Health Systems, 1(1), 17\u201325.","journal-title":"Health Systems"},{"key":"4321_CR35","doi-asserted-by":"crossref","unstructured":"Gutenschwager, K., Wenzel, S., & Sven\u00a0Spieckermann, S. (2017). Simulation in Produktion und Logistik: Grundlagen und Anwendungen. Springer.","DOI":"10.1007\/978-3-662-55745-7"},{"key":"4321_CR36","doi-asserted-by":"crossref","unstructured":"Heilala, J., Montonen, J., J\u00e4rvinen, P., Kivikunnas, S., Maantila, M., Sillanp\u00e4\u00e4, J., & Jokinen, T. (2010). Developing simulation-based decision support systems for customer-driven manufacturing operation planning. In Proceedings of the 2010 winter simulation conference (pp. 3363\u20133375).","DOI":"10.1109\/WSC.2010.5679027"},{"issue":"1","key":"4321_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0951-8320(96)00002-6","volume":"52","author":"T Homma","year":"1996","unstructured":"Homma, T., & Saltelli, A. (1996). Importance measures in global sensitivity analysis of nonlinear models. Reliability Engineering & System Safety, 52(1), 1\u201317.","journal-title":"Reliability Engineering & System Safety"},{"key":"4321_CR38","unstructured":"Hopfe, C. J. (2009). Uncertainty and sensitivity analysis in building performance simulation for decision support and design optimization (p. 215). Eindhoven University of Technology."},{"issue":"5\u20136","key":"4321_CR39","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1177\/0037549709340733","volume":"86","author":"C-Y Huang","year":"2010","unstructured":"Huang, C.-Y., Tsai, Y.-S., & Wen, T.-H. (2010). A network-based simulation architecture for studying epidemic dynamics. Simulation, 86(5\u20136), 351\u2013368.","journal-title":"Simulation"},{"key":"4321_CR40","unstructured":"IBM. (2015). IBM SPSS Modeler 17 Algorithms Guide. Software documentation available at ftp:\/\/public.dhe.ibm.com\/software\/analytics\/spss\/documentation\/modeler\/17.0\/en\/AlgorithmsGuide.pdf (visited on October 2nd, 2020)."},{"key":"4321_CR41","doi-asserted-by":"crossref","unstructured":"Iooss, B., & Lema\u00eetre, P. (2015). A review on global sensitivity analysis methods. Uncertainty management in simulation-optimization of complex systems (pp. 101\u2013122). Springer.","DOI":"10.1007\/978-1-4899-7547-8_5"},{"key":"4321_CR42","doi-asserted-by":"publisher","first-page":"101922","DOI":"10.1016\/j.tre.2020.101922","volume":"136","author":"D Ivanov","year":"2020","unstructured":"Ivanov, D. (2020). Predicting the impacts of epidemic outbreaks on global supply chains: A simulation-based analysis on the coronavirus outbreak (COVID-19\/SARS-CoV-2) case. Transportation Research Part E: Logistics and Transportation Review, 136, 101922.","journal-title":"Transportation Research Part E: Logistics and Transportation Review"},{"issue":"4","key":"4321_CR43","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1103\/PhysRev.106.620","volume":"106","author":"E Jaynes","year":"1957","unstructured":"Jaynes, E. (1957a). Information theory and statistical mechanics. Physical Review, 106(4), 620\u2013630.","journal-title":"Physical Review"},{"issue":"2","key":"4321_CR44","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1103\/PhysRev.108.171","volume":"108","author":"E Jaynes","year":"1957","unstructured":"Jaynes, E. (1957b). Information theory and statistical mechanics II. Physical Review, 108(2), 171\u2013190.","journal-title":"Physical Review"},{"issue":"2","key":"4321_CR45","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1057\/palgrave.jors.2600669","volume":"50","author":"J Jun","year":"1999","unstructured":"Jun, J., Jacobson, S. H., & Swisher, J. R. (1999). Application of discrete-event simulation in health care clinics: A survey. Journal of the Operational Research Society, 50(2), 109\u2013123.","journal-title":"Journal of the Operational Research Society"},{"key":"4321_CR46","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.simpat.2013.12.004","volume":"42","author":"F Kadri","year":"2014","unstructured":"Kadri, F., Chaabane, S., & Tahon, C. (2014a). A simulation-based decision support system to prevent and predict strain situations in emergency department systems. Simulation Modelling Practice and Theory, 42, 32\u201352.","journal-title":"Simulation Modelling Practice and Theory"},{"key":"4321_CR47","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.simpat.2013.12.004","volume":"42","author":"F Kadri","year":"2014","unstructured":"Kadri, F., Chaabane, S., & Tahon, C. (2014b). A simulation-based decision support system to prevent and predict strain situations in emergency department systems. Simulation Modelling Practice and Theory, 42, 32\u201352.","journal-title":"Simulation Modelling Practice and Theory"},{"issue":"1","key":"4321_CR48","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1186\/1471-2458-9-117","volume":"9","author":"JK Kelso","year":"2009","unstructured":"Kelso, J. K., Milne, G. J., & Kelly, H. (2009). Simulation suggests that rapid activation of social distancing can arrest epidemic development due to a novel strain of influenza. BMC Public Health, 9(1), 117.","journal-title":"BMC Public Health"},{"key":"4321_CR49","doi-asserted-by":"crossref","unstructured":"Kleijnen, J. P. C. (2007). Experimental design for sensitivity analysis, optimization, and validation of simulation models. Handbook of Simulation (pp. 173\u2013223). Wiley.","DOI":"10.1002\/9780470172445.ch6"},{"key":"4321_CR50","doi-asserted-by":"crossref","unstructured":"Kopman, S., Akba\u015f, M.\u00a0I., & Turgut, D. (2012). Epidemicsim: Epidemic simulation system with realistic mobility. In Proceedings of the 37th annual IEEE conference on local computer networks (pp. 659\u2013665).","DOI":"10.1109\/LCNW.2012.6424047"},{"issue":"3","key":"4321_CR51","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/0377-2217(92)90155-3","volume":"63","author":"P Korhonen","year":"1992","unstructured":"Korhonen, P., Moskowitz, H., & Wallenius, J. (1992). Multiple criteria decision support: A review. European Journal of Operational Research, 63(3), 361\u2013375.","journal-title":"European Journal of Operational Research"},{"key":"4321_CR52","unstructured":"Law, A. M., & Kelton, W. D. (2000). Simulation modeling and analysis (3rd ed.). McGraw-Hill."},{"issue":"4","key":"4321_CR53","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1017\/S0950268806007217","volume":"135","author":"J Legrand","year":"2007","unstructured":"Legrand, J., Grais, R. F., Boelle, P.-Y., Valleron, A.-J., & Flahault, A. (2007). Understanding the dynamics of Ebola epidemics. Epidemiology and Infection, 135(4), 610\u2013621.","journal-title":"Epidemiology and Infection"},{"issue":"4","key":"4321_CR54","doi-asserted-by":"publisher","first-page":"1257","DOI":"10.1016\/j.asoc.2009.11.034","volume":"10","author":"Y Li","year":"2010","unstructured":"Li, Y., Ng, S., Xie, M., & Goh, T. (2010). A systematic comparison of metamodeling techniques for simulation optimization in decision support systems. Applied Soft Computing, 10(4), 1257\u20131273.","journal-title":"Applied Soft Computing"},{"issue":"3\u20134","key":"4321_CR55","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1016\/0020-7101(93)90018-2","volume":"32","author":"JZ Ma","year":"1993","unstructured":"Ma, J. Z., & Ackerman, E. (1993). Parameter sensitivity of a model of viral epidemics simulated with Monte Carlo techniques. II. Durations and peaks. International Journal of Bio-Medical Computing, 32(3\u20134), 255\u2013268.","journal-title":"International Journal of Bio-Medical Computing"},{"issue":"3\u20134","key":"4321_CR56","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1016\/0020-7101(93)90017-Z","volume":"32","author":"JZ Ma","year":"1993","unstructured":"Ma, J. Z., Ackerman, E., & Yang, J.-J. (1993). Parameter sensitivity of a model of viral epidemics simulated with Monte Carlo techniques. I. Illness attack rates. International Journal of Bio-Medical Computing, 32(3\u20134), 237\u2013253.","journal-title":"International Journal of Bio-Medical Computing"},{"key":"4321_CR57","doi-asserted-by":"crossref","unstructured":"Ma, Y., Bisset, K., Chen, J., Deodhar, S., & Marathe, M. (2011). Efficient implementation of complex interventions in large scale epidemic simulations. In Proceedings of the 2011 winter simulation conference (pp. 1349\u20131361).","DOI":"10.1109\/WSC.2011.6147856"},{"key":"4321_CR58","doi-asserted-by":"crossref","unstructured":"Macal, C.\u00a0M. (2010). To agent-based simulation from system dynamics. In Proceedings of the 2010 winter simulation conference (pp. 371\u2013382).","DOI":"10.1109\/WSC.2010.5679148"},{"issue":"6","key":"4321_CR59","doi-asserted-by":"publisher","first-page":"768","DOI":"10.1016\/j.simpat.2010.01.015","volume":"18","author":"I Mahdavi","year":"2010","unstructured":"Mahdavi, I., Shirazi, B., & Solimanpur, M. (2010). Development of a simulation-based decision support system for controlling stochastic flexible job shop manufacturing systems. Simulation Modelling Practice and Theory, 18(6), 768\u2013786.","journal-title":"Simulation Modelling Practice and Theory"},{"key":"4321_CR60","doi-asserted-by":"crossref","unstructured":"Malmir, B., & Zobel, C. (2021). An applied approach to multi-criteria humanitarian supply chain planning for pandemic response. Journal of Humanitarian Logistics and Supply Chain Management.","DOI":"10.1108\/JHLSCM-08-2020-0064"},{"issue":"1","key":"4321_CR61","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/0377-2217(86)90159-1","volume":"26","author":"B Mareschal","year":"1986","unstructured":"Mareschal, B. (1986). Stochastic multicriteria decision making and uncertainty. European Journal of Operational Research, 26(1), 58\u201364.","journal-title":"European Journal of Operational Research"},{"issue":"4","key":"4321_CR62","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1007\/s40273-014-0135-0","volume":"32","author":"K Marsh","year":"2014","unstructured":"Marsh, K., Lanitis, T., Neasham, D., Orfanos, P., & Caro, J. (2014). Assessing the value of healthcare interventions using multi-criteria decision analysis: A review of the literature. PharmacoEconomics, 32(4), 345\u2013365.","journal-title":"PharmacoEconomics"},{"issue":"2","key":"4321_CR63","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1057\/jos.2009.23","volume":"4","author":"JAB Montevechi","year":"2010","unstructured":"Montevechi, J. A. B., de Almeida Filho, R. G., Paiva, A., Costa, R., & Medeiros, A. L. (2010). Sensitivity analysis in discrete-event simulation using fractional factorial designs. Journal of Simulation, 4(2), 128\u2013142.","journal-title":"Journal of Simulation"},{"issue":"3","key":"4321_CR64","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1016\/j.ejor.2016.08.016","volume":"257","author":"JS Morgan","year":"2017","unstructured":"Morgan, J. S., Howick, S., & Belton, V. (2017). A toolkit of designs for mixing discrete event simulation and system dynamics. European Journal of Operational Research, 257(3), 907\u2013918.","journal-title":"European Journal of Operational Research"},{"issue":"1","key":"4321_CR65","first-page":"50","volume":"26","author":"N Mustafee","year":"2013","unstructured":"Mustafee, N., Katsaliaki, K., Gunasekaran, A., Williams, M. D., Chahal, K., Eldabi, T., & Young, T. (2013). A conceptual framework for hybrid system dynamics and discrete event simulation for healthcare. Journal of Enterprise Information Management, 26(1), 50\u201374.","journal-title":"Journal of Enterprise Information Management"},{"key":"4321_CR66","unstructured":"Mykoniatis, K. (2015). A generic framework for multi-method modeling and simulation of complex systems using discrete event, system dynamics and agent based approaches. Ph.D. thesis, University of Central Florida."},{"key":"4321_CR67","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.simpat.2014.01.007","volume":"43","author":"A Nikakhtar","year":"2014","unstructured":"Nikakhtar, A., & Hsiang, S. M. (2014). Incorporating the dynamics of epidemics in simulation models of healthcare systems. Simulation Modelling Practice and Theory, 43, 67\u201378.","journal-title":"Simulation Modelling Practice and Theory"},{"key":"4321_CR68","doi-asserted-by":"crossref","unstructured":"Nossent, J., Elsen, P., & Bauwens, W. (2011). Sobol\u2019 sensitivity analysis of a complex environmental model. Environmental Modelling & Software, 26(12), 1515\u20131525.","DOI":"10.1016\/j.envsoft.2011.08.010"},{"issue":"10","key":"4321_CR69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0045414","volume":"7","author":"EO Nsoesie","year":"2012","unstructured":"Nsoesie, E. O., Beckman, R. J., & Marathe, M. V. (2012). Sensitivity analysis of an individual-based model for simulation of influenza epidemics. PLoS ONE, 7(10), 1\u201316.","journal-title":"PLoS ONE"},{"key":"4321_CR70","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.epidem.2016.12.001","volume":"19","author":"C Orbann","year":"2017","unstructured":"Orbann, C., Sattenspiel, L., Miller, E., & Dimka, J. (2017). Defining epidemics in computer simulation models: How do definitions influence conclusions? Epidemics, 19, 24\u201332.","journal-title":"Epidemics"},{"issue":"5","key":"4321_CR71","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1177\/0037549716640877","volume":"92","author":"\u00d6 \u00d6zmen","year":"2016","unstructured":"\u00d6zmen, \u00d6., Nutaro, J. J., Pullum, L. L., & Ramanathan, A. (2016). Analyzing the impact of modeling choices and assumptions in compartmental epidemiological models. Simulation, 92(5), 459\u2013472.","journal-title":"Simulation"},{"key":"4321_CR72","unstructured":"Page, E. H. (1994). Simulation modeling methodology: Principles and etiology of decision support. Ph.D. thesis, Virginia Polytechnic Institute and State University."},{"issue":"18","key":"4321_CR73","doi-asserted-by":"publisher","first-page":"7504","DOI":"10.3390\/su12187504","volume":"12","author":"D Pamu\u010dar","year":"2020","unstructured":"Pamu\u010dar, D., \u017di\u017eovi\u0107, M., Marinkovi\u0107, D., Doljanica, D., Jovanovi\u0107, S., & Brzakovi\u0107, P. (2020). Development of a multi-criteria model for sustainable reorganization of a healthcare system in an emergency situation caused by the covid-19 pandemic. Sustainability, 12(18), 7504.","journal-title":"Sustainability"},{"key":"4321_CR74","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1016\/j.envsoft.2016.02.008","volume":"79","author":"F Pianosi","year":"2016","unstructured":"Pianosi, F., Beven, K., Freer, J., Hall, J. W., Rougier, J., Stephenson, D. B., & Wagener, T. (2016). Sensitivity analysis of environmental models: A systematic review with practical workflow. Environmental Modelling & Software, 79, 214\u2013232.","journal-title":"Environmental Modelling & Software"},{"issue":"2","key":"4321_CR75","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1016\/S0377-2217(98)00215-X","volume":"113","author":"VV Podinovski","year":"1999","unstructured":"Podinovski, V. V. (1999). A DSS for multiple criteria decision analysis with imprecisely specified trade-offs. European Journal of Operational Research, 113(2), 261\u2013270.","journal-title":"European Journal of Operational Research"},{"issue":"3","key":"4321_CR76","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.1016\/j.dss.2005.05.030","volume":"43","author":"D Power","year":"2007","unstructured":"Power, D., & Sharda, R. (2007). Model-driven decision support systems: Concepts and research directions. Decision Support Systems, 43(3), 1044\u20131061.","journal-title":"Decision Support Systems"},{"key":"4321_CR77","doi-asserted-by":"crossref","unstructured":"Power, D.\u00a0J. (2008). Decision support systems: A historical overview. In Handbook on decision support systems 1, (pp. 121\u2013140). Springer.","DOI":"10.1007\/978-3-540-48713-5_7"},{"key":"4321_CR78","doi-asserted-by":"crossref","unstructured":"Prieur, C., & Tarantola, S. (2016). Variance-based sensitivity analysis: Theory and estimation algorithms. In R. Ghanem, D. Higdon, & H. Owhadi (Eds.), Handbook of uncertainty quantification (pp. 1\u201323). Springer.","DOI":"10.1007\/978-3-319-11259-6_35-1"},{"key":"4321_CR79","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.trc.2013.05.007","volume":"34","author":"E Quaglietta","year":"2013","unstructured":"Quaglietta, E., & Punzo, V. (2013). Supporting the design of railway systems by means of a Sobol variance-based sensitivity analysis. Transportation Research Part C: Emerging Technologies, 34, 38\u201354.","journal-title":"Transportation Research Part C: Emerging Technologies"},{"key":"4321_CR80","doi-asserted-by":"publisher","first-page":"294","DOI":"10.3389\/fpubh.2020.00294","volume":"8","author":"D Raboisson","year":"2020","unstructured":"Raboisson, D., & Lhermie, G. (2020). Living with covid-19: A systemic and multi-criteria approach to enact evidence-based health policy. Front. Public Health, 8, 294.","journal-title":"Front. Public Health"},{"issue":"1","key":"4321_CR81","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1016\/j.envsoft.2008.06.011","volume":"24","author":"DM Rao","year":"2009","unstructured":"Rao, D. M., Chernyakhovsky, A., & Rao, V. (2009). Modeling and analysis of global epidemiology of avian influenza. Environmental Modelling & Software, 24(1), 124\u2013134.","journal-title":"Environmental Modelling & Software"},{"issue":"2","key":"4321_CR82","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.cpc.2009.09.018","volume":"181","author":"A Saltelli","year":"2010","unstructured":"Saltelli, A., Annoni, P., Azzini, I., Campolongo, F., Ratto, M., & Tarantola, S. (2010). Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Computer Physics Communications, 181(2), 259\u2013270.","journal-title":"Computer Physics Communications"},{"key":"4321_CR83","unstructured":"Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004). Sensitivity analysis in practice: A guide to assessing scientific models. Wiley."},{"issue":"3","key":"4321_CR84","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1057\/jos.2010.14","volume":"4","author":"P-O Siebers","year":"2010","unstructured":"Siebers, P.-O., Macal, C. M., Garnett, J., Buxton, D., & Pidd, M. (2010). Discrete-event simulation is dead, long live agent-based simulation! Journal of Simulation, 4(3), 204\u2013210.","journal-title":"Journal of Simulation"},{"issue":"2","key":"4321_CR85","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/S0377-2217(98)00213-6","volume":"113","author":"Y Siskos","year":"1999","unstructured":"Siskos, Y., & Spyridakos, A. (1999). Intelligent multicriteria decision support: Overview and perspectives. European Journal of Operational Research, 113(2), 236\u2013246.","journal-title":"European Journal of Operational Research"},{"issue":"4","key":"4321_CR86","first-page":"407","volume":"1","author":"IM Sobol","year":"1993","unstructured":"Sobol, I. M. (1993). Sensitivity estimates for nonlinear mathematical models. Mathematical Modeling and Computational Experiment, 1(4), 407\u2013414.","journal-title":"Mathematical Modeling and Computational Experiment"},{"key":"4321_CR87","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.ecolmodel.2012.08.005","volume":"247","author":"X Song","year":"2012","unstructured":"Song, X., Bryan, B. A., Paul, K. I., & Zhao, G. (2012). Variance-based sensitivity analysis of a forest growth model. Ecological Modelling, 247, 135\u2013143.","journal-title":"Ecological Modelling"},{"issue":"3","key":"4321_CR88","first-page":"54","volume":"1","author":"S Sumari","year":"2013","unstructured":"Sumari, S., Ibrahim, R., Zakaria, N. H., & Ab Hamid, A. H. (2013). Comparing three simulation model using taxonomy: System dynamic simulation, discrete event simulation and agent based simulation. International Journal of Simulation Modelling, 1(3), 54\u201359.","journal-title":"International Journal of Simulation Modelling"},{"key":"4321_CR89","doi-asserted-by":"crossref","unstructured":"Tako, A. A., & Robinson, S. (2018). Comparing discrete-event simulation and system dynamics: Users\u2019 perceptions. In System dynamics (pp. 261\u2013299). Springer.","DOI":"10.1057\/978-1-349-95257-1_9"},{"issue":"11","key":"4321_CR90","doi-asserted-by":"publisher","first-page":"1067","DOI":"10.1080\/07408170490500654","volume":"36","author":"E Tekin","year":"2004","unstructured":"Tekin, E., & Sabuncuoglu, I. (2004). Simulation optimization: A comprehensive review on theory and applications. IIE Transactions, 36(11), 1067\u20131081.","journal-title":"IIE Transactions"},{"issue":"8","key":"4321_CR91","doi-asserted-by":"publisher","first-page":"1172","DOI":"10.1016\/j.jval.2012.06.015","volume":"15","author":"P Thokala","year":"2012","unstructured":"Thokala, P., & Duenas, A. (2012). Multiple criteria decision analysis for health technology assessment. Value Health, 15(8), 1172\u20131181.","journal-title":"Value Health"},{"issue":"1","key":"4321_CR92","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1016\/j.ejor.2014.02.052","volume":"237","author":"J Viana","year":"2014","unstructured":"Viana, J., Brailsford, S. C., Harindra, V., & Harper, P. R. (2014). Combining discrete-event simulation and system dynamics in a healthcare setting: A composite model for chlamydia infection. European Journal of Operational Research, 237(1), 196\u2013206.","journal-title":"European Journal of Operational Research"},{"key":"4321_CR93","doi-asserted-by":"crossref","unstructured":"Vu, K. K., D\u2019Ambrosio, C., Hamadi, Y., & Liberti, L. (2016). Surrogate-based methods for black-box optimization. International Transactions in Operational Research, 24(3), 393\u2013424.","DOI":"10.1111\/itor.12292"},{"issue":"4","key":"4321_CR94","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1016\/j.envsoft.2010.10.007","volume":"26","author":"J Yang","year":"2011","unstructured":"Yang, J. (2011). Convergence and uncertainty analyses in Monte-Carlo based sensitivity analysis. Environmental Modelling & Software, 26(4), 444\u2013457.","journal-title":"Environmental Modelling & Software"},{"issue":"10","key":"4321_CR95","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1177\/0037549711411964","volume":"87","author":"M Zakerifar","year":"2011","unstructured":"Zakerifar, M., Biles, W. E., & Evans, G. W. (2011). Kriging metamodeling in multiple-objective simulation optimization. Simulation, 87(10), 843\u2013856.","journal-title":"Simulation"}],"container-title":["Annals of Operations Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-021-04321-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10479-021-04321-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-021-04321-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:02:28Z","timestamp":1777489348000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10479-021-04321-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,12]]},"references-count":95,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,5]]}},"alternative-id":["4321"],"URL":"https:\/\/doi.org\/10.1007\/s10479-021-04321-8","relation":{},"ISSN":["0254-5330","1572-9338"],"issn-type":[{"value":"0254-5330","type":"print"},{"value":"1572-9338","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,12]]},"assertion":[{"value":"27 September 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 October 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}