{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T17:35:07Z","timestamp":1754156107976,"version":"3.41.2"},"reference-count":55,"publisher":"Emerald","issue":"4","license":[{"start":{"date-parts":[[2018,11,12]],"date-time":"2018-11-12T00:00:00Z","timestamp":1541980800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JSIT"],"published-print":{"date-parts":[[2018,11,12]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>Stochastic simulation is a popular tool among practitioners and researchers alike for quantitative analysis of systems. Recent advancement in research on formulating production systems improvement problems into multi-objective optimizations has provided the possibility to predict the optimal trade-offs between improvement costs and system performance, before making the final decision for implementation. However, the fact that stochastic simulations rely on running a large number of replications to cope with the randomness and obtain some accurate statistical estimates of the system outputs, has posed a serious issue for using this kind of multi-objective optimization in practice, especially with complex models. Therefore, the purpose of this study is to investigate the performance enhancements of a reference point based evolutionary multi-objective optimization algorithm in practical production systems improvement problems, when combined with various dynamic re-sampling mechanisms.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>Many algorithms consider the preferences of decision makers to converge to optimal trade-off solutions faster. There also exist advanced dynamic resampling procedures to avoid wasting a multitude of simulation replications to non-optimal solutions. However, very few attempts have been made to study the advantages of combining these two approaches to further enhance the performance of computationally expensive optimizations for complex production systems. Therefore, this paper proposes some combinations of preference-based guided search with dynamic resampling mechanisms into an evolutionary multi-objective optimization algorithm to lower both the computational cost in re-sampling and the total number of simulation evaluations.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>This paper shows the performance enhancements of the reference-point based algorithm, R-NSGA-II, when augmented with three different dynamic resampling mechanisms with increasing degrees of statistical sophistication, namely, time-based, distance-rank and optimal computing buffer allocation, when applied to two real-world production system improvement studies. The results have shown that the more stochasticity that the simulation models exert, the more the statistically advanced dynamic resampling mechanisms could significantly enhance the performance of the optimization process.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>Contributions of this paper include combining decision makers\u2019 preferences and dynamic resampling procedures; performance evaluations on two real-world production system improvement studies and illustrating statistically advanced dynamic resampling mechanism is needed for noisy models.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/jsit-10-2017-0084","type":"journal-article","created":{"date-parts":[[2018,11,8]],"date-time":"2018-11-08T05:40:58Z","timestamp":1541655658000},"page":"489-512","source":"Crossref","is-referenced-by-count":5,"title":["Reference point based evolutionary multi-objective optimization with dynamic resampling for production systems improvement"],"prefix":"10.1108","volume":"20","author":[{"given":"Amos H.C.","family":"Ng","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florian","family":"Siegmund","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kalyanmoy","family":"Deb","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2020092611405847800_ref001","first-page":"48","article-title":"Dynamic control of genetic algorithms in a noisy environment","volume-title":"Proceedings of the Fifth International Conference on Genetic Algorithms","year":"1993"},{"issue":"2","key":"key2020092611405847800_ref002","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1162\/evco.1994.2.2.97","article-title":"Scheduling of genetic algorithms in a noisy environment","volume":"2","year":"1994","journal-title":"Evolutionary Computation"},{"key":"key2020092611405847800_ref003","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.eswa.2016.10.015","article-title":"Data mining methods for knowledge discovery in Multi-Objective optimization: Part a \u2013 survey","volume":"70","year":"2017","journal-title":"Expert Systems with Applications"},{"key":"key2020092611405847800_ref004","first-page":"261","article-title":"Particle swarm optimization and sequential sampling in noisy environments","volume-title":"Metaheuristics \u2013 Progress in Complex Systems Optimization","year":"2007"},{"key":"key2020092611405847800_ref04a","first-page":"2183","article-title":"Simulation-based multi-objective bottleneck improvement: towards an automated toolset for industry","volume-title":"Winter Simulation Conference (WSC)","year":"2015"},{"key":"key2020092611405847800_ref005","first-page":"202","article-title":"Sequential sampling in noisy environments","volume-title":"Proceedings of the 8th International Conference on Parallel Problem Solving from Nature, 2004, Birmingham","year":"2004"},{"article-title":"Finding knees in multi-objective optimization","volume-title":"International Conference on Parallel Problem Solving from Nature","year":"2004","key":"key2020092611405847800_ref006"},{"key":"key2020092611405847800_ref007","first-page":"157","article-title":"Consideration of partial user preferences in evolutionary multiobjective optimization","volume-title":"Multiobjective Optimization: Interactive and Evolutionary Approaches","year":"2008"},{"issue":"4","key":"key2020092611405847800_ref008","first-page":"579","article-title":"Efficient simulation budget allocation for selecting an optimal subset","volume":"20","year":"2000","journal-title":"Informs Journal on Computing"},{"issue":"3","key":"key2020092611405847800_ref009","first-page":"251","article-title":"Simulation budget allocation for further enhancing the efficiency of ordinal optimization","volume":"10","year":"2008","journal-title":"Discrete Event Dynamic Systems"},{"volume-title":"Stochastic Simulation Optimization \u2013 An Optimal Computing Budget Allocation","year":"2010","key":"key2020092611405847800_ref010"},{"key":"key2020092611405847800_ref011","first-page":"10","article-title":"Approximating a multi-dimensional pareto front for a land use management problem: a modified MOEA with an epigenetic silencing metaphor","year":"2012","journal-title":"IEEE Congress on Evolutionary Computation, CEC 2012"},{"key":"key2020092611405847800_ref012","first-page":"1475","article-title":"Multi-objective tool sequence and parameter optimization for rough milling applications","year":"2013","journal-title":"IEEE Congress on Evolutionary Computation, CEC 2013"},{"first-page":"181","volume-title":"Proceeding of the Fifteenth Annual Conference Companion on Genetic and Evolutionary Computation Conference Companion \u2013 GECCO","year":"2013","key":"key2020092611405847800_ref013"},{"issue":"2","key":"key2020092611405847800_ref014","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1109\/4235.996017","article-title":"A fast and elitist multiobjective genetic algorithm: NSGA-II","volume":"6","year":"2002","journal-title":"IEEE Transactions on Evolutionary Computation"},{"volume-title":"Multi-Objective Optimization Using Evolutionary Algorithms","year":"2004","key":"key2020092611405847800_ref015"},{"issue":"3","key":"key2020092611405847800_ref016","first-page":"273","article-title":"Reference point based multiobjective optimization using evolutionary algorithms","volume":"2","year":"2006","journal-title":"International Journal of Computational Intelligence Research"},{"issue":"11","key":"key2020092611405847800_ref017","doi-asserted-by":"crossref","first-page":"1175","DOI":"10.1080\/0305215X.2010.548863","article-title":"Understanding knee points in bicriteria problems and their implications as preferred solution principles","volume":"43","year":"2011","journal-title":"Engineering Optimization"},{"key":"key2020092611405847800_ref018","first-page":"416","article-title":"Genetic algorithms for multiobjective optimization: formulation, discussion, and generalization","year":"1993","journal-title":"International Conference on Genetic Algorithms"},{"issue":"1","key":"key2020092611405847800_ref019","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/3468.650319","article-title":"Multiobjective optimization and multiple constraint handling with evolutionary algorithms - Part I: a unified formulation","volume":"28","year":"1998","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans"},{"issue":"6","key":"key2020092611405847800_ref020","doi-asserted-by":"crossref","first-page":"44","DOI":"10.5120\/2584-3570","article-title":"Multi-Objective optimization to workflow grid scheduling using reference point based evolutionary algorithm","volume":"22","year":"2011","journal-title":"International Journal of Computer Applications"},{"issue":"1","key":"key2020092611405847800_ref021","doi-asserted-by":"crossref","first-page":"80","DOI":"10.4018\/jaec.2012010105","article-title":"Reference point based multi-objective optimization to workflow grid scheduling","volume":"3","year":"2012","journal-title":"International Journal of Applied Evolutionary Computation ( Computation)"},{"key":"key2020092611405847800_ref022","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.ins.2015.09.015","article-title":"Preference-guided evolutionary algorithms for many-objective optimization","volume":"329","year":"2016","journal-title":"Information Sciences"},{"key":"key2020092611405847800_ref023","article-title":"Design and analysis of simulation experiments","volume-title":"International Series in Operation Research and Management Science","year":"2015","edition":"2nd edition"},{"key":"key2020092611405847800_ref024","first-page":"552","article-title":"A summary-attainment-surface plotting method for visualizing the performance of stochastic multiobjective optimizers","volume-title":"Proceedings of the 5th International Conference on Intelligent Systems Design and Applications (ISDA), 8-10 September 2005","year":"2005"},{"key":"key2020092611405847800_ref025","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ins.2014.04.023","article-title":"Including preferences into a multiobjective evolutionary algorithm to deal with many-objective engineering optimization problems","volume":"277","year":"2014","journal-title":"Information Sciences"},{"volume-title":"Nonlinear Multiobjective Optimization","year":"1999","key":"key2020092611405847800_ref026"},{"key":"key2020092611405847800_ref027","first-page":"27","article-title":"Introduction to multiobjective optimization: Interactive approaches","volume-title":"Multiobjective Optimization: Interactive and Evolutionary Approaches","year":"2008"},{"key":"key2020092611405847800_ref028","first-page":"61","article-title":"Preference-based multi-objective software modelling","volume-title":"Proceedings of 1st International Workshop on Combining Modelling and Search-Based Software Engineering","year":"2013"},{"key":"key2020092611405847800_ref029","first-page":"147","article-title":"Aspiration level approach to interactive multi-objective programming and its applications","volume-title":"Advances in Multicriteria Analysis","year":"1995"},{"issue":"9","key":"key2020092611405847800_ref030","first-page":"1","article-title":"An evolutionary algorithm in grid scheduling by multiobjective optimization using variants of NSGA","volume":"2","year":"2012","journal-title":"International Journal of Scientific and Research Publications"},{"issue":"2","key":"key2020092611405847800_ref031","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.jmsy.2013.12.007","article-title":"Simulation for manufacturing system design and operation: Literature review and analysis","volume":"33","year":"2014","journal-title":"Journal of Manufacturing Systems"},{"year":"2014","key":"key2020092611405847800_ref034a","article-title":"What does multi-objective optimization have to do with bottleneck improvement of production systems?"},{"issue":"2","key":"key2020092611405847800_ref034","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1080\/00207543.2010.538741","article-title":"A comparative study of production control mechanisms using simulation-based multi-objective optimization","volume":"50","year":"2012","journal-title":"International Journal of Production Research"},{"key":"key2020092611405847800_ref033","first-page":"2","article-title":"Multi-Objective simulation optimization for production systems design using FACTS analyzer","volume-title":"Proceedings of the 2\u2019nd Swedish Production Symposium (SPS\u201908)","year":"2008"},{"key":"key2020092611405847800_ref032","first-page":"1","article-title":"FACTS analyzer: an innovative tool for factory conceptual design using simulation","volume-title":"Proceedings of the 1st Swedish Production Symposium (SPS07)","year":"2007"},{"key":"key2020092611405847800_ref035","first-page":"431","article-title":"Multi-objective production system optimisation including investment and running costs","volume-title":"Evolutionary Multi-Objective Optimization in Product Design and Manufacturing","year":"2011"},{"issue":"4","key":"key2020092611405847800_ref036","doi-asserted-by":"crossref","first-page":"1036","DOI":"10.1016\/j.cie.2013.08.011","article-title":"Industrial cost modelling for multi-objective optimisation of production systems","volume":"66","year":"2013","journal-title":"International Journal of Computer and Industrial Engineering"},{"key":"key2020092611405847800_ref037","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.jmsy.2016.02.001","article-title":"Automatic identification of constraints and improvement actions in production systems using multi-objective optimization and post-optimality analysis","volume":"39","year":"2016","journal-title":"International Journal of Manufacturing Systems"},{"issue":"1","key":"key2020092611405847800_ref038","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.ejor.2006.05.040","article-title":"A simulation optimization method that considers uncertainty and multiple performance measures","volume":"181","year":"2007","journal-title":"European Journal of Operational Research"},{"volume-title":"Toyota Kata: Managing People for Improvement, Adaptiveness and Superior Results","year":"2009","key":"key2020092611405847800_ref039"},{"key":"key2020092611405847800_ref040","first-page":"1826","article-title":"A comparative study of dynamic resampling strategies for guided evolutionary multi-objective optimization","volume-title":"Proceedings of the Congress on Evolutionary Computation","year":"2013"},{"first-page":"366","volume-title":"Proceedings of the 8th International Conference on Evolutionary Multi-Criterion Optimization","year":"2015","key":"key2020092611405847800_ref041"},{"key":"key2020092611405847800_ref042","first-page":"24","article-title":"A ranking and selection strategy for preference-based evolutionary multi-objective optimization of variable-noise problems","volume-title":"IEEE Congress on Evolutionary Computation","year":"2016"},{"year":"2012","key":"key2020092611405847800_ref042a","article-title":"Reference point-based evolutionary multi-objective optimization for industrial systems simulation"},{"first-page":"557","volume-title":"Evolutionary Optimization Algorithms: Biologically Inpsired and Population-Based Approaches to Computer Intelligence","year":"2013","key":"key2020092611405847800_ref043"},{"issue":"3","key":"key2020092611405847800_ref052","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/j.ejor.2009.11.003","article-title":"Evolutionary optimisation of noisy multi-objective problems using confidence-based dynamic resampling","volume":"204","year":"2010","journal-title":"European Journal of Operation Research"},{"issue":"4","key":"key2020092611405847800_ref044","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1007\/s10845-012-0714-x","article-title":"A polar-based guided multi-objective evolutionary algorithm to search for optimal solutions interested by decision-makers in a logistics network design problem","volume":"25","year":"2014","journal-title":"Journal of Intelligent Manufacturing"},{"issue":"1","key":"key2020092611405847800_ref045","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1080\/00207540210161641","article-title":"Practical considerations in the optimization of flow production systems","volume":"41","year":"2003","journal-title":"International Journal of Production Research"},{"issue":"11\/12","key":"key2020092611405847800_ref046","first-page":"1254","article-title":"Key issues and developments in modelling and simulation-based methodologies for manufacturing systems analysis, design and performance evaluation","volume":"25","year":"2005","journal-title":"The International Journal of Advanced Manufacturing Technology"},{"key":"key2020092611405847800_ref047","first-page":"955","article-title":"Reference point-based evolutionary multi-objective optimization for reversible logic circuit synthesis","volume-title":"The 7th International Conference on Biomedical Engineering and Informatics (BME","year":"2014"},{"issue":"4","key":"key2020092611405847800_ref048","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1007\/s10723-015-9344-9","article-title":"Cost-time efficient scheduling plan for executing workflows in the cloud","volume":"13","year":"2015","journal-title":"Journal of Grid Computing"},{"key":"key2020092611405847800_ref049","first-page":"468","article-title":"The use of reference objectives in multiobjective optimization","volume-title":"Multiple Criteria Decision Making Theory and Applications","year":"1980"},{"issue":"5","key":"key2020092611405847800_ref050","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1016\/0270-0255(82)90038-0","article-title":"A mathematical basis for satisficing decision making","volume":"3","year":"1982","journal-title":"Mathematical Modelling"},{"issue":"2","key":"key2020092611405847800_ref051","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/BF01719738","article-title":"On the completeness and constructiveness of parametric characterizations to vector optimization problems","volume":"8","year":"1986","journal-title":"Operations-Research-Spektrum"}],"container-title":["Journal of Systems and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JSIT-10-2017-0084\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JSIT-10-2017-0084\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:24:02Z","timestamp":1753395842000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jsit\/article\/20\/4\/489-512\/247349"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,12]]},"references-count":55,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,11,12]]}},"alternative-id":["10.1108\/JSIT-10-2017-0084"],"URL":"https:\/\/doi.org\/10.1108\/jsit-10-2017-0084","relation":{},"ISSN":["1328-7265"],"issn-type":[{"type":"print","value":"1328-7265"}],"subject":[],"published":{"date-parts":[[2018,11,12]]}}}