{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:48:35Z","timestamp":1760240915368,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2019,10,15]],"date-time":"2019-10-15T00:00:00Z","timestamp":1571097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61702527"],"award-info":[{"award-number":["61702527"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The ranking and selection of simulation optimization is a very powerful tool in systems engineering and operations research. Due to the influence of randomness, the algorithms for ranking and selection need high and uncertain amounts of computing power. Recent advances in cloud computing provide an economical and flexible platform to execute these algorithms. Among all ranking and selection algorithms, the optimal computing budget allocation (OCBA) algorithm is one of the most efficient. However, because of the lack of sufficient samples that can be executed in parallel at each stage, some features of the cloud-computing platform, such as parallelism, scalability, flexibility, and symmetry, cannot be fully utilized. To solve these problems, this paper proposes a distributed asynchronous OCBA (DA-OCBA) algorithm. Under the framework of parallel asynchronous simulation, this algorithm takes advantage of every idle docker container to run better designs in advance that are selected by an asymptotic allocation rule. The experiment demonstrated that the efficiency of simulation optimization for DA-OCBA was clearly higher than that for the traditional OCBA on the cloud platform with symmetric architecture. As the number of containers grew, the speedup of DA-OCBA was linearly increasing for simulation optimization.<\/jats:p>","DOI":"10.3390\/sym11101297","type":"journal-article","created":{"date-parts":[[2019,10,16]],"date-time":"2019-10-16T03:32:54Z","timestamp":1571196774000},"page":"1297","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["DA-OCBA: Distributed Asynchronous Optimal Computing Budget Allocation Algorithm of Simulation Optimization Using Cloud Computing"],"prefix":"10.3390","volume":"11","author":[{"given":"Yukai","family":"Wang","sequence":"first","affiliation":[{"name":"College of Computer, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenjie","family":"Tang","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiping","family":"Yao","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feng","family":"Zhu","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gosavi, A. (2015). Simulation-Based Optimization, Springer.","DOI":"10.1007\/978-1-4899-7491-4"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fu, M.C. (2015). Handbook of Simulation Optimization, Springer.","DOI":"10.1007\/978-1-4939-1384-8"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s10479-015-2019-x","article-title":"Simulation optimization: A review of algorithms and applications","volume":"240","author":"Amaran","year":"2016","journal-title":"Ann. Oper. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3593","DOI":"10.1109\/TAC.2016.2522094","article-title":"Balancing search and estimation in random search based stochastic simulation optimization","volume":"61","author":"Zhu","year":"2016","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kleijnen, J.P. (2015). Design and analysis of simulation experiments. International Workshop on Simulation, Springer.","DOI":"10.1007\/978-3-319-18087-8"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Peng, Y., Chen, C.H., Chong, E.K., and Fu, M.C. (2018, January 9\u201312). A review of static and dynamic optimization for ranking and selection. Proceedings of the 2018 Winter Simulation Conference (WSC), Gothenburg, Sweden.","DOI":"10.1109\/WSC.2018.8632510"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Akl, A.M., Sarker, R.A., and Essam, D.L. (2017, January 8\u201311). Simulation optimization approach for solving stochastic programming. Proceedings of the 2017 2nd IEEE International Conference on Computational Intelligence and Applications (ICCIA), Beijing, China.","DOI":"10.1109\/CIAPP.2017.8167200"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.automatica.2017.03.019","article-title":"Robust ranking and selection with optimal computing budget allocation","volume":"81","author":"Gao","year":"2017","journal-title":"Automatica"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chen, C.h., and Lee, L.H. (2011). Stochastic Simulation Optimization: An Optimal Computing Budget Allocation, World Scientific.","DOI":"10.1142\/7437"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1080\/07408170903116360","article-title":"Optimal budget allocation for discrete-event simulation experiments","volume":"42","author":"Chen","year":"2009","journal-title":"IIE Trans."},{"key":"ref_11","unstructured":"Jian, N., and Henderson, S.G. (2015, January 6\u20139). An introduction to simulation optimization. Proceedings of the 2015 Winter Simulation Conference (WSC), Huntington Beach, CA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.simpat.2016.05.004","article-title":"On the optimal computing budget allocation problem for large scale simulation optimization","volume":"71","author":"Almomani","year":"2017","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_13","unstructured":"Marinescu, D.C. (2017). Cloud Computing: Theory and Practice, Morgan Kaufmann."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chung, M.T., Quang-Hung, N., Nguyen, M.T., and Thoai, N. (2016, January 27\u201329). Using docker in high performance computing applications. Proceedings of the 2016 IEEE Sixth International Conference on Communications and Electronics (ICCE), Ha Long, Vietnam.","DOI":"10.1109\/CCE.2016.7562612"},{"key":"ref_15","unstructured":"DeHaan, M.P., Henson, S.J., and Eckersberg, I.J.J. (2015). Flexible Cloud Management with Power Management Support. (9,104,407), U.S. Patent."},{"key":"ref_16","first-page":"19","article-title":"A review of optimal computing budget allocation algorithms for simulation optimization problem","volume":"7","author":"Lee","year":"2010","journal-title":"Int. J. Oper. Res."},{"key":"ref_17","unstructured":"Fu, M.C., Glover, F.W., and April, J. (2005, January 4\u20137). Simulation optimization: A review, new developments, and applications. Proceedings of the Winter Simulation Conference, Orlando, FL, USA."},{"key":"ref_18","first-page":"28","article-title":"Allocation of observations in ranking and selection with unequal variances","volume":"37","author":"Dudewicz","year":"1975","journal-title":"Optim. Methods Stat."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1080\/03610927808827671","article-title":"On two-stage selection procedures and related probability-inequalities","volume":"7","author":"Rinott","year":"1978","journal-title":"Commun. Stat."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1287\/opre.49.6.950.10019","article-title":"Simple procedures for selecting the best simulated system when the number of alternatives is large","volume":"49","author":"Nelson","year":"2001","journal-title":"Oper. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1145\/502109.502111","article-title":"A fully sequential procedure for indifference-zone selection in simulation","volume":"11","author":"Kim","year":"2001","journal-title":"ACM Trans. Model. Comput. Simul. (TOMACS)"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Goldsman, D., Nelson, B.L., and Banks, J. (1998). Comparing systems via simulation. Handbook of Simulation: Principles, Methodology, Advances, Applications, and Practice, John Wiley & Sons.","DOI":"10.1002\/9780470172445.ch8"},{"key":"ref_23","unstructured":"Law, A.M., Kelton, W.D., and Kelton, W.D. (2000). Simulation Modeling and Analysis, McGraw-Hill."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kim, S.H., and Nelson, B. (2006). Selecting the best system: Simulation. Elsevier Handbooks in Operations Research and Management Science: Simulation, Elsevier.","DOI":"10.1016\/S0927-0507(06)13017-0"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1023\/A:1008349927281","article-title":"Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization","volume":"10","author":"Chen","year":"2000","journal-title":"Discret. Event Dyn. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/S1569-190X(02)00095-3","article-title":"Optimal computing budget allocation for Monte Carlo simulation with application to product design","volume":"11","author":"Chen","year":"2003","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1109\/JLT.2010.2047712","article-title":"Ultra-High Data-Rate 60 GHz Radio-over-Fiber Systems Employing Optical Frequency Multiplication and Adaptive OFDM Formats","volume":"28","author":"Lin","year":"2010","journal-title":"J. Lightwave Technol."},{"key":"ref_28","unstructured":"Glynn, P., and Juneja, S. (2004, January 5\u20138). A large deviations perspective on ordinal optimization. Proceedings of the 36th Conference on Winter Simulation, Washington, DC, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bogon, T., Timm, I.J., Jessen, U., and Schmitz, M. (2012, January 9\u201312). Towards assisted input and output data analysis in manufacturing simulation: The EDASim approach. Proceedings of the Winter Simulation Conference, Berlin, Germany.","DOI":"10.1109\/WSC.2012.6465114"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Laporte, G.J., Branke, J., and Chen, C.H. (2012, January 9\u201312). Optimal computing budget allocation for small computing budgets. Proceedings of the 2012 Winter Simulation Conference (WSC), Berlin, Germany.","DOI":"10.1109\/WSC.2012.6465085"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2005","DOI":"10.1109\/TAC.2006.884993","article-title":"Efficient dynamic simulation allocation in ordinal optimization","volume":"51","author":"Chen","year":"2006","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1287\/opre.2016.1577","article-title":"Efficient Ranking and Selection in Parallel Computing Environments","volume":"65","author":"Ni","year":"2016","journal-title":"Oper. Res."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Radu, L.D. (2017). Green cloud computing: A literature survey. Symmetry, 9.","DOI":"10.3390\/sym9120295"},{"key":"ref_34","first-page":"501","article-title":"Selecting the best system","volume":"13","author":"Kim","year":"2006","journal-title":"Handb. Oper. Res. Manag. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Luo, J., and Hong, L.J. (2011, January 11\u201314). Large-scale ranking and selection using cloud computing. Proceedings of the 2011 Winter Simulation Conference (WSC), Phoenix, AZ, USA.","DOI":"10.1109\/WSC.2011.6148094"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1550019","DOI":"10.1142\/S0217595915500190","article-title":"Simulation optimization: A review and exploration in the new era of cloud computing and big data","volume":"32","author":"Xu","year":"2015","journal-title":"Asia-Pac. J. Oper. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1057\/jos.2015.22","article-title":"\u2018Some tactical problems in digital simulation\u2019for the next 10 years","volume":"10","author":"Nelson","year":"2016","journal-title":"J. Simul."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1287\/mnsc.47.8.1133.10229","article-title":"New procedures to select the best simulated system using common random numbers","volume":"47","author":"Chick","year":"2001","journal-title":"Manag. Sci."},{"key":"ref_39","unstructured":"Law, A.M., and Kelton, W.D. (2009). Simulation Modeling and Analysis, McGraw-Hill."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2940","DOI":"10.1109\/TAC.2012.2195931","article-title":"Approximate Simulation Budget Allocation for Selecting the Best Design in the Presence of Stochastic Constraints","volume":"57","author":"Lee","year":"2012","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chen, C.H., Chen, H.C., and Dai, L. (1996, January 8\u201311). A gradient approach for smartly allocating computing budget for discrete event simulation. Proceedings of the 28th Conference on Winter Simulation, Coronado, CA, USA.","DOI":"10.1145\/256562.256696"},{"key":"ref_42","unstructured":"Inoue, K., and Chick, S.E. (1998, January 13\u201316). Comparison of Bayesian and frequentist assessments of uncertainty for selecting the best system. Proceedings of the 1998 Winter Simulation Conference, Washington, DC, USA."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.sysarc.2016.12.007","article-title":"State machine replication in containers managed by Kubernetes","volume":"73","author":"Netto","year":"2017","journal-title":"J. Syst. Archit."},{"key":"ref_44","unstructured":"Chen, H.C., Chen, C.H., Lin, J., and Yucesan, E. (1999, January 5\u20138). An asymptotic allocation for simultaneous simulation experiments. Proceedings of the Conference on Winter Simulation: Simulation-a Bridge to the Future, Phoenix, AZ, USA."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Nakayama, M.K. (1995, January 3\u20136). Selecting the best system in steady-state simulations using batch means. Proceedings of the 27th Conference on Winter Simulation, Arlington, VA, USA.","DOI":"10.1145\/224401.224637"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1080\/03610918508812467","article-title":"A procedure for selecting a subset of size m containing the l best of k independent normal populations, with applications to simulation","volume":"14","author":"Koenig","year":"1985","journal-title":"Commun. Stat. -Simul. Comput."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Boru, A., Dosdo\u011fru, A.T., G\u00f6\u00e7ken, M., and Erol, R. (2019). A Novel Hybrid Artificial Intelligence Based Methodology for the Inventory Routing Problem. Symmetry, 11.","DOI":"10.3390\/sym11050717"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/10\/1297\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:26:26Z","timestamp":1760189186000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/10\/1297"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,15]]},"references-count":47,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["sym11101297"],"URL":"https:\/\/doi.org\/10.3390\/sym11101297","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2019,10,15]]}}}