{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:22:11Z","timestamp":1760239331770,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,11,4]],"date-time":"2020-11-04T00:00:00Z","timestamp":1604448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61903368"],"award-info":[{"award-number":["61903368"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Accurate memory resource prediction can achieve optimal performance for complex system simulation (CSS) using optimistic parallel execution in the cloud computing environment. However, because of the varying memory resource demands of CSS applications caused by the simulation entity scale and frequent optimistic synchronization, the existing approaches are unable to predict the memory resource required by a CSS application accurately, which cannot take full advantage of the elasticity and symmetry of cloud computing. In this paper, a probabilistic prediction approach based on ensemble learning, which regards the entity scale and frequent optimistic synchronization as the important features, is proposed. The approach using stacking strategy consists of a two-layer architecture. The first-layer architecture includes two kinds of base models, namely, back-propagation neural network (BPNN) and random forest (RF). The root mean squared error-based pruning algorithm is designed to choose the optimal subset of the base models. The second-layer is the Gaussian process regression (GPR) model, which is applied to quantify the uncertainty information in the probabilistic prediction for memory resources. A series of experiments are presented to prove that the proposed approach can achieve higher accuracy and performance compared to RF, BPNN, GPR, Bagging ensemble approach, and Regressive Ensemble Approach for Prediction.<\/jats:p>","DOI":"10.3390\/sym12111826","type":"journal-article","created":{"date-parts":[[2020,11,5]],"date-time":"2020-11-05T00:00:37Z","timestamp":1604534437000},"page":"1826","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Probabilistic Prediction Approach for Memory Resource of Complex System Simulation in Cloud Computing Environment"],"prefix":"10.3390","volume":"12","author":[{"given":"Shuai","family":"Wang","sequence":"first","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiping","family":"Yao","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feng","family":"Zhu","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenjie","family":"Tang","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuhao","family":"Xiao","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Jiang, Z., Zhao, T., Wang, S., and Ren, F. (2020). A Novel Risk Assessment and Analysis Method for Correlation in a Complex System Based on Multi-Dimensional Theory. Appl. Sci., 10.","DOI":"10.3390\/app10093007"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2866577","article-title":"Research Challenges in Parallel and Distributed Simulation","volume":"26","author":"Fujimoto","year":"2016","journal-title":"ACM Trans. Modeling Comput. Simul."},{"key":"ref_3","first-page":"1","article-title":"Parallel and distributed simulation in the cloud","volume":"3","author":"Fujimoto","year":"2010","journal-title":"SCS M S Mag."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, Y., Tang, W., Yao, Y., and Zhu, F. (2019). DA-OCBA: Distributed Asynchronous Optimal Computing Budget Allocation Algorithm of Simulation Optimization Using Cloud Computing. Symmetry, 11.","DOI":"10.3390\/sym11101297"},{"key":"ref_5","unstructured":"Shuai, W., Feng, Z., Yiping, Y., Wenjie, T., Yuhao, X., and Siqi, X. (2020). A Computing Resources Prediction Approach Based on Ensemble Learning for Complex System Simulation in Cloud Environment. Simul. Model. Pract. Theory."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"102067","DOI":"10.1016\/j.simpat.2020.102067","article-title":"An Efficient Multi-threaded Memory Allocator for PDES Applications","volume":"100","author":"Tianlin","year":"2020","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1318","DOI":"10.1016\/j.simpat.2011.01.008","article-title":"Balancing the performance of block multithreaded distributed-memory systems","volume":"19","author":"Zuberek","year":"2011","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Malik, A., Park, A., and Fujimoto, R.M. (2009, January 21\u201325). Optimistic synchronization of parallel simulations in cloud computing environments. Proceedings of the IEEE International Conference on Cloud Computing, Bangalore, India.","DOI":"10.1109\/CLOUD.2009.79"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"283","DOI":"10.3233\/MGS-180292","article-title":"Prediction methods for effective resource provisioning in cloud computing: A survey","volume":"14","author":"Kumar","year":"2018","journal-title":"Multiagent Grid Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.jnca.2017.01.016","article-title":"Survey on prediction models of applications for resources provisioning in cloud","volume":"82","author":"Amiri","year":"2017","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/s12293-019-00284-3","article-title":"An Intelligent Scheduling Algorithm for Complex Manufacturing System Simulation with Frequent Synchronizations in Clouds","volume":"11","author":"Feng","year":"2019","journal-title":"Memetic Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.simpat.2018.09.019","article-title":"An energy efficient anti-correlated virtual machine placement algorithm using resource usage predictions","volume":"93","author":"Shaw","year":"2019","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.cam.2019.112665","article-title":"Gaussian process regression with skewed errors","volume":"370","author":"Alodat","year":"2020","journal-title":"J. Comput. Appl. Math."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/S0022-1694(02)00106-3","article-title":"Bayesian system for probabilistic river stage forecasting","volume":"268","author":"Roman","year":"2002","journal-title":"J. Hydrol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jiao, A., Zhang, G., Liu, B., and Liu, W. (2020). Prediction of Manufacturing Quality of Holes Based on a BP Neural Network. Appl. Sci., 10.","DOI":"10.3390\/app10062108"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Al-Rawahi, M., Edirisinghe, A., and Jeyarajan, T. (2016, January 18\u201321). Machine Learning-Based Framework for Resource Management and Modelling for Video Analytic in Cloud-Based Hadoop Environment. Proceedings of the 2016 Intl IEEE Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress, Toulouse, France.","DOI":"10.1109\/UIC-ATC-ScalCom-CBDCom-IoP-SmartWorld.2016.0128"},{"key":"ref_18","first-page":"441","article-title":"Hadoop Performance Modeling for Job Estimation and Resource Provisioning","volume":"99","author":"Mukhtaj","year":"2015","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jpdc.2018.08.008","article-title":"An intelligent regressive ensemble approach for predicting resource usage in cloud computing","volume":"123","author":"Gurleen","year":"2019","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ganapathi, A., Chen, Y., Fox, A., Katz, R., and Patterson, D. (2010, January 1\u20136). Statistics-driven workload modeling for the Cloud. Proceedings of the 26th International Conference on Data Engineering, Long Beach, CA, USA.","DOI":"10.1109\/ICDEW.2010.5452742"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.jnca.2016.03.002","article-title":"Virtual Resource Prediction in Cloud Environment: A Bayesian Approach","volume":"65","author":"Gopal","year":"2016","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.comcom.2019.12.028","article-title":"An Intelligent Swarm Based Prediction Approach For Predicting Cloud Computing User Resource Needs","volume":"151","author":"Hisham","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_23","unstructured":"Mehiar, D., Bechir, H., Mohsen, G., and Ammar, R. (May, January 26). Efficient Datacenter Resource Utilization Through Cloud Resource Overcommitment. Proceedings of the 2015 IEEE INFOCOM Workshop on Mobile Cloud and Virtualization, Hong Kong, China."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.future.2017.09.049","article-title":"A learning automata-based ensemble resource usage prediction algorithm for cloud computing environment","volume":"79","author":"Ali","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.future.2017.02.022","article-title":"An autonomic resource provisioning approach for service-based cloud applications: A hybrid approach","volume":"78","author":"Mostafa","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.knosys.2019.04.008","article-title":"ANID-SEoKELM: Adaptive network intrusion detection based on selective ensemble of kernel ELMs with random features","volume":"177","author":"Jinping","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"103411","DOI":"10.1016\/j.jbi.2020.103411","article-title":"Deep ensemble learning for Alzheimer\u2019s disease classification","volume":"105","author":"Ning","year":"2020","journal-title":"J. Biomed. Inform."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"106729","DOI":"10.1016\/j.compeleceng.2020.106729","article-title":"Improving malware detection using big data and ensemble learning","volume":"86","author":"Deepak","year":"2020","journal-title":"Comput. Electr. Eng."},{"key":"ref_29","unstructured":"Tiago, P., Isabel, P., Zita, V., and Jose, S. (2020). Ensemble learning for electricity consumption forecasting in office buildings. Neurocomputing, in press."},{"key":"ref_30","unstructured":"Robert, H.N. (2002, January 12\u201317). Theory of the Backpropagation Neural Network. Proceedings of the International Joint Conference on Neural Networks, Honolulu, HI, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Liu, Y., Li, M., Su, P., Ma, B., and You, Z. (2020). Porosity Prediction of Granular Materials through Discrete Element Method and Back Propagation Neural Network Algorithm. Appl. Sci., 10.","DOI":"10.3390\/app10051693"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.cherd.2020.02.033","article-title":"Gaussian process regression with heteroscedastic noises\u2014A machine-learning predictive variance approach","volume":"157","author":"Zhenxing","year":"2020","journal-title":"Chem. Eng. Res. Des."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2746232","article-title":"Efficient Parallel Discrete Event Simulation on Cloud\/Virtual Machine Platforms","volume":"26","author":"Srikanth","year":"2015","journal-title":"ACM Trans. Modeling Comput. Simul."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1016\/j.patcog.2014.12.003","article-title":"META-DES: A dynamic ensemble selection framework using meta-learning","volume":"48","author":"Rafael","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.simpat.2017.05.010","article-title":"A hierarchical composite framework of parallel discrete event simulation for modelling complex adaptive systems","volume":"77","author":"Feng","year":"2017","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1177\/0037549713495752","article-title":"Modeling and simulation of large-scale social networks using parallel discrete event simulation","volume":"89","author":"Bonan","year":"2013","journal-title":"Simul. Trans. Soc. Modeling Simul. Int."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/11\/1826\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:29:00Z","timestamp":1760178540000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/11\/1826"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,4]]},"references-count":36,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["sym12111826"],"URL":"https:\/\/doi.org\/10.3390\/sym12111826","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,11,4]]}}}