{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T22:09:03Z","timestamp":1740175743508,"version":"3.37.3"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T00:00:00Z","timestamp":1680480000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T00:00:00Z","timestamp":1680480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61903368","61906207"],"award-info":[{"award-number":["61903368","61906207"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Predicting the computing resources required by simulation applications can provide a more reasonable resource-allocation scheme for efficient execution. Existing prediction methods based on machine learning, such as classification\/regression, typically must accurately predict the runtime of simulation applications and select the optimal computing resource allocation scheme by sorting the length of the simulation runtime. However, the ranking results are easily affected by the simulation runtime prediction accuracy. This study proposes a time-sensitive learning-to-rank (LTR) approach for cloud simulations resource prediction. First, we use the Shapley additive explanation (SHAP) value from the field of explainable artificial intelligence (XAI) to analyze the impact of relevant factors on the simulation runtime and to extract the feature dimensions that significantly affect the simulation runtime. Second, by modifying the target loss function of the rankboost algorithm and training a time-sensitive LTR model based on simulation features, we can accurately predict the computing resource allocation scheme that maximizes the execution efficiency of simulation applications. Compared with the traditional machine learning prediction algorithm, the proposed method can improve the average sorting performance by 3%\u201348% and can accurately predict the computing resources required for the simulation applications to execute in the shortest amount of time.<\/jats:p>","DOI":"10.1007\/s40747-023-01045-z","type":"journal-article","created":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T10:11:46Z","timestamp":1680516706000},"page":"5731-5744","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A time-sensitive learning-to-rank approach for cloud simulation resource prediction"],"prefix":"10.1007","volume":"9","author":[{"given":"Yuhao","family":"Xiao","sequence":"first","affiliation":[]},{"given":"Yiping","family":"Yao","sequence":"additional","affiliation":[]},{"given":"Kai","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Wenjie","family":"Tang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0263-6806","authenticated-orcid":false,"given":"Feng","family":"Zhu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,3]]},"reference":[{"issue":"3","key":"1045_CR1","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1057\/s41273-017-0057-x","volume":"11","author":"Y-P Yao","year":"2017","unstructured":"Yao Y-P, Meng D, Zhu F, Yan L-B, Qu Q-J, Lin Z-W, Ma H-B (2017) Three-level-parallelization support framework for large-scale analytic simulation. J Simul 11(3):194\u2013207. https:\/\/doi.org\/10.1057\/s41273-017-0057-x","journal-title":"J Simul"},{"key":"1045_CR2","first-page":"1","volume":"3","author":"RM Fujimoto","year":"2010","unstructured":"Fujimoto RM, Malik AW, Park A et al (2010) Parallel and distributed simulation in the cloud. SCS M &S Magaz 3:1\u201310","journal-title":"SCS M &S Magaz"},{"key":"1045_CR3","doi-asserted-by":"publisher","DOI":"10.1145\/2866577","author":"RM Fujimoto","year":"2016","unstructured":"Fujimoto RM (2016) Research challenges in parallel and distributed simulation. ACM Trans Model Comput Simul. https:\/\/doi.org\/10.1145\/2866577","journal-title":"ACM Trans Model Comput Simul"},{"key":"1045_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2022.103419","volume":"205","author":"D Soni","year":"2022","unstructured":"Soni D, Kumar N (2022) Machine learning techniques in emerging cloud computing integrated paradigms: A survey and taxonomy. J Network Comput Appl 205:103419. https:\/\/doi.org\/10.1016\/j.jnca.2022.103419","journal-title":"J Network Comput Appl"},{"key":"1045_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2022.102595","volume":"119","author":"Y Xiao","year":"2022","unstructured":"Xiao Y, Yao Y, Chen K, Tang W, Zhu F (2022) A simulation task partition method based on cloud computing resource prediction using ensemble learning. Simul Model Pract Theory 119:102595. https:\/\/doi.org\/10.1016\/j.simpat.2022.102595","journal-title":"Simul Model Pract Theory"},{"issue":"3","key":"1045_CR6","doi-asserted-by":"publisher","first-page":"1848","DOI":"10.1109\/TCC.2020.2998017","volume":"10","author":"IK Kim","year":"2022","unstructured":"Kim IK, Wang W, Qi Y, Humphrey M (2022) Forecasting cloud application workloads with cloudinsight for predictive resource management. IEEE Trans Cloud Comput 10(3):1848\u20131863. https:\/\/doi.org\/10.1109\/TCC.2020.2998017","journal-title":"IEEE Trans Cloud Comput"},{"key":"1045_CR7","doi-asserted-by":"publisher","unstructured":"Chen Z, Zhu Y, Di Y, Feng S (2015) Self-adaptive prediction of cloud resource demands using ensemble model and subtractive-fuzzy clustering based fuzzy neural network. Intell Neurosci 2015. https:\/\/doi.org\/10.1155\/2015\/919805","DOI":"10.1155\/2015\/919805"},{"issue":"5","key":"1045_CR8","doi-asserted-by":"publisher","first-page":"981","DOI":"10.6688\/JISE.202009_36(5).0003","volume":"36","author":"J Kumar","year":"2020","unstructured":"Kumar J, Singh AK (2020) Adaptive learning based prediction framework for cloud datacenter networks\u2019 workload anticipation. J Inform Sci Eng 36(5):981\u2013992. https:\/\/doi.org\/10.6688\/JISE.202009_36(5).0003","journal-title":"J Inform Sci Eng"},{"key":"1045_CR9","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.comcom.2019.12.028","volume":"151","author":"HA Kholidy","year":"2020","unstructured":"Kholidy HA (2020) An intelligent swarm based prediction approach for predicting cloud computing user resource needs. Comput Commun 151:133\u2013144. https:\/\/doi.org\/10.1016\/j.comcom.2019.12.028","journal-title":"Comput Commun"},{"key":"1045_CR10","first-page":"13130","volume":"34","author":"P Zhuang","year":"2020","unstructured":"Zhuang P, Wan Y, Qiao Y (2020) Learning attentive pairwise interaction for fine-grained classification. AAAI Confer Artif Intell 34:13130\u201313137","journal-title":"AAAI Confer Artif Intell"},{"key":"1045_CR11","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.simpat.2013.02.002","volume":"34","author":"K Vanmechelen","year":"2013","unstructured":"Vanmechelen K, De Munck S, Broeckhove J (2013) Conservative distributed discrete-event simulation on the amazon ec2 cloud: An evaluation of time synchronization protocol performance and cost efficiency. Simul Model Pract Theory 34:126\u2013143. https:\/\/doi.org\/10.1016\/j.simpat.2013.02.002","journal-title":"Simul Model Pract Theory"},{"issue":"3","key":"1045_CR12","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.future.2010.09.004","volume":"27","author":"S Seneviratne","year":"2011","unstructured":"Seneviratne S, Levy DC (2011) Task profiling model for load profile prediction. Future Gener Comput Syst Int J Sci 27(3):245\u2013255. https:\/\/doi.org\/10.1016\/j.future.2010.09.004","journal-title":"Future Gener Comput Syst Int J Sci"},{"key":"1045_CR13","unstructured":"Lee B, Schopf J (2003) Run-time prediction of parallel applications on shared environments. In: IEEE International Conference on Cluster Computing, proceedings, pp. 487\u2013491"},{"key":"1045_CR14","doi-asserted-by":"publisher","unstructured":"Angiulli F, Fassetti F (2013) Nearest neighbor-based classification of uncertain data. ACM TRANS Knowledge Discovery Data. https:\/\/doi.org\/10.1145\/2435209.2435210","DOI":"10.1145\/2435209.2435210"},{"key":"1045_CR15","doi-asserted-by":"crossref","unstructured":"Miu T, Missier P (2012) Predicting the execution time of workflow activities based on their input features, pp. 64\u201372","DOI":"10.1109\/SC.Companion.2012.21"},{"key":"1045_CR16","doi-asserted-by":"crossref","unstructured":"Matsunaga A, Fortes JA (2010) On the use of machine learning to predict the time and resources consumed by applications. In: 2010 10th IEEE\/ACM International Conference on Cluster, Cloud and Grid Computing, pp. 495\u2013504","DOI":"10.1109\/CCGRID.2010.98"},{"key":"1045_CR17","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.jnca.2016.03.002","volume":"65","author":"GK Shyam","year":"2016","unstructured":"Shyam GK, Manvi SS (2016) Virtual resource prediction in cloud environment: a bayesian approach. J Network Comput Appl 65:144\u2013154. https:\/\/doi.org\/10.1016\/j.jnca.2016.03.002","journal-title":"J Network Comput Appl"},{"key":"1045_CR18","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-021-03496-z","author":"A Ullah","year":"2021","unstructured":"Ullah A, Nawi NM (2021) An improved in tasks allocation system for virtual machines in cloud computing using hbac algorithm. J Ambient Intell Hum Comput. https:\/\/doi.org\/10.1007\/s12652-021-03496-z","journal-title":"J Ambient Intell Hum Comput"},{"key":"1045_CR19","doi-asserted-by":"publisher","DOI":"10.3390\/app12042160","author":"S Malik","year":"2022","unstructured":"Malik S, Tahir M, Sardaraz M, Alourani A (2022) A resource utilization prediction model for cloud data centers using evolutionary algorithms and machine learning techniques. Appl Sci-Basel. https:\/\/doi.org\/10.3390\/app12042160","journal-title":"Appl Sci-Basel"},{"issue":"4","key":"1045_CR20","doi-asserted-by":"publisher","first-page":"396","DOI":"10.1177\/1063293X211032622","volume":"29","author":"K Valarmathi","year":"2021","unstructured":"Valarmathi K, Raja SKS (2021) Resource utilization prediction technique in cloud using knowledge based ensemble random forest with lstm model. Concurr Eng-Res Appl 29(4):396\u2013404. https:\/\/doi.org\/10.1177\/1063293X211032622","journal-title":"Concurr Eng-Res Appl"},{"key":"1045_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2020.102202","author":"S Wang","year":"2021","unstructured":"Wang S, Zhu F, Yao Y, Tang W, Xiao Y, Xiong S (2021) A computing resources prediction approach based on ensemble learning for complex system simulation in cloud environment. Simul Model Pract Theory. https:\/\/doi.org\/10.1016\/j.simpat.2020.102202","journal-title":"Simul Model Pract Theory"},{"issue":"4","key":"1045_CR22","doi-asserted-by":"publisher","first-page":"944","DOI":"10.1109\/TSC.2018.2804916","volume":"14","author":"B Xia","year":"2021","unstructured":"Xia B, Li T, Zhou Q, Li Q, Zhang H (2021) An effective classification-based framework for predicting cloud capacity demand in cloud services. IEEE Trans Serv Comput 14(4):944\u2013956. https:\/\/doi.org\/10.1109\/TSC.2018.2804916","journal-title":"IEEE Trans Serv Comput"},{"key":"1045_CR23","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-021-09561-3","author":"P Nawrocki","year":"2021","unstructured":"Nawrocki P, Osypanka P (2021) Cloud resource demand prediction using machine learning in the context of qos parameters. J Grid Comput. https:\/\/doi.org\/10.1007\/s10723-021-09561-3","journal-title":"J Grid Comput"},{"issue":"12","key":"1045_CR24","doi-asserted-by":"publisher","first-page":"3886","DOI":"10.1109\/TPDS.2022.3172493","volume":"33","author":"H Shen","year":"2022","unstructured":"Shen H, Chen L (2022) A resource-efficient predictive resource provisioning system in cloud systems. IEEE Trans Paral Distrib Syst 33(12):3886\u20133900. https:\/\/doi.org\/10.1109\/TPDS.2022.3172493","journal-title":"IEEE Trans Paral Distrib Syst"},{"issue":"13","key":"1045_CR25","doi-asserted-by":"publisher","first-page":"10211","DOI":"10.1007\/s00521-021-06665-5","volume":"34","author":"MS Al-Asaly","year":"2022","unstructured":"Al-Asaly MS, Bencherif MA, Alsanad A, Hassan MM (2022) A deep learning-based resource usage prediction model for resource provisioning in an autonomic cloud computing environment. Neural Comput Appl 34(13):10211\u201310228. https:\/\/doi.org\/10.1007\/s00521-021-06665-5","journal-title":"Neural Comput Appl"},{"key":"1045_CR26","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.neucom.2020.11.011","volume":"424","author":"J Bi","year":"2021","unstructured":"Bi J, Li S, Yuan H, Zhou M (2021) Integrated deep learning method for workload and resource prediction cloud systems. NEurocomputing 424:35\u201348. https:\/\/doi.org\/10.1016\/j.neucom.2020.11.011","journal-title":"NEurocomputing"},{"issue":"1","key":"1045_CR27","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1109\/TR.2019.2931559","volume":"69","author":"X Yu","year":"2020","unstructured":"Yu X, Liu J, Keung JW, Li Q, Bennin KE, Xu Z, Wang J, Cui X (2020) Improving ranking-oriented defect prediction using a cost-sensitive ranking svm. IEEE Trans Reliab 69(1):139\u2013153. https:\/\/doi.org\/10.1109\/TR.2019.2931559","journal-title":"IEEE Trans Reliab"},{"key":"1045_CR28","doi-asserted-by":"crossref","unstructured":"Joachims T (2002) Optimizing search engines using clickthrough data. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 133\u2013142","DOI":"10.1145\/775047.775067"},{"issue":"6","key":"1045_CR29","doi-asserted-by":"publisher","first-page":"933","DOI":"10.1162\/1532443041827916","volume":"4","author":"Y Freund","year":"2004","unstructured":"Freund Y, Iyer R, Schapire R, Singer Y (2004) An efficient boosting algorithm for combining preferences. J Machin Learn Res 4(6):933\u2013969. https:\/\/doi.org\/10.1162\/1532443041827916","journal-title":"J Machin Learn Res"},{"key":"1045_CR30","first-page":"2193","volume":"10","author":"C Rudin","year":"2009","unstructured":"Rudin C, Schapire RE (2009) Margin-based ranking and an equivalence between adaboost and rankboost. J Machin Learn Res 10:2193\u20132232","journal-title":"J Machin Learn Res"},{"key":"1045_CR31","doi-asserted-by":"crossref","unstructured":"Ganjisaffar Y, Caruana R, Lopes CV (2011) Bagging gradient-boosted trees for high precision, low variance ranking models. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 85\u201394","DOI":"10.1145\/2009916.2009932"},{"key":"1045_CR32","doi-asserted-by":"crossref","unstructured":"Nguyen TT, An TQ, Hai VT, Phuong TM (2014) Similarity-based and rank-based defect prediction. In: 2014 International Conference on Advanced Technologies for Communications (ATC 2014), pp. 321\u201332","DOI":"10.1109\/ATC.2014.7043405"},{"issue":"1","key":"1045_CR33","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1109\/TR.2014.2370891","volume":"64","author":"X Yang","year":"2015","unstructured":"Yang X, Tang K, Yao X (2015) A learning-to-rank approach to software defect prediction. IEEE Trans Reliabil 64(1):234\u2013246. https:\/\/doi.org\/10.1109\/TR.2014.2370891","journal-title":"IEEE Trans Reliabil"},{"key":"1045_CR34","unstructured":"Burges C, Svore K, Bennett P, Pastusiak A, Wu Q (2011) Learning to rank using an ensemble of lambda-gradient models. In: Proceedings of the Learning to Rank Challenge, pp. 25\u201335"},{"issue":"1","key":"1045_CR35","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","volume":"55","author":"Y Freund","year":"1997","unstructured":"Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119\u2013139. https:\/\/doi.org\/10.1006\/jcss.1997.1504","journal-title":"J Comput Syst Sci"},{"key":"1045_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.simpat.2019.01.003","volume":"93","author":"HD Karatza","year":"2019","unstructured":"Karatza HD, Stavrinides GL (2019) Modeling and simulation of cloud computing and big data. Simul Model Pract Theory 93:1\u20132. https:\/\/doi.org\/10.1016\/j.simpat.2019.01.003","journal-title":"Simul Model Pract Theory"},{"key":"1045_CR37","doi-asserted-by":"publisher","DOI":"10.1145\/2746232","author":"SB Yoginath","year":"2015","unstructured":"Yoginath SB, Perumalla KS (2015) Efficient parallel discrete event simulation on cloud\/virtual machine platforms. ACM Trans Model Comput Simul. https:\/\/doi.org\/10.1145\/2746232","journal-title":"ACM Trans Model Comput Simul"},{"key":"1045_CR38","doi-asserted-by":"publisher","unstructured":"Baptista ML, Goebel K, Henriques EMP (2022) Relation between prognostics predictor evaluation metrics and local interpretability shap values. Artif Intel 306:103667. https:\/\/doi.org\/10.1016\/j.artint.2022.103667","DOI":"10.1016\/j.artint.2022.103667"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01045-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01045-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01045-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T17:24:40Z","timestamp":1695403480000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01045-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,3]]},"references-count":38,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["1045"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01045-z","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2023,4,3]]},"assertion":[{"value":"7 October 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"we declare that we have no known competing financial interests or personal relationships or organizations that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}