{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T16:02:28Z","timestamp":1778083348567,"version":"3.51.4"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T00:00:00Z","timestamp":1713830400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T00:00:00Z","timestamp":1713830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004569","name":"Ministerstwo Edukacji i Nauki","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004569","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Grid Computing"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>One of the challenges in managing cloud computing clusters is assigning resources based on the customers\u2019 needs. For this mechanism to work efficiently, it is imperative that there are sufficient resources reserved to maintain continuous operation, but not too much to avoid overhead costs. Additionally, to avoid the overhead of acquisition time, it is important to reserve resources sufficiently in advance. This paper presents a novel reliable general-purpose mechanism for prediction-based resource usage reservation. The proposed solution should be capable of operating for long periods of time without drift-related problems, and dynamically adapt to changes in system usage. To achieve this, a novel signature-based ensemble prediction method is presented, which utilizes multiple distinct prediction algorithms suited for various use-cases, as well as an anomaly detection mechanism used to improve prediction accuracy. This ensures that the mechanism can operate efficiently in different real-life scenarios. Thanks to a novel signature-based selection algorithm, it is possible to use the best available prediction algorithm for each use-case, even over long periods of time, which would typically lead to drifts. The proposed approach has been evaluated using real-life historical data from various production servers, which include traces from more than 1,500 machines collected over more than a year. Experimental results have demonstrated an increase in prediction accuracy of up to 21.4 percent over the neural network approach. The evaluation of the proposed approach highlights the importance of choosing the appropriate prediction method, especially in diverse scenarios where the load changes frequently.<\/jats:p>","DOI":"10.1007\/s10723-024-09764-4","type":"journal-article","created":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T11:02:01Z","timestamp":1713870121000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Signature-based Adaptive Cloud Resource Usage Prediction Using Machine Learning and Anomaly Detection"],"prefix":"10.1007","volume":"22","author":[{"given":"Wiktor","family":"Sus","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Piotr","family":"Nawrocki","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,4,23]]},"reference":[{"key":"9764_CR1","unstructured":"Albayrak, S., Camtepe, S.A., Edman, M., et al.: Host-based anomaly detection via resource usage signatures. Tech. rep., Distributed Artificial Intelligence Laboratory - Technische Universitat Berlin, Berlin, Germany (2009)"},{"key":"9764_CR2","doi-asserted-by":"publisher","unstructured":"Anupama, K.C., Shivakumar, B.R., Nagaraja, R.: Resource utilization prediction in cloud computing using hybrid model. Int. J. Adv. Comput. Sci. Appl. 12(4) (2021). https:\/\/doi.org\/10.14569\/IJACSA.2021.0120447","DOI":"10.14569\/IJACSA.2021.0120447"},{"key":"9764_CR3","doi-asserted-by":"publisher","unstructured":"Bisina, K.V., Azeez, M.A.: Optimized estimation of power spectral density. In: 2017 International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 871\u2013875 (2017). https:\/\/doi.org\/10.1109\/ICCONS.2017.8250588","DOI":"10.1109\/ICCONS.2017.8250588"},{"key":"9764_CR4","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1016\/j.inffus.2017.09.010","volume":"41","author":"RM Cruz","year":"2018","unstructured":"Cruz, R.M., Sabourin, R., Cavalcanti, G.D.: Dynamic classifier selection: recent advances and perspectives. Inf. Fusion 41, 195\u2013216 (2018). https:\/\/doi.org\/10.1016\/j.inffus.2017.09.010","journal-title":"Inf. Fusion"},{"issue":"11","key":"9764_CR5","doi-asserted-by":"publisher","first-page":"1940009","DOI":"10.1142\/S0218001419400093","volume":"33","author":"RM Cruz","year":"2019","unstructured":"Cruz, R.M., Souza, M.A., Sabourin, R., et al.: Dynamic ensemble selection and data preprocessing for multi-class imbalance learning. Int. J. Pattern Recognit. Artif. Intell. 33(11), 1940009 (2019)","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"9764_CR6","doi-asserted-by":"crossref","unstructured":"Faber, K., Corizzo, R., Sniezynski, B., et\u00a0al.: Lifelong learning for anomaly detection: new challenges, perspectives, and insights. arXiv:2303.07557 (2023)","DOI":"10.2139\/ssrn.4374293"},{"issue":"3","key":"9764_CR7","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1007\/s00607-021-00941-x","volume":"105","author":"L Girish","year":"2023","unstructured":"Girish, L., Rao, S.K.: Anomaly detection in cloud environment using artificial intelligence techniques. Computing 105(3), 675\u2013688 (2023)","journal-title":"Computing"},{"issue":"4","key":"9764_CR8","doi-asserted-by":"publisher","first-page":"2335","DOI":"10.1109\/TNSM.2020.3013922","volume":"17","author":"S Gupta","year":"2020","unstructured":"Gupta, S., Dileep, A.D., Gonsalves, T.A.: Online sparse blstm models for resource usage prediction in cloud datacentres. IEEE Trans. Netw. Serv. Manage. 17(4), 2335\u20132349 (2020). https:\/\/doi.org\/10.1109\/TNSM.2020.3013922","journal-title":"IEEE Trans. Netw. Serv. Manage."},{"key":"9764_CR9","doi-asserted-by":"publisher","unstructured":"Hagemann, T., Katsarou, K.: A systematic review on anomaly detection for cloud computing environments. In: Proceedings of the 2020 3rd Artificial Intelligence and Cloud Computing Conference. Association for Computing Machinery, New York, NY, USA, AICCC \u201920, pp. 83\u201396 (2021). https:\/\/doi.org\/10.1145\/3442536.3442550","DOI":"10.1145\/3442536.3442550"},{"issue":"4","key":"9764_CR10","doi-asserted-by":"publisher","first-page":"1705","DOI":"10.1109\/TNNLS.2020.3027736","volume":"34","author":"Z He","year":"2023","unstructured":"He, Z., Chen, P., Li, X., et al.: A spatiotemporal deep learning approach for unsupervised anomaly detection in cloud systems. IEEE Trans. Neural Netw. Learn. Syst. 34(4), 1705\u20131719 (2023). https:\/\/doi.org\/10.1109\/TNNLS.2020.3027736","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"9764_CR11","doi-asserted-by":"publisher","unstructured":"He, Z., Hu, G., Lee, R.B.: Cloudshield: real-time anomaly detection in the cloud. In: Proceedings of the Thirteenth ACM Conference on Data and Application Security and Privacy. Association for Computing Machinery, New York, NY, USA, CODASPY \u201923, pp. 91\u2013102 (2023). https:\/\/doi.org\/10.1145\/3577923.3583639","DOI":"10.1145\/3577923.3583639"},{"key":"9764_CR12","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.future.2017.10.047","volume":"81","author":"J Kumar","year":"2018","unstructured":"Kumar, J., Singh, A.K.: Workload prediction in cloud using artificial neural network and adaptive differential evolution. Futur. Gener. Comput. Syst. 81, 41\u201352 (2018). https:\/\/doi.org\/10.1016\/j.future.2017.10.047","journal-title":"Futur. Gener. Comput. Syst."},{"key":"9764_CR13","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1016\/j.procs.2017.12.087","volume":"125","author":"J Kumar","year":"2018","unstructured":"Kumar, J., Goomer, R., Singh, A.K.: Long short term memory recurrent neural network (lstm-rnn) based workload forecasting model for cloud datacenters. Procedia Comput. Sci. 125, 676\u2013682 (2018). https:\/\/doi.org\/10.1016\/j.procs.2017.12.087","journal-title":"Procedia Comput. Sci."},{"key":"9764_CR14","doi-asserted-by":"publisher","unstructured":"Li, X., Wang, H., Xiu, P., et\u00a0al.: Resource usage prediction based on bilstm-gru combination model. In: 2022 IEEE International Conference on Joint Cloud Computing (JCC), pp. 9\u201316 (2022). https:\/\/doi.org\/10.1109\/JCC56315.2022.00009","DOI":"10.1109\/JCC56315.2022.00009"},{"key":"9764_CR15","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/978-981-97-0801-7_24","volume-title":"Algorithms and Architectures for Parallel Processing","author":"P Liao","year":"2024","unstructured":"Liao, P., Pan, G., Wang, B., et al.: Efficient proactive resource allocation for multi-stage cloud-native microservices. In: Tari, Z., Li, K., Wu, H. (eds.) Algorithms and Architectures for Parallel Processing, pp. 411\u2013432. Springer Nature Singapore, Singapore (2024)"},{"issue":"1","key":"9764_CR16","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1109\/18.61115","volume":"37","author":"J Lin","year":"1991","unstructured":"Lin, J.: Divergence measures based on the shannon entropy. IEEE Trans. Inf. Theory 37(1), 145\u2013151 (1991). https:\/\/doi.org\/10.1109\/18.61115","journal-title":"IEEE Trans. Inf. Theory"},{"issue":"1","key":"9764_CR17","doi-asserted-by":"publisher","DOI":"10.1063\/5.0152298","volume":"2771","author":"A Malav","year":"2023","unstructured":"Malav, A., Gupta, S.K., Mahariya, S.K., et al.: Optimal resource management in cloud computing. AIP Conf. Proc. 2771(1), 020040 (2023). https:\/\/doi.org\/10.1063\/5.0152298","journal-title":"AIP Conf. Proc."},{"key":"9764_CR18","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1016\/j.future.2018.03.040","volume":"86","author":"K Mason","year":"2018","unstructured":"Mason, K., Duggan, M., Barrett, E., et al.: Predicting host cpu utilization in the cloud using evolutionary neural networks. Futur. Gener. Comput. Syst. 86, 162\u2013173 (2018). https:\/\/doi.org\/10.1016\/j.future.2018.03.040","journal-title":"Futur. Gener. Comput. Syst."},{"key":"9764_CR19","doi-asserted-by":"publisher","unstructured":"Mohapatra, S.S., Kumar, R.R., Alenezi, M., et\u00a0al.: Qos-aware cloud service recommendation using metaheuristic approach. Electronics 11(21) (2022). https:\/\/doi.org\/10.3390\/electronics11213469","DOI":"10.3390\/electronics11213469"},{"key":"9764_CR20","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.ins.2020.07.056","volume":"543","author":"TJ Moura","year":"2021","unstructured":"Moura, T.J., Cavalcanti, G.D., Oliveira, L.S.: Mine: a framework for dynamic regressor selection. Inf. Sci. 543, 157\u2013179 (2021). https:\/\/doi.org\/10.1016\/j.ins.2020.07.056","journal-title":"Inf. Sci."},{"key":"9764_CR21","doi-asserted-by":"crossref","unstructured":"Nawrocki, P., Smendowski, M.: Long-term prediction of cloud resource usage in high-performance computing. In: Miky\u0161ka, J., de\u00a0Mulatier, C., Paszynski, M., et\u00a0al. (eds.) Computational Science \u2013 ICCS 2023, pp. 532\u2013546 . Springer Nature Switzerland, Cham (2023)","DOI":"10.1007\/978-3-031-36021-3_53"},{"issue":"10","key":"9764_CR22","doi-asserted-by":"publisher","first-page":"2689","DOI":"10.1007\/s10115-022-01721-5","volume":"64","author":"P Nawrocki","year":"2022","unstructured":"Nawrocki, P., Sus, W.: Anomaly detection in the context of long-term cloud resource usage planning. Knowl. Inf. Syst. 64(10), 2689\u20132711 (2022). https:\/\/doi.org\/10.1007\/s10115-022-01721-5","journal-title":"Knowl. Inf. Syst."},{"issue":"1","key":"9764_CR23","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1007\/s10723-022-09641-y","volume":"21","author":"P Nawrocki","year":"2023","unstructured":"Nawrocki, P., Osypanka, P., Posluszny, B.: Data-driven adaptive prediction of cloud resource usage. J. Grid Comput. 21(1), 6 (2023). https:\/\/doi.org\/10.1007\/s10723-022-09641-y","journal-title":"J. Grid Comput."},{"key":"9764_CR24","doi-asserted-by":"publisher","unstructured":"Nguyen, T., Tran, N., Nguyen, B.M., et\u00a0al.: A resource usage prediction system using functional-link and genetic algorithm neural network for multivariate cloud metrics. In: 2018 IEEE 11th Conference on Service-Oriented Computing and Applications (SOCA), pp. 49\u201356 (2018). https:\/\/doi.org\/10.1109\/SOCA.2018.00014","DOI":"10.1109\/SOCA.2018.00014"},{"key":"9764_CR25","doi-asserted-by":"publisher","unstructured":"Ouali, C., Dumouchel, P., Gupta, V.: A robust audio fingerprinting method for content-based copy detection. In: 2014 12th International Workshop on Content-Based Multimedia Indexing (CBMI), pp. 1\u20136 (2014). https:\/\/doi.org\/10.1109\/CBMI.2014.6849814","DOI":"10.1109\/CBMI.2014.6849814"},{"key":"9764_CR26","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/j.jss.2014.12.029","volume":"101","author":"J Park","year":"2015","unstructured":"Park, J., Baik, J.: Improving software reliability prediction through multi-criteria based dynamic model selection and combination. J. Syst. Softw. 101, 236\u2013244 (2015). https:\/\/doi.org\/10.1016\/j.jss.2014.12.029","journal-title":"J. Syst. Softw."},{"key":"9764_CR27","doi-asserted-by":"publisher","unstructured":"Riganelli, O., Saltarel, P., Tundo, A., et\u00a0al.: Cloud failure prediction with hierarchical temporal memory: an empirical assessment. In: 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 785\u2013790 (2021). https:\/\/doi.org\/10.1109\/ICMLA52953.2021.00130","DOI":"10.1109\/ICMLA52953.2021.00130"},{"key":"9764_CR28","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.neucom.2016.08.072","volume":"218","author":"AT Sergio","year":"2016","unstructured":"Sergio, A.T., de Lima, T.P., Ludermir, T.B.: Dynamic selection of forecast combiners. Neurocomputing 218, 37\u201350 (2016). https:\/\/doi.org\/10.1016\/j.neucom.2016.08.072","journal-title":"Neurocomputing"},{"key":"9764_CR29","doi-asserted-by":"crossref","unstructured":"Shah, S.Y., Patel, D., Vu, L., et\u00a0al.: Autoai-ts: autoai for time series forecasting. CoRR abs\/2102.12347. arXiv:2102.12347 (2021)","DOI":"10.1145\/3448016.3457557"},{"issue":"4","key":"9764_CR30","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1007\/s10723-019-09487-x","volume":"17","author":"B Sniezynski","year":"2019","unstructured":"Sniezynski, B., Nawrocki, P., Wilk, M., et al.: VM reservation plan adaptation using machine learning in cloud computing. J. Grid Comput. 17(4), 797\u2013812 (2019). https:\/\/doi.org\/10.1007\/s10723-019-09487-x","journal-title":"J. Grid Comput."},{"key":"9764_CR31","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2023.109653","volume":"225","author":"F Ullah","year":"2023","unstructured":"Ullah, F., Bilal, M., Yoon, S.K.: Intelligent time-series forecasting framework for non-linear dynamic workload and resource prediction in cloud. Comput. Netw. 225, 109653 (2023). https:\/\/doi.org\/10.1016\/j.comnet.2023.109653","journal-title":"Comput. Netw."},{"key":"9764_CR32","doi-asserted-by":"publisher","DOI":"10.1186\/s13677-022-00383-6","author":"R Xin","year":"2023","unstructured":"Xin, R., Liu, H., Chen, P., et al.: Robust and accurate performance anomaly detection and prediction for cloud applications: a novel ensemble learning-based framework. J. Grid Comput. (2023). https:\/\/doi.org\/10.1186\/s13677-022-00383-6","journal-title":"J. Grid Comput."}],"container-title":["Journal of Grid Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10723-024-09764-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10723-024-09764-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10723-024-09764-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T07:06:10Z","timestamp":1719471970000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10723-024-09764-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,23]]},"references-count":32,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["9764"],"URL":"https:\/\/doi.org\/10.1007\/s10723-024-09764-4","relation":{},"ISSN":["1570-7873","1572-9184"],"issn-type":[{"value":"1570-7873","type":"print"},{"value":"1572-9184","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,23]]},"assertion":[{"value":"13 February 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 April 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval and Consent to Participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"46"}}