{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T16:29:21Z","timestamp":1775838561795,"version":"3.50.1"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T00:00:00Z","timestamp":1698969600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T00:00:00Z","timestamp":1698969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100016047","name":"Science Fund of the Republic of Serbia","doi-asserted-by":"crossref","award":["IDEA#7751676"],"award-info":[{"award-number":["IDEA#7751676"]}],"id":[{"id":"10.13039\/501100016047","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recent improvements in networking technologies have led to a significant shift towards distributed cloud-based services. However, adequate management of computation resources by providers is vital to maintain the costs of operations and quality of services. A robust system is needed to forecast demand and prevent excessive resource allocations. Extensive literature review suggests that the potential of recurrent neural networks with attention mechanisms is not sufficiently explored and applied to cloud computing. To address this gap, this work proposes a methodology for forecasting load of cloud resources based on recurrent neural networks with and without attention layers. Utilized deep learning models are further optimized through hyperparameter tuning using a modified particle swarm optimization metaheuristic, which is also introduced in this work. To help models deal with complex non-stationary data sequences, the variational mode decomposition for decomposing complex series has also been utilized. The performance of this approach is compared to several state-of-the-art algorithms on a real-world cloud-load dataset. Captured performance metrics (<jats:inline-formula><jats:alternatives><jats:tex-math>$$R^2$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:msup>\n                    <mml:mi>R<\/mml:mi>\n                    <mml:mn>2<\/mml:mn>\n                  <\/mml:msup>\n                <\/mml:math><\/jats:alternatives><\/jats:inline-formula>, mean square error, root mean square error, and index of agreement) strongly indicate that the proposed method has great potential for accurately forecasting cloud load. Further, models optimized by the introduced metaheuristic outperformed competing approaches, which was confirmed by conducted statistical validation. In addition, the best-performing forecasting model has been subjected to SHapley Additive exPlanations analysis to determine the impact each feature has on model forecasts, which could potentially be a very useful tool for cloud providers when making decisions.<\/jats:p>","DOI":"10.1007\/s40747-023-01265-3","type":"journal-article","created":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T01:01:50Z","timestamp":1698973310000},"page":"2249-2269","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":65,"title":["Cloud-load forecasting via decomposition-aided attention recurrent neural network tuned by modified particle swarm optimization"],"prefix":"10.1007","volume":"10","author":[{"given":"Bratislav","family":"Predi\u0107","sequence":"first","affiliation":[]},{"given":"Luka","family":"Jovanovic","sequence":"additional","affiliation":[]},{"given":"Vladimir","family":"Simic","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2062-924X","authenticated-orcid":false,"given":"Nebojsa","family":"Bacanin","sequence":"additional","affiliation":[]},{"given":"Miodrag","family":"Zivkovic","sequence":"additional","affiliation":[]},{"given":"Petar","family":"Spalevic","sequence":"additional","affiliation":[]},{"given":"Nebojsa","family":"Budimirovic","sequence":"additional","affiliation":[]},{"given":"Milos","family":"Dobrojevic","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,11,3]]},"reference":[{"key":"1265_CR1","volume-title":"Cloud computing","author":"B Hayes","year":"2008","unstructured":"Hayes B (2008) Cloud computing. ACM New York, NY, USA"},{"key":"1265_CR2","doi-asserted-by":"crossref","unstructured":"Dillon T, Wu C, Chang E (2010) Cloud computing: issues and challenges. In: 2010 24th IEEE International conference on advanced information networking and applications, pp. 27\u201333 . Ieee","DOI":"10.1109\/AINA.2010.187"},{"key":"1265_CR3","doi-asserted-by":"crossref","unstructured":"Krogh A What are artificial neural networks? Nature biotechnology 26(2), 195\u2013197 (2008)","DOI":"10.1038\/nbt1386"},{"issue":"64\u201367","key":"1265_CR4","first-page":"2","volume":"5","author":"LR Medsker","year":"2001","unstructured":"Medsker LR (2001) Jain L Recurrent neural networks. Design Appl 5(64\u201367):2","journal-title":"Design Appl"},{"issue":"9","key":"1265_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.23915\/distill.00001","volume":"1","author":"C Olah","year":"2016","unstructured":"Olah C (2016) Carter S Attention and augmented recurrent neural networks. Distill 1(9):1","journal-title":"Distill"},{"issue":"3","key":"1265_CR6","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1109\/TSP.2013.2288675","volume":"62","author":"K Dragomiretskiy","year":"2013","unstructured":"Dragomiretskiy K (2013) Zosso D Variational mode decomposition. IEEE Trans Signal Process 62(3):531\u2013544","journal-title":"IEEE Trans Signal Process"},{"issue":"11","key":"1265_CR7","first-page":"4841","volume":"12","author":"K Kumar","year":"2021","unstructured":"Kumar K et al (2021) Forecasting of cloud computing services workload using machine learning. Turkish J Comput Math Educ (TURCOMAT) 12(11):4841\u20134846","journal-title":"Turkish J Comput Math Educ (TURCOMAT)"},{"key":"1265_CR8","unstructured":"Saxena D, Singh AK (2021) Workload forecasting and resource management models based on machine learning for cloud computing environments. arXiv preprint arXiv:2106.15112"},{"key":"1265_CR9","doi-asserted-by":"crossref","unstructured":"Tang X, Liu Q, Dong Y, Han J, Zhang Z Fisher: An efficient container load prediction model with deep neural network in clouds. In: 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA\/IUCC\/BDCloud\/SocialCom\/SustainCom), pp. 199\u2013206 (2018). IEEE","DOI":"10.1109\/BDCloud.2018.00041"},{"key":"1265_CR10","doi-asserted-by":"crossref","unstructured":"Ding Z, Wang J, Cheng Y, He C (2020) Alice: A lstm neural network based short-term power load forecasting approach in distributed cloud-edge environment. In: Journal of Physics: Conference Series, vol. 1624, p. 052017. IOP Publishing","DOI":"10.1088\/1742-6596\/1624\/5\/052017"},{"key":"1265_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2022.105345","volume":"116","author":"R Aron","year":"2022","unstructured":"Aron R, Abraham A (2022) Resource scheduling methods for cloud computing environment: The role of meta-heuristics and artificial intelligence. Eng Appl Artificial Intell 116:105345","journal-title":"Eng Appl Artificial Intell"},{"issue":"3","key":"1265_CR12","doi-asserted-by":"publisher","first-page":"1434","DOI":"10.3390\/en16031434","volume":"16","author":"N Bacanin","year":"2023","unstructured":"Bacanin N, Stoean C, Zivkovic M, Rakic M, Strulak-W\u00f3jcikiewicz R (2023) Stoean R On the benefits of using metaheuristics in the hyperparameter tuning of deep learning models for energy load forecasting. Energies 16(3):1434","journal-title":"Energies"},{"key":"1265_CR13","doi-asserted-by":"crossref","unstructured":"Wolpert D.H, Macready W.G No free lunch theorems for optimization. IEEE transactions on evolutionary computation 1(1), 67\u201382 (1997)","DOI":"10.1109\/4235.585893"},{"key":"1265_CR14","first-page":"64","volume":"5","author":"LR Medsker","year":"2001","unstructured":"Medsker LR (2001) Jain L Recurrent neural networks. Design Appl 5:64\u201367","journal-title":"Design Appl"},{"key":"1265_CR15","unstructured":"Kennedy J, Eberhart R Particle swarm optimization. In: Proceedings of ICNN\u201995-international Conference on Neural Networks, vol. 4, pp. 1942\u20131948 (1995). IEEE"},{"key":"1265_CR16","doi-asserted-by":"crossref","unstructured":"Hickey J.M, Di\u00a0Stefano P.G, Vasileiou V Fairness by explicability and adversarial shap learning. In: Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14\u201318, 2020, Proceedings, Part III, pp. 174\u2013190 (2021). Springer","DOI":"10.1007\/978-3-030-67664-3_11"},{"key":"1265_CR17","unstructured":"Almorsy M, Grundy J, M\u00fcller I An analysis of the cloud computing security problem. arXiv preprint arXiv:1609.01107 (2016)"},{"key":"1265_CR18","doi-asserted-by":"crossref","unstructured":"Ray P.P A survey of iot cloud platforms. Future Comput Inform J 1(1-2), 35\u201346 (2016)","DOI":"10.1016\/j.fcij.2017.02.001"},{"key":"1265_CR19","unstructured":"Jovanovic L, Bacanin N, Zivkovic M, Antonijevic M, Jovanovic B, Sretenovic M.B, Strumberger I Machine learning tuning by diversity oriented firefly metaheuristics for industry 4.0. Expert Systems, 13293"},{"key":"1265_CR20","doi-asserted-by":"crossref","unstructured":"ul Haq H.B, Saqlain M An implementation of effective machine learning approaches to perform sybil attack detection (sad) in iot network. Theoretical Appl Comput Intell 1(1), 1\u201314 (2023)","DOI":"10.31181\/taci1120232"},{"key":"1265_CR21","doi-asserted-by":"crossref","unstructured":"Murad S.A, Muzahid A.J.M, Azmi Z.R.M, Hoque M.I, Kowsher M A review on job scheduling technique in cloud computing and priority rule based intelligent framework. J King Saud Univ Comput Inform Sci (2022)","DOI":"10.1016\/j.jksuci.2022.03.027"},{"key":"1265_CR22","doi-asserted-by":"crossref","unstructured":"Tiwari R, Sille R, Salankar N, Singh P Utilization and energy consumption optimization for cloud computing environment. In: Cyber Security and Digital Forensics: Proceedings of ICCSDF 2021, pp. 609\u2013619 (2022). Springer","DOI":"10.1007\/978-981-16-3961-6_50"},{"issue":"3","key":"1265_CR23","doi-asserted-by":"publisher","first-page":"845","DOI":"10.5267\/j.uscm.2022.3.010","volume":"10","author":"P Ricardianto","year":"2022","unstructured":"Ricardianto P, Lermatan E, Thamrin M, Abdurachman E, Subagyo H, Priadi A, Sirait D, Wahyuni T, Kosman R (2022) Endri E Impact of loading and unloading productivity on service user satisfaction. Uncertain Supply Chain Manag 10(3):845\u2013854","journal-title":"Uncertain Supply Chain Manag"},{"key":"1265_CR24","first-page":"1","volume":"2021","author":"K Zhang","year":"2021","unstructured":"Zhang K, Guo W, Feng J (2021) Liu M Load forecasting method based on improved deep learning in cloud computing environment. Sci Program 2021:1\u201311","journal-title":"Sci Program"},{"key":"1265_CR25","doi-asserted-by":"crossref","unstructured":"Peng Z, Song X, Song S, Stojanovic V Hysteresis quantified control for switched reaction\u2013diffusion systems and its application. Complex & Intelligent Systems, 1\u201310 (2023)","DOI":"10.1007\/s40747-023-01135-y"},{"key":"1265_CR26","doi-asserted-by":"crossref","unstructured":"Song X, Wu N, Song S, Zhang Y, Stojanovic V Bipartite synchronization for cooperative-competitive neural networks with reaction\u2013diffusion terms via dual event-triggered mechanism. Neurocomputing, 126498 (2023)","DOI":"10.1016\/j.neucom.2023.126498"},{"key":"1265_CR27","doi-asserted-by":"crossref","unstructured":"Hu R, Jiang J, Liu G, Wang L, et al.: Efficient resources provisioning based on load forecasting in cloud. Sci World J 2014 (2014)","DOI":"10.1155\/2014\/321231"},{"key":"1265_CR28","doi-asserted-by":"crossref","unstructured":"Peng H, Wen W.-S, Tseng M.-L, Li L.-L A cloud load forecasting model with nonlinear changes using whale optimization algorithm hybrid strategy. Soft Comput 25(15), 10205\u201310220 (2021)","DOI":"10.1007\/s00500-021-05961-5"},{"issue":"4","key":"1265_CR29","doi-asserted-by":"publisher","first-page":"1802","DOI":"10.1109\/TCCN.2022.3188153","volume":"8","author":"W Xu","year":"2022","unstructured":"Xu W, An J, Xu Y, Huang C, Gan L (2022) Yuen C Time-varying channel prediction for ris-assisted mu-miso networks via deep learning. IEEE Trans Cognit Commun Netw 8(4):1802\u20131815","journal-title":"IEEE Trans Cognit Commun Netw"},{"key":"1265_CR30","unstructured":"Luong M.-T, Le Q.V, Sutskever I, Vinyals O, Kaiser L Multi-task sequence to sequence learning. arXiv preprint arXiv:1511.06114 (2015)"},{"key":"1265_CR31","doi-asserted-by":"crossref","unstructured":"Yang X.-S Firefly algorithm, stochastic test functions and design optimisation. Int J Bio-inspired Comput 2(2), 78\u201384 (2010)","DOI":"10.1504\/IJBIC.2010.032124"},{"issue":"1","key":"1265_CR32","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1016\/j.asoc.2007.05.007","volume":"8","author":"D Karaboga","year":"2008","unstructured":"Karaboga D (2008) Basturk B On the performance of artificial bee colony (abc) algorithm. Appl Soft Comput 8(1):687\u2013697","journal-title":"Appl Soft Comput"},{"key":"1265_CR33","doi-asserted-by":"crossref","unstructured":"Mirjalili S, Mirjalili S Genetic algorithm. Evolutionary Algorithms and Neural Networks: Theory and Applications, 43\u201355 (2019)","DOI":"10.1007\/978-3-319-93025-1_4"},{"key":"1265_CR34","doi-asserted-by":"crossref","unstructured":"Mirjalili S Sca: a sine cosine algorithm for solving optimization problems. Knowl-Based Syst 96, 120\u2013133 (2016)","DOI":"10.1016\/j.knosys.2015.12.022"},{"key":"1265_CR35","doi-asserted-by":"crossref","unstructured":"Abualigah L, Diabat A, Mirjalili S, Abd\u00a0Elaziz M, Gandomi A.H The arithmetic optimization algorithm. Comput Methods Appl Mech Eng 376, 113609 (2021)","DOI":"10.1016\/j.cma.2020.113609"},{"key":"1265_CR36","doi-asserted-by":"crossref","unstructured":"Jovanovic L, Jovanovic D, Bacanin N, Jovancai Stakic A, Antonijevic M, Magd H, Thirumalaisamy R (2022) Zivkovic M Multi-step crude oil price prediction based on lstm approach tuned by salp swarm algorithm with disputation operator. Sustainability 14(21):14616","DOI":"10.3390\/su142114616"},{"issue":"1","key":"1265_CR37","doi-asserted-by":"publisher","first-page":"109","DOI":"10.3390\/atmos14010109","volume":"14","author":"L Jovanovic","year":"2023","unstructured":"Jovanovic L, Jovanovic G, Perisic M, Alimpic F, Stanisic S, Bacanin N, Zivkovic M (2023) Stojic A The explainable potential of coupling metaheuristics-optimized-xgboost and shap in revealing vocs\u2019 environmental fate. Atmosphere 14(1):109","journal-title":"Atmosphere"},{"issue":"1","key":"1265_CR38","doi-asserted-by":"publisher","first-page":"15","DOI":"10.31181\/taci1120231","volume":"1","author":"J Mani","year":"2023","unstructured":"Mani J, Shaker H, Jovanovic L et al (2023) Sunspot occurrence forecasting with metaheuristic optimized recurrent neural networks. Theoretical Appl Comput Intell 1(1):15\u201326","journal-title":"Theoretical Appl Comput Intell"},{"key":"1265_CR39","doi-asserted-by":"crossref","unstructured":"Mohamed A.W, Sallam K.M, Agrawal P, Hadi A.A, Mohamed A.K Evaluating the performance of meta-heuristic algorithms on cec 2021 benchmark problems. Neural Computing and Applications 35(2), 1493\u20131517 (2023)","DOI":"10.1007\/s00521-022-07788-z"},{"key":"1265_CR40","doi-asserted-by":"crossref","unstructured":"Rahnamayan S, Tizhoosh H.R, Salama M.M Quasi-oppositional differential evolution. In: 2007 IEEE Congress on Evolutionary Computation, pp. 2229\u20132236 (2007). IEEE","DOI":"10.1109\/CEC.2007.4424748"},{"key":"1265_CR41","doi-asserted-by":"crossref","unstructured":"Abualigah L, Abd\u00a0Elaziz M, Sumari P, Geem Z.W, Gandomi A.H Reptile search algorithm (rsa): A nature-inspired meta-heuristic optimizer. Expert Systems with Applications 191, 116158 (2022)","DOI":"10.1016\/j.eswa.2021.116158"},{"key":"1265_CR42","doi-asserted-by":"crossref","unstructured":"Khishe M, Mosavi M.R Chimp optimization algorithm. Expert systems with applications 149, 113338 (2020)","DOI":"10.1016\/j.eswa.2020.113338"},{"key":"1265_CR43","doi-asserted-by":"crossref","unstructured":"Gurrola-Ramos J, Hern\u00e0ndez-Aguirre A, Dalmau-Cede\u00f1o O Colshade for real-world single-objective constrained optimization problems. In: 2020 IEEE Congress on Evolutionary Computation (CEC), pp. 1\u20138 (2020). IEEE","DOI":"10.1109\/CEC48606.2020.9185583"},{"key":"1265_CR44","doi-asserted-by":"crossref","unstructured":"Wheeler S.E, Schleyer P.v.R, Schaefer H.F Sass: A symmetry adapted stochastic search algorithm exploiting site symmetry. J Chem Phys 126(10), 104104 (2007)","DOI":"10.1063\/1.2646940"},{"key":"1265_CR45","unstructured":"Botchkarev A Performance metrics (error measures) in machine learning regression, forecasting and prognostics: Properties and typology. arXiv preprint arXiv:1809.03006 (2018)"},{"issue":"1","key":"1265_CR46","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.swevo.2011.02.002","volume":"1","author":"J Derrac","year":"2011","unstructured":"Derrac J, Garc\u00eda S, Molina D (2011) Herrera F A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3\u201318","journal-title":"Swarm Evol Comput"},{"key":"1265_CR47","doi-asserted-by":"crossref","unstructured":"Eftimov T, Koro\u0161ec P, Seljak B.K A novel approach to statistical comparison of meta-heuristic stochastic optimization algorithms using deep statistics. Inform Sci 417, 186\u2013215 (2017)","DOI":"10.1016\/j.ins.2017.07.015"},{"key":"1265_CR48","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2021.100973","volume":"67","author":"A LaTorre","year":"2021","unstructured":"LaTorre A, Molina D, Osaba E, Poyatos J, Del Ser J (2021) Herrera F A prescription of methodological guidelines for comparing bio-inspired optimization algorithms. Swarm Evol Comput 67:100973","journal-title":"Swarm Evol Comput"},{"issue":"337","key":"1265_CR49","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1080\/01621459.1972.10481232","volume":"67","author":"SS Shapiro","year":"1972","unstructured":"Shapiro SS (1972) Francia R An approximate analysis of variance test for normality. J Am Stat Assoc 67(337):215\u2013216","journal-title":"J Am Stat Assoc"},{"issue":"2","key":"1265_CR50","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s00362-012-0443-4","volume":"54","author":"S Taheri","year":"2013","unstructured":"Taheri S (2013) Hesamian G A generalization of the wilcoxon signed-rank test and its applications. Stat Papers 54(2):457","journal-title":"Stat Papers"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01265-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01265-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01265-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,30]],"date-time":"2024-03-30T15:26:57Z","timestamp":1711812417000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01265-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,3]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["1265"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01265-3","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,3]]},"assertion":[{"value":"9 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}