{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T17:40:51Z","timestamp":1776361251546,"version":"3.51.2"},"reference-count":156,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T00:00:00Z","timestamp":1713830400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T00:00:00Z","timestamp":1713830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100018525","name":"Key Research and Development Program of Sichuan Province","doi-asserted-by":"publisher","award":["2021YFG0325"],"award-info":[{"award-number":["2021YFG0325"]}],"id":[{"id":"10.13039\/501100018525","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018AAA0103203.2"],"award-info":[{"award-number":["2018AAA0103203.2"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Sichuan Provincial Science and Technology Plan Project","award":["2021JDRC0005"],"award-info":[{"award-number":["2021JDRC0005"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With the acceleration of the Internet in Web 2.0, Cloud computing is a new paradigm to offer dynamic, reliable and elastic computing services. Efficient scheduling of resources or optimal allocation of requests is one of the prominent issues in emerging Cloud computing. Considering the growing complexity of Cloud computing, future Cloud systems will require more effective resource management methods. In some complex scenarios with difficulties in directly evaluating the performance of scheduling solutions, classic algorithms (such as heuristics and meta-heuristics) will fail to obtain an effective scheme. Deep reinforcement learning (DRL) is a novel method to solve scheduling problems. Due to the combination of deep learning and reinforcement learning (RL), DRL has achieved considerable performance in current studies. To focus on this direction and analyze the application prospect of DRL in Cloud scheduling, we provide a comprehensive review for DRL-based methods in resource scheduling of Cloud computing. Through the theoretical formulation of scheduling and analysis of RL frameworks, we discuss the advantages of DRL-based methods in Cloud scheduling. We also highlight different challenges and discuss the future directions existing in the DRL-based Cloud scheduling.<\/jats:p>","DOI":"10.1007\/s10462-024-10756-9","type":"journal-article","created":{"date-parts":[[2024,4,23]],"date-time":"2024-04-23T06:02:01Z","timestamp":1713852121000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":149,"title":["Deep reinforcement learning-based methods for resource scheduling in cloud computing: a review and future directions"],"prefix":"10.1007","volume":"57","author":[{"given":"Guangyao","family":"Zhou","sequence":"first","affiliation":[]},{"given":"Wenhong","family":"Tian","sequence":"additional","affiliation":[]},{"given":"Rajkumar","family":"Buyya","sequence":"additional","affiliation":[]},{"given":"Ruini","family":"Xue","sequence":"additional","affiliation":[]},{"given":"Liang","family":"Song","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,4,23]]},"reference":[{"key":"10756_CR2","doi-asserted-by":"publisher","DOI":"10.1007\/S10586-020-03075-5","author":"L Abualigah","year":"2020","unstructured":"Abualigah L, Diabat A (2020) A novel hybrid antlion optimization algorithm for multi-objective task scheduling problems in cloud computing environments. Clust Comput. https:\/\/doi.org\/10.1007\/S10586-020-03075-5","journal-title":"Clust Comput"},{"issue":"4","key":"10756_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3325097","volume":"52","author":"M Adhikari","year":"2019","unstructured":"Adhikari M, Amgoth T, Srirama SN (2019) A survey on scheduling strategies for workflows in cloud environment and emerging trends. ACM Comput Surv 52(4):1\u201336. https:\/\/doi.org\/10.1145\/3325097","journal-title":"ACM Comput Surv"},{"key":"10756_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/J.ASOC.2020.106411","volume":"93","author":"M Adhikari","year":"2020","unstructured":"Adhikari M, Amgoth T, Srirama SN (2020) Multi-objective scheduling strategy for scientific workflows in cloud environment: a firefly-based approach. Appl Soft Comput 93:106411. https:\/\/doi.org\/10.1016\/J.ASOC.2020.106411","journal-title":"Appl Soft Comput"},{"issue":"4","key":"10756_CR5","doi-asserted-by":"publisher","first-page":"1797","DOI":"10.1007\/S10586-018-2811-X","volume":"21","author":"HB Alla","year":"2018","unstructured":"Alla HB, Alla SB, Touhafi A et al (2018) A novel task scheduling approach based on dynamic queues and hybrid meta-heuristic algorithms for cloud computing environment. Clust Comput 21(4):1797\u20131820. https:\/\/doi.org\/10.1007\/S10586-018-2811-X","journal-title":"Clust Comput"},{"issue":"4","key":"10756_CR6","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1145\/1721654.1721672","volume":"53","author":"M Armbrust","year":"2010","unstructured":"Armbrust M, Fox A, Griffith R et al (2010) A view of cloud computing. Commun ACM 53(4):50\u201358. https:\/\/doi.org\/10.1145\/1721654.1721672","journal-title":"Commun ACM"},{"key":"10756_CR7","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1016\/J.FUTURE.2018.09.014","volume":"91","author":"AR Arunarani","year":"2019","unstructured":"Arunarani AR, Manjula D, Sugumaran V (2019) Task scheduling techniques in cloud computing: a literature survey. Future Gener Comput Syst 91:407\u2013415. https:\/\/doi.org\/10.1016\/J.FUTURE.2018.09.014","journal-title":"Future Gener Comput Syst"},{"key":"10756_CR8","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1016\/J.FUTURE.2020.06.038","volume":"112","author":"E Baccour","year":"2020","unstructured":"Baccour E, Erbad A, Mohamed A et al (2020) RL-OPRA: reinforcement learning for online and proactive resource allocation of crowdsourced live videos. Future Gener Comput Syst 112:982\u2013995. https:\/\/doi.org\/10.1016\/J.FUTURE.2020.06.038","journal-title":"Future Gener Comput Syst"},{"issue":"4","key":"10756_CR9","doi-asserted-by":"publisher","first-page":"2871","DOI":"10.1007\/S10586-020-03053-X","volume":"23","author":"A Belgacem","year":"2020","unstructured":"Belgacem A, Bey KB, Nacer H et al (2020) Efficient dynamic resource allocation method for cloud computing environment. Clust Comput 23(4):2871\u20132889. https:\/\/doi.org\/10.1007\/S10586-020-03053-X","journal-title":"Clust Comput"},{"issue":"5","key":"10756_CR10","doi-asserted-by":"publisher","first-page":"1477","DOI":"10.1109\/TPDS.2014.2321378","volume":"26","author":"S Bera","year":"2015","unstructured":"Bera S, Misra S, Rodrigues JJPC (2015) Cloud computing applications for smart grid: a survey. IEEE Trans Parallel Distrib Syst 26(5):1477\u20131494. https:\/\/doi.org\/10.1109\/TPDS.2014.2321378","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"2","key":"10756_CR11","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1145\/3364684","volume":"63","author":"R Bianchini","year":"2020","unstructured":"Bianchini R, Fontoura M, Cortez E et al (2020) Toward ml-centric cloud platforms. Commun ACM 63(2):50\u201359. https:\/\/doi.org\/10.1145\/3364684","journal-title":"Commun ACM"},{"key":"10756_CR12","doi-asserted-by":"publisher","unstructured":"Bitsakos C, Konstantinou I, Koziris N (2018) DERP: A deep reinforcement learning cloud system for elastic resource provisioning. In: 2018 IEEE international conference on cloud computing technology and science, CloudCom 2018, December 10-13, 2018. IEEE Computer Society, Nicosia, Cyprus, pp 21\u201329, https:\/\/doi.org\/10.1109\/CLOUDCOM2018.2018.00020","DOI":"10.1109\/CLOUDCOM2018.2018.00020"},{"key":"10756_CR13","doi-asserted-by":"publisher","unstructured":"Braiki K, Youssef H (2019) Resource management in cloud data centers: A survey. In: 15th International wireless communications & mobile computing conference, IWCMC 2019, June 24-28, 2019. IEEE, Tangier, Morocco, pp 1007\u20131012, https:\/\/doi.org\/10.1109\/IWCMC.2019.8766736","DOI":"10.1109\/IWCMC.2019.8766736"},{"issue":"7","key":"10756_CR14","doi-asserted-by":"publisher","first-page":"6201","DOI":"10.1109\/JIOT.2020.2968951","volume":"7","author":"Z Cao","year":"2020","unstructured":"Cao Z, Zhou P, Li R et al (2020) Multiagent deep reinforcement learning for joint multichannel access and task offloading of mobile-edge computing in industry 4.0. IEEE Internet Things J 7(7):6201\u20136213. https:\/\/doi.org\/10.1109\/JIOT.2020.2968951","journal-title":"IEEE Internet Things J"},{"key":"10756_CR15","doi-asserted-by":"publisher","unstructured":"Caron E, Desprez F, Loureiro D, et\u00a0al (2009) Cloud computing resource management through a grid middleware: A case study with DIET and eucalyptus. In: IEEE International conference on cloud computing, CLOUD 2009, 21-25 September, 2009. IEEE Computer Society, Bangalore, India, pp 151\u2013154, https:\/\/doi.org\/10.1109\/CLOUD.2009.70","DOI":"10.1109\/CLOUD.2009.70"},{"issue":"3","key":"10756_CR16","doi-asserted-by":"publisher","first-page":"396","DOI":"10.1109\/TSC.2015.2476812","volume":"10","author":"J Chase","year":"2017","unstructured":"Chase J, Niyato D (2017) Joint optimization of resource provisioning in cloud computing. IEEE Trans Serv Comput 10(3):396\u2013409. https:\/\/doi.org\/10.1109\/TSC.2015.2476812","journal-title":"IEEE Trans Serv Comput"},{"key":"10756_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/J.ASOC.2019.105627","author":"D Chaudhary","year":"2019","unstructured":"Chaudhary D, Kumar B (2019) Cost optimized hybrid genetic-gravitational search algorithm for load scheduling in cloud computing. Appl Soft Comput. https:\/\/doi.org\/10.1016\/J.ASOC.2019.105627","journal-title":"Appl Soft Comput"},{"key":"10756_CR18","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1016\/J.FUTURE.2022.11.032","volume":"141","author":"G Chen","year":"2023","unstructured":"Chen G, Qi J, Sun Y et al (2023) A collaborative scheduling method for cloud computing heterogeneous workflows based on deep reinforcement learning. Future Gener Comput Syst 141:284\u2013297. https:\/\/doi.org\/10.1016\/J.FUTURE.2022.11.032","journal-title":"Future Gener Comput Syst"},{"issue":"7","key":"10756_CR19","doi-asserted-by":"publisher","first-page":"1866","DOI":"10.1109\/TPDS.2016.2636210","volume":"28","author":"T Chen","year":"2017","unstructured":"Chen T, Marqu\u00e9s AG, Giannakis GB (2017) DGLB: distributed stochastic geographical load balancing over cloud networks. IEEE Trans Parallel Distrib Syst 28(7):1866\u20131880. https:\/\/doi.org\/10.1109\/TPDS.2016.2636210","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"5","key":"10756_CR20","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1109\/TSC.2018.2826544","volume":"12","author":"W Chen","year":"2019","unstructured":"Chen W, Wang D, Li K (2019) Multi-user multi-task computation offloading in green mobile edge cloud computing. IEEE Trans Serv Comput 12(5):726\u2013738. https:\/\/doi.org\/10.1109\/TSC.2018.2826544","journal-title":"IEEE Trans Serv Comput"},{"issue":"3","key":"10756_CR21","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1109\/TPDS.2021.3100298","volume":"33","author":"X Chen","year":"2022","unstructured":"Chen X, Zhang J, Lin B et al (2022) Energy-efficient offloading for dnn-based smart iot systems in cloud-edge environments. IEEE Trans Parallel Distrib Syst 33(3):683\u2013697. https:\/\/doi.org\/10.1109\/TPDS.2021.3100298","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"2","key":"10756_CR22","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1109\/TCC.2020.2992537","volume":"10","author":"X Chen","year":"2022","unstructured":"Chen X, Zhu F, Chen Z et al (2022) Resource allocation for cloud-based software services using prediction-enabled feedback control with reinforcement learning. IEEE Trans Cloud Comput 10(2):1117\u20131129. https:\/\/doi.org\/10.1109\/TCC.2020.2992537","journal-title":"IEEE Trans Cloud Comput"},{"issue":"2","key":"10756_CR23","doi-asserted-by":"publisher","first-page":"1871","DOI":"10.1109\/TCC.2022.3169157","volume":"11","author":"X Chen","year":"2023","unstructured":"Chen X, Yang L, Chen Z et al (2023) Resource allocation with workload-time windows for cloud-based software services: a deep reinforcement learning approach. IEEE Trans Cloud Comput 11(2):1871\u20131885. https:\/\/doi.org\/10.1109\/TCC.2022.3169157","journal-title":"IEEE Trans Cloud Comput"},{"issue":"8","key":"10756_CR24","doi-asserted-by":"publisher","first-page":"1911","DOI":"10.1109\/TPDS.2021.3132422","volume":"33","author":"Z Chen","year":"2022","unstructured":"Chen Z, Hu J, Min G et al (2022) Adaptive and efficient resource allocation in cloud datacenters using actor-critic deep reinforcement learning. IEEE Trans Parallel Distrib Syst 33(8):1911\u20131923. https:\/\/doi.org\/10.1109\/TPDS.2021.3132422","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"1","key":"10756_CR25","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1007\/S12083-021-01245-9","volume":"15","author":"Z Chen","year":"2022","unstructured":"Chen Z, Zheng H, Zhang J et al (2022) Joint computation offloading and deployment optimization in multi-uav-enabled MEC systems. Peer-to-Peer Netw Appl 15(1):194\u2013205. https:\/\/doi.org\/10.1007\/S12083-021-01245-9","journal-title":"Peer-to-Peer Netw Appl"},{"key":"10756_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/J.CIE.2023.109053","volume":"177","author":"Z Chen","year":"2023","unstructured":"Chen Z, Zhang L, Wang X et al (2023) Cloud-edge collaboration task scheduling in cloud manufacturing: an attention-based deep reinforcement learning approach. Comput Ind Eng 177:109053. https:\/\/doi.org\/10.1016\/J.CIE.2023.109053","journal-title":"Comput Ind Eng"},{"key":"10756_CR27","doi-asserted-by":"publisher","unstructured":"Cheng M, Li J, Nazarian S (2018) Drl-cloud: Deep reinforcement learning-based resource provisioning and task scheduling for cloud service providers. In: 23rd Asia and South Pacific design automation conference, ASP-DAC 2018, January 22-25, 2018. IEEE, Jeju, Korea (South), pp 129\u2013134, https:\/\/doi.org\/10.1109\/ASPDAC.2018.8297294","DOI":"10.1109\/ASPDAC.2018.8297294"},{"issue":"2","key":"10756_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3376917","volume":"53","author":"P Cong","year":"2020","unstructured":"Cong P, Xu G, Wei T et al (2020) A survey of profit optimization techniques for cloud providers. ACM Comput Surv 53(2):1\u201335. https:\/\/doi.org\/10.1145\/3376917","journal-title":"ACM Comput Surv"},{"issue":"2","key":"10756_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3378935","volume":"53","author":"P Cong","year":"2020","unstructured":"Cong P, Zhou J, Li L et al (2020) A survey of hierarchical energy optimization for mobile edge computing: a perspective from end devices to the cloud. ACM Comput Surv 53(2):1\u201344. https:\/\/doi.org\/10.1145\/3378935","journal-title":"ACM Comput Surv"},{"issue":"2","key":"10756_CR30","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/4235.996017","volume":"6","author":"K Deb","year":"2002","unstructured":"Deb K, Agrawal S, Pratap A et al (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182\u2013197. https:\/\/doi.org\/10.1109\/4235.996017","journal-title":"IEEE Trans Evol Comput"},{"key":"10756_CR31","doi-asserted-by":"publisher","unstructured":"Demirci M (2015) A survey of machine learning applications for energy-efficient resource management in cloud computing environments. In: 14th IEEE international conference on machine learning and applications, ICMLA 2015, December 9-11, 2015. IEEE, Miami, FL, USA, pp 1185\u20131190, https:\/\/doi.org\/10.1109\/ICMLA.2015.205","DOI":"10.1109\/ICMLA.2015.205"},{"key":"10756_CR32","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/J.JPDC.2020.03.022","volume":"142","author":"AFS Devaraj","year":"2020","unstructured":"Devaraj AFS, Elhoseny M, Dhanasekaran S et al (2020) Hybridization of firefly and improved multi-objective particle swarm optimization algorithm for energy efficient load balancing in cloud computing environments. J Parallel Distrib Comput 142:36\u201345. https:\/\/doi.org\/10.1016\/J.JPDC.2020.03.022","journal-title":"J Parallel Distrib Comput"},{"key":"10756_CR33","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/J.FUTURE.2020.02.018","volume":"108","author":"D Ding","year":"2020","unstructured":"Ding D, Fan X, Zhao Y et al (2020) Q-learning based dynamic task scheduling for energy-efficient cloud computing. Future Gener Comput Syst 108:361\u2013371. https:\/\/doi.org\/10.1016\/J.FUTURE.2020.02.018","journal-title":"Future Gener Comput Syst"},{"key":"10756_CR34","doi-asserted-by":"publisher","DOI":"10.1002\/CPE.5654","author":"T Dong","year":"2020","unstructured":"Dong T, Xue F, Xiao C et al (2020) Task scheduling based on deep reinforcement learning in a cloud manufacturing environment. Concurr Comput Pract Exp. https:\/\/doi.org\/10.1002\/CPE.5654","journal-title":"Concurr Comput Pract Exp"},{"issue":"9","key":"10756_CR35","doi-asserted-by":"publisher","first-page":"9916","DOI":"10.1007\/S10489-022-03963-W","volume":"53","author":"T Dong","year":"2023","unstructured":"Dong T, Xue F, Tang H et al (2023) Deep reinforcement learning for fault-tolerant workflow scheduling in cloud environment. Appl Intell 53(9):9916\u20139932. https:\/\/doi.org\/10.1007\/S10489-022-03963-W","journal-title":"Appl Intell"},{"issue":"5","key":"10756_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3341145","volume":"52","author":"TL Duc","year":"2019","unstructured":"Duc TL, Leiva RAG, Casari P et al (2019) Machine learning methods for reliable resource provisioning in edge-cloud computing: a survey. ACM Comput Surv 52(5):1\u201339. https:\/\/doi.org\/10.1145\/3341145","journal-title":"ACM Comput Surv"},{"issue":"7","key":"10756_CR37","doi-asserted-by":"publisher","first-page":"6214","DOI":"10.1109\/JIOT.2019.2961707","volume":"7","author":"J Feng","year":"2020","unstructured":"Feng J, Yu FR, Pei Q et al (2020) Cooperative computation offloading and resource allocation for blockchain-enabled mobile-edge computing: a deep reinforcement learning approach. IEEE Internet Things J 7(7):6214\u20136228. https:\/\/doi.org\/10.1109\/JIOT.2019.2961707","journal-title":"IEEE Internet Things J"},{"issue":"4","key":"10756_CR38","doi-asserted-by":"publisher","first-page":"738","DOI":"10.1109\/TCC.2015.2424892","volume":"5","author":"C Fiandrino","year":"2017","unstructured":"Fiandrino C, Kliazovich D, Bouvry P et al (2017) Performance and energy efficiency metrics for communication systems of cloud computing data centers. IEEE Trans Cloud Comput 5(4):738\u2013750. https:\/\/doi.org\/10.1109\/TCC.2015.2424892","journal-title":"IEEE Trans Cloud Comput"},{"issue":"18","key":"10756_CR39","doi-asserted-by":"publisher","first-page":"14817","DOI":"10.1007\/S00521-020-04834-6","volume":"32","author":"D Gabi","year":"2020","unstructured":"Gabi D, Ismail AS, Zainal A et al (2020) Cloud customers service selection scheme based on improved conventional cat swarm optimization. Neural Comput Appl 32(18):14817\u201314838. https:\/\/doi.org\/10.1007\/S00521-020-04834-6","journal-title":"Neural Comput Appl"},{"key":"10756_CR40","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/J.JPDC.2018.05.008","volume":"133","author":"L Ghalami","year":"2019","unstructured":"Ghalami L, Grosu D (2019) Scheduling parallel identical machines to minimize makespan: a parallel approximation algorithm. J Parallel Distrib Comput 133:221\u2013231. https:\/\/doi.org\/10.1016\/J.JPDC.2018.05.008","journal-title":"J Parallel Distrib Comput"},{"issue":"9","key":"10756_CR41","doi-asserted-by":"publisher","first-page":"2049","DOI":"10.1007\/S00607-020-00813-W","volume":"102","author":"A Ghasemi","year":"2020","unstructured":"Ghasemi A, Haghighat AT (2020) A multi-objective load balancing algorithm for virtual machine placement in cloud data centers based on machine learning. Computing 102(9):2049\u20132072. https:\/\/doi.org\/10.1007\/S00607-020-00813-W","journal-title":"Computing"},{"key":"10756_CR42","doi-asserted-by":"publisher","DOI":"10.21236\/AD0633642","volume-title":"Introduction to cybernetics","author":"VM Glushkov","year":"1966","unstructured":"Glushkov VM, Kranc GM (1966) Introduction to cybernetics. Academic Press, New York"},{"issue":"7","key":"10756_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1142\/S0218126620501005","volume":"29","author":"M Gokuldhev","year":"2020","unstructured":"Gokuldhev M, Singaravel G, Mohan NRR (2020) Multi-objective local pollination-based gray wolf optimizer for task scheduling heterogeneous cloud environment. J Circuits Syst Comput 29(7):1\u201324. https:\/\/doi.org\/10.1142\/S0218126620501005","journal-title":"J Circuits Syst Comput"},{"key":"10756_CR44","doi-asserted-by":"publisher","unstructured":"Goodarzy S, Nazari M, Han R, et\u00a0al (2020) Resource management in cloud computing using machine learning: a survey. In: Wani MA, Luo F, Li XA, et\u00a0al (eds) 19th IEEE international conference on machine learning and applications, ICMLA 2020, December 14\u201317, 2020. IEEE, Miami, FL, USA, pp 811\u2013816, https:\/\/doi.org\/10.1109\/ICMLA51294.2020.00132","DOI":"10.1109\/ICMLA51294.2020.00132"},{"issue":"2","key":"10756_CR45","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1007\/S10462-021-09996-W","volume":"55","author":"S Gronauer","year":"2022","unstructured":"Gronauer S, Diepold K (2022) Multi-agent deep reinforcement learning: a survey. Artif Intell Rev 55(2):895\u2013943. https:\/\/doi.org\/10.1007\/S10462-021-09996-W","journal-title":"Artif Intell Rev"},{"issue":"4","key":"10756_CR46","doi-asserted-by":"publisher","first-page":"780","DOI":"10.1109\/TCC.2015.2440257","volume":"5","author":"Z Guan","year":"2017","unstructured":"Guan Z, Melodia T (2017) The value of cooperation: minimizing user costs in multi-broker mobile cloud computing networks. IEEE Trans Cloud Comput 5(4):780\u2013791. https:\/\/doi.org\/10.1109\/TCC.2015.2440257","journal-title":"IEEE Trans Cloud Comput"},{"issue":"2","key":"10756_CR47","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1109\/TMC.2018.2831230","volume":"18","author":"S Guo","year":"2019","unstructured":"Guo S, Liu J, Yang Y et al (2019) Energy-efficient dynamic computation offloading and cooperative task scheduling in mobile cloud computing. IEEE Trans Mob Comput 18(2):319\u2013333. https:\/\/doi.org\/10.1109\/TMC.2018.2831230","journal-title":"IEEE Trans Mob Comput"},{"issue":"5","key":"10756_CR48","doi-asserted-by":"publisher","first-page":"3576","DOI":"10.1109\/JIOT.2020.3025015","volume":"8","author":"W Guo","year":"2021","unstructured":"Guo W, Tian W, Ye Y et al (2021) Cloud resource scheduling with deep reinforcement learning and imitation learning. IEEE Internet Things J 8(5):3576\u20133586. https:\/\/doi.org\/10.1109\/JIOT.2020.3025015","journal-title":"IEEE Internet Things J"},{"issue":"5","key":"10756_CR49","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1007\/S00607-019-00784-7","volume":"102","author":"SS Haytamy","year":"2020","unstructured":"Haytamy SS, Omara FA (2020) A deep learning based framework for optimizing cloud consumer qos-based service composition. Computing 102(5):1117\u20131137. https:\/\/doi.org\/10.1007\/S00607-019-00784-7","journal-title":"Computing"},{"issue":"12","key":"10756_CR50","doi-asserted-by":"publisher","first-page":"2759","DOI":"10.1109\/TPDS.2019.2926979","volume":"30","author":"Z Hong","year":"2019","unstructured":"Hong Z, Chen W, Huang H et al (2019) Multi-hop cooperative computation offloading for industrial iot-edge-cloud computing environments. IEEE Trans Parallel Distrib Syst 30(12):2759\u20132774. https:\/\/doi.org\/10.1109\/TPDS.2019.2926979","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"10756_CR51","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1016\/J.JNCA.2018.03.028","volume":"114","author":"H Hu","year":"2018","unstructured":"Hu H, Li Z, Hu H et al (2018) Multi-objective scheduling for scientific workflow in multicloud environment. J Netw Comput Appl 114:108\u2013122. https:\/\/doi.org\/10.1016\/J.JNCA.2018.03.028","journal-title":"J Netw Comput Appl"},{"issue":"2","key":"10756_CR52","doi-asserted-by":"publisher","first-page":"2500","DOI":"10.1109\/JSYST.2023.3249217","volume":"17","author":"J Huang","year":"2023","unstructured":"Huang J, Wan J, Lv B et al (2023) Joint computation offloading and resource allocation for edge-cloud collaboration in internet of vehicles via deep reinforcement learning. IEEE Syst J 17(2):2500\u20132511. https:\/\/doi.org\/10.1109\/JSYST.2023.3249217","journal-title":"IEEE Syst J"},{"key":"10756_CR53","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/J.JPDC.2020.05.002","volume":"143","author":"GJ Ibrahim","year":"2020","unstructured":"Ibrahim GJ, Rashid TA, Akinsolu MO (2020) An energy efficient service composition mechanism using a hybrid meta-heuristic algorithm in a mobile cloud environment. J Parallel Distrib Comput 143:77\u201387. https:\/\/doi.org\/10.1016\/J.JPDC.2020.05.002","journal-title":"J Parallel Distrib Comput"},{"issue":"5","key":"10756_CR54","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.1109\/TPDS.2020.3040800","volume":"32","author":"S Ilager","year":"2021","unstructured":"Ilager S, Ramamohanarao K, Buyya R (2021) Thermal prediction for efficient energy management of clouds using machine learning. IEEE Trans Parallel Distrib Syst 32(5):1044\u20131056. https:\/\/doi.org\/10.1109\/TPDS.2020.3040800","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"10756_CR55","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1016\/J.FUTURE.2019.08.012","volume":"102","author":"G Ismayilov","year":"2020","unstructured":"Ismayilov G, Topcuoglu HR (2020) Neural network based multi-objective evolutionary algorithm for dynamic workflow scheduling in cloud computing. Future Gener Comput Syst 102:307\u2013322. https:\/\/doi.org\/10.1016\/J.FUTURE.2019.08.012","journal-title":"Future Gener Comput Syst"},{"key":"10756_CR56","doi-asserted-by":"publisher","first-page":"1219","DOI":"10.1016\/j.procs.2015.07.419","volume":"57","author":"R Jena","year":"2015","unstructured":"Jena R (2015) Multi objective task scheduling in cloud environment using nested pso framework. Procedia Comput Sci 57:1219\u20131227. https:\/\/doi.org\/10.1016\/j.procs.2015.07.419","journal-title":"Procedia Comput Sci"},{"issue":"3","key":"10756_CR57","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1007\/S10922-014-9307-7","volume":"23","author":"B Jennings","year":"2015","unstructured":"Jennings B, Stadler R (2015) Resource management in clouds: survey and research challenges. J Netw Syst Manag 23(3):567\u2013619. https:\/\/doi.org\/10.1007\/S10922-014-9307-7","journal-title":"J Netw Syst Manag"},{"key":"10756_CR58","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1016\/j.jmsy.2016.09.008","volume":"41","author":"H Jiang","year":"2016","unstructured":"Jiang H, Yi J, Chen S et al (2016) A multi-objective algorithm for task scheduling and resource allocation in cloud-based disassembly. J Manuf Syst 41:239\u2013255. https:\/\/doi.org\/10.1016\/j.jmsy.2016.09.008","journal-title":"J Manuf Syst"},{"key":"10756_CR59","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1613\/JAIR.301","volume":"4","author":"LP Kaelbling","year":"1996","unstructured":"Kaelbling LP, Littman ML, Moore AW (1996) Reinforcement learning: a survey. J Artif Intell Res 4:237\u2013285. https:\/\/doi.org\/10.1613\/JAIR.301","journal-title":"J Artif Intell Res"},{"issue":"3","key":"10756_CR60","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1109\/TPDS.2020.3025914","volume":"32","author":"S Kardani-Moghaddam","year":"2021","unstructured":"Kardani-Moghaddam S, Buyya R, Ramamohanarao K (2021) ADRL: a hybrid anomaly-aware deep reinforcement learning-based resource scaling in clouds. IEEE Trans Parallel Distrib Syst 32(3):514\u2013526. https:\/\/doi.org\/10.1109\/TPDS.2020.3025914","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"19","key":"10756_CR61","doi-asserted-by":"publisher","first-page":"14933","DOI":"10.1007\/S00500-020-04846-3","volume":"24","author":"K Karthiban","year":"2020","unstructured":"Karthiban K, Raj JS (2020) An efficient green computing fair resource allocation in cloud computing using modified deep reinforcement learning algorithm. Soft Comput 24(19):14933\u201314942. https:\/\/doi.org\/10.1007\/S00500-020-04846-3","journal-title":"Soft Comput"},{"issue":"Supplement","key":"10756_CR62","doi-asserted-by":"publisher","first-page":"3165","DOI":"10.1007\/S10586-018-2011-8","volume":"22","author":"S Kayalvili","year":"2019","unstructured":"Kayalvili S, Selvam M (2019) Hybrid SFLA-GA algorithm for an optimal resource allocation in cloud. Clust Comput 22(Supplement):3165\u20133173. https:\/\/doi.org\/10.1007\/S10586-018-2011-8","journal-title":"Clust Comput"},{"key":"10756_CR63","doi-asserted-by":"publisher","DOI":"10.1016\/J.JNCA.2022.103405","volume":"204","author":"T Khan","year":"2022","unstructured":"Khan T, Tian W, Zhou G et al (2022) Machine learning (ml)-centric resource management in cloud computing: a review and future directions. J Netw Comput Appl 204:103405. https:\/\/doi.org\/10.1016\/J.JNCA.2022.103405","journal-title":"J Netw Comput Appl"},{"key":"10756_CR64","doi-asserted-by":"publisher","unstructured":"Kontarinis A, Kantere V, Koziris N (2016) Cloud resource allocation from the user perspective: A bare-bones reinforcement learning approach. In: Web information systems engineering - WISE 2016 - 17th International Conference, Shanghai, China, November 8\u201310, 2016, Proceedings, Part I, pp 457\u2013469, https:\/\/doi.org\/10.1007\/978-3-319-48740-3_34","DOI":"10.1007\/978-3-319-48740-3_34"},{"issue":"4","key":"10756_CR65","doi-asserted-by":"publisher","first-page":"1835","DOI":"10.1007\/S11277-019-06360-8","volume":"107","author":"AMS Kumar","year":"2019","unstructured":"Kumar AMS, Venkatesan M (2019) Multi-objective task scheduling using hybrid genetic-ant colony optimization algorithm in cloud environment. Wirel Pers Commun 107(4):1835\u20131848. https:\/\/doi.org\/10.1007\/S11277-019-06360-8","journal-title":"Wirel Pers Commun"},{"key":"10756_CR66","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/J.JNCA.2019.06.006","volume":"143","author":"M Kumar","year":"2019","unstructured":"Kumar M, Sharma SC, Goel A et al (2019) A comprehensive survey for scheduling techniques in cloud computing. J Netw Comput Appl 143:1\u201333. https:\/\/doi.org\/10.1016\/J.JNCA.2019.06.006","journal-title":"J Netw Comput Appl"},{"key":"10756_CR67","doi-asserted-by":"publisher","DOI":"10.1016\/J.RCIM.2019.101850","volume":"61","author":"Y Laili","year":"2020","unstructured":"Laili Y, Lin S, Tang D (2020) Multi-phase integrated scheduling of hybrid tasks in cloud manufacturing environment. Robot Comput-Integr Manuf 61:101850. https:\/\/doi.org\/10.1016\/J.RCIM.2019.101850","journal-title":"Robot Comput-Integr Manuf"},{"key":"10756_CR68","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/J.INS.2019.12.049","volume":"516","author":"C Li","year":"2020","unstructured":"Li C, Bai J, Chen Y et al (2020) Resource and replica management strategy for optimizing financial cost and user experience in edge cloud computing system. Inform Sci 516:33\u201355. https:\/\/doi.org\/10.1016\/J.INS.2019.12.049","journal-title":"Inform Sci"},{"issue":"3","key":"10756_CR69","doi-asserted-by":"publisher","first-page":"2793","DOI":"10.1007\/S10586-017-0893-5","volume":"20","author":"H Li","year":"2017","unstructured":"Li H, Zhu G, Zhao Y et al (2017) Energy-efficient and qos-aware model based resource consolidation in cloud data centers. Clust Comput 20(3):2793\u20132803. https:\/\/doi.org\/10.1007\/S10586-017-0893-5","journal-title":"Clust Comput"},{"issue":"8","key":"10756_CR70","doi-asserted-by":"publisher","first-page":"1717","DOI":"10.1007\/S00607-023-01171-Z","volume":"105","author":"H Li","year":"2023","unstructured":"Li H, Lu L, Shi W et al (2023) Energy-aware scheduling for spark job based on deep reinforcement learning in cloud. Computing 105(8):1717\u20131743. https:\/\/doi.org\/10.1007\/S00607-023-01171-Z","journal-title":"Computing"},{"key":"10756_CR71","doi-asserted-by":"publisher","unstructured":"Li L (2009) An optimistic differentiated service job scheduling system for cloud computing service users and providers. In: 2009 Third international conference on multimedia and ubiquitous engineering, MUE 2009, June 4\u20136, 2009. IEEE Computer Society, Qingdao, China, pp 295\u2013299, https:\/\/doi.org\/10.1109\/MUE.2009.58","DOI":"10.1109\/MUE.2009.58"},{"issue":"10","key":"10756_CR72","doi-asserted-by":"publisher","first-page":"9399","DOI":"10.1109\/JIOT.2020.3007869","volume":"7","author":"M Li","year":"2020","unstructured":"Li M, Yu FR, Si P et al (2020) Resource optimization for delay-tolerant data in blockchain-enabled iot with edge computing: a deep reinforcement learning approach. IEEE Internet Things J 7(10):9399\u20139412. https:\/\/doi.org\/10.1109\/JIOT.2020.3007869","journal-title":"IEEE Internet Things J"},{"issue":"7","key":"10756_CR73","doi-asserted-by":"publisher","first-page":"5976","DOI":"10.1109\/JIOT.2019.2953108","volume":"7","author":"Q Li","year":"2020","unstructured":"Li Q, Yao H, Mai T et al (2020) Reinforcement-learning- and belief-learning-based double auction mechanism for edge computing resource allocation. IEEE Internet Things J 7(7):5976\u20135985. https:\/\/doi.org\/10.1109\/JIOT.2019.2953108","journal-title":"IEEE Internet Things J"},{"key":"10756_CR74","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/J.SUSCOM.2017.10.007","volume":"20","author":"W Lin","year":"2018","unstructured":"Lin W, Wang W, Wu W et al (2018) A heuristic task scheduling algorithm based on server power efficiency model in cloud environments. Sustain Comput Inform Syst 20:56\u201365. https:\/\/doi.org\/10.1016\/J.SUSCOM.2017.10.007","journal-title":"Sustain Comput Inform Syst"},{"issue":"5","key":"10756_CR75","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3406208","volume":"53","author":"W Lin","year":"2021","unstructured":"Lin W, Shi F, Wu W et al (2021) A taxonomy and survey of power models and power modeling for cloud servers. ACM Comput Surv 53(5):1\u201341. https:\/\/doi.org\/10.1145\/3406208","journal-title":"ACM Comput Surv"},{"issue":"2","key":"10756_CR76","doi-asserted-by":"publisher","first-page":"766","DOI":"10.1109\/TSC.2019.2961082","volume":"15","author":"W Lin","year":"2022","unstructured":"Lin W, Wu W, He L (2022) An on-line virtual machine consolidation strategy for dual improvement in performance and energy conservation of server clusters in cloud data centers. IEEE Trans Serv Comput 15(2):766\u2013777. https:\/\/doi.org\/10.1109\/TSC.2019.2961082","journal-title":"IEEE Trans Serv Comput"},{"issue":"4","key":"10756_CR77","doi-asserted-by":"publisher","first-page":"3643","DOI":"10.1109\/TCC.2023.3308927","volume":"11","author":"W Lin","year":"2023","unstructured":"Lin W, Luo X, Li C et al (2023) An energy-efficient tuning method for cloud servers combining DVFS and parameter optimization. IEEE Trans Cloud Comput 11(4):3643\u20133655. https:\/\/doi.org\/10.1109\/TCC.2023.3308927","journal-title":"IEEE Trans Cloud Comput"},{"issue":"12","key":"10756_CR78","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3573009","volume":"55","author":"W Lin","year":"2023","unstructured":"Lin W, Xiong C, Wu W et al (2023) Performance interference of virtual machines: a survey. ACM Comput Surv 55(12):1\u201337. https:\/\/doi.org\/10.1145\/3573009","journal-title":"ACM Comput Surv"},{"key":"10756_CR79","doi-asserted-by":"publisher","unstructured":"Liu N, Li Z, Xu J, et\u00a0al (2017) A hierarchical framework of cloud resource allocation and power management using deep reinforcement learning. In: 37th IEEE international conference on distributed computing systems, ICDCS 2017, June 5\u20138, 2017. IEEE Computer Society, Atlanta, GA, USA, pp 372\u2013382, https:\/\/doi.org\/10.1109\/ICDCS.2017.123","DOI":"10.1109\/ICDCS.2017.123"},{"issue":"17","key":"10756_CR80","doi-asserted-by":"publisher","first-page":"4002","DOI":"10.1002\/SEC.1582","volume":"9","author":"Q Liu","year":"2016","unstructured":"Liu Q, Cai W, Shen J et al (2016) A speculative approach to spatial-temporal efficiency with multi-objective optimization in a heterogeneous cloud environment. Secur Commun Netw 9(17):4002\u20134012. https:\/\/doi.org\/10.1002\/SEC.1582","journal-title":"Secur Commun Netw"},{"issue":"1","key":"10756_CR81","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1109\/TEVC.2016.2623803","volume":"22","author":"XF Liu","year":"2018","unstructured":"Liu XF, Zhan Z, Deng JD et al (2018) An energy efficient ant colony system for virtual machine placement in cloud computing. IEEE Trans Evol Comput 22(1):113\u2013128. https:\/\/doi.org\/10.1109\/TEVC.2016.2623803","journal-title":"IEEE Trans Evol Comput"},{"key":"10756_CR82","doi-asserted-by":"publisher","unstructured":"Lolos K, Konstantinou I, Kantere V, et\u00a0al (2017a) Elastic management of cloud applications using adaptive reinforcement learning. In: 2017 IEEE international conference on big data, BigData 2017, December 11\u201314, 2017. IEEE Computer Society, Boston, MA, USA, pp 203\u2013212, https:\/\/doi.org\/10.1109\/BIGDATA.2017.8257928","DOI":"10.1109\/BIGDATA.2017.8257928"},{"key":"10756_CR83","doi-asserted-by":"publisher","unstructured":"Lolos K, Konstantinou I, Kantere V, et\u00a0al (2017b) Rethinking reinforcement learning for cloud elasticity. In: Proceedings of the 2017 symposium on cloud computing, SoCC 2017, September 24\u201327, 2017. ACM, Santa Clara, CA, USA, p 648, https:\/\/doi.org\/10.1145\/3127479.3131211","DOI":"10.1145\/3127479.3131211"},{"key":"10756_CR84","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1016\/J.FUTURE.2019.07.019","volume":"102","author":"H Lu","year":"2020","unstructured":"Lu H, Gu C, Luo F et al (2020) Optimization of lightweight task offloading strategy for mobile edge computing based on deep reinforcement learning. Future Gener Comput Syst 102:847\u2013861. https:\/\/doi.org\/10.1016\/J.FUTURE.2019.07.019","journal-title":"Future Gener Comput Syst"},{"issue":"4","key":"10756_CR85","doi-asserted-by":"publisher","first-page":"3133","DOI":"10.1109\/COMST.2019.2916583","volume":"21","author":"NC Luong","year":"2019","unstructured":"Luong NC, Hoang DT, Gong S et al (2019) Applications of deep reinforcement learning in communications and networking: a survey. IEEE Commun Surv Tutor 21(4):3133\u20133174. https:\/\/doi.org\/10.1109\/COMST.2019.2916583","journal-title":"IEEE Commun Surv Tutor"},{"key":"10756_CR86","doi-asserted-by":"publisher","DOI":"10.1002\/CPE.6195","author":"M Mahil","year":"2021","unstructured":"Mahil M, Jayasree, (2021) Combined particle swarm optimization and ant colony system for energy efficient cloud data centers. Concurr Comput Pract Exp. https:\/\/doi.org\/10.1002\/CPE.6195","journal-title":"Concurr Comput Pract Exp"},{"key":"10756_CR87","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1016\/J.CIE.2019.03.006","volume":"130","author":"N Mansouri","year":"2019","unstructured":"Mansouri N, Zade BMH, Javidi MM (2019) Hybrid task scheduling strategy for cloud computing by modified particle swarm optimization and fuzzy theory. Comput Ind Eng 130:597\u2013633. https:\/\/doi.org\/10.1016\/J.CIE.2019.03.006","journal-title":"Comput Ind Eng"},{"issue":"1","key":"10756_CR88","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1109\/TPDS.2018.2851246","volume":"30","author":"J Mei","year":"2019","unstructured":"Mei J, Li K, Tong Z et al (2019) Profit maximization for cloud brokers in cloud computing. IEEE Trans Parallel Distrib Syst 30(1):190\u2013203. https:\/\/doi.org\/10.1109\/TPDS.2018.2851246","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"1","key":"10756_CR89","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1216370.1216371","volume":"39","author":"J van der Merwe","year":"2007","unstructured":"van der Merwe J, Dawoud DS, McDonald S (2007) A survey on peer-to-peer key management for mobile ad hoc networks. ACM Comput Surv 39(1):1. https:\/\/doi.org\/10.1145\/1216370.1216371","journal-title":"ACM Comput Surv"},{"key":"10756_CR90","doi-asserted-by":"publisher","first-page":"925","DOI":"10.1016\/J.FUTURE.2019.09.035","volume":"102","author":"Y Miao","year":"2020","unstructured":"Miao Y, Wu G, Li M et al (2020) Intelligent task prediction and computation offloading based on mobile-edge cloud computing. Future Gener Comput Syst 102:925\u2013931. https:\/\/doi.org\/10.1016\/J.FUTURE.2019.09.035","journal-title":"Future Gener Comput Syst"},{"key":"10756_CR91","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/J.JNCA.2017.11.016","volume":"103","author":"S Midya","year":"2018","unstructured":"Midya S, Roy A, Majumder K et al (2018) Multi-objective optimization technique for resource allocation and task scheduling in vehicular cloud architecture: a hybrid adaptive nature inspired approach. J Netw Comput Appl 103:58\u201384. https:\/\/doi.org\/10.1016\/J.JNCA.2017.11.016","journal-title":"J Netw Comput Appl"},{"issue":"2","key":"10756_CR92","doi-asserted-by":"publisher","first-page":"759","DOI":"10.1007\/S12065-020-00436-2","volume":"14","author":"AJ Miriam","year":"2021","unstructured":"Miriam AJ, Saminathan R, Chakaravarthi S (2021) Non-dominated sorting genetic algorithm (NSGA-III) for effective resource allocation in cloud. Evol Intell 14(2):759\u2013765. https:\/\/doi.org\/10.1007\/S12065-020-00436-2","journal-title":"Evol Intell"},{"issue":"4","key":"10756_CR93","doi-asserted-by":"publisher","first-page":"3079","DOI":"10.1007\/S10586-020-03071-9","volume":"23","author":"SK Mishra","year":"2020","unstructured":"Mishra SK, Manjula R (2020) A meta-heuristic based multi objective optimization for load distribution in cloud data center under varying workloads. Clust Comput 23(4):3079\u20133093. https:\/\/doi.org\/10.1007\/S10586-020-03071-9","journal-title":"Clust Comput"},{"key":"10756_CR94","doi-asserted-by":"publisher","DOI":"10.1016\/J.JNCA.2019.102464","author":"DA Monge","year":"2020","unstructured":"Monge DA, Pacini E, Mateos C et al (2020) CMI: an online multi-objective genetic autoscaler for scientific and engineering workflows in cloud infrastructures with unreliable virtual machines. J Netw Comput Appl. https:\/\/doi.org\/10.1016\/J.JNCA.2019.102464","journal-title":"J Netw Comput Appl"},{"issue":"5","key":"10756_CR95","doi-asserted-by":"publisher","first-page":"10769","DOI":"10.1007\/S10586-017-1174-Z","volume":"22","author":"B Muthulakshmi","year":"2019","unstructured":"Muthulakshmi B, Somasundaram K (2019) A hybrid ABC-SA based optimized scheduling and resource allocation for cloud environment. Clust Comput 22(5):10769\u201310777. https:\/\/doi.org\/10.1007\/S10586-017-1174-Z","journal-title":"Clust Comput"},{"issue":"4","key":"10756_CR96","doi-asserted-by":"publisher","first-page":"1887","DOI":"10.1007\/S11277-019-06817-W","volume":"110","author":"G Natesan","year":"2020","unstructured":"Natesan G, Chokkalingam A (2020) Multi-objective task scheduling using hybrid whale genetic optimization algorithm in heterogeneous computing environment. Wirel Pers Commun 110(4):1887\u20131913. https:\/\/doi.org\/10.1007\/S11277-019-06817-W","journal-title":"Wirel Pers Commun"},{"key":"10756_CR97","doi-asserted-by":"publisher","unstructured":"Ni X, Li J, Yu M, et\u00a0al (2020) Generalizable resource allocation in stream processing via deep reinforcement learning. In: The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, February 7\u201312, 2020. AAAI Press, New York, NY, USA, pp 857\u2013864, https:\/\/doi.org\/10.1609\/AAAI.V34I01.5431","DOI":"10.1609\/AAAI.V34I01.5431"},{"key":"10756_CR98","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1016\/J.FUTURE.2018.11.049","volume":"94","author":"SMR Nouri","year":"2019","unstructured":"Nouri SMR, Li H, Venugopal S et al (2019) Autonomic decentralized elasticity based on a reinforcement learning controller for cloud applications. Future Gener Comput Syst 94:765\u2013780. https:\/\/doi.org\/10.1016\/J.FUTURE.2018.11.049","journal-title":"Future Gener Comput Syst"},{"key":"10756_CR99","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1016\/J.COMCOM.2020.06.016","volume":"160","author":"S Pandiyan","year":"2020","unstructured":"Pandiyan S, Lawrence TS, Sathiyamoorthi V et al (2020) A performance-aware dynamic scheduling algorithm for cloud-based iot applications. Comput Commun 160:512\u2013520. https:\/\/doi.org\/10.1016\/J.COMCOM.2020.06.016","journal-title":"Comput Commun"},{"issue":"8","key":"10756_CR100","doi-asserted-by":"publisher","first-page":"1947","DOI":"10.1109\/TPDS.2021.3052895","volume":"32","author":"Y Peng","year":"2021","unstructured":"Peng Y, Bao Y, Chen Y et al (2021) DL2: a deep learning-driven scheduler for deep learning clusters. IEEE Trans Parallel Distrib Syst 32(8):1947\u20131960. https:\/\/doi.org\/10.1109\/TPDS.2021.3052895","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"4","key":"10756_CR101","doi-asserted-by":"publisher","first-page":"1595","DOI":"10.1007\/S10586-015-0484-2","volume":"18","author":"Z Peng","year":"2015","unstructured":"Peng Z, Cui D, Zuo J et al (2015) Random task scheduling scheme based on reinforcement learning in cloud computing. Clust Comput 18(4):1595\u20131607. https:\/\/doi.org\/10.1007\/S10586-015-0484-2","journal-title":"Clust Comput"},{"key":"10756_CR102","doi-asserted-by":"publisher","unstructured":"Price CC (1982) Task allocation in distributed systems: a survey of practical strategies. In: Proceedings of the ACM\u201982 conference, pp 176\u2013181, https:\/\/doi.org\/10.1145\/800174.809792","DOI":"10.1145\/800174.809792"},{"key":"10756_CR103","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1016\/J.ASOC.2018.12.021","volume":"76","author":"V Priya","year":"2019","unstructured":"Priya V, Kumar CS, Kannan R (2019) Resource scheduling algorithm with load balancing for cloud service provisioning. Appl Soft Comput 76:416\u2013424. https:\/\/doi.org\/10.1016\/J.ASOC.2018.12.021","journal-title":"Appl Soft Comput"},{"issue":"10","key":"10756_CR104","doi-asserted-by":"publisher","first-page":"3975","DOI":"10.1007\/S12652-019-01631-5","volume":"11","author":"A Ragmani","year":"2020","unstructured":"Ragmani A, Elomri A, Abghour N et al (2020) FACO: a hybrid fuzzy ant colony optimization algorithm for virtual machine scheduling in high-performance cloud computing. J Ambient Intell Human Comput 11(10):3975\u20133987. https:\/\/doi.org\/10.1007\/S12652-019-01631-5","journal-title":"J Ambient Intell Human Comput"},{"key":"10756_CR105","doi-asserted-by":"publisher","unstructured":"Ramezani F, Lu J, Hussain FK (2013) Task scheduling optimization in cloud computing applying multi-objective particle swarm optimization. In: Service-oriented computing - 11th international conference, ICSOC 2013, December 2\u20135, 2013, Proceedings, Lecture Notes in Computer Science, vol 8274. Springer, Berlin, Germany, pp 237\u2013251, https:\/\/doi.org\/10.1007\/978-3-642-45005-1_17","DOI":"10.1007\/978-3-642-45005-1_17"},{"issue":"6","key":"10756_CR106","doi-asserted-by":"publisher","first-page":"1737","DOI":"10.1007\/S11280-015-0335-3","volume":"18","author":"F Ramezani","year":"2015","unstructured":"Ramezani F, Lu J, Taheri J et al (2015) Evolutionary algorithm-based multi-objective task scheduling optimization model in cloud environments. World Wide Web 18(6):1737\u20131757. https:\/\/doi.org\/10.1007\/S11280-015-0335-3","journal-title":"World Wide Web"},{"key":"10756_CR107","doi-asserted-by":"publisher","unstructured":"Reddy GN, Kumar SP (2017) Multi objective task scheduling algorithm for cloud computing using whale optimization technique. In: International conference on next generation computing technologies, Springer, pp 286\u2013297, https:\/\/doi.org\/10.1007\/978-981-10-8657-1_22","DOI":"10.1007\/978-981-10-8657-1_22"},{"key":"10756_CR108","doi-asserted-by":"publisher","DOI":"10.1002\/CPE.4949","author":"A Rehman","year":"2019","unstructured":"Rehman A, Hussain SS, Rehman Z et al (2019) Multi-objective approach of energy efficient workflow scheduling in cloud environments. Concurr Comput Pract Exp. https:\/\/doi.org\/10.1002\/CPE.4949","journal-title":"Concurr Comput Pract Exp"},{"issue":"4","key":"10756_CR109","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3414840","volume":"20","author":"H Ren","year":"2020","unstructured":"Ren H, Wang Y, Xu C et al (2020) Smig-rl: an evolutionary migration framework for cloud services based on deep reinforcement learning. ACM Trans Internet Tech 20(4):1\u201318. https:\/\/doi.org\/10.1145\/3414840","journal-title":"ACM Trans Internet Tech"},{"issue":"6","key":"10756_CR110","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3362031","volume":"52","author":"J Ren","year":"2020","unstructured":"Ren J, Zhang D, He S et al (2020) A survey on end-edge-cloud orchestrated network computing paradigms: transparent computing, mobile edge computing, fog computing, and cloudlet. ACM Comput Surv 52(6):1\u201336. https:\/\/doi.org\/10.1145\/3362031","journal-title":"ACM Comput Surv"},{"issue":"3","key":"10756_CR111","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1007\/S10723-009-9132-5","volume":"7","author":"T Rings","year":"2009","unstructured":"Rings T, Caryer G, Gallop JR et al (2009) Grid and cloud computing: opportunities for integration with the next generation network. J Grid Comput 7(3):375\u2013393. https:\/\/doi.org\/10.1007\/S10723-009-9132-5","journal-title":"J Grid Comput"},{"key":"10756_CR112","doi-asserted-by":"publisher","first-page":"1079","DOI":"10.1016\/J.FUTURE.2019.11.019","volume":"110","author":"G Rjoub","year":"2020","unstructured":"Rjoub G, Bentahar J, Wahab OA (2020) Bigtrustscheduling: trust-aware big data task scheduling approach in cloud computing environments. Future Gener Comput Syst 110:1079\u20131097. https:\/\/doi.org\/10.1016\/J.FUTURE.2019.11.019","journal-title":"Future Gener Comput Syst"},{"issue":"1","key":"10756_CR113","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1109\/COMST.2019.2943405","volume":"22","author":"TK Rodrigues","year":"2020","unstructured":"Rodrigues TK, Suto K, Nishiyama H et al (2020) Machine learning meets computation and communication control in evolving edge and cloud: challenges and future perspective. IEEE Commun Surv Tutor 22(1):38\u201367. https:\/\/doi.org\/10.1109\/COMST.2019.2943405","journal-title":"IEEE Commun Surv Tutor"},{"issue":"4","key":"10756_CR114","doi-asserted-by":"publisher","first-page":"891","DOI":"10.1016\/j.jestch.2019.11.002","volume":"23","author":"M Sanaj","year":"2020","unstructured":"Sanaj M, Prathap PJ (2020) Nature inspired chaotic squirrel search algorithm (cssa) for multi objective task scheduling in an iaas cloud computing atmosphere. Eng Sci Technol Int J 23(4):891\u2013902. https:\/\/doi.org\/10.1016\/j.jestch.2019.11.002","journal-title":"Eng Sci Technol Int J"},{"issue":"8","key":"10756_CR115","doi-asserted-by":"publisher","first-page":"155014772094914","DOI":"10.1177\/1550147720949142","volume":"16","author":"M Sardaraz","year":"2020","unstructured":"Sardaraz M, Tahir M (2020) A parallel multi-objective genetic algorithm for scheduling scientific workflows in cloud computing. Int J Distrib Sens Netw 16(8):1550147720949142. https:\/\/doi.org\/10.1177\/1550147720949142","journal-title":"Int J Distrib Sens Netw"},{"key":"10756_CR1","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/J.SUSCOM.2019.04.004","volume":"22","author":"A Sc","year":"2019","unstructured":"Sc A, Sudhakar C, Ramesh T (2019) Energy efficient VM scheduling and routing in multi-tenant cloud data center. Sustain Comput Inform Syst 22:139\u2013151. https:\/\/doi.org\/10.1016\/J.SUSCOM.2019.04.004","journal-title":"Sustain Comput Inform Syst"},{"key":"10756_CR116","doi-asserted-by":"publisher","unstructured":"Seada H, Deb K (2015) U-NSGA-III: A unified evolutionary optimization procedure for single, multiple, and many objectives: proof-of-principle results. In: Gaspar-Cunha A, Antunes CH, Coello CAC (eds) Evolutionary multi-criterion optimization - 8th international conference, EMO 2015, Guimar\u00e3es, Portugal, March 29\u2013April 1, 2015. Proceedings, Part II, Lecture Notes in Computer Science, vol 9019. Springer, pp 34\u201349, https:\/\/doi.org\/10.1007\/978-3-319-15892-1_3","DOI":"10.1007\/978-3-319-15892-1_3"},{"key":"10756_CR117","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/J.COMCOM.2020.05.037","volume":"160","author":"N Shan","year":"2020","unstructured":"Shan N, Cui X, Gao Z (2020) drl + fl: an intelligent resource allocation model based on deep reinforcement learning for mobile edge computing. Comput Commun 160:14\u201324. https:\/\/doi.org\/10.1016\/J.COMCOM.2020.05.037","journal-title":"Comput Commun"},{"key":"10756_CR118","doi-asserted-by":"publisher","unstructured":"Shao J, Ma J, Li Y, et\u00a0al (2019) GPU scheduling for short tasks in private cloud. In: 13th IEEE international conference on service-oriented system engineering, SOSE 2019, April 4\u20139, 2019. IEEE, San Francisco, CA, USA, https:\/\/doi.org\/10.1109\/SOSE.2019.00037","DOI":"10.1109\/SOSE.2019.00037"},{"key":"10756_CR119","doi-asserted-by":"publisher","unstructured":"Shishira SR, Kandasamy A, Chandrasekaran K (2016) Survey on meta heuristic optimization techniques in cloud computing. In: 2016 International conference on advances in computing, communications and informatics, ICACCI 2016, September 21\u201324, 2016. IEEE, Jaipur, India, pp 1434\u20131440, https:\/\/doi.org\/10.1109\/ICACCI.2016.7732249","DOI":"10.1109\/ICACCI.2016.7732249"},{"issue":"3","key":"10756_CR120","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3494520","volume":"55","author":"RM Singh","year":"2023","unstructured":"Singh RM, Awasthi LK, Sikka G (2023) Towards metaheuristic scheduling techniques in cloud and fog: an extensive taxonomic review. ACM Comput Surv 55(3):1\u201343. https:\/\/doi.org\/10.1145\/3494520","journal-title":"ACM Comput Surv"},{"issue":"2","key":"10756_CR121","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1007\/S10922-017-9425-0","volume":"26","author":"AS Sofia","year":"2018","unstructured":"Sofia AS, Ganeshkumar P (2018) Multi-objective task scheduling to minimize energy consumption and makespan of cloud computing using NSGA-II. J Netw Syst Manag 26(2):463\u2013485. https:\/\/doi.org\/10.1007\/S10922-017-9425-0","journal-title":"J Netw Syst Manag"},{"key":"10756_CR122","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/J.FUTURE.2019.09.044","volume":"104","author":"G Sun","year":"2020","unstructured":"Sun G, Zhan T, Boateng GO et al (2020) Revised reinforcement learning based on anchor graph hashing for autonomous cell activation in cloud-rans. Future Gener Comput Syst 104:60\u201373. https:\/\/doi.org\/10.1016\/J.FUTURE.2019.09.044","journal-title":"Future Gener Comput Syst"},{"issue":"3","key":"10756_CR123","doi-asserted-by":"publisher","first-page":"1773","DOI":"10.1007\/S11227-013-0974-Z","volume":"66","author":"W Tian","year":"2013","unstructured":"Tian W, Xiong Q, Cao J (2013) An online parallel scheduling method with application to energy-efficiency in cloud computing. J Supercomput 66(3):1773\u20131790. https:\/\/doi.org\/10.1007\/S11227-013-0974-Z","journal-title":"J Supercomput"},{"issue":"6","key":"10756_CR124","doi-asserted-by":"publisher","first-page":"2376","DOI":"10.1007\/S11227-016-1737-4","volume":"72","author":"W Tian","year":"2016","unstructured":"Tian W, Li G, Yang W et al (2016) Hscheduler: an optimal approach to minimize the makespan of multiple mapreduce jobs. J Supercomput 72(6):2376\u20132393. https:\/\/doi.org\/10.1007\/S11227-016-1737-4","journal-title":"J Supercomput"},{"key":"10756_CR125","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1016\/J.JNCA.2018.03.033","volume":"113","author":"W Tian","year":"2018","unstructured":"Tian W, He M, Guo W et al (2018) On minimizing total energy consumption in the scheduling of virtual machine reservations. J Netw Comput Appl 113:64\u201374. https:\/\/doi.org\/10.1016\/J.JNCA.2018.03.033","journal-title":"J Netw Comput Appl"},{"key":"10756_CR126","doi-asserted-by":"publisher","first-page":"1170","DOI":"10.1016\/J.INS.2019.10.035","volume":"512","author":"Z Tong","year":"2020","unstructured":"Tong Z, Chen H, Deng X et al (2020) A scheduling scheme in the cloud computing environment using deep Q-learning. Inform Sci 512:1170\u20131191. https:\/\/doi.org\/10.1016\/J.INS.2019.10.035","journal-title":"Inform Sci"},{"issue":"3","key":"10756_CR127","doi-asserted-by":"publisher","first-page":"940","DOI":"10.1109\/TMC.2020.3017079","volume":"21","author":"S Tuli","year":"2022","unstructured":"Tuli S, Ilager S, Ramamohanarao K et al (2022) Dynamic scheduling for stochastic edge-cloud computing environments using A3C learning and residual recurrent neural networks. IEEE Trans Mob Comput 21(3):940\u2013954. https:\/\/doi.org\/10.1109\/TMC.2020.3017079","journal-title":"IEEE Trans Mob Comput"},{"issue":"7","key":"10756_CR128","doi-asserted-by":"publisher","first-page":"1518","DOI":"10.1109\/TPDS.2020.2968913","volume":"31","author":"B Wan","year":"2020","unstructured":"Wan B, Dang J, Li Z et al (2020) Modeling analysis and cost-performance ratio optimization of virtual machine scheduling in cloud computing. IEEE Trans Parallel Distrib Syst 31(7):1518\u20131532. https:\/\/doi.org\/10.1109\/TPDS.2020.2968913","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"12","key":"10756_CR129","doi-asserted-by":"publisher","first-page":"1726","DOI":"10.1631\/FITEE.1900533","volume":"21","author":"H Wang","year":"2020","unstructured":"Wang H, Liu N, Zhang Y et al (2020) Deep reinforcement learning: a survey. Front Inform Technol Electron Eng 21(12):1726\u20131744. https:\/\/doi.org\/10.1631\/FITEE.1900533","journal-title":"Front Inform Technol Electron Eng"},{"issue":"1","key":"10756_CR130","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1109\/TPDS.2020.3014896","volume":"32","author":"J Wang","year":"2021","unstructured":"Wang J, Hu J, Min G et al (2021) Fast adaptive task offloading in edge computing based on meta reinforcement learning. IEEE Trans Parallel Distrib Syst 32(1):242\u2013253. https:\/\/doi.org\/10.1109\/TPDS.2020.3014896","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"10","key":"10756_CR131","doi-asserted-by":"publisher","first-page":"2822","DOI":"10.1109\/TPDS.2014.2362139","volume":"26","author":"W Wang","year":"2015","unstructured":"Wang W, Liang B, Li B (2015) Multi-resource fair allocation in heterogeneous cloud computing systems. IEEE Trans Parallel Distrib Syst 26(10):2822\u20132835. https:\/\/doi.org\/10.1109\/TPDS.2014.2362139","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"10756_CR132","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/J.FUTURE.2013.12.004","volume":"36","author":"X Wang","year":"2014","unstructured":"Wang X, Wang Y, Cui Y (2014) A new multi-objective bi-level programming model for energy and locality aware multi-job scheduling in cloud computing. Future Gener Comput Syst 36:91\u2013101. https:\/\/doi.org\/10.1016\/J.FUTURE.2013.12.004","journal-title":"Future Gener Comput Syst"},{"issue":"2","key":"10756_CR133","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1109\/TPDS.2020.3023936","volume":"32","author":"X Wang","year":"2021","unstructured":"Wang X, Ning Z, Guo S (2021) Multi-agent imitation learning for pervasive edge computing: a decentralized computation offloading algorithm. IEEE Trans Parallel Distrib Syst 32(2):411\u2013425. https:\/\/doi.org\/10.1109\/TPDS.2020.3023936","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"10756_CR134","doi-asserted-by":"publisher","DOI":"10.1016\/J.JII.2023.100471","volume":"34","author":"X Wang","year":"2023","unstructured":"Wang X, Zhang L, Liu Y et al (2023) Logistics-involved task scheduling in cloud manufacturing with offline deep reinforcement learning. J Ind Inform Integr 34:100471. https:\/\/doi.org\/10.1016\/J.JII.2023.100471","journal-title":"J Ind Inform Integr"},{"issue":"3","key":"10756_CR135","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3388922","volume":"53","author":"T Welsh","year":"2020","unstructured":"Welsh T, Benkhelifa E (2020) On resilience in cloud computing: a survey of techniques across the cloud domain. ACM Comput Surv 53(3):1\u201336. https:\/\/doi.org\/10.1145\/3388922","journal-title":"ACM Comput Surv"},{"issue":"6","key":"10756_CR136","doi-asserted-by":"publisher","first-page":"925","DOI":"10.1109\/TSC.2016.2642182","volume":"12","author":"K Xie","year":"2019","unstructured":"Xie K, Wang X, Xie G et al (2019) Distributed multi-dimensional pricing for efficient application offloading in mobile cloud computing. IEEE Trans Serv Comput 12(6):925\u2013940. https:\/\/doi.org\/10.1109\/TSC.2016.2642182","journal-title":"IEEE Trans Serv Comput"},{"issue":"2","key":"10756_CR137","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/J.JPDC.2011.10.003","volume":"72","author":"C Xu","year":"2012","unstructured":"Xu C, Rao J, Bu X (2012) URL: a unified reinforcement learning approach for autonomic cloud management. J Parallel Distrib Comput 72(2):95\u2013105. https:\/\/doi.org\/10.1016\/J.JPDC.2011.10.003","journal-title":"J Parallel Distrib Comput"},{"issue":"1","key":"10756_CR138","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3234151","volume":"52","author":"M Xu","year":"2019","unstructured":"Xu M, Buyya R (2019) Brownout approach for adaptive management of resources and applications in cloud computing systems: a taxonomy and future directions. ACM Comput Surv 52(1):1\u201327. https:\/\/doi.org\/10.1145\/3234151","journal-title":"ACM Comput Surv"},{"key":"10756_CR139","doi-asserted-by":"publisher","unstructured":"Xu M, Cui L, Wang H, et\u00a0al (2009) A multiple qos constrained scheduling strategy of multiple workflows for cloud computing. In: IEEE International symposium on parallel and distributed processing with applications, ISPA 2009, 10\u201312 August 2009. IEEE Computer Society, Chengdu, Sichuan, China, pp 629\u2013634, https:\/\/doi.org\/10.1109\/ISPA.2009.95","DOI":"10.1109\/ISPA.2009.95"},{"key":"10756_CR140","doi-asserted-by":"publisher","DOI":"10.1002\/CPE.4123","author":"M Xu","year":"2017","unstructured":"Xu M, Tian W, Buyya R (2017) A survey on load balancing algorithms for virtual machines placement in cloud computing. Concurr Comput Pract Exp. https:\/\/doi.org\/10.1002\/CPE.4123","journal-title":"Concurr Comput Pract Exp"},{"key":"10756_CR141","doi-asserted-by":"publisher","first-page":"522","DOI":"10.1016\/J.FUTURE.2018.12.055","volume":"95","author":"X Xu","year":"2019","unstructured":"Xu X, Liu Q, Luo Y et al (2019) A computation offloading method over big data for iot-enabled cloud-edge computing. Future Gener Comput Syst 95:522\u2013533. https:\/\/doi.org\/10.1016\/J.FUTURE.2018.12.055","journal-title":"Future Gener Comput Syst"},{"key":"10756_CR142","doi-asserted-by":"publisher","unstructured":"Xu Z, Wang Y, Tang J, et\u00a0al (2017b) A deep reinforcement learning based framework for power-efficient resource allocation in cloud rans. In: IEEE international conference on communications, ICC 2017, May 21\u201325, 2017. IEEE, Paris, France, pp 1\u20136, https:\/\/doi.org\/10.1109\/ICC.2017.7997286","DOI":"10.1109\/ICC.2017.7997286"},{"issue":"7","key":"10756_CR143","doi-asserted-by":"publisher","first-page":"2533","DOI":"10.1109\/TMC.2020.3044282","volume":"21","author":"Z Xu","year":"2022","unstructured":"Xu Z, Tang J, Yin C et al (2022) Recarl: resource allocation in cloud rans with deep reinforcement learning. IEEE Trans Mob Comput 21(7):2533\u20132545. https:\/\/doi.org\/10.1109\/TMC.2020.3044282","journal-title":"IEEE Trans Mob Comput"},{"key":"10756_CR144","doi-asserted-by":"publisher","unstructured":"Yan L, Rong C, Zhao G (2009) Strengthen cloud computing security with federal identity management using hierarchical identity-based cryptography. In: Cloud computing, first international conference, CloudCom 2009, December 1\u20134, 2009. Proceedings, Lecture Notes in Computer Science, vol 5931. Springer, Beijing, China, pp 167\u2013177, https:\/\/doi.org\/10.1007\/978-3-642-10665-1_15","DOI":"10.1007\/978-3-642-10665-1_15"},{"issue":"1\u20134","key":"10756_CR145","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1007\/s00170-018-03215-7","volume":"102","author":"Y Yang","year":"2019","unstructured":"Yang Y, Yang B, Wang S et al (2019) A dynamic ant-colony genetic algorithm for cloud service composition optimization. Int J Adv Manuf Technol 102(1\u20134):355\u2013368. https:\/\/doi.org\/10.1007\/s00170-018-03215-7","journal-title":"Int J Adv Manuf Technol"},{"key":"10756_CR146","doi-asserted-by":"publisher","DOI":"10.1016\/J.JNCA.2022.103385","volume":"202","author":"BMH Zade","year":"2022","unstructured":"Zade BMH, Mansouri N, Javidi MM (2022) A two-stage scheduler based on new caledonian crow learning algorithm and reinforcement learning strategy for cloud environment. J Netw Comput Appl 202:103385. https:\/\/doi.org\/10.1016\/J.JNCA.2022.103385","journal-title":"J Netw Comput Appl"},{"issue":"4","key":"10756_CR147","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2788397","volume":"47","author":"Z Zhan","year":"2015","unstructured":"Zhan Z, Liu XF, Gong Y et al (2015) Cloud computing resource scheduling and a survey of its evolutionary approaches. ACM Comput Surv 47(4):1\u201333. https:\/\/doi.org\/10.1145\/2788397","journal-title":"ACM Comput Surv"},{"key":"10756_CR148","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/J.INS.2020.04.039","volume":"531","author":"L Zhang","year":"2020","unstructured":"Zhang L, Zhou L, Salah A (2020) Efficient scientific workflow scheduling for deadline-constrained parallel tasks in cloud computing environments. Inform Sci 531:31\u201346. https:\/\/doi.org\/10.1016\/J.INS.2020.04.039","journal-title":"Inform Sci"},{"issue":"6","key":"10756_CR149","doi-asserted-by":"publisher","first-page":"2291","DOI":"10.1007\/S11280-019-00680-2","volume":"22","author":"P Zhang","year":"2019","unstructured":"Zhang P, Ma X, Xiao Y et al (2019) Two-level task scheduling with multi-objectives in geo-distributed and large-scale saas cloud. World Wide Web 22(6):2291\u20132319. https:\/\/doi.org\/10.1007\/S11280-019-00680-2","journal-title":"World Wide Web"},{"issue":"3","key":"10756_CR150","doi-asserted-by":"publisher","first-page":"708","DOI":"10.1109\/TCC.2015.2511727","volume":"6","author":"W Zhang","year":"2018","unstructured":"Zhang W, Wen Y (2018) Energy-efficient task execution for application as a general topology in mobile cloud computing. IEEE Trans Cloud Comput 6(3):708\u2013719. https:\/\/doi.org\/10.1109\/TCC.2015.2511727","journal-title":"IEEE Trans Cloud Comput"},{"issue":"3","key":"10756_CR151","doi-asserted-by":"publisher","first-page":"4968","DOI":"10.1109\/JIOT.2019.2894000","volume":"6","author":"X Zhang","year":"2019","unstructured":"Zhang X, Jia M, Gu X et al (2019) An energy efficient resource allocation scheme based on cloud-computing in H-CRAN. IEEE Internet Things J 6(3):4968\u20134976. https:\/\/doi.org\/10.1109\/JIOT.2019.2894000","journal-title":"IEEE Internet Things J"},{"issue":"2","key":"10756_CR152","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1109\/TPDS.2016.2571281","volume":"28","author":"J Zhao","year":"2017","unstructured":"Zhao J, Xiang Y, Lan T et al (2017) Elastic reliability optimization through peer-to-peer checkpointing in cloud computing. IEEE Trans Parallel Distrib Syst 28(2):491\u2013502. https:\/\/doi.org\/10.1109\/TPDS.2016.2571281","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"10756_CR153","doi-asserted-by":"publisher","DOI":"10.1016\/J.JNCA.2022.103520","volume":"208","author":"G Zhou","year":"2022","unstructured":"Zhou G, Wen R, Tian W et al (2022) Deep reinforcement learning-based algorithms selectors for the resource scheduling in hierarchical cloud computing. J Netw Comput Appl 208:103520. https:\/\/doi.org\/10.1016\/J.JNCA.2022.103520","journal-title":"J Netw Comput Appl"},{"key":"10756_CR154","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1016\/J.FUTURE.2022.11.031","volume":"141","author":"G Zhou","year":"2023","unstructured":"Zhou G, Tian W, Buyya R (2023) Multi-search-routes-based methods for minimizing makespan of homogeneous and heterogeneous resources in cloud computing. Future Gener Comput Syst 141:414\u2013432. https:\/\/doi.org\/10.1016\/J.FUTURE.2022.11.031","journal-title":"Future Gener Comput Syst"},{"key":"10756_CR155","doi-asserted-by":"publisher","DOI":"10.1016\/J.ASOC.2023.110027","volume":"136","author":"G Zhou","year":"2023","unstructured":"Zhou G, Tian W, Buyya R et al (2023) Growable genetic algorithm with heuristic-based local search for multi-dimensional resources scheduling of cloud computing. Appl Soft Comput 136:110027. https:\/\/doi.org\/10.1016\/J.ASOC.2023.110027","journal-title":"Appl Soft Comput"},{"key":"10756_CR156","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/J.FUTURE.2018.10.046","volume":"93","author":"X Zhou","year":"2019","unstructured":"Zhou X, Zhang G, Sun J et al (2019) Minimizing cost and makespan for workflow scheduling in cloud using fuzzy dominance sort based HEFT. Future Gener Comput Syst 93:278\u2013289. https:\/\/doi.org\/10.1016\/J.FUTURE.2018.10.046","journal-title":"Future Gener Comput Syst"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10756-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-024-10756-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10756-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T06:17:14Z","timestamp":1715926634000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-024-10756-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,23]]},"references-count":156,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["10756"],"URL":"https:\/\/doi.org\/10.1007\/s10462-024-10756-9","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,23]]},"assertion":[{"value":"26 March 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 April 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"124"}}