{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,10]],"date-time":"2025-09-10T22:40:53Z","timestamp":1757544053155,"version":"3.37.3"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T00:00:00Z","timestamp":1693353600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T00:00:00Z","timestamp":1693353600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61962040","61962040"],"award-info":[{"award-number":["61962040","61962040"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Current deep learning technologies used a large number of parameters to achieve a high accuracy rate, and the number of parameters is commonly more than a hundred million for image-related tasks. To improve both training speed and accuracy in multi-clouds, distributed deep learning is also widely applied. Therefore, reducing the network scale or improving the training speed has become an urgent problem to be solved in multi-clouds. Concerning this issue, we proposed a game architecture in multi-clouds, which can be supported by resource provision and service schedule. Furthermore, we trained a deep learning network, which can ensure high accuracy while reducing the number of network parameters. An adapted game, called flappy bird, is used as an experimental environment to test our neural network. Experimental results showed that the decision logic of the flappy bird, including flight planning, avoidance, and sacrifice, is accurate. In addition, we published the parameters of the neural network, so other scholars can reuse our neural network parameters for further research.<\/jats:p>","DOI":"10.1186\/s13677-023-00505-8","type":"journal-article","created":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T10:02:23Z","timestamp":1693389743000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["AI-empowered game architecture and application for resource provision and scheduling in multi-clouds"],"prefix":"10.1186","volume":"12","author":[{"given":"Lei","family":"Yu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yucong","family":"Duan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,8,30]]},"reference":[{"key":"505_CR1","unstructured":"Chen Y, Hu J, Zhao J, Min G (2023) Qos-aware computation offloading in Leo satellite edge computing for IoT: A game-theoretical approach. Chin J Electron 33:1\u201312"},{"key":"505_CR2","doi-asserted-by":"publisher","first-page":"157","DOI":"10.3389\/fgene.2020.00157","volume":"11","author":"TA Myers","year":"2020","unstructured":"Myers TA, Chanock SJ, Machiela MJ (2020) Ldlinkr: An r package for rapidly calculating linkage disequilibrium statistics in diverse populations. Front Genet 11:157","journal-title":"Front Genet"},{"key":"505_CR3","doi-asserted-by":"crossref","unstructured":"Chen Y, Zhao J, Wu Y, Huang J, Shen XS (2022) Qoe-aware decentralized task offloading and resource allocation for end-edge-cloud systems: A game-theoretical approach. IEEE Trans Mob Comput 21:1\u201317","DOI":"10.1109\/TMC.2022.3223119"},{"key":"505_CR4","doi-asserted-by":"publisher","first-page":"2912","DOI":"10.1109\/TCYB.2018.2832640","volume":"49","author":"Z-G Chen","year":"2019","unstructured":"Chen Z-G, Zhan Z-H, Lin Y, Gong Y-J, Gu T-L, Zhao F et al (2019) Multiobjective cloud workflow scheduling: a multiple populations ant colony system approach. IEEE Trans Cybern 49:2912\u20132926. https:\/\/doi.org\/10.1109\/TCYB.2018.2832640","journal-title":"IEEE Trans Cybern"},{"key":"505_CR5","doi-asserted-by":"crossref","unstructured":"Chen Y, Zhao J, Hu J, Wan S, Huang J (2023) Distributed task offloading and resource purchasing in NOMA-enabled mobile edge computing: hierarchical game theoretical approaches. ACM Trans Embed Comput Syst","DOI":"10.1145\/3597023"},{"key":"505_CR6","doi-asserted-by":"publisher","first-page":"1379","DOI":"10.1007\/s10586-019-02915-3","volume":"22","author":"N Panwar","year":"2019","unstructured":"Panwar N, Negi S, Rauthan MMS, Vaisla KS (2019) Topsis\u2013pso inspired non-preemptive tasks scheduling algorithm in cloud environment. Clust Comput 22:1379\u20131396. https:\/\/doi.org\/10.1007\/s10586-019-02915-3","journal-title":"Clust Comput"},{"key":"505_CR7","doi-asserted-by":"publisher","unstructured":"Fangzheng Liu, Jiwei Huang, Xianbin Wang (2023) Joint Task Offloading and Resource Allocation for Device-Edge-Cloud Collaboration with Subtask Dependencies. IEEE Trans Cloud Comput. https:\/\/doi.org\/10.1109\/TCC.2023.3251561","DOI":"10.1109\/TCC.2023.3251561"},{"key":"505_CR8","doi-asserted-by":"crossref","unstructured":"George N, Chandrasekaran K, Binu A (2016) Optimization-aware scheduling in cloud computing. In: Proceedings of the International Conference on Informatics and Analytics. Pondicherry India, pp 1\u20135","DOI":"10.1145\/2980258.2980293"},{"key":"505_CR9","doi-asserted-by":"publisher","first-page":"237","DOI":"10.30630\/joiv.3.3.266","volume":"3","author":"S Ghasemi","year":"2019","unstructured":"Ghasemi S, Kheyrolahi A, Shaltooki AA (2019) Workflow scheduling in cloud environment using firefly optimization algorithm. JOIV Int J Inf Vis 3:237\u2013242. https:\/\/doi.org\/10.30630\/joiv.3.3.266","journal-title":"JOIV Int J Inf Vis"},{"key":"505_CR10","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1016\/j.jpdc.2017.05.001","volume":"117","author":"AI Orhean","year":"2018","unstructured":"Orhean AI, Pop F, Raicu I (2018) New scheduling approach using reinforcement learning for heterogeneous distributed systems. J Parallel Distributed Comput 117:292\u2013302. https:\/\/doi.org\/10.1016\/j.jpdc.2017.05.001","journal-title":"J Parallel Distributed Comput"},{"key":"505_CR11","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2023.3258191","author":"J Liang","year":"2023","unstructured":"Liang J, Ma B, Feng Z, Huang J (2023) Reliability-aware task processing and offloading for data-intensive applications in edge computing. IEEE Trans Netw Serv Manage. https:\/\/doi.org\/10.1109\/TNSM.2023.3258191","journal-title":"IEEE Trans Netw Serv Manage"},{"key":"505_CR12","doi-asserted-by":"crossref","unstructured":"Cheng M, Li J, Nazarian S (2018) Drl-cloud: Deep reinforcement learning-based resource provisioning and task scheduling for cloud service providers. In: IEEE 23rd Asia and South Pacific design automation conference, Jeju, Korea (South). pp 129\u2013134","DOI":"10.1109\/ASPDAC.2018.8297294"},{"key":"505_CR13","doi-asserted-by":"publisher","first-page":"55112","DOI":"10.1109\/access.2018.2872674","volume":"6","author":"Y Wei","year":"2018","unstructured":"Wei Y, Pan L, Liu S, Wu L, Meng X (2018) Drl-scheduling: An intelligent QoS-aware job scheduling framework for applications in clouds. IEEE Access 6:55112\u201355125. https:\/\/doi.org\/10.1109\/access.2018.2872674","journal-title":"IEEE Access"},{"key":"505_CR14","doi-asserted-by":"crossref","unstructured":"Meng H, Chao D, Huo R, Guo Q, Li X, Huang T (2019) Deep reinforcement learning based delay-sensitive task scheduling and resource management algorithm for multi-user mobile-edge computing systems. In: 4th International Conference on Mathematics and Artificial Intelligence, Chengdu China. pp 66\u201370","DOI":"10.1145\/3325730.3325731"},{"key":"505_CR15","doi-asserted-by":"crossref","unstructured":"Ran L, Shi X, Shang M (2019) Slas-aware online task scheduling based on deep reinforcement learning method in cloud environment. In: IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC\/SmartCity\/DSS), Zhangjiajie, China. pp 1518\u20131525","DOI":"10.1109\/HPCC\/SmartCity\/DSS.2019.00209"},{"key":"505_CR16","doi-asserted-by":"crossref","unstructured":"Zhang L, Qi Q, Wang J, Sun H, Liao J (2019) Multi-task deep reinforcement learning for scalable parallel task scheduling. In: IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA. pp 2992\u20133001","DOI":"10.1109\/BigData47090.2019.9006027"},{"key":"505_CR17","doi-asserted-by":"publisher","first-page":"e5654","DOI":"10.1002\/cpe.5654","volume":"32","author":"T Dong","year":"2020","unstructured":"Dong T, Xue F, Xiao C, Li J (2020) Task scheduling based on deep reinforcement learning in a cloud manufacturing environment. Concurr Comput Pract Exper 32:e5654. https:\/\/doi.org\/10.1002\/cpe.5654","journal-title":"Concurr Comput Pract Exper"},{"key":"505_CR18","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.future.2022.09.007","volume":"139","author":"J Huang","year":"2023","unstructured":"Huang J, Gao H, Wan S, Chen Y (2023) AoI-aware energy control and computation offloading for industrial IoT. Futur Gener Comput Syst 139:29\u201337","journal-title":"Futur Gener Comput Syst"},{"key":"505_CR19","doi-asserted-by":"publisher","unstructured":"Almezeini N, Hafez A (2017) Task scheduling in cloud computing using lion optimization algorithm. Int J Adv Comput Sci Appl 8. https:\/\/doi.org\/10.14569\/ijacsa.2017.081110","DOI":"10.14569\/ijacsa.2017.081110"},{"key":"505_CR20","doi-asserted-by":"crossref","unstructured":"Xiaoqing Z, Yajie H, Chunlin A (2018) Data-dependent tasks rescheduling energy efficient algorithm. In: IEEE 4th International Conference on Computer and Communications, Chengdu, p 2542\u20132546","DOI":"10.1109\/CompComm.2018.8781014"},{"key":"505_CR21","doi-asserted-by":"crossref","unstructured":"Chen Y, Gu W, Xu J, Zhang Y, Min G (2023) Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning. In: China Communications. pp 1\u201312","DOI":"10.23919\/JCC.ea.2022-0372.202302"},{"key":"505_CR22","doi-asserted-by":"publisher","first-page":"2500","DOI":"10.1109\/JSYST.2023.3249217","volume":"17","author":"J Huang","year":"2023","unstructured":"Huang J, Wan J, Lv B, Ye Q, Chen Y (2023) Joint computation offloading and resource allocation for edge-cloud collaboration in internet of vehicles via deep reinforcement learning. IEEE Syst J 17:2500\u20132511","journal-title":"IEEE Syst J"},{"key":"505_CR23","unstructured":"Wang Z, Schaul T, Hessel M, Hasselt H, Lanctot M, Freitas N (2016) Dueling network architectures for deep reinforcement learning. In: International conference on machine learning, New York NY USA. pp 1995\u20132003"},{"key":"505_CR24","doi-asserted-by":"crossref","unstructured":"Van Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double q-learning\u201d, Phoenix, Arizona USA. Proc. AAAI Conf. Artif. Intell.30, pp 2094\u20132100","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"505_CR25","doi-asserted-by":"publisher","unstructured":"Schaul T, Quan J, Antonoglou I, Silver D (2016) Prioritized experience replay. In: International Conference on Learning Representations, San Juan, Puerto Rico. https:\/\/doi.org\/10.48550\/arXiv.1511.05952","DOI":"10.48550\/arXiv.1511.05952"},{"key":"505_CR26","doi-asserted-by":"publisher","first-page":"1695","DOI":"10.1109\/tpds.2021.3124670","volume":"33","author":"MT Islam","year":"2021","unstructured":"Islam MT, Karunasekera S, Buyya R (2021) Performance and cost-efficient spark job scheduling based on deep reinforcement learning in cloud computing environments. IEEE Trans Parallel Distrib Syst 33:1695\u20131710. https:\/\/doi.org\/10.1109\/tpds.2021.3124670","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"505_CR27","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1007\/978-3-030-47436-2_68","volume-title":"Advances in knowledge discovery and data mining","author":"S Liang","year":"2020","unstructured":"Liang S, Yang Z, Jin F, Chen Y (2020) Data centers job scheduling with deep reinforcement learning. Advances in knowledge discovery and data mining. Springer International Publishing, New York, pp 906\u2013917"},{"key":"505_CR28","doi-asserted-by":"crossref","unstructured":"Chen Y, Zhao J, Zhou X (2023) A distributed game theoretical approach for credibility-guaranteed multimedia data offloading in MEC. In: Information Sciences","DOI":"10.1016\/j.ins.2023.119306"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-023-00505-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13677-023-00505-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-023-00505-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T20:11:55Z","timestamp":1700251915000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-023-00505-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,30]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["505"],"URL":"https:\/\/doi.org\/10.1186\/s13677-023-00505-8","relation":{},"ISSN":["2192-113X"],"issn-type":[{"type":"electronic","value":"2192-113X"}],"subject":[],"published":{"date-parts":[[2023,8,30]]},"assertion":[{"value":"5 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The research has consent for Ethical Approval and Consent to participate.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Consent has been granted by all authors and there is no conflict.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"129"}}