{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T21:18:37Z","timestamp":1773091117949,"version":"3.50.1"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T00:00:00Z","timestamp":1698969600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T00:00:00Z","timestamp":1698969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"nsfc","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>As a new approach to machine learning, Federated learning enables distributned traiing on edge devices and aggregates local models into a global model. The edge devices that participate in federated learning are highly heterogeneous in terms of computing power, device state, and data distribution, making it challenging to converge models efficiently. In this paper, we propose FedState, which is an adaptive device sampling and deadline determination technique for cloud-based heterogeneous federated learning. Specifically, we consider the cloud as a central server that orchestrates federated learning on a large pool of edge devices. To improve the efficiency of model convergence in heterogeneous federated learning, our approach adaptively samples devices to join each round of training and determines the deadline for result submission based on device state. We analyze existing device usage traces to build device state models in different scenarios and design a dynamic importance measurement mechanism based on device availability, data utility, and computing power. We also propose a deadline determination module that dynamically sets the deadline according to the availability of all sampled devices, local training time, and communication time, enabling more clients to submit local models more efficiently. Due to the variability of device state, we design an experience-driven algorithm based on Deep Reinforcement Learning (DRL) that can dynamically adjust our sampling and deadline policies according to the current environment state. We demonstrate the effectiveness of our approach through a series of experiments with the FMNIST dataset and show that our method outperforms current state-of-the-art approaches in terms of model accuracy and convergence speed.<\/jats:p>","DOI":"10.1186\/s13677-023-00515-6","type":"journal-article","created":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T14:01:47Z","timestamp":1699020107000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Adaptive device sampling and deadline determination for cloud-based heterogeneous federated learning"],"prefix":"10.1186","volume":"12","author":[{"given":"Deyu","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wang","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zi-Ang","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenxin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shiwen","family":"He","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,11,3]]},"reference":[{"key":"515_CR1","doi-asserted-by":"publisher","unstructured":"Chen Z, Cao Y, Liu Y, Wang H, Xie T, Liu X\u00a0(2020) A comprehensive study on challenges in deploying deep learning based software. ESEC\/FSE 2020. Association for Computing Machinery,\u00a0New York, p 750\u2013762.\u00a0https:\/\/doi.org\/10.1145\/3368089.3409759","DOI":"10.1145\/3368089.3409759"},{"key":"515_CR2","doi-asserted-by":"publisher","unstructured":"Chen Y, Xing H, Ma Z, Chen X, Huang J (2022) Cost-efficient edge caching for noma-enabled IoT services. Chin Commun. https:\/\/doi.org\/10.1155\/2022\/8072493","DOI":"10.1155\/2022\/8072493"},{"key":"515_CR3","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.future.2022.09.007","volume":"139","author":"J Huang","year":"2023","unstructured":"Huang J, Gao H, Wan S et al (2023) Aoi-aware energy control and computation offloading for industrial IoT. Futur Gener Comput Syst 139:29\u201337","journal-title":"Futur Gener Comput Syst"},{"issue":"11","key":"515_CR4","doi-asserted-by":"publisher","first-page":"2177","DOI":"10.1109\/LCOMM.2016.2601087","volume":"20","author":"J Van Der Hooft","year":"2016","unstructured":"Van Der Hooft J, Petrangeli S, Wauters T, Huysegems R, Alface PR, Bostoen T, De Turck F (2016) Http\/2-based adaptive streaming of HEVC video over 4g\/LTE networks. IEEE Commun Lett 20(11):2177\u20132180","journal-title":"IEEE Commun Lett"},{"key":"515_CR5","doi-asserted-by":"crossref","unstructured":"Shen X, Gao J, Wu W, Li M, Zhou C, Zhuang W, (1st. Quart. (2022) Holistic network virtualization and pervasive network intelligence for 6G. IEEE Commun Surv Tuts 24(1):1\u201330","DOI":"10.1109\/COMST.2021.3135829"},{"key":"515_CR6","doi-asserted-by":"crossref","unstructured":"Wu W, Zhou C, Li M, Wu H, Zhou H, Zhang N, Xuemin S, Zhuang W (Feb. 2022,) AI-native network slicing for 6G networks. IEEE Wirel Commun 29(1):96\u2013103","DOI":"10.1109\/MWC.001.2100338"},{"key":"515_CR7","doi-asserted-by":"crossref","unstructured":"Xu X, Duan S, Zhang J, Luo Y, Zhang D (2021) Optimizing federated learning on device heterogeneity with a sampling strategy. In: 2021 IEEE\/ACM 29th International Symposium on Quality of Service (IWQOS), IEEE, pp 1\u201310","DOI":"10.1109\/IWQOS52092.2021.9521361"},{"key":"515_CR8","doi-asserted-by":"crossref","unstructured":"CHEN Y, HU J, ZHAO J, MIN G\u00a0(2023) Qos-aware computation offloading in leo satellite edge computing for iot: A game-theoretical approach. Chin J Electron 33:1\u201312\u00a0","DOI":"10.23919\/cje.2022.00.412"},{"key":"515_CR9","doi-asserted-by":"crossref","unstructured":"Chen Y, Zhao J, Zhou X, Qi L, Xu X, Huang J\u00a0(2023) A distributed game theoretical approach for credibility-guaranteed multimedia data offloading in mec. Inf Sci 119306\u00a0","DOI":"10.1016\/j.ins.2023.119306"},{"key":"515_CR10","unstructured":"McMahan B, Moore E, Ramage D, Hampson S, y\u00a0Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics, PMLR, pp 1273\u20131282"},{"key":"515_CR11","doi-asserted-by":"publisher","unstructured":"Chen Y, Zhao J, Hu J, Wan S, Huang J\u00a0(2023) Distributed task offloading and resource purchasing in noma-enabled mobile edge computing: Hierarchical game theoretical approaches. ACM Trans Embed Comput Syst. https:\/\/doi.org\/10.1145\/3597023. Just Accepted","DOI":"10.1145\/3597023"},{"key":"515_CR12","doi-asserted-by":"publisher","unstructured":"Chen Y, Zhao J, Wu Y et al (2022) Qoe-aware decentralized task offloading and resource allocation for end-edge-cloud systems: A game-theoretical approach. IEEE Trans Mob Comput. https:\/\/doi.org\/10.1109\/TMC.2022.3223119","DOI":"10.1109\/TMC.2022.3223119"},{"key":"515_CR13","doi-asserted-by":"crossref","unstructured":"Mell P, Grance T et al\u00a0(2011) The nist definition of cloud computing","DOI":"10.6028\/NIST.SP.800-145"},{"issue":"3","key":"515_CR14","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/MSP.2020.2975749","volume":"37","author":"T Li","year":"2020","unstructured":"Li T, Sahu AK, Talwalkar A, Smith V (2020) Federated learning: Challenges, methods, and future directions. IEEE Signal Proc Mag 37(3):50\u201360","journal-title":"IEEE Signal Proc Mag"},{"key":"515_CR15","first-page":"7611","volume":"33","author":"J Wang","year":"2020","unstructured":"Wang J, Liu Q, Liang H, Joshi G, Poor HV (2020) Tackling the objective inconsistency problem in heterogeneous federated optimization. Adv Neural Inf Process Syst 33:7611\u20137623","journal-title":"Adv Neural Inf Process Syst"},{"key":"515_CR16","doi-asserted-by":"crossref","unstructured":"Luo B, Li X, Wang S, Huang J, Tassiulas L (2021) Cost-effective federated learning design. In: IEEE INFOCOM 2021-IEEE Conference on Computer Communications, IEEE, pp 1\u201310","DOI":"10.1109\/INFOCOM42981.2021.9488679"},{"key":"515_CR17","first-page":"374","volume":"1","author":"K Bonawitz","year":"2019","unstructured":"Bonawitz K, Eichner H, Grieskamp W, Huba D, Ingerman A, Ivanov V, Kiddon C, Kone\u010dn\u1ef3 J, Mazzocchi S, McMahan B et al (2019) Towards federated learning at scale: System design. Proc Mach Learn Syst 1:374\u2013388","journal-title":"Proc Mach Learn Syst"},{"key":"515_CR18","doi-asserted-by":"crossref","unstructured":"Zhan Y, Li P, Guo S (2020) Experience-driven computational resource allocation of federated learning by deep reinforcement learning. In: 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS), IEEE, pp 234\u2013243","DOI":"10.1109\/IPDPS47924.2020.00033"},{"key":"515_CR19","doi-asserted-by":"publisher","unstructured":"Shin J, Li Y, Liu Y, Lee SJ\u00a0(2022) Fedbalancer: Data and pace control for efficient federated learning on heterogeneous clients. In: Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services. MobiSys \u201922,\u00a0 Association for Computing Machinery, New York, p 436\u2013449. https:\/\/doi.org\/10.1145\/3498361.3538917","DOI":"10.1145\/3498361.3538917"},{"key":"515_CR20","doi-asserted-by":"crossref","unstructured":"Wang H, Kaplan Z, Niu D, Li B (2020) Optimizing federated learning on non-iid data with reinforcement learning. In: IEEE INFOCOM 2020-IEEE Conference on Computer Communications, IEEE, pp 1698\u20131707","DOI":"10.1109\/INFOCOM41043.2020.9155494"},{"key":"515_CR21","first-page":"935","volume":"2021","author":"C Yang","year":"2021","unstructured":"Yang C, Wang Q, Xu M, Chen Z, Bian K, Liu Y, Liu X (2021) Characterizing impacts of heterogeneity in federated learning upon large-scale smartphone data. Proceedings of the Web Conference 2021:935\u2013946","journal-title":"Proceedings of the Web Conference"},{"key":"515_CR22","doi-asserted-by":"crossref","unstructured":"Li Z, Zhang J, Liu L, Liu J (2022) Auditing privacy defenses in federated learning via generative gradient leakage. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, p 10132\u201310142","DOI":"10.1109\/CVPR52688.2022.00989"},{"key":"515_CR23","doi-asserted-by":"crossref","unstructured":"Gong X, Sharma A, Karanam S, Wu Z, Chen T, Doermann D, Innanje A (2021) Ensemble attention distillation for privacy-preserving federated learning. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, p 15076\u201315086","DOI":"10.1109\/ICCV48922.2021.01480"},{"key":"515_CR24","doi-asserted-by":"publisher","first-page":"5234","DOI":"10.1109\/TSP.2021.3106104","volume":"69","author":"J Wang","year":"2021","unstructured":"Wang J, Liu Q, Liang H, Joshi G, Poor HV (2021) A novel framework for the analysis and design of heterogeneous federated learning. IEEE Trans Signal Process 69:5234\u20135249","journal-title":"IEEE Trans Signal Process"},{"key":"515_CR25","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1016\/j.neucom.2021.08.141","volume":"483","author":"C Palihawadana","year":"2022","unstructured":"Palihawadana C, Wiratunga N, Wijekoon A, Kalutarage H (2022) Fedsim: Similarity guided model aggregation for federated learning. Neurocomputing 483:432\u2013445","journal-title":"Neurocomputing"},{"key":"515_CR26","unstructured":"Chen HY, Chao WL (2020) Fedbe: Making bayesian model ensemble applicable to federated learning. arXiv preprint arXiv:2009.01974"},{"issue":"4","key":"515_CR27","first-page":"1","volume":"13","author":"Z Liu","year":"2022","unstructured":"Liu Z, Chen Y, Yu H, Liu Y, Cui L (2022) Gtg-shapley: Efficient and accurate participant contribution evaluation in federated learning. ACM Trans Intell Syst Technol (TIST) 13(4):1\u201321","journal-title":"ACM Trans Intell Syst Technol (TIST)"},{"key":"515_CR28","doi-asserted-by":"crossref","unstructured":"Wang T, Rausch J, Zhang C, Jia R, Song D (2020) A principled approach to data valuation for federated learning. In: Federated Learning, Springer, pp 153\u2013167","DOI":"10.1007\/978-3-030-63076-8_11"},{"key":"515_CR29","unstructured":"Paulik M, Seigel M, Mason H, Telaar D, Kluivers J, van Dalen R, Lau CW, Carlson L, Granqvist F, Vandevelde C, et\u00a0al (2021) Federated evaluation and tuning for on-device personalization: System design & applications. arXiv preprint arXiv:2102.08503"},{"key":"515_CR30","doi-asserted-by":"crossref","unstructured":"Wang S, Lee M, Hosseinalipour S, Morabito R, Chiang M, Brinton CG (2021) Device sampling for heterogeneous federated learning: Theory, algorithms, and implementation. In: IEEE INFOCOM 2021-IEEE Conference on Computer Communications, IEEE, pp 1\u201310","DOI":"10.1109\/INFOCOM42981.2021.9488906"},{"key":"515_CR31","unstructured":"Balakrishnan R, Li T, Zhou T, Himayat N, Smith V, Bilmes J\u00a0(2022) Diverse client selection for federated learning via submodular maximization. In: International Conference on Learning Representations.\u00a0https:\/\/openreview.net\/forum?id=nwKXyFvaUm"},{"key":"515_CR32","doi-asserted-by":"crossref","unstructured":"Zhang SQ, Lin J, Zhang Q (2022) A multi-agent reinforcement learning approach for efficient client selection in federated learning. arXiv preprint arXiv:2201.02932","DOI":"10.1609\/aaai.v36i8.20894"},{"key":"515_CR33","unstructured":"Cho YJ, Wang J, Joshi G (2022) Towards understanding biased client selection in federated learning. In: International Conference on Artificial Intelligence and Statistics, PMLR, pp 10351\u201310375"},{"key":"515_CR34","unstructured":"Lai F, Zhu X, Madhyastha H, Chowdhury M (2021) Oort: Efficient federated learning via guided participant selection. In: Proceedings of the 15th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2021, p 19\u201335"},{"key":"515_CR35","doi-asserted-by":"crossref","unstructured":"Li L, Xiong H, Guo Z, Wang J, Xu CZ (2019) Smartpc: Hierarchical pace control in real-time federated learning system. In: 2019 IEEE Real-Time Systems Symposium (RTSS), IEEE, pp 406\u2013418","DOI":"10.1109\/RTSS46320.2019.00043"},{"key":"515_CR36","unstructured":"Kone\u010dn\u1ef3 J, McMahan HB, Yu FX, Richt\u00e1rik P, Suresh AT, Bacon D (2016) Federated learning: Strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492"},{"key":"515_CR37","first-page":"429","volume":"2","author":"T Li","year":"2020","unstructured":"Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2020) Federated optimization in heterogeneous networks. Proc Mach Learn Syst 2:429\u2013450","journal-title":"Proc Mach Learn Syst"},{"key":"515_CR38","doi-asserted-by":"crossref","unstructured":"Ignatov A, Timofte R, Chou W, Wang K, Wu M, Hartley T, Van Gool L\u00a0(2018) Ai benchmark: Running deep neural networks on android smartphones. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops","DOI":"10.1007\/978-3-030-11021-5_19"},{"key":"515_CR39","doi-asserted-by":"crossref","unstructured":"Lai F, Dai Y, Singapuram S, Liu J, Zhu X, Madhyastha H, Chowdhury M\u00a0(2022) FedScale: Benchmarking model and system performance of federated learning at scale. In: Chaudhuri K, Jegelka S, Song L, Szepesvari C, Niu G, Sabato S (eds.) Proceedings of the 39th International Conference on Machine Learning, vol. 162. Proceedings of Machine Learning Research, p 11814\u201311827","DOI":"10.1145\/3477114.3488760"},{"issue":"8","key":"515_CR40","doi-asserted-by":"publisher","first-page":"1996","DOI":"10.1109\/TPDS.2021.3134647","volume":"33","author":"Y Deng","year":"2021","unstructured":"Deng Y, Lyu F, Ren J, Wu H, Zhou Y, Zhang Y, Shen X (2021) Auction: Automated and quality-aware client selection framework for efficient federated learning. IEEE Trans Parallel Distrib Syst 33(8):1996\u20132009","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"515_CR41","doi-asserted-by":"publisher","unstructured":"Chen Y, Gu W, Xu J, Zhang Y, Min G\u00a0(2023) Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning. Chin Commun 1\u201312 https:\/\/doi.org\/10.23919\/JCC.ea.2022-0372.202302","DOI":"10.23919\/JCC.ea.2022-0372.202302"},{"key":"515_CR42","doi-asserted-by":"publisher","DOI":"10.1109\/JSYST.2023.3249217","author":"J Huang","year":"2023","unstructured":"Huang J, Wan J, Lv B, Ye Q et al (2023) Joint computation offloading and resource allocation for edge-cloud collaboration in internet of vehicles via deep reinforcement learning. IEEE Syst J. https:\/\/doi.org\/10.1109\/JSYST.2023.3249217","journal-title":"IEEE Syst J"},{"issue":"7","key":"515_CR43","doi-asserted-by":"publisher","first-page":"2076","DOI":"10.1109\/JSAC.2020.3041405","volume":"39","author":"W Wu","year":"2021","unstructured":"Wu W, Chen N, Zhou C, Li M, Shen X, Zhuang W, Li X (2021) Dynamic RAN slicing for service-oriented vehicular networks via constrained learning. IEEE J Sel Areas Commun 39(7):2076\u20132089","journal-title":"IEEE J Sel Areas Commun"},{"key":"515_CR44","doi-asserted-by":"publisher","unstructured":"Van\u00a0Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double q-learning. In: Proceedings of the AAAI conference on artificial intelligence, vol\u00a030.\u00a0https:\/\/doi.org\/10.1609\/aaai.v30i1.10295. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/1029","DOI":"10.1609\/aaai.v30i1.10295"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-023-00515-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13677-023-00515-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-023-00515-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T09:44:39Z","timestamp":1730454279000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-023-00515-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,3]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["515"],"URL":"https:\/\/doi.org\/10.1186\/s13677-023-00515-6","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,3]]},"assertion":[{"value":"30 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"153"}}