{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T15:54:05Z","timestamp":1778255645333,"version":"3.51.4"},"reference-count":55,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2023,7,31]],"date-time":"2023-07-31T00:00:00Z","timestamp":1690761600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Federated learning (FL) is a transformative approach to Machine Learning that enables the training of a shared model without transferring private data to a central location. This decentralized training paradigm has found particular applicability in edge computing, where IoT devices and edge nodes often possess limited computational power, network bandwidth, and energy resources. While various techniques have been developed to optimize the FL training process, an important question remains unanswered: how should resources be allocated in the training workflow? To address this question, it is crucial to understand the nature of these resources. In physical environments, the allocation is typically performed at the node level, with the entire node dedicated to executing a single workload. In contrast, virtualized environments allow for the dynamic partitioning of a node into containerized units that can adapt to changing workloads. Consequently, the new question that arises is: how can a physical node be partitioned into virtual resources to maximize the efficiency of the FL process? To answer this, we investigate various resource allocation methods that consider factors such as computational and network capabilities, the complexity of datasets, as well as the specific characteristics of the FL workflow and ML backend. We explore two scenarios: (i) running FL over a finite number of testbed nodes and (ii) hosting multiple parallel FL workflows on the same set of testbed nodes. Our findings reveal that the default configurations of state-of-the-art cloud orchestrators are sub-optimal when orchestrating FL workflows. Additionally, we demonstrate that different libraries and ML models exhibit diverse computational footprints. Building upon these insights, we discuss methods to mitigate computational interferences and enhance the overall performance of the FL pipeline execution.<\/jats:p>","DOI":"10.3390\/fi15080261","type":"journal-article","created":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T09:14:40Z","timestamp":1690881280000},"page":"261","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Towards Efficient Resource Allocation for Federated Learning in Virtualized Managed Environments"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9379-6233","authenticated-orcid":false,"given":"Fotis","family":"Nikolaidis","sequence":"first","affiliation":[{"name":"Institute of Computer Science, Foundation for Research and Technology Hellas, 70013 Heraklion, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2711-1949","authenticated-orcid":false,"given":"Moysis","family":"Symeonides","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Cyprus, 1678 Nicosia, Cyprus"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9540-7342","authenticated-orcid":false,"given":"Demetris","family":"Trihinas","sequence":"additional","affiliation":[{"name":"Department of Computer Science, School of Sciences and Engineering, University of Nicosia, 2417 Nicosia, Cyprus"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,31]]},"reference":[{"key":"ref_1","unstructured":"McMahan, B., Moore, E., Ramage, D., Hampson, S., and y Arcas, B.A. (2017, January 20\u201322). Communication-efficient learning of deep networks from decentralized data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS) 2017, Fort Lauderdale, FL, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"106775","DOI":"10.1016\/j.knosys.2021.106775","article-title":"A survey on federated learning","volume":"216","author":"Zhang","year":"2021","journal-title":"Knowl. Based Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"106854","DOI":"10.1016\/j.cie.2020.106854","article-title":"A review of applications in federated learning","volume":"149","author":"Li","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_4","unstructured":"(2016). The European General Data Protection Regulation (EU 2016\/67). Off. J. Eur. Union, L 119, 1\u201388."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"102402","DOI":"10.1016\/j.cose.2021.102402","article-title":"Privacy preservation in federated learning: An insightful survey from the GDPR perspective","volume":"110","author":"Truong","year":"2021","journal-title":"Comput. Secur."},{"key":"ref_6","unstructured":"(2023, July 24). Flower: A Friendly Federated Learning Framework. Available online: https:\/\/flower.dev\/."},{"key":"ref_7","unstructured":"Bonawitz, K.A., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Kone\u010dn\u00fd, J., Mazzocchi, S., and McMahan, H.B. (2019). Towards Federated Learning at Scale: System Design. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, R., Wu, F., Wu, C., Wang, Y., Lyu, L., Chen, H., and Xie, X. (2022, January 14\u201318). No one left behind: Inclusive federated learning over heterogeneous devices. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.","DOI":"10.1145\/3534678.3539086"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"100008","DOI":"10.1016\/j.hcc.2021.100008","article-title":"A survey of federated learning for edge computing: Research problems and solutions","volume":"1","author":"Xia","year":"2021","journal-title":"High Confid. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Symeonides, M., Trihinas, D., Georgiou, Z., Pallis, G., and Dikaiakos, M. (2019, January 24\u201327). Query-driven descriptive analytics for IoT and edge computing. Proceedings of the 2019 IEEE International Conference on Cloud Engineering (IC2E), Prague, Czech Republic.","DOI":"10.1109\/IC2E.2019.00-12"},{"key":"ref_11","unstructured":"(2023, July 24). Production-Grade Container Orchestration. Available online: https:\/\/kubernetes.io\/."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Nikolaidis, F., Marazakis, M., and Bilas, A. (2021, January 10\u201313). IOTier: A Virtual Testbed to evaluate systems for IoT environments. Proceedings of the 2021 IEEE\/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid), Melbourne, Australia.","DOI":"10.1109\/CCGrid51090.2021.00081"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Brewer, E.A. (2015, January 27\u201329). Kubernetes and the path to cloud native. Proceedings of the Sixth ACM Symposium on Cloud Computing, Kohala Coast, HI, USA.","DOI":"10.1145\/2806777.2809955"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Al-Dhuraibi, Y., Paraiso, F., Djarallah, N., and Merle, P. (2017, January 25\u201330). Autonomic vertical elasticity of docker containers with elasticdocker. Proceedings of the 2017 IEEE 10th International Conference on Cloud Computing (CLOUD), Honololu, HI, USA.","DOI":"10.1109\/CLOUD.2017.67"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.future.2018.09.014","article-title":"Task scheduling techniques in cloud computing: A literature survey","volume":"91","author":"Arunarani","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2540","DOI":"10.1109\/TPDS.2022.3144994","article-title":"EdgeTB: A Hybrid Testbed for Distributed Machine Learning at the Edge with High Fidelity","volume":"33","author":"Yang","year":"2022","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lai, F., Dai, Y., Singapuram, S., Liu, J., Zhu, X., Madhyastha, H., and Chowdhury, M. (2022, January 17\u201323). FedScale: Benchmarking Model and System Performance of Federated Learning at Scale. Proceedings of the 39th International Conference on Machine Learning, Baltimore, MD, USA.","DOI":"10.1145\/3477114.3488760"},{"key":"ref_18","unstructured":"(2023, July 24). THE MNIST DATABASE of Handwritten Digits. Available online: http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"ref_19","unstructured":"(2023, July 24). The CIFAR-10 Dataset. Available online: https:\/\/www.cs.toronto.edu\/~kriz\/cifar.html."},{"key":"ref_20","unstructured":"(2023, July 24). PyTorch. Available online: https:\/\/pytorch.org\/."},{"key":"ref_21","unstructured":"(2023, July 24). TensorFlow: An End-to-End Machine Learning Platform. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_22","unstructured":"Kone\u010dn\u1ef3, J., McMahan, B., and Ramage, D. (2015). Federated optimization: Distributed optimization beyond the datacenter. arXiv."},{"key":"ref_23","unstructured":"Kone\u010dn\u1ef3, J., McMahan, H.B., Ramage, D., and Richt\u00e1rik, P. (2016). Federated optimization: Distributed machine learning for on-device intelligence. arXiv."},{"key":"ref_24","unstructured":"McMahan, B., and Ramage, D. (2023, July 24). Federated Learning: Collaborative Machine Learning without Centralized Training Data. Available online: https:\/\/ai.googleblog.com\/2017\/04\/federated-learning-collaborative.html."},{"key":"ref_25","unstructured":"Gadekallu, T.R., Pham, Q.V., Huynh-The, T., Bhattacharya, S., Maddikunta, P.K.R., and Liyanage, M. (2021). Federated Learning for Big Data: A Survey on Opportunities, Applications, and Future Directions. arXiv."},{"key":"ref_26","first-page":"50","article-title":"Federated Learning: Challenges, Methods, and Future Directions","volume":"37","author":"Li","year":"2020","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_27","unstructured":"Karimireddy, S.P., Kale, S., Mohri, M., Reddi, S.J., Stich, S.U., and Suresh, A.T. (2021). SCAFFOLD: Stochastic Controlled Averaging for Federated Learning. arXiv."},{"key":"ref_28","unstructured":"Acar, D.A.E., Zhao, Y., Navarro, R.M., Mattina, M., Whatmough, P.N., and Saligrama, V. (2021). Federated Learning Based on Dynamic Regularization. arXiv."},{"key":"ref_29","unstructured":"Cho, Y.J., Wang, J., and Joshi, G. (2020). Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Nishio, T., and Yonetani, R. (2019, January 20\u201324). Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge. Proceedings of the ICC 2019\u20142019 IEEE International Conference on Communications (ICC), Shanghai, China.","DOI":"10.1109\/ICC.2019.8761315"},{"key":"ref_31","unstructured":"Li, T., Sanjabi, M., Beirami, A., and Smith, V. (2019). Fair resource allocation in federated learning. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Symeonides, M., Georgiou, Z., Trihinas, D., Pallis, G., and Dikaiakos, M.D. (2020, January 12\u201314). Fogify: A fog computing emulation framework. Proceedings of the 2020 IEEE\/ACM Symposium on Edge Computing (SEC), San Jose, CA, USA.","DOI":"10.1109\/SEC50012.2020.00011"},{"key":"ref_33","unstructured":"(2023, July 24). Dockerfile Reference. Available online: https:\/\/docs.docker.com\/engine\/reference\/builder\/."},{"key":"ref_34","unstructured":"(2023, July 24). Kubernetes Components. Available online: https:\/\/kubernetes.io\/docs\/concepts\/overview\/components\/."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Nikolaidis, F., Chazapis, A., Marazakis, M., and Bilas, A. (2021). Frisbee: Automated testing of Cloud-native applications in Kubernetes. arXiv.","DOI":"10.1145\/3447851.3458738"},{"key":"ref_36","unstructured":"Nikolaidis, F., Chazapis, A., Marazakis, M., and Bilas, A. (2022). Event-Driven Testing For Edge Applications. arXiv."},{"key":"ref_37","unstructured":"(2023, July 24). Testing Patterns for Federated Learning Deployments. Available online: https:\/\/github.com\/CARV-ICS-FORTH\/frisbee\/tree\/main\/examples\/patterns\/federated-learning."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1109\/TCC.2015.2511760","article-title":"Monitoring Elastically Adaptive Multi-Cloud Services","volume":"6","author":"Trihinas","year":"2018","journal-title":"IEEE Trans. Cloud Comput."},{"key":"ref_39","unstructured":"(2023, July 24). cadvisor: Analyzes Resource Usage and Performance Characteristics of Running Containers. Available online: https:\/\/github.com\/google\/cadvisor."},{"key":"ref_40","unstructured":"(2023, July 24). Prometheus: From Metrics to Insight. Available online: https:\/\/prometheus.io."},{"key":"ref_41","unstructured":"(2023, July 24). Grafana: Compose and Scale Observability with One or All Pieces of the Stack. Available online: https:\/\/grafana.com\/."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2019). MobileNetV2: Inverted Residuals and Linear Bottlenecks. arXiv.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_43","unstructured":"Ananthanarayanan, G., Ghodsi, A., Shenker, S., and Stoica, I. (2013, January 2\u20135). Effective Straggler Mitigation: Attack of the Clones. Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13), Lombard, IL, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Georgiou, J., Symeonides, M., Kasioulis, M., Trihinas, D., Pallis, G., and Dikaiakos, M.D. (July, January 30). BenchPilot: Repeatable & Reproducible Benchmarking for Edge Micro-DCs. Proceedings of the 2022 IEEE Symposium on Computers and Communications (ISCC), Rhodes, Greece.","DOI":"10.1109\/ISCC55528.2022.9912882"},{"key":"ref_45","unstructured":"Caldas, S., Duddu, S.M.K., Wu, P., Li, T., Kone\u010dn\u00fd, J., McMahan, H.B., Smith, V., and Talwalkar, A. (2018). LEAF: A Benchmark for Federated Settings. arXiv."},{"key":"ref_46","unstructured":"He, C., Li, S., So, J., Zeng, X., Zhang, M., Wang, H., Wang, X., Vepakomma, P., Singh, A., and Qiu, H. (2020). FedML: A Research Library and Benchmark for Federated Machine Learning. arXiv."},{"key":"ref_47","unstructured":"Beutel, D.J., Topal, T., Mathur, A., Qiu, X., Parcollet, T., and Lane, N.D. (2020). Flower: A Friendly Federated Learning Research Framework. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Sharma, P., Chaufournier, L., Shenoy, P., and Tay, Y.C. (2016, January 12\u201316). Containers and Virtual Machines at Scale: A Comparative Study. Proceedings of the 17th International Middleware Conference, New York, NY, USA.","DOI":"10.1145\/2988336.2988337"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2381","DOI":"10.1109\/TCC.2020.3034500","article-title":"Characterizing Co-Located Workloads in Alibaba Cloud Datacenters","volume":"10","author":"Jiang","year":"2022","journal-title":"IEEE Trans. Cloud Comput."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Gao, J., Wang, H., and Shen, H. (2020, January 3\u20136). Machine Learning Based Workload Prediction in Cloud Computing. Proceedings of the 2020 29th International Conference on Computer Communications and Networks (ICCCN), Honolulu, HI, USA.","DOI":"10.1109\/ICCCN49398.2020.9209730"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Giannakopoulos, I., Tsoumakos, D., Papailiou, N., and Koziris, N. (2015, January 9\u201313). PANIC: Modeling Application Performance over Virtualized Resources. Proceedings of the 2015 IEEE International Conference on Cloud Engineering, Tempe, AZ, USA.","DOI":"10.1109\/IC2E.2015.27"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Chen, W., Ye, K., and Xu, C.Z. (2019, January 10\u201312). Co-Locating Online Workload and Offline Workload in the Cloud: An Interference Analysis. Proceedings of the 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC\/SmartCity\/DSS), Zhangjiajie, China.","DOI":"10.1109\/HPCC\/SmartCity\/DSS.2019.00316"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Zhu, J., Yang, R., Hu, C., Wo, T., Xue, S., Ouyang, J., and Xu, J. (2021, January 10\u201313). Perph: A Workload Co-location Agent with Online Performance Prediction and Resource Inference. Proceedings of the 2021 IEEE\/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid), Melbourne, Australia.","DOI":"10.1109\/CCGrid51090.2021.00027"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Zhu, J., Yang, R., Hu, C., Wo, T., Xue, S., Ouyang, J., and Xu, J. (2019, January 20\u201323). Perphon: A ML-Based Agent for Workload Co-Location via Performance Prediction and Resource Inference. Proceedings of the SoCC \u201919 ACM Symposium on Cloud Computing, New York, NY, USA.","DOI":"10.1145\/3357223.3365440"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Zhong, Z., He, J., Rodriguez, M.A., Erfani, S., Kotagiri, R., and Buyya, R. (2020, January 19\u201321). Heterogeneous Task Co-location in Containerized Cloud Computing Environments. Proceedings of the 2020 IEEE 23rd International Symposium on Real-Time Distributed Computing (ISORC), Nashville, TN, USA.","DOI":"10.1109\/ISORC49007.2020.00021"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/8\/261\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:23:29Z","timestamp":1760127809000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/8\/261"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,31]]},"references-count":55,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["fi15080261"],"URL":"https:\/\/doi.org\/10.3390\/fi15080261","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,31]]}}}