{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T08:12:45Z","timestamp":1767859965013,"version":"3.49.0"},"reference-count":49,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2021,12,11]],"date-time":"2021-12-11T00:00:00Z","timestamp":1639180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Agencia Estatal de Investigaci\u00f3n of Ministerio de Ciencia e Innovaci\u00f3n of Spain","award":["PID2019-108713RB-C51 MCIN\/AEI\/10.13039\/501100011033"],"award-info":[{"award-number":["PID2019-108713RB-C51 MCIN\/AEI\/10.13039\/501100011033"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper studies the problem of the dynamic scaling and load balancing of transparent virtualized network functions (VNFs). It analyzes different particularities of this problem, such as loop avoidance when performing scaling-out actions, and bidirectional flow affinity. To address this problem, a software-defined networking (SDN)-based solution is implemented consisting of two SDN controllers and two OpenFlow switches (OFSs). In this approach, the SDN controllers run the solution logic (i.e., monitoring, scaling, and load-balancing modules). According to the SDN controllers instructions, the OFSs are responsible for redirecting traffic to and from the VNF clusters (i.e., load-balancing strategy). Several experiments were conducted to validate the feasibility of this proposed solution on a real testbed. Through connectivity tests, not only could end-to-end (E2E) traffic be successfully achieved through the VNF cluster, but the bidirectional flow affinity strategy was also found to perform well because it could simultaneously create flow rules in both switches. Moreover, the selected CPU-based load-balancing method guaranteed an average imbalance below 10% while ensuring that new incoming traffic was redirected to the least loaded instance without requiring packet modification. Additionally, the designed monitoring function was able to detect failures in the set of active members in near real-time and active new instances in less than a minute. Likewise, the proposed auto-scaling module had a quick response to traffic changes. Our solution showed that the use of SDN controllers along with OFS provides great flexibility to implement different load-balancing, scaling, and monitoring strategies.<\/jats:p>","DOI":"10.3390\/s21248283","type":"journal-article","created":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T01:29:33Z","timestamp":1639358973000},"page":"8283","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["An SDN-Based Solution for Horizontal Auto-Scaling and Load Balancing of Transparent VNF Clusters"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4329-7962","authenticated-orcid":false,"given":"Alejandro","family":"Llorens-Carrodeguas","sequence":"first","affiliation":[{"name":"Department of Network Engineering, Universitat Polit\u00e8cnica de Catalunya (UPC), 08860 Castelldefels, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6356-5840","authenticated-orcid":false,"given":"Irian","family":"Leyva-Pupo","sequence":"additional","affiliation":[{"name":"Department of Network Engineering, Universitat Polit\u00e8cnica de Catalunya (UPC), 08860 Castelldefels, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8056-0774","authenticated-orcid":false,"given":"Cristina","family":"Cervell\u00f3-Pastor","sequence":"additional","affiliation":[{"name":"Department of Network Engineering, Universitat Polit\u00e8cnica de Catalunya (UPC), 08860 Castelldefels, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis","family":"Pi\u00f1eiro","sequence":"additional","affiliation":[{"name":"Bequant, 28003 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8257-4969","authenticated-orcid":false,"given":"Shuaib","family":"Siddiqui","sequence":"additional","affiliation":[{"name":"i2CAT Foundation, 08034 Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1109\/COMST.2015.2477041","article-title":"Network function virtualization: State-of-the-art and research challenges","volume":"18","author":"Mijumbi","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1109\/TNSM.2017.2730199","article-title":"On the placement of VNF managers in large-scale and distributed NFV systems","volume":"14","author":"Naboulsi","year":"2017","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_3","unstructured":"Hu, Y.C., Patel, M., Sabella, D., Sprecher, N., and Young, V. (2015). Mobile Edge Computing\u2014A Key Technology Towards 5G, ETSI. ETSI White Paper No. 11."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1857","DOI":"10.1109\/LCOMM.2021.3063262","article-title":"End-to-End Provisioning of Latency and Availability Constrained 5G Services","volume":"25","author":"Lashgari","year":"2021","journal-title":"IEEE Commun. Lett."},{"key":"ref_5","unstructured":"Lee, D., Park, J., Hiremath, C., Mangan, J., and Lynch, M. (2018). Towards Achieving High Performance in 5G Mobile Packet Core\u2019s User Plane Function, SK Telecom. Technical Report."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MCC.2018.064181118","article-title":"Accelerator virtualization in fog computing: Moving from the cloud to the edge","volume":"5","author":"Varghese","year":"2018","journal-title":"IEEE Cloud Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bertin, P., Mamouni, T., and Gosselin, S. (2017). Next-generation pop with functional convergence redistributions. Fiber-Wireless Convergence in Next-Generation Communication Networks, Springer.","DOI":"10.1007\/978-3-319-42822-2_12"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1109\/MNET.011.2000089","article-title":"Convergence of networking and cloud\/edge computing: Status, challenges, and opportunities","volume":"34","author":"Duan","year":"2020","journal-title":"IEEE Netw."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dutta, S., Taleb, T., and Ksentini, A. (2016, January 22\u201327). QoE-aware elasticity support in cloud-native 5G systems. Proceedings of the 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICC.2016.7511377"},{"key":"ref_10","unstructured":"Ma, J., Rankothge, W., Makaya, C., Morales, M., Le, F., and Lobo, J. (2018). A comprehensive study on load balancers for vnf chains horizontal scaling. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Alawe, I., Hadjadj-Aoul, Y., Ksentini, A., Bertin, P., and Darche, D. (2018, January 12\u201315). On the scalability of 5g core network: The amf case. Proceedings of the 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2018.8319194"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, H.Y., Chiang, C.Y., Cheng, H.S., and Chiang, M.L. (2018, January 27\u201329). OpenFlow-based Server Cluster with Dynamic Load Balancing. Proceedings of the 2018 19th IEEE\/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing (SNPD), Busan, Korea.","DOI":"10.1109\/SNPD.2018.8441096"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s10586-020-03135-w","article-title":"SDN-based server clusters with dynamic load balancing and performance improvement","volume":"24","author":"Chiang","year":"2021","journal-title":"Clust. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"531538","DOI":"10.1155\/2015\/531538","article-title":"Dynamic server cluster load balancing in virtualization environment with openflow","volume":"11","author":"Chen","year":"2015","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Manzanares-Lopez, P., Mu\u00f1oz-Gea, J.P., and Malgosa-Sanahuja, J. (2019, January 10\u201313). An MPTCP-compatible load balancing solution for pools of servers in OpenFlow SDN networks. Proceedings of the 2019 Sixth International Conference on Software Defined Systems (SDS), Rome, Italy.","DOI":"10.1109\/SDS.2019.8768495"},{"key":"ref_16","unstructured":"Ntop (2021, June 22). PF_Ring: High-Speed Packet Capture, Filtering and Analysis. Available online: https:\/\/www.ntop.org\/products\/packet-capture\/pf_ring\/."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"de Oliveira, J.V.G., Bellotti, P.C.P., de Oliveira, R.M., Vieira, A.B., and Chaves, L.J. (2021). Virtualizing Packet-Processing Network Functions over Heterogeneous OpenFlow Switches. IEEE Trans. Netw. Serv. Manag.","DOI":"10.1109\/TNSM.2021.3112403"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1109\/MCOM.2018.1701016","article-title":"SDN-based load balancing service for cloud servers","volume":"56","author":"Abdelltif","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/MCOM.2018.1701336","article-title":"Automated network service scaling in NFV: Concepts, mechanisms and scaling workflow","volume":"56","author":"Ameigeiras","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Buyakar, T.V.K., Rangisetti, A.K., Franklin, A.A., and Tamma, B.R. (2017, January 26\u201330). Auto scaling of data plane VNFs in 5G networks. Proceedings of the 2017 13th International Conference on Network and Service Management (CNSM), Tokyo, Japan.","DOI":"10.23919\/CNSM.2017.8256027"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1109\/TNSM.2019.2961988","article-title":"A scaling mechanism for an evolved packet core based on network functions virtualization","volume":"17","author":"Arteaga","year":"2019","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ghorab, A., Kusedghi, A., Nourian, M., and Akbari, A. (2020, January 1\u20132). Joint VNF Load Balancing and Service Auto-Scaling in NFV with Multimedia Case Study. Proceedings of the 2020 25th International Computer Conference, Computer Society of Iran (CSICC), Tehran, Iran.","DOI":"10.1109\/CSICC49403.2020.9050122"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.1109\/TNSM.2020.3015244","article-title":"A network intelligence architecture for efficient vnf lifecycle management","volume":"18","author":"Lange","year":"2020","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.csi.2016.12.007","article-title":"Technology pillars in the architecture of future 5G mobile networks: NFV, MEC and SDN","volume":"54","author":"Blanco","year":"2017","journal-title":"Comput. Stand. Interfaces"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MVT.2019.2921208","article-title":"6G wireless networks: Vision, requirements, architecture, and key technologies","volume":"14","author":"Zhang","year":"2019","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"110301","DOI":"10.1007\/s11432-020-2955-6","article-title":"Towards 6G wireless communication networks: Vision, enabling technologies, and new paradigm shifts","volume":"64","author":"You","year":"2021","journal-title":"Sci. China Inf. Sci."},{"key":"ref_27","unstructured":"ETSI-ISG-NFV (2014). Network Function Virtualization; Management and Orchestration, ETSI. White Paper."},{"key":"ref_28","unstructured":"Hajji, W. (2018). Dynamic Service Chain Composition in Virtualised Environment. [Ph.D. Thesis, Loughborough University]."},{"key":"ref_29","unstructured":"ONAP (2021, June 22). Open Network Automation Platform. Available online: https:\/\/www.onap.org\/."},{"key":"ref_30","unstructured":"OSM (2021, June 22). Open Source MANO. Available online: https:\/\/osm.etsi.org\/."},{"key":"ref_31","unstructured":"Baton, O. (2021, June 22). An Extensible and Customizable NFV MANO-Compliant Framework. Available online: https:\/\/openbaton.github.io\/."},{"key":"ref_32","unstructured":"Cloudify (2021, June 22). Open Source, Multi-Cloud Orchestration Platform. Available online: https:\/\/cloudify.co\/."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.comcom.2020.07.013","article-title":"Benchmarking open source NFV MANO systems: OSM and ONAP","volume":"161","author":"Yilma","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"102856","DOI":"10.1016\/j.jnca.2020.102856","article-title":"A comprehensive survey of load balancing techniques in software-defined network","volume":"174","author":"Hamdan","year":"2021","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1109\/MCOM.2018.1700601","article-title":"How to measure network flexibility? A proposal for evaluating softwarized networks","volume":"56","author":"Kellerer","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"47804","DOI":"10.1109\/ACCESS.2019.2910140","article-title":"A survey on data plane flexibility and programmability in software-defined networking","volume":"7","author":"Kaljic","year":"2019","journal-title":"IEEE Access"},{"key":"ref_37","unstructured":"ONF (2021, June 22). OpenFlow Specifications. Available online: https:\/\/opennetworking.org\/wp-content\/uploads\/2014\/10\/openflow-switch-v1.5.1.pdf."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhang, W., Hwang, J., Rajagopalan, S., Ramakrishnan, K., and Wood, T. (2016, January 12\u201315). Flurries: Countless fine-grained nfs for flexible per-flow customization. Proceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies, Irvine, CA, USA.","DOI":"10.1145\/2999572.2999602"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Li, Y., Han, Z., Gu, S., Zhuang, G., and Li, F. (2021, January 7\u201310). Dyncast: Use Dynamic Anycast to Facilitate Service Semantics Embedded in IP address. Proceedings of the 2021 IEEE 22nd International Conference on High Performance Switching and Routing (HPSR), Paris, France.","DOI":"10.1109\/HPSR52026.2021.9481819"},{"key":"ref_40","unstructured":"HAProxy (2021, June 22). The Reliable, High Performance TCP\/HTTP Load Balancer. Available online: https:\/\/www.haproxy.org\/."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Llorens-Carrodeguas, A., Cervell\u00f3-Pastor, C., and Leyva-Pupo, I. (August, January 29). A data distribution service in a hierarchical sdn architecture: Implementation and evaluation. Proceedings of the 2019 28th International Conference on Computer Communication and Networks (ICCCN), Valencia, Spain.","DOI":"10.1109\/ICCCN.2019.8847035"},{"key":"ref_42","unstructured":"OpenStack (2021, June 22). OpenStack Nova Service. Available online: https:\/\/docs.openstack.org\/nova\/latest\/."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Isyaku, B., Mohd Zahid, M.S., Bte Kamat, M., Abu Bakar, K., and Ghaleb, F.A. (2020). Software Defined Networking Flow Table Management of OpenFlow Switches Performance and Security Challenges: A Survey. Future Internet, 12.","DOI":"10.3390\/fi12090147"},{"key":"ref_44","first-page":"228","article-title":"Efficient flow table management scheme in SDN-based cloud computing networks","volume":"14","author":"Ha","year":"2018","journal-title":"J. Inf. Process. Syst."},{"key":"ref_45","unstructured":"Kaur, S., Kumar, K., Singh, J., and Ghumman, N.S. (2015, January 11\u201313). Round-robin based load balancing in Software Defined Networking. Proceedings of the 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India."},{"key":"ref_46","unstructured":"Ryu (2021, June 22). RYU SDN Framework. Available online: https:\/\/book.ryu-sdn.org\/en\/Ryubook.pdf."},{"key":"ref_47","unstructured":"Iperf (2021, June 22). The Ultimate Speed Test Tool for TCP, UDP and SCTP. Available online: https:\/\/iperf.fr\/."},{"key":"ref_48","unstructured":"Turkovic, B., Kuipers, F.A., and Uhlig, S. (2019). Fifty shades of congestion control: A performance and interactions evaluation. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Statkus, A., Paulikas, \u0160., and Krukonis, A. (2021). TCP Acknowledgment Optimization in Low Power and Embedded Devices. Electronics, 10.","DOI":"10.3390\/electronics10060639"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8283\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:45:25Z","timestamp":1760168725000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8283"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,11]]},"references-count":49,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21248283"],"URL":"https:\/\/doi.org\/10.3390\/s21248283","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,11]]}}}