{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:19:35Z","timestamp":1761401975491,"version":"build-2065373602"},"reference-count":62,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2018,9,28]],"date-time":"2018-09-28T00:00:00Z","timestamp":1538092800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fog computing, which places computing resources close to IoT devices, can offer low latency data processing for IoT applications. With software-defined networking (SDN), fog computing can enable network control logics to become programmable and run on a decoupled control plane, rather than on a physical switch. Therefore, network switches are controlled via the control plane. However, existing control planes have limitations in providing isolation and high performance, which are crucial to support multi-tenancy and scalability in fog computing. In this paper, we present optimization techniques for Linux to provide isolation and high performance for the control plane of SDN. The new techniques are (1) separate execution environment (SE2), which separates the execution environments between multiple control planes, and (2) separate packet processing (SP2), which reduces the complexity of the existing network stack in Linux. We evaluate the proposed techniques on commodity hardware and show that the maximum performance of a control plane increases by four times compared to the native Linux while providing strong isolation.<\/jats:p>","DOI":"10.3390\/s18103267","type":"journal-article","created":{"date-parts":[[2018,9,28]],"date-time":"2018-09-28T10:31:28Z","timestamp":1538130688000},"page":"3267","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Enhancing the Isolation and Performance of Control Planes for Fog Computing"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0705-623X","authenticated-orcid":false,"given":"Kyungwoon","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chiyoung","family":"Lee","sequence":"additional","affiliation":[{"name":"Institute of Convergence Technology, Korea Telecom Corporation, 70 Yuseong-daero 1689 beon-gil, Yuseong-gu, Daejeon 34047, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4730-950X","authenticated-orcid":false,"given":"Cheol-Ho","family":"Hong","sequence":"additional","affiliation":[{"name":"School of Electrical and Electronics Engineering, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1115-1862","authenticated-orcid":false,"given":"Chuck","family":"Yoo","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,9,28]]},"reference":[{"key":"ref_1","first-page":"46","article-title":"Cross-site virtual network in cloud and fog computing","volume":"2","author":"Montero","year":"2017","journal-title":"IEEE Cloud Comput."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hakiri, A., Sellami, B., Patil, P., Berthou, P., and Gokhale, A. (November, January 30). Managing Wireless Fog Networks using Software-Defined Networking. Proceedings of the 2017 IEEE\/ACS 14th International Conference on Computer Systems and Applications (AICCSA), Hammamet, Tunisia.","DOI":"10.1109\/AICCSA.2017.9"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Yi, S., Li, C., and Li, Q. (2015, January 21). A survey of fog computing: Concepts, applications and issues. Proceedings of the 2015 Workshop on Mobile Big Data, Hangzhou, China.","DOI":"10.1145\/2757384.2757397"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6900","DOI":"10.1109\/ACCESS.2017.2778504","article-title":"A survey on the edge computing for the Internet of Things","volume":"6","author":"Yu","year":"2017","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Willis, D., Dasgupta, A., and Banerjee, S. (2014, January 11). ParaDrop: A multi-tenant platform to dynamically install third party services on wireless gateways. Proceedings of the 9th ACM Workshop on Mobility in the Evolving Internet Architecture, Maui, HI, USA.","DOI":"10.1145\/2645892.2645901"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hong, K., Lillethun, D., Ramachandran, U., Ottenw\u00e4lder, B., and Koldehofe, B. (2013, January 16). Mobile fog: A programming model for large-scale applications on the internet of things. Proceedings of the Second ACM SIGCOMM Workshop on Mobile Cloud Computing, Hong Kong, China.","DOI":"10.1145\/2491266.2491270"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Satyanarayanan, M., Chen, Z., Ha, K., Hu, W., Richter, W., and Pillai, P. (2014, January 6\u20137). Cloudlets: At the leading edge of mobile-cloud convergence. Proceedings of the 2014 6th International Conference on Mobile Computing, Applications and Services (MobiCASE), Austin, TX, USA.","DOI":"10.4108\/icst.mobicase.2014.257757"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/JPROC.2014.2371999","article-title":"Software-defined networking: A comprehensive survey","volume":"103","author":"Kreutz","year":"2015","journal-title":"Proc. IEEE"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Iannone, L., and Riguidel, M. (2015, January 18\u201321). On the performance of SDN controllers: A reality check. Proceedings of the 2015 IEEE Conference on Network Function Virtualization and Software Defined Network (NFV-SDN), San Francisco, CA, USA.","DOI":"10.1109\/NFV-SDN.2015.7387410"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1994","DOI":"10.1109\/JIOT.2017.2746186","article-title":"Software-defined networking for internet of things: A survey","volume":"4","author":"Bera","year":"2017","journal-title":"IEEE Int. Things J."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Shin, S., Song, Y., Lee, T., Lee, S., Chung, J., Porras, P., Yegneswaran, V., Noh, J., and Kang, B.B. (2014, January 3\u20137). Rosemary: A robust, secure, and high-performance network operating system. Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security, Scottsdale, AZ, USA.","DOI":"10.1145\/2660267.2660353"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Betg\u00e9-Brezetz, S., Kamga, G.B., and Tazi, M. (2015, January 13\u201317). Trust support for SDN controllers and virtualized network applications. Proceedings of the 2015 1st IEEE Conference on Network Softwarization (NetSoft), London, UK.","DOI":"10.1109\/NETSOFT.2015.7116153"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1145\/2740070.2626304","article-title":"Troubleshooting blackbox SDN control software with minimal causal sequences","volume":"44","author":"Scott","year":"2015","journal-title":"ACM SIGCOMM Comput. Commun. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Porras, P.A., Cheung, S., Fong, M.W., Skinner, K., and Yegneswaran, V. (2015). Securing the Software Defined Network Control Layer, NDSS.","DOI":"10.14722\/ndss.2015.23222"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3514","DOI":"10.1109\/TNET.2017.2748159","article-title":"Flow wars: Systemizing the attack surface and defenses in software-defined networks","volume":"6","author":"Yoon","year":"2017","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_16","unstructured":"Dalton, M., Schultz, D., Adriaens, J., Arefin, A., Gupta, A., Fahs, B., Rubinstein, D., Zermeno, E.C., Rubow, E., and Docauer, J.A. (,  2018). Andromeda: Performance, Isolation, and Velocity at Scale in Cloud Network Virtualization. Proceedings of the 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI), Available online: https:\/\/www.usenix.org\/system\/files\/conference\/nsdi18\/nsdi18-dalton.pdf."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yang, G., Yu, B.Y., Jeong, W., and Yoo, C. (,  2018). FlowVirt: Flow Rule Virtualization for Dynamic Scalability of Programmable Network Virtualization. Proceedings of the International Conference on Cloud Computing, San Francisco, CA, USA.","DOI":"10.1109\/CLOUD.2018.00051"},{"key":"ref_18","unstructured":"Rizzo, L. (2012, January 8\u201310). Netmap: A novel framework for fast packet I\/O. Proceedings of the 21st USENIX Security Symposium (USENIX Security 12), Bellevue, WA, USA."},{"key":"ref_19","unstructured":"Tootoonchian, A., Gorbunov, S., Ganjali, Y., Casado, M., and Sherwood, R. (2012, January 24). On Controller Performance in Software-Defined Networks. Proceedings of the 2nd USENIX Workshop on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services, San Jose, CA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/MIC.2012.144","article-title":"Scalable network virtualization in software-defined networks","volume":"17","author":"Drutskoy","year":"2013","journal-title":"IEEE Int. Comput."},{"key":"ref_21","unstructured":"Jin, X., Gossels, J., Rexford, J., and Walker, D. (2015, January 4\u20136). Covisor: A compositional hypervisor for software-defined networks. Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15), Oakland, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Renart, E.G., Zhang, E.Z., and Nath, B. (2015, January 9\u201312). Towards a GPU SDN controller. Proceedings of the 2015 International Conference and Workshops on Networked Systems (NetSys), Cottbus, Germany.","DOI":"10.1109\/NetSys.2015.7089058"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Porras, P., Shin, S., Yegneswaran, V., Fong, M., Tyson, M., and Gu, G. (2012, January 13). A security enforcement kernel for OpenFlow networks. Proceedings of the First Workshop on Hot Topics in Software Defined Networks, Helsinki, Finland.","DOI":"10.1145\/2342441.2342466"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Luo, T., Tan, H.P., Quan, P.C., Law, Y.W., and Jin, J. (2012, January 15\u201317). Enhancing responsiveness and scalability for OpenFlow networks via control-message quenching. Proceedings of the 2012 International Conference on ICT Convergence (ICTC), Jeju Island, Korea.","DOI":"10.1109\/ICTC.2012.6386857"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Li, Y., Dong, L., Qu, J., and Zhang, H. (2014, January 26\u201327). Multiple controller management in software defined networking. Proceedings of the 2014 IEEE Symposium on Computer Applications and Communications (SCAC), Weihai, China.","DOI":"10.1109\/SCAC.2014.22"},{"key":"ref_26","unstructured":"Jeong, E., Woo, S., Jamshed, M.A., Jeong, H., Ihm, S., Han, D., and Park, K. (2018, September 28). mTCP: A Highly Scalable User-Level TCP Stack for Multicore Systems. Available online: https:\/\/www.usenix.org\/node\/179774."},{"key":"ref_27","unstructured":"(2018, July 02). Intel Data Plane Development Kit. Available online: http:\/\/dpdk.org."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gelberger, A., Yemini, N., and Giladi, R. (2013, January 14\u201316). Performance analysis of software-defined networking (SDN). Proceedings of the 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems, San Francisco, CA, USA.","DOI":"10.1109\/MASCOTS.2013.58"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Erickson, D. (2013, January 16). The beacon openflow controller. Proceedings of the Second ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking, Hong Kong, China.","DOI":"10.1145\/2491185.2491189"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Phemius, K., Bouet, M., and Leguay, J. (2014, January 5\u20139). Disco: Distributed multi-domain SDN controllers. Proceedings of the 2014 IEEE Network Operations and Management Symposium (NOMS), Krakow, Poland.","DOI":"10.1109\/NOMS.2014.6838330"},{"key":"ref_31","unstructured":"(2018, July 02). Floodlight Project. Available online: http:\/\/www.projectfloodlight.org\/."},{"key":"ref_32","unstructured":"HP (2013). SDN Controller Architecture, HP. Technical Report."},{"key":"ref_33","unstructured":"Tootoonchian, A., and Ganjali, Y. (,  2010). HyperFlow: A distributed control plane for OpenFlow. Proceedings of the 2010 Internet Network Management Conference on Research on Enterprise Networking, Available online: https:\/\/www.usenix.org\/legacy\/event\/inmwren10\/tech\/full_papers\/Tootoonchian.pdf."},{"key":"ref_34","unstructured":"Koponen, T., Casado, M., Gude, N., Stribling, J., Poutievski, L., Zhu, M., Ramanathan, R., Iwata, Y., Inoue, H., and Hama, T. (2010). Onix: A Distributed Control Platform for Large-Scale Production Networks, OSDI. Available online: http:\/\/static.usenix.org\/events\/osdi10\/tech\/full_papers\/Koponen.pdf."},{"key":"ref_35","unstructured":"Ng, E. (2010). Maestro: A System for Scalable Openflow Control, Rice University."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1109\/MCOM.2013.6461196","article-title":"Meridian: An SDN platform for cloud network services","volume":"51","author":"Banikazemi","year":"2013","journal-title":"IEEE Commun. Mag."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1145\/1384609.1384625","article-title":"NOX: Towards an operating system for networks","volume":"38","author":"Gude","year":"2008","journal-title":"ACM SIGCOMM Comput. Commun. Rev."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Medved, J., Varga, R., Tkacik, A., and Gray, K. (2014, January 19). Opendaylight: Towards a model-driven sdn controller architecture. In Proceeding of the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks, Sydney, Australia.","DOI":"10.1109\/WoWMoM.2014.6918985"},{"key":"ref_39","unstructured":"Berde, P., Gerola, M., Hart, J., Higuchi, Y., Kobayashi, M., Koide, T., Lantz, B., O\u2019Connor, B., Radoslavov, P., and Snow, W. (2014, January 22). ONOS: Towards an open, distributed SDN OS. Proceedings of the Third Workshop on Hot Topics in Software Defined Networking, Chicago, IL, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ferguson, A.D., Guha, A., Liang, C., Fonseca, R., and Krishnamurthi, S. (2013, January 12\u201316). Participatory networking: An API for application control of SDNs. Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM, Hong Kong, China.","DOI":"10.1145\/2486001.2486003"},{"key":"ref_41","unstructured":"McCauley, M. (2018, June 11). POX. Available online: http:\/\/www.noxrepo.org\/."},{"key":"ref_42","unstructured":"Telegraph, N., and Corporation, T. (2018, June 11). RYU Network Operating System. Available online: https:\/\/ryu.readthedocs.io\/."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Botelho, F., Bessani, A., Ramos, F.M., and Ferreira, P. (2014, January 1\u20133). On the design of practical fault-tolerant SDN controllers. Proceedings of the 2014 Third European Workshop on Software Defined Networks, London, UK.","DOI":"10.1109\/EWSDN.2014.25"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Sasaki, T., Perrig, A., and Asoni, D.E. (2016, January 6\u201310). Control-plane isolation and recovery for a secure SDN architecture. Proceedings of the 2016 IEEE NetSoft Conference and Workshops (NetSoft), Seoul, Korea.","DOI":"10.1109\/NETSOFT.2016.7502485"},{"key":"ref_45","unstructured":"(2018, June 11). Monitoring and Tuning the Linux Networking Stack: Sending Data. Available online: https:\/\/blog.packagecloud.io\/eng\/2017\/02\/06\/monitoring-tuning-linux-networking-stack-sending-data."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Farinacci, D., Li, T., Hanks, S., Meyer, D., and Traina, P. (2000). RFC 2784\u2014Generic Routing Encapsulation (GRE), IETF.","DOI":"10.17487\/rfc2784"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Benson, T., Akella, A., and Maltz, D.A. (2010, January 1\u201330). Network traffic characteristics of data centers in the wild. Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement, Melbourne, Australia.","DOI":"10.1145\/1879141.1879175"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1109\/TNET.2017.2786268","article-title":"Minimizing Controller Response Time through Flow Redirecting in SDNs","volume":"26","author":"Wang","year":"2018","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1109\/MCOM.2013.6461198","article-title":"On scalability of software-defined networking","volume":"2","author":"Yeganeh","year":"2013","journal-title":"IEEE Commun. Mag."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Garfinkel, T., Pfaff, B., Chow, J., Rosenblum, M., and Boneh, D. (2003, January 19\u201322). Terra: A virtual machine-based platform for trusted computing. Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, Bolton Landing, NY, USA.","DOI":"10.1145\/945445.945464"},{"key":"ref_51","unstructured":"Koponen, T., Amidon, K., Balland, P., Casado, M., Chanda, A., Fulton, B., Ganichev, I., Gross, J., Ingram, P., and Jackson, E. (2014, January 2\u20134). Network virtualization in multi-tenant datacenters. Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14), Seattle, WA, USA."},{"key":"ref_52","unstructured":"(2018, June 11). CVE Details. Available online: http:\/\/www.cvedetails.com."},{"key":"ref_53","unstructured":"Santos, J.R., Turner, Y., Janakiraman, G.J., and Pratt, I. (2008, January 22\u201327). Bridging the Gap between Software and Hardware Techniques for I\/O Virtualization. Proceedings of the USENIX Annual Technical Conference, Boston, MA, USA."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Liao, G., Guo, D., Bhuyan, L., and King, S.R. (2008, January 6\u20137). Software techniques to improve virtualized I\/O performance on multi-core systems. Proceedings of the 4th ACM\/IEEE Symposium on Architectures for Networking and Communications Systems, San Jose, CA, USA.","DOI":"10.1145\/1477942.1477971"},{"key":"ref_55","unstructured":"Intel (2011). PCI-SIG SR-IOV Primer: An Introduction to SR-IOV Technology, Intel."},{"key":"ref_56","unstructured":"Firestone, D., Putnam, A., Mundkur, S., Chiou, D., Dabagh, A., Andrewartha, M., Angepat, H., Bhanu, V., Caulfield, A., and Chung, E. (,  2018). Azure Accelerated Networking: SmartNICs in the Public Cloud. Proceedings of the 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18), Available online: https:\/\/www.usenix.org\/sites\/default\/files\/conference\/protected-files\/nsdi18_slides_firestone.pdf."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Kim, J., Jang, K., Lee, K., Ma, S., Shim, J., and Moon, S. (2015, January 21\u201324). NBA (network balancing act): A high-performance packet processing framework for heterogeneous processors. Proceedings of the Tenth European Conference on Computer Systems, Bordeaux, France.","DOI":"10.1145\/2741948.2741969"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Yasukata, K., Huici, F., Maffione, V., Lettieri, G., and Honda, M. (2017, January 24\u201327). HyperNF: Building a high performance, high utilization and fair NFV platform. Proceedings of the 2017 Symposium on Cloud Computing, Santa Clara, CA, USA.","DOI":"10.1145\/3127479.3127489"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Thimmaraju, K., Shastry, B., Fiebig, T., Hetzelt, F., Seifert, J.P., Feldmann, A., and Schmid, S. (2018, January 28\u201329). Taking control of sdn-based cloud systems via the data plane. Proceedings of the Symposium on SDN Research, Los Angeles, CA, USA.","DOI":"10.1145\/3185467.3185468"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Heller, B., Sherwood, R., and McKeown, N. (2012, January 13). The controller placement problem. Proceedings of the First Workshop on Hot Topics in Software Defined Networks, Helsinki, Finland.","DOI":"10.1145\/2342441.2342444"},{"key":"ref_61","unstructured":"(2018, August 16). OpenFlow Switch Specification. Available online: https:\/\/www.opennetworking.org\/wp-content\/uploads\/2014\/10\/openflow-switch-v1.5.1.pdf."},{"key":"ref_62","unstructured":"Bahl, V. (2018, August 16). Cloudlets for Mobile Computing. Available online: https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/11\/Cloudlets-for-Mobile-Computing.pdf."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/10\/3267\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:23:00Z","timestamp":1760196180000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/10\/3267"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,28]]},"references-count":62,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,10]]}},"alternative-id":["s18103267"],"URL":"https:\/\/doi.org\/10.3390\/s18103267","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,9,28]]}}}