{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,6]],"date-time":"2025-07-06T00:34:13Z","timestamp":1751762053384,"version":"3.37.3"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2020,7,29]],"date-time":"2020-07-29T00:00:00Z","timestamp":1595980800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,29]],"date-time":"2020-07-29T00:00:00Z","timestamp":1595980800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Netw Syst Manage"],"published-print":{"date-parts":[[2020,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents MaxHadoop, a flexible and scalable emulation tool, which allows the efficient and accurate emulation of Hadoop environments over Software Defined Networks (SDNs). Hadoop has been designed to manage endless data-streams over networks, making it a tailored candidate to support the new class of network services belonging to Big Data. The development of Hadoop is contemporary with the evolution of networks towards the new architectures \u201cSoftware Defined.\u201d To create our emulation environment, tailored to SDNs, we employ MaxiNet, given its capability of emulating large-scale SDNs. We make it possible to emulate realistic Hadoop scenarios on large-scale SDNs using low-cost commodity hardware, by resolving a few key limitations of MaxiNet through appropriate configuration settings. We validate the MaxHadoop emulator by executing two benchmarks, namely WordCount and TeraSort, to evaluate a set of Key Performance Indicators. The tests\u2019 outcomes evidence that MaxHadoop outperforms other existing emulation tools running over commodity hardware. Finally, we show the potentiality of MaxHadoop by utilizing it to perform a comparison of SDN-based network protocols.<\/jats:p>","DOI":"10.1007\/s10922-020-09552-x","type":"journal-article","created":{"date-parts":[[2020,7,29]],"date-time":"2020-07-29T05:26:20Z","timestamp":1596000380000},"page":"1610-1638","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["MaxHadoop: An Efficient Scalable Emulation Tool to Test SDN Protocols in Emulated Hadoop Environments"],"prefix":"10.1007","volume":"28","author":[{"given":"Claudio","family":"Calcaterra","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessio","family":"Carmenini","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2426-1902","authenticated-orcid":false,"given":"Andrea","family":"Marotta","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ubaldo","family":"Bucci","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dajana","family":"Cassioli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,7,29]]},"reference":[{"key":"9552_CR1","doi-asserted-by":"publisher","first-page":"5803","DOI":"10.1002\/sec.1737","volume":"9","author":"AE Elalaoui","year":"2016","unstructured":"Elalaoui, A.E., Benzekki, K., Fergougui, A.E.: Software-defined networking (SDN): a survey. Secur. Commun. Netw. 9, 5803\u20135833 (2016)","journal-title":"Secur. Commun. Netw."},{"key":"9552_CR2","first-page":"69","volume":"38","author":"H Balakrishnan","year":"2008","unstructured":"Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J., McKeown, N., Anderson, T.: Openflow: enabling innovation in campus networks. Int. J. Parallel Programm. 38, 69\u201374 (2008)","journal-title":"Int. J. Parallel Programm."},{"key":"9552_CR3","unstructured":"Fang, G., Lee,\u00a0B., Qiao,\u00a0Y., Wang,\u00a0X.: Doopnet: an emulator for network performance analysis of Hadoop clusters using Docker and Mininet. In: IEEE Symposium on Computers and Communication (ISCC), pp. 784\u2013790, (2016)"},{"key":"9552_CR4","unstructured":"Schwabe, A., Wallaschek, F., Zahraee, MH., Karl, H., Wette, P., Dr\u00e4xler, M.: MaxiNet: Distributed emulation of software-defined networks. In: 2014 IFIP Networking Conference, pp. 1\u20139, (2014)"},{"key":"9552_CR5","unstructured":"Lebiednik, Brian., Mangal, Aman., Tiwari, Niharika.: A survey and evaluation of data center network topologies. arXiv preprint arXiv:1605.01701. (2016)"},{"key":"9552_CR6","doi-asserted-by":"crossref","unstructured":"Vahdat, A., Al-Fares, M., Loukissas, A.: A scalable, commodity data center network architecture. In: Proceedings of the ACM SIGCOMM 2008 Conference on Data Communication, pp. 63\u201374, (2008)","DOI":"10.1145\/1402946.1402967"},{"key":"9552_CR7","doi-asserted-by":"crossref","unstructured":"Calcaterra, C., Carmenini, A., Marotta, A., Cassioli, D.: Hadoop performance evaluation in software defined data center networks. In: Proc. of the 2019 International Conference on Computing, Networking and Communications (ICNC), pp. 18\u201321, (2019)","DOI":"10.1109\/ICCNC.2019.8685506"},{"key":"9552_CR8","unstructured":"Docker Inc. Docker, (June 2018). https:\/\/www.docker.com\/index.html"},{"key":"9552_CR9","unstructured":"Peuster, M.: Containernet home page. https:\/\/containernet.github.io\/ (2018)"},{"key":"9552_CR10","doi-asserted-by":"publisher","first-page":"472","DOI":"10.1007\/s10766-013-0281-6","volume":"43","author":"B Yao","year":"2015","unstructured":"Yao, B., Guo, M., Li, Z., Shen, Y.: Ofscheduler: a dynamic network optimizer for MapReduce in heterogeneous cluster. Int J Parallel Programm. 43, 472\u2013488 (2015)","journal-title":"Int J Parallel Programm."},{"key":"9552_CR11","doi-asserted-by":"crossref","unstructured":"Ferguson, Andrew\u00a0D., Guha, Arjun., Liang, Chen., Fonseca, Rodrigo., Krishnamurthi, Shriram.: Participatory networking: An API for application control of SDNs. In: Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM, SIGCOMM \u201913, pp. 327\u2013338, New York, NY, USA, Association for Computing Machinery. https:\/\/doi.org\/10.1145\/2486001.2486003. (2013)","DOI":"10.1145\/2534169.2486003"},{"key":"9552_CR12","doi-asserted-by":"crossref","unstructured":"Wang G., Ng. TSE, Shaikh, A.: Programming your network at run-time for big data applications. In: Proceedings of the First Workshop on Hot Topics in Software Defined Networks, pp. 103\u2013108, (2012)","DOI":"10.1145\/2342441.2342462"},{"key":"9552_CR13","doi-asserted-by":"publisher","first-page":"93294","DOI":"10.1109\/ACCESS.2019.2927822","volume":"7","author":"AA Abbasi","year":"2019","unstructured":"Abbasi, A.A., Abbasi, A., Shamshirband, S., Chronopoulos, A.T., Persico, V., Pescap\u00e8, A.: Software-defined cloud computing: a systematic review on latest trends and developments. IEEE Access 7, 93294\u201393314 (2019)","journal-title":"IEEE Access"},{"key":"9552_CR14","unstructured":"VMware. VMware Tanzu Kubernetes Grid. https:\/\/tanzu.vmware.com\/kubernetes-grid. Accessed 18 Apr 2020"},{"key":"9552_CR15","unstructured":"Colbert, K.: Introducing vSphere 7: Modern Applications and Kubernetes. https:\/\/blogs.vmware.com\/vsphere\/2020\/03\/vsphere-7-kubernetes-tanzu.html. Accessed 18 Apr 2020"},{"key":"9552_CR16","unstructured":"Lai, J., Tian, J., Zhang, K., Yang, Z., Dingde, J.: Towards a cloud-based network emulation platform. In: Mobile Networks and Applications, Network Emulation as a Service (NEAAS) (2020)"},{"key":"9552_CR17","doi-asserted-by":"crossref","unstructured":"Zulu, L.L., Ogudo, K.A., Umenne, P.O.: Emulating software defined network using mininet and opendaylight controller hosted on amazon web services cloud platform to demonstrate a realistic programmable network. In 2018 International Conference on Intelligent and Innovative Computing Applications (ICONIC), pp. 1\u20137, (2018)","DOI":"10.1109\/ICONIC.2018.8601254"},{"issue":"14","key":"9552_CR18","first-page":"527","volume":"14","author":"TR Henderson","year":"2008","unstructured":"Henderson, T.R., Lacage, M., Riley, G.F., Dowell, C., Kopena, J.: Network simulations with the ns-3 simulator. SIGCOMM Demonstrat. 14(14), 527 (2008)","journal-title":"SIGCOMM Demonstrat."},{"key":"9552_CR19","first-page":"110","volume":"51","author":"C Yang","year":"2013","unstructured":"Yang, C., Wang, S., Chou, C.: Estinet openflow network simulator and emulator. EEE Commun. Mag. 51, 110\u2013117 (2013)","journal-title":"EEE Commun. Mag."},{"key":"9552_CR20","unstructured":"Calheiros, RN., Ji, X., Yoon, Y., Buyya,\u00a0R., Son,\u00a0J., Dastjerdi, AV.: Cloudsimsdn: Modeling and simulation of software defined cloud data centers. In: 15th IEEE\/ACM International Symposium on Cluster, Cloud and Grid Computing, pp. 475\u2013484, (2015)"},{"key":"9552_CR21","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1002\/spe.995","volume":"41","author":"A Beloglazov","year":"2011","unstructured":"Beloglazov, A., Rose, C.A.F.D., Buyya, R., Calheiros, R.N., Ranjan, R.: Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource\nprovisioning algorithms. Softw Pract Exp 41, 23\u201350 (2011)","journal-title":"Softw Pract Exp"},{"key":"9552_CR22","unstructured":"McKeown, N., Lantz, B., Heller, B.: A network in a laptop: rapid prototyping for software defined networks. In: Proceedings of the Ninth ACM SIGCOMM Workshop on Hot Topics in Networks, pp. 1\u20136, (2010)"},{"key":"9552_CR23","unstructured":"Adami, D., Chiaro, AD., Giordano, S., Santos, A., Teixeira, J., Antichi, G.: Datacenter in a box: test your SDN cloud datacenter controller at home. In: 2013 Second European Workshop on Software Defined Networks, pp. 99\u2013101, (2013)"},{"key":"9552_CR24","unstructured":"Zhu, R.: Dockernet source code. https:\/\/github.com\/vfreex\/dockernet"},{"key":"9552_CR25","doi-asserted-by":"crossref","unstructured":"Farias, Fernando N.\u00a0N., Junior, Ant\u00f4nio de\u00a0O., da\u00a0Costa, Leonardo\u00a0B., Pinheiro, Billy\u00a0A., Abel\u00e9m, Ant\u00f4nio J.\u00a0G.: vsdnemul: A software-defined network emulator based on container virtualization, (2019)","DOI":"10.5013\/IJSSST.a.20.04.07"},{"key":"9552_CR26","unstructured":"Cloud Native Computing Foundation. kubernetes. https:\/\/kubernetes.io. Accessed 18 Apr 2020"},{"key":"9552_CR27","unstructured":"Docker. Swarm. https:\/\/docs.docker.com\/engine\/swarm. Accessed 18 Apr 2020."},{"key":"9552_CR28","unstructured":"Cloud Native Computing Foundation. containerd. https:\/\/containerd.io. Accessed 18 Apr 2020"},{"key":"9552_CR29","unstructured":"Ryu SDN Framework. Ryu SDN Framework Community. https:\/\/osrg.github.io\/ryu\/. (2017)"},{"key":"9552_CR30","unstructured":"Apache\u00a0Software Foundation. Apache hadoop 2.9.0 hadoop cluster setup. https:\/\/hadoop.apache.org\/docs\/r2.9.0\/hadoop-project-dist\/hadoop-common\/ClusterSetup.html. (2017)"},{"key":"9552_CR31","unstructured":"Apache\u00a0Software Foundation. Apache hadoop 2.9.0\u2014mapreduce application master rest APIs. https:\/\/hadoop.apache.org\/docs\/r2.9.0\/hadoop-mapreduce-client\/hadoop-mapreduce-client-core\/MapredAppMasterRest.html. (2017)"},{"key":"9552_CR32","unstructured":"Apache\u00a0Software Foundation. Rumen. http:\/\/hadoop.apache.org\/docs\/r1.2.1\/rumen.html. (2018)"},{"key":"9552_CR33","doi-asserted-by":"crossref","unstructured":"Li, Z., Kihl, M., Lu, Q., Andersson, J.\u00a0A.: Performance overhead comparison between hypervisor and container based virtualization. In: 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA), pp. 955\u2013962, (2017)","DOI":"10.1109\/AINA.2017.79"}],"container-title":["Journal of Network and Systems Management"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10922-020-09552-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10922-020-09552-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10922-020-09552-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,28]],"date-time":"2021-07-28T23:28:41Z","timestamp":1627514921000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10922-020-09552-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,29]]},"references-count":33,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,10]]}},"alternative-id":["9552"],"URL":"https:\/\/doi.org\/10.1007\/s10922-020-09552-x","relation":{},"ISSN":["1064-7570","1573-7705"],"issn-type":[{"type":"print","value":"1064-7570"},{"type":"electronic","value":"1573-7705"}],"subject":[],"published":{"date-parts":[[2020,7,29]]},"assertion":[{"value":"29 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 June 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 July 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}