{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:08:10Z","timestamp":1750306090937,"version":"3.41.0"},"reference-count":23,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2017,6,13]],"date-time":"2017-06-13T00:00:00Z","timestamp":1497312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1551057","1064963","1345142","1629009"],"award-info":[{"award-number":["1551057","1064963","1345142","1629009"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Meas. Anal. Comput. Syst."],"published-print":{"date-parts":[[2017,6,13]]},"abstract":"<jats:p>The Named Data Networking (NDN) architecture retrieves content by names rather than connecting to specific hosts. It provides benefits such as highly efficient and resilient content distribution, which fit well to data-intensive distributed computing. This paper presents and discusses our experience in modifying Apache Hadoop, a popular MapReduce framework, to operate on an NDN network. Through this first-of-its-kind implementation process, we demonstrate the feasibility of running an existing, large, and complex piece of distributed software commonly seen in data centers over NDN. We show advantages such as simplified network code and reduced network traffic which are beneficial in a data center environment. There are also challenges faced by NDN, that are being addressed by the community, which can be magnified under data center traffic. Through detailed evaluation, we show a reduction of 16% for overall data transmission between Hadoop nodes while writing data with default replication settings. Preliminary results also show promise for in-network caching of repeated reads in distributed applications. We also show that overall performance is currently slower under NDN, and we identify challenges and opportunities for further NDN improvements.<\/jats:p>","DOI":"10.1145\/3084439","type":"journal-article","created":{"date-parts":[[2018,3,23]],"date-time":"2018-03-23T18:28:08Z","timestamp":1521829688000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Hadoop on Named Data Networking"],"prefix":"10.1145","volume":"1","author":[{"given":"Mathias","family":"Gibbens","sequence":"first","affiliation":[{"name":"The University of Arizona, Tucson, AZ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Gniady","sequence":"additional","affiliation":[{"name":"The University of Arizona, Tucson, AZ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Ye","sequence":"additional","affiliation":[{"name":"The University of Arizona, Tucson, AZ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Beichuan","family":"Zhang","sequence":"additional","affiliation":[{"name":"The University of Arizona, Tucson, AZ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,6,13]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1402946.1402967"},{"volume-title":"Networking in the Hadoop Cluster. https:\/\/www.arista.com\/assets\/data\/pdf\/TechBulletins\/\\\\NetworkingInTheHadoopCluster.pdf","year":"2016","key":"e_1_2_1_2_1","unstructured":"Arista. Networking in the Hadoop Cluster. https:\/\/www.arista.com\/assets\/data\/pdf\/TechBulletins\/\\\\NetworkingInTheHadoopCluster.pdf , 2016 . Arista. Networking in the Hadoop Cluster. https:\/\/www.arista.com\/assets\/data\/pdf\/TechBulletins\/\\\\NetworkingInTheHadoopCluster.pdf, 2016."},{"key":"e_1_2_1_3_1","first-page":"1","volume-title":"Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA)","author":"Bonifacio A. S.","unstructured":"A. S. Bonifacio , A. Menolli , and F. Silva . Hadoop mapreduce configuration parameters and system performance: a systematic review . In Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA) , page 1 . The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 2014. A. S. Bonifacio, A. Menolli, and F. Silva. Hadoop mapreduce configuration parameters and system performance: a systematic review. In Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), page 1. The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 2014."},{"key":"e_1_2_1_4_1","first-page":"1","volume-title":"Mercury: Host-side flash caching for the data center. In 012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST)","author":"Byan S.","year":"2012","unstructured":"S. Byan , J. Lentini , A. Madan , and L. Pabon . Mercury: Host-side flash caching for the data center. In 012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST) , pages 1 -- 12 . IEEE , 2012 . S. Byan, J. Lentini, A. Madan, and L. Pabon. Mercury: Host-side flash caching for the data center. In 012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST), pages 1--12. IEEE, 2012."},{"key":"e_1_2_1_5_1","volume-title":"https:\/\/developers.google.com\/protocol-buffers\/","author":"Google Developers Protocol Buffers","year":"2016","unstructured":"Google. Protocol Buffers | Google Developers . https:\/\/developers.google.com\/protocol-buffers\/ , 2016 . Google. Protocol Buffers | Google Developers. https:\/\/developers.google.com\/protocol-buffers\/, 2016."},{"volume-title":"HiBench: HiBench is a big data benchmark suite. https:\/\/github.com\/intel-hadoop\/HiBench","year":"2016","key":"e_1_2_1_6_1","unstructured":"Intel. HiBench: HiBench is a big data benchmark suite. https:\/\/github.com\/intel-hadoop\/HiBench , 2016 . Intel. HiBench: HiBench is a big data benchmark suite. https:\/\/github.com\/intel-hadoop\/HiBench, 2016."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1658939.1658941"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2486001.2486019"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2342488.2342506"},{"issue":"1","key":"e_1_2_1_10_1","first-page":"63","volume":"103","author":"Kreutz D.","year":"2015","unstructured":"D. Kreutz , F. M. V. Ramos , P. Ver\u00edssimo , C. E. Rothenberg , S. Azodolmolky , and S. Uhlig . Software-Defined Networking: A Comprehensive Survey. Proceedings of the IEEE , 103 ( 1 ): 63 , 2015 . D. Kreutz, F. M. V. Ramos, P. Ver\u00edssimo, C. E. Rothenberg, S. Azodolmolky, and S. Uhlig. Software-Defined Networking: A Comprehensive Survey. Proceedings of the IEEE, 103(1):63, 2015.","journal-title":"Software-Defined Networking: A Comprehensive Survey. Proceedings of the IEEE"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2287036.2287045"},{"key":"e_1_2_1_12_1","volume-title":"https:\/\/blogs.parc.com\/ccnx\/","author":"Palo Alto Research Center","year":"2016","unstructured":"Palo Alto Research Center . CC Nx | PARC's implementation of content-centric networking. https:\/\/blogs.parc.com\/ccnx\/ , 2016 . Palo Alto Research Center. CCNx | PARC's implementation of content-centric networking. https:\/\/blogs.parc.com\/ccnx\/, 2016."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984356.2984369"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPASS.2010.5452045"},{"key":"e_1_2_1_15_1","volume-title":"An implementation of content-centric networking sockets for use with hadoop","author":"Sherwood J.","year":"2011","unstructured":"J. Sherwood . An implementation of content-centric networking sockets for use with hadoop . Stetson University , 12 2011 . Senior research project. J. Sherwood. An implementation of content-centric networking sockets for use with hadoop. Stetson University, 12 2011. Senior research project."},{"key":"e_1_2_1_16_1","volume-title":"An implementation of hadoop utilizing content-centric networking","author":"Sherwood J.","year":"2011","unstructured":"J. Sherwood . Proposal : An implementation of hadoop utilizing content-centric networking . Stetson University , 5 2011 . J. Sherwood. Proposal: An implementation of hadoop utilizing content-centric networking. Stetson University, 5 2011."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984356.2984358"},{"key":"e_1_2_1_18_1","volume-title":"https:\/\/hadoop.apache.org\/","author":"Software Foundataion The Apache","year":"2016","unstructured":"The Apache Software Foundataion . Apache Hadoop . https:\/\/hadoop.apache.org\/ , 2016 . The Apache Software Foundataion. Apache Hadoop. https:\/\/hadoop.apache.org\/, 2016."},{"key":"e_1_2_1_19_1","volume-title":"Apache Hadoop - HDFS Architecture. https:\/\/hadoop.apache.org\/docs\/current\/hadoop-project-dist\/hadoop-hdfs\/HdfsDesign.html","author":"Software Foundataion The Apache","year":"2016","unstructured":"The Apache Software Foundataion . Apache Hadoop - HDFS Architecture. https:\/\/hadoop.apache.org\/docs\/current\/hadoop-project-dist\/hadoop-hdfs\/HdfsDesign.html , 2016 . The Apache Software Foundataion. Apache Hadoop - HDFS Architecture. https:\/\/hadoop.apache.org\/docs\/current\/hadoop-project-dist\/hadoop-hdfs\/HdfsDesign.html, 2016."},{"key":"e_1_2_1_20_1","volume-title":"Named Data Networking (NDN) - A Future Internet Architecture. https:\/\/named-data.net\/","author":"Project The NDN","year":"2016","unstructured":"The NDN Project . Named Data Networking (NDN) - A Future Internet Architecture. https:\/\/named-data.net\/ , 2016 . The NDN Project. Named Data Networking (NDN) - A Future Internet Architecture. https:\/\/named-data.net\/, 2016."},{"key":"e_1_2_1_21_1","volume-title":"Tools and Applications - Named Data Networking (NDN). https:\/\/named-data.net\/codebase\/applications\/","author":"Project The NDN","year":"2016","unstructured":"The NDN Project . Tools and Applications - Named Data Networking (NDN). https:\/\/named-data.net\/codebase\/applications\/ , 2016 . The NDN Project. Tools and Applications - Named Data Networking (NDN). https:\/\/named-data.net\/codebase\/applications\/, 2016."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2656877.2656887"},{"key":"e_1_2_1_23_1","volume-title":"CCDN: Content-Centric Data Center Networks","author":"Zhu M.","year":"2016","unstructured":"M. Zhu , D. Li , F. Wang , A. Li , K. Ramakrishnan , Y. Liu , J. Wu , N. Zhu , and X. Liu . CCDN: Content-Centric Data Center Networks . 2016 . M. Zhu, D. Li, F. Wang, A. Li, K. Ramakrishnan, Y. Liu, J. Wu, N. Zhu, and X. Liu. CCDN: Content-Centric Data Center Networks. 2016."}],"container-title":["Proceedings of the ACM on Measurement and Analysis of Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3084439","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3084439","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3084439","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:22Z","timestamp":1750217422000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3084439"}},"subtitle":["Experience and Results"],"short-title":[],"issued":{"date-parts":[[2017,6,13]]},"references-count":23,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,6,13]]}},"alternative-id":["10.1145\/3084439"],"URL":"https:\/\/doi.org\/10.1145\/3084439","relation":{},"ISSN":["2476-1249"],"issn-type":[{"type":"electronic","value":"2476-1249"}],"subject":[],"published":{"date-parts":[[2017,6,13]]},"assertion":[{"value":"2017-06-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}