{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T21:54:47Z","timestamp":1740174887083,"version":"3.37.3"},"reference-count":6,"publisher":"Wiley","license":[{"start":{"date-parts":[[2016,1,1]],"date-time":"2016-01-01T00:00:00Z","timestamp":1451606400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Laboratory of Computer Network and Information Integration of Ministry of Education of China","award":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"],"award-info":[{"award-number":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"]}]},{"name":"Jiangsu Provincial Key Laboratory of Network and Information Security","award":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"],"award-info":[{"award-number":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"]}]},{"name":"China National High Technology Research and Development Program","award":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"],"award-info":[{"award-number":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"],"award-info":[{"award-number":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"],"award-info":[{"award-number":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"],"award-info":[{"award-number":["93K-9","BM2003201","2013AA013503","61370207","61572128","61320106007"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientific Programming"],"published-print":{"date-parts":[[2016]]},"abstract":"<jats:p>Hadoop distributed file system (HDFS) is undoubtedly the most popular framework for storing and processing large amount of data on clusters of machines. Although a plethora of practices have been proposed for improving the processing efficiency and resource utilization, traditional HDFS still suffers from the overhead of disk-based low throughput and I\/O rate. In this paper, we attempt to address this problem by developing a memory-based Hadoop framework called MHDFS. Firstly, a strategy for allocating and configuring reasonable memory resources for MHDFS is designed and RAMFS is utilized to develop the framework. Then, we propose a new method to handle the data replacement to disk when memory resource is excessively occupied. An algorithm for estimating and updating the replacement is designed based on the metrics of file heat. Finally, substantial experiments are conducted which demonstrate the effectiveness of MHDFS and its advantage against conventional HDFS.<\/jats:p>","DOI":"10.1155\/2016\/1808396","type":"journal-article","created":{"date-parts":[[2016,5,9]],"date-time":"2016-05-09T17:02:47Z","timestamp":1462813367000},"page":"1-12","source":"Crossref","is-referenced-by-count":0,"title":["MHDFS: A Memory-Based Hadoop Framework for Large Data Storage"],"prefix":"10.1155","volume":"2016","author":[{"given":"Aibo","family":"Song","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Southeast University, Nanjing 211189, China"}]},{"given":"Maoxian","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Mathematics and Systems Science, Shandong University of Science and Technology, Qingdao 266590, China"}]},{"given":"Yingying","family":"Xue","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Southeast University, Nanjing 211189, China"}]},{"given":"Junzhou","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Southeast University, Nanjing 211189, China"}]}],"member":"311","reference":[{"year":"2004","key":"1"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1038\/455047a"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1145\/1629175.1629198"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-013-0319-9"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367513"}],"container-title":["Scientific Programming"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2016\/1808396.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2016\/1808396.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/sp\/2016\/1808396.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2016,7,26]],"date-time":"2016-07-26T08:59:41Z","timestamp":1469523581000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.hindawi.com\/journals\/sp\/2016\/1808396\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016]]},"references-count":6,"alternative-id":["1808396","1808396"],"URL":"https:\/\/doi.org\/10.1155\/2016\/1808396","relation":{},"ISSN":["1058-9244","1875-919X"],"issn-type":[{"type":"print","value":"1058-9244"},{"type":"electronic","value":"1875-919X"}],"subject":[],"published":{"date-parts":[[2016]]}}}