{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T22:28:24Z","timestamp":1782599304736,"version":"3.54.5"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T00:00:00Z","timestamp":1583193600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T00:00:00Z","timestamp":1583193600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Grid Computing"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper is motivated by the need of deadline-bounded applications in live mobile network environments to obtain the guarantee and the appropriate share of an input and output (I\/O) data rate. However, data processing frameworks only support the request of memory and the computing capacity at present. In this paper, we propose a solution that allows the control of disk I\/O and network I\/O for data processing applications in YARN and Mesos frameworks. Experimental results show that our tool can provision the I\/O data rate sharing of competing data processing applications.<\/jats:p>","DOI":"10.1007\/s10723-020-09508-0","type":"journal-article","created":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T11:02:46Z","timestamp":1583233366000},"page":"491-506","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Provisioning Input and Output Data Rates in Data Processing Frameworks"],"prefix":"10.1007","volume":"18","author":[{"given":"Nam H.","family":"Do","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tien","family":"Van Do","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"L\u00f3r\u00e1nt","family":"Farkas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Csaba","family":"Rotter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,3,3]]},"reference":[{"key":"9508_CR1","unstructured":"Apache Hadoop. http:\/\/hadoop.apache.org. Accessed: 2017-06-05"},{"key":"9508_CR2","unstructured":"Apache Mesos. http:\/\/mesos.apache.org\/. Accessed: 2017-12-17"},{"key":"9508_CR3","unstructured":"Apache Spark. http:\/\/spark.apache.org\/. Accessed: 2017-12-17"},{"key":"9508_CR4","unstructured":"CGroups Blkio Controller. https:\/\/www.kernel.org\/doc\/Documentation\/cgroup-v1\/blkio-controller.txt. Accessed: 2019-12-18"},{"key":"9508_CR5","unstructured":"Fio - an I\/O tool for benchmark and stress\/hardware verification. https:\/\/linux.die.net\/man\/1\/fio. Accessed: 2015-03-4"},{"key":"9508_CR6","unstructured":"Linux Advanced Routing and Traffic Control: HOWTO. http:\/\/lartc.org. Accessed: 2017-04-10"},{"key":"9508_CR7","unstructured":"NCBI Bacteria Genome Database. ftp:\/\/ftp.ncbi.nlm.nih.gov\/genomes\/archive\/old_refseq\/Bacteria\/. Accessed: 2017-11-05"},{"key":"9508_CR8","unstructured":"TeraSort benchmark for Spark. https:\/\/github.com\/ehiggs\/spark-terasort. Accessed: 2017-04-05"},{"key":"9508_CR9","doi-asserted-by":"crossref","unstructured":"Amamou, A, Bourguiba, M., Haddadou, K., Pujolle, G.: A Dynamic Bandwidth Allocator for Virtual Machines in a Cloud Environment. In: 2012 IEEE Consumer Communications and Networking Conference (CCNC), pp. 99\u2013104 (2012)","DOI":"10.1109\/CCNC.2012.6181065"},{"key":"9508_CR10","unstructured":"Do, N.H., Do, T., Tran, T.X., Farkas, L., Rotter, C.: Data I\/O Provision for Spark Applications in a Mesos Cluster. In: 2016 19Th International Conference On Intelligence in Next Generation Networks (ICIN) (2016)"},{"key":"9508_CR11","doi-asserted-by":"crossref","unstructured":"Do, T.V., Vu, B.T., Do, N.H., Farkas, L., Rotter, C., Tarjanyi, T.: Building Block Components to Control a Data Rate in the Apache Hadoop Compute Platform. In: 2015 18Th International Conference On Intelligence in Next Generation Networks (ICIN), pp. 23\u201329 (2015)","DOI":"10.1109\/ICIN.2015.7073802"},{"issue":"3","key":"9508_CR12","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/s10723-019-09483-1","volume":"17","author":"I Dra\u0307gan","year":"2019","unstructured":"Dra\u0307gan, I., Iuhasz, G., Petcu, D.: A scalable platform for monitoring data intensive applications. J. Grid Comput. 17(3), 503\u2013528 (2019)","journal-title":"J. Grid Comput."},{"issue":"4","key":"9508_CR13","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1007\/s10723-018-9460-4","volume":"16","author":"J Enes","year":"2018","unstructured":"Enes, J., Cacheiro, J.L., Exp\u00f3sito, R.R., Tourin\u0307o, J.: Big data-oriented PaaS architecture with disk-as-a-resource capability and container-based virtualization. J. Grid Comput. 16(4), 587\u2013605 (2018)","journal-title":"J. Grid Comput."},{"key":"9508_CR14","unstructured":"Karimi, R., Hajdu, A.: HTSFinder: Powerful Pipeline of DNA Signature Discovery by Parallel and Distributed Computing. submitted to the Journal of Evolutionary Bioinformatics (2015). http:\/\/www.inf.unideb.hu\/~hajdua\/HTSFinder.html"},{"key":"9508_CR15","doi-asserted-by":"crossref","unstructured":"Kc, K., Freeh, V.: Dynamically Controlling Node-Level Parallelism in Hadoop. In: 2015 IEEE 8Th International Conference on Cloud Computing (CLOUD), pp. 309\u2013316 (2015)","DOI":"10.1109\/CLOUD.2015.49"},{"key":"9508_CR16","doi-asserted-by":"crossref","unstructured":"Ko, B.-M., Lee, J., Jo, H.: Toward enhancing block I\/O performance for virtualized hadoop cluster. In: Proceedings of the 2014 IEEE\/ACM 7th International Conference on Utility and Cloud Computing, UCC \u201914, pp. 481\u2013482. IEEE Computer Society (2014)","DOI":"10.1109\/UCC.2014.61"},{"key":"9508_CR17","doi-asserted-by":"crossref","unstructured":"Kumar, K.A., Konishetty, V.K., Voruganti, K., Rao, G.V.P.: CASH: context aware scheduler for hadoop. In: Proceedings of the International Conference on Advances in Computing, Communications and Informatics, ICACCI \u201912, pp. 52\u201361. ACM (2012)","DOI":"10.1145\/2345396.2345406"},{"issue":"2","key":"9508_CR18","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1007\/s10723-017-9423-1","volume":"16","author":"J Liao","year":"2018","unstructured":"Liao, J., Yin, D., Peng, X.: Block I\/O scheduling on storage servers of distributed file systems. J. Grid Comput. 16(2), 299\u2013316 (2018)","journal-title":"J. Grid Comput."},{"key":"9508_CR19","doi-asserted-by":"crossref","unstructured":"Malensek, M., Pallickara, S.L., Pallickara, S.: Alleviation of Disk I\/O Contention in Virtualized Settings for Data-Intensive Computing. In: 2015 IEEE\/ACM 2Nd International Symposium on Big Data Computing (BDC), pp. 1\u201310 (2015)","DOI":"10.1109\/BDC.2015.32"},{"key":"9508_CR20","unstructured":"Murthy, A.C., Vavilapalli, V.K., Eadline, D., Niemiec, J., Markham, J.: Apache Hadoop YARN: Moving Beyond MapReduce and Batch Processing with Apache Hadoop 2, 1st edn. Addison-Wesley Professional (2014)"},{"key":"9508_CR21","doi-asserted-by":"publisher","unstructured":"Park, J.K.: Improving the Performance of HDFS by Reducing I\/O Using Adaptable I\/O System. In: 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT), pp. 3139\u20133144. https:\/\/doi.org\/10.1109\/ICEEOT.2016.7755280 (2016)","DOI":"10.1109\/ICEEOT.2016.7755280"},{"key":"9508_CR22","unstructured":"Recommendation ITU-T G.1000: Communications Quality of Service: A Framework and Definitions. International Telecommunication Union (2001)"},{"key":"9508_CR23","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.procs.2016.11.044","volume":"101","author":"A Spivak","year":"2016","unstructured":"Spivak, A., Nasonov, D.: Data Preloading and Data Placement for MapReduce Performance Improving. Procedia Comput. Sci. 101, 379\u2013387 (2016). 5Th International Young Scientist Conference on Computational Science, YSC 2016, Krakow","journal-title":"Procedia Comput. Sci."},{"key":"9508_CR24","doi-asserted-by":"crossref","unstructured":"Tran, X.T., Do, T.V., Do, N.H., Farkas, L., Rotter, C.: Provision of Disk I\/O Guarantee for MapReduce Applications. In: 2015 IEEE Trustcom\/BigdataSE\/ISPA, Vol. 2, pp. 161\u2013166. IEEE, Helsinki (2015)","DOI":"10.1109\/Trustcom.2015.576"},{"key":"9508_CR25","doi-asserted-by":"crossref","unstructured":"Vavilapalli, V. K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., Seth, S., Saha, B., Curino, C., O\u2019Malley, O., Radia, S., Reed, B., Baldeschwieler, E.: apache hadoop YARN: yet another resource negotiator. In: Proceedings of the 4th Annual Symposium on Cloud Computing, SOCC \u201913, pp. 5:1\u20135:16. ACM, New York (2013)","DOI":"10.1145\/2523616.2523633"},{"key":"9508_CR26","unstructured":"White, T.: Hadoop: The Definitive Guide, 4th edn. O\u2019Reilly Media Inc (2015)"},{"key":"9508_CR27","doi-asserted-by":"crossref","unstructured":"Xu, Y., Zhao, M.: IBIS: Interposed Big-data I\/O Scheduler. In: Proceedings of the 25th ACM International Symposium on High-Performance Parallel and Distributed Computing, HPDC \u201916, pp. 111-122. ACM, New York (2016)","DOI":"10.1145\/2907294.2907319"},{"issue":"11","key":"9508_CR28","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/2934664","volume":"59","author":"M Zaharia","year":"2016","unstructured":"Zaharia, M., Xin, R.S., Wendell, P., Das, T., Armbrust, M., Dave, A., Meng, X., Rosen, J., Venkataraman, S., Franklin, M.J., Ghodsi, A., Gonzalez, J., Shenker, S., Stoica, I.: Apache Spark: A unified engine for big data processing. Commun. ACM 59(11), 56\u201365 (2016)","journal-title":"Commun. ACM"}],"container-title":["Journal of Grid Computing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10723-020-09508-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10723-020-09508-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10723-020-09508-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:41:51Z","timestamp":1614732111000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10723-020-09508-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,3]]},"references-count":28,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["9508"],"URL":"https:\/\/doi.org\/10.1007\/s10723-020-09508-0","relation":{},"ISSN":["1570-7873","1572-9184"],"issn-type":[{"value":"1570-7873","type":"print"},{"value":"1572-9184","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,3]]},"assertion":[{"value":"20 June 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}