{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T16:10:45Z","timestamp":1781107845857,"version":"3.54.1"},"reference-count":32,"publisher":"IGI Global Scientific Publishing","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,4]]},"abstract":"<jats:p>This article describes how stateful data analytic frameworks have emerged to provide fresh and low-latency results for big data processing. At present, it is desired to achieve the fine-grained data model in Spark data processing framework. However, Spark adopts coarse-grained data model in order to facilitate parallelization, it is challenging in dealing with the fine-grained data access in stateful data analytics. In this paper, the authors introduce a fine-grained stateful data component, Resilient State Table (RST), to Spark framework. For filling the gap between the coarse-grained data model in Spark and the fine-grained data access requirements in stateful data analytics, they devise the programming model of RST which interacts with Spark's coarse-grained memory representation seamlessly, and enable users to query\/update the state entries in fine granularity with Spark-like programming interfaces. Performance evaluation experiments in various application fields demonstrate that their proposed solution achieves the improvements in latency, fault-tolerance, as well as scalability.<\/jats:p>","DOI":"10.4018\/ijssci.2018040105","type":"journal-article","created":{"date-parts":[[2018,3,22]],"date-time":"2018-03-22T09:59:44Z","timestamp":1521712784000},"page":"66-79","source":"Crossref","is-referenced-by-count":1,"title":["A Fine-Grained Stateful Data Analytics Method Based on Resilient State Table"],"prefix":"10.4018","volume":"10","author":[{"given":"Jike","family":"Ge","sequence":"first","affiliation":[{"name":"College of Electrical and Information Engineering, Chongqing University of Science and Technology, Chongqing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenbo","family":"He","sequence":"additional","affiliation":[{"name":"McMaster University, Toronto, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zuqin","family":"Chen","sequence":"additional","affiliation":[{"name":"Chongqing University of Science and Technology, Chongqing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Can","family":"Liu","sequence":"additional","affiliation":[{"name":"Chongqing University of Science and Technology, Chongqing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Peng","sequence":"additional","affiliation":[{"name":"Chongqing University of Science and Technology, Chongqing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guorong","family":"Chen","sequence":"additional","affiliation":[{"name":"Chongqing University of Science and Technology, Chongqing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"IJSSCI.2018040105-0","unstructured":"Apache samza. Retrieved August 26, 2017, from http:\/\/samza.apache.org\/"},{"key":"IJSSCI.2018040105-1","first-page":"7","article-title":"Incoop: MapReduce for incremental computations.","author":"P.Bhatotia","year":"2011","journal-title":"Proceedings of the 2nd ACM Symposium on Cloud Computing"},{"key":"IJSSCI.2018040105-2","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920881"},{"key":"IJSSCI.2018040105-3","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465282"},{"key":"IJSSCI.2018040105-4","unstructured":"Dean, J., Corrado, G., Monga, R., Chen, K., Devin, M., Mao, M., & Ng, A. Y. (2012). Large scale distributed deep networks. In Advances in neural information processing systems (pp. 1223-1231)."},{"key":"IJSSCI.2018040105-5","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"IJSSCI.2018040105-6","first-page":"49","article-title":"Making State Explicit for Imperative Big Data Processing.","author":"R. C.Fernandez","year":"2014","journal-title":"USENIX Annual Technical Conference"},{"key":"IJSSCI.2018040105-7","doi-asserted-by":"publisher","DOI":"10.4018\/IJSSCI.2016040101"},{"key":"IJSSCI.2018040105-8","unstructured":"Flink. (n.d.). Retrieved August 26, 2017, from https:\/\/flink.apache.org\/"},{"key":"IJSSCI.2018040105-9","unstructured":"Gunda, P. K., Ravindranath, L., Thekkath, C. A., Yu, Y., & Zhuang, L. (2010, October). Nectar: Automatic Management of Data and Computation in Datacenters. In OSDI (Vol. 10, pp. 1-8)."},{"key":"IJSSCI.2018040105-10","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742785"},{"key":"IJSSCI.2018040105-11","author":"P.Kulkarni","year":"2016","journal-title":"Big data analytics"},{"key":"IJSSCI.2018040105-12","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1145\/1807128.1807138","article-title":"Stateful bulk processing for incremental analytics.","author":"D.Logothetis","year":"2010","journal-title":"Proceedings of the 1st ACM symposium on Cloud computing"},{"key":"IJSSCI.2018040105-13","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553462"},{"issue":"1","key":"IJSSCI.2018040105-14","first-page":"1235","article-title":"Mllib: Machine learning in apache spark.","volume":"17","author":"X.Meng","year":"2016","journal-title":"Journal of Machine Learning Research"},{"key":"IJSSCI.2018040105-15","unstructured":"Movielens-20m. (n.d.). Retrieved August 26, 2017, from http:\/\/grouplens.org\/datasets\/movielens\/20m\/"},{"key":"IJSSCI.2018040105-16","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522738"},{"key":"IJSSCI.2018040105-17","doi-asserted-by":"publisher","DOI":"10.4018\/IJSSCI.2017010103"},{"key":"IJSSCI.2018040105-18","author":"C.Okasaki","year":"1999","journal-title":"Purely functional data structures"},{"key":"IJSSCI.2018040105-19","unstructured":"Power, R., & Li, J. (2010, October). Piccolo: Building Fast, Distributed Programs with Partitioned Tables. In OSDI (Vol. 10, pp. 1-14)."},{"key":"IJSSCI.2018040105-20","doi-asserted-by":"crossref","unstructured":"Raghupathi, W., & Raghupathi, V. (2014). Big data analytics in healthcare: promise and potential. Health information science and systems, 2(1), 3.","DOI":"10.1186\/2047-2501-2-3"},{"key":"IJSSCI.2018040105-21","doi-asserted-by":"crossref","unstructured":"Salloum, S., Dautov, R., Chen, X., Peng, P. X., & Huang, J. Z. (2016). Big data analytics on Apache Spark. International Journal of Data Science and Analytics.","DOI":"10.1007\/s41060-016-0027-9"},{"key":"IJSSCI.2018040105-22","first-page":"24","article-title":"Big data analytics.","author":"S.Srinivasa","year":"2012","journal-title":"Proceedings of the First International Conference on Big Data Analytics BDA"},{"key":"IJSSCI.2018040105-23","unstructured":"To, Q. C., Soto, J., & Markl, V. (2017). A Survey of State Management in Big Data Processing Systems. arXiv:1702.01596"},{"key":"IJSSCI.2018040105-24","doi-asserted-by":"publisher","DOI":"10.4018\/IJSSCI.2015040103"},{"key":"IJSSCI.2018040105-25","doi-asserted-by":"publisher","DOI":"10.1145\/2806777.2806778"},{"key":"IJSSCI.2018040105-26","doi-asserted-by":"publisher","DOI":"10.4018\/IJSSCI.2015040104"},{"key":"IJSSCI.2018040105-27","doi-asserted-by":"publisher","DOI":"10.4018\/IJSSCI.2015070104"},{"key":"IJSSCI.2018040105-28","doi-asserted-by":"publisher","DOI":"10.1145\/1755913.1755940"},{"key":"IJSSCI.2018040105-29","first-page":"2","article-title":"Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing.","author":"M.Zaharia","year":"2012","journal-title":"Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation"},{"key":"IJSSCI.2018040105-30","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522737"},{"key":"IJSSCI.2018040105-31","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522737"}],"container-title":["International Journal of Software Science and Computational Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=202955","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T10:03:57Z","timestamp":1651831437000},"score":1,"resource":{"primary":{"URL":"http:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJSSCI.2018040105"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2018,4]]},"references-count":32,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.4018\/ijssci.2018040105","relation":{},"ISSN":["1942-9045","1942-9037"],"issn-type":[{"value":"1942-9045","type":"print"},{"value":"1942-9037","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4]]}}}