{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:35:54Z","timestamp":1750221354044,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,6,15]],"date-time":"2018-06-15T00:00:00Z","timestamp":1529020800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,6,15]]},"DOI":"10.1145\/3206333.3206335","type":"proceedings-article","created":{"date-parts":[[2018,5,17]],"date-time":"2018-05-17T17:51:36Z","timestamp":1526579496000},"page":"1-9","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["MapRDD"],"prefix":"10.1145","author":[{"given":"Zhenyu","family":"Li","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Warwick, Coventry, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Jarvis","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Warwick, Coventry, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,6,15]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16)","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , Manjunath Kudlur , Josh Levenberg , Rajat Monga , Sherry Moore , Derek G. Murray , Benoit Steiner , Paul Tucker , Vijay Vasudevan , Pete Warden , Martin Wicke , Yuan Yu , and Xiaoqiang Zheng . 2016 . TensorFlow: A System for Large-scale Machine Learning . In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16) . USENIX Association, Berkeley, CA, USA, 265--283. http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899 Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A System for Large-scale Machine Learning. In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16). USENIX Association, Berkeley, CA, USA, 265--283. http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899"},{"key":"e_1_3_2_1_2_1","volume-title":"Apache flink: Stream and batch processing in a single engine. Data Engineering 38, 4","author":"Carbone Paris","year":"2015","unstructured":"Paris Carbone , Asterios Katsifodimos , Stephan Ewen , Volker Markl , Seif Haridi , and Kostas Tzoumas . 2015. Apache flink: Stream and batch processing in a single engine. Data Engineering 38, 4 ( 2015 ). Paris Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2015. Apache flink: Stream and batch processing in a single engine. Data Engineering 38, 4 (2015)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_3_2_1_4_1","volume-title":"https:\/\/github.com\/BVLC\/caffe\/tree\/master\/models\/bvlc_reference_caffenet. (2016). {Online","author":"Donahue Jeff","year":"2018","unstructured":"Jeff Donahue . 2016. https:\/\/github.com\/BVLC\/caffe\/tree\/master\/models\/bvlc_reference_caffenet. (2016). {Online ; Accessed 08- April - 2018 }. Jeff Donahue. 2016. https:\/\/github.com\/BVLC\/caffe\/tree\/master\/models\/bvlc_reference_caffenet. (2016). {Online; Accessed 08-April-2018}."},{"key":"e_1_3_2_1_5_1","unstructured":"Erik Erlandson. n.d.. http:\/\/erikerlandson.github.io\/blog\/2014\/09\/11\/faster-random-samples-with-gap-sampling\/. (n.d.). {Online; Accessed 23-January-2018}.  Erik Erlandson. n.d.. http:\/\/erikerlandson.github.io\/blog\/2014\/09\/11\/faster-random-samples-with-gap-sampling\/. (n.d.). {Online; Accessed 23-January-2018}."},{"key":"e_1_3_2_1_6_1","first-page":"2","article-title":"Powergraph: distributed graph-parallel computation on natural graphs","volume":"12","author":"Gonzalez Joseph E","year":"2012","unstructured":"Joseph E Gonzalez , Yucheng Low , Haijie Gu , Danny Bickson , and Carlos Guestrin . 2012 . Powergraph: distributed graph-parallel computation on natural graphs .. In OSDI , Vol. 12. 2 . Joseph E Gonzalez, Yucheng Low, Haijie Gu, Danny Bickson, and Carlos Guestrin. 2012. Powergraph: distributed graph-parallel computation on natural graphs.. In OSDI, Vol. 12. 2.","journal-title":"OSDI"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2017.41"},{"key":"e_1_3_2_1_8_1","unstructured":"ImageNet. n.d.. http:\/\/www.image-net.org\/. (n.d.). {Online; Accessed 01-August-2017}.  ImageNet. n.d.. http:\/\/www.image-net.org\/. (n.d.). {Online; Accessed 01-August-2017}."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1272998.1273005"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654889"},{"key":"e_1_3_2_1_11_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.   Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3146347.3146350"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/2212351.2212354"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807184"},{"key":"e_1_3_2_1_15_1","unstructured":"Lester Martin. 2016. https:\/\/martin.atlassian.net\/wiki\/spaces\/lestermartin\/blog\/2016\/05\/19\/67043332\/why+spark+s+mapPartitions+transformation+is+faster+than+map+calls+your+function+once+partition+not+once+element. (2016). {Online; Accessed 08-April-2018}.  Lester Martin. 2016. https:\/\/martin.atlassian.net\/wiki\/spaces\/lestermartin\/blog\/2016\/05\/19\/67043332\/why+spark+s+mapPartitions+transformation+is+faster+than+map+calls+your+function+once+partition+not+once+element. (2016). {Online; Accessed 08-April-2018}."},{"key":"e_1_3_2_1_16_1","volume-title":"Jordan","author":"Moritz Philipp","year":"2015","unstructured":"Philipp Moritz , Robert Nishihara , Ion Stoica , and Michael I . Jordan . 2015 . SparkNet: Training Deep Networks in Spark. CoRR abs\/1511.06051 (2015). Philipp Moritz, Robert Nishihara, Ion Stoica, and Michael I. Jordan. 2015. SparkNet: Training Deep Networks in Spark. CoRR abs\/1511.06051 (2015)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522738"},{"key":"e_1_3_2_1_18_1","unstructured":"n.a. n.d.. http:\/\/www.deeplearning.net\/software\/theano\/. (n.d.). {Online; Accessed 23-January-2018}.  n.a. n.d.. http:\/\/www.deeplearning.net\/software\/theano\/. (n.d.). {Online; Accessed 23-January-2018}."},{"volume-title":"n.d.. https:\/\/stackoverflow.com\/questions\/21185092\/apache-spark-map-vs-mappartitions. (n.d.). {Online","year":"2018","key":"e_1_3_2_1_19_1","unstructured":"n.a. n.d.. https:\/\/stackoverflow.com\/questions\/21185092\/apache-spark-map-vs-mappartitions. (n.d.). {Online ; Accessed 08- April - 2018 }. n.a. n.d.. https:\/\/stackoverflow.com\/questions\/21185092\/apache-spark-map-vs-mappartitions. (n.d.). {Online; Accessed 08-April-2018}."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595641"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2016.7840613"},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI'12)","author":"Zaharia Matei","year":"2012","unstructured":"Matei Zaharia , Mosharaf Chowdhury , Tathagata Das , Ankur Dave , Justin Ma , Murphy McCauley , Michael J. Franklin , Scott Shenker , and Ion Stoica . 2012 . Resilient Distributed Datasets: A Fault-tolerant Abstraction for In-memory Cluster Computing . In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI'12) . USENIX Association, Berkeley, CA, USA, 2--2. http:\/\/dl.acm.org\/citation.cfm?id=2228298.2228301 Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2012. Resilient Distributed Datasets: A Fault-tolerant Abstraction for In-memory Cluster Computing. In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI'12). USENIX Association, Berkeley, CA, USA, 2--2. http:\/\/dl.acm.org\/citation.cfm?id=2228298.2228301"}],"event":{"name":"SIGMOD\/PODS '18: International Conference on Management of Data","sponsor":["SIGMOD ACM Special Interest Group on Management of Data"],"location":"Houston TX USA","acronym":"SIGMOD\/PODS '18"},"container-title":["Proceedings of the 5th ACM SIGMOD Workshop on Algorithms and Systems for MapReduce and Beyond"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3206333.3206335","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3206333.3206335","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:05Z","timestamp":1750213565000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3206333.3206335"}},"subtitle":["Finer Grained Resilient Distributed Dataset for Machine Learning"],"short-title":[],"issued":{"date-parts":[[2018,6,15]]},"references-count":22,"alternative-id":["10.1145\/3206333.3206335","10.1145\/3206333"],"URL":"https:\/\/doi.org\/10.1145\/3206333.3206335","relation":{},"subject":[],"published":{"date-parts":[[2018,6,15]]},"assertion":[{"value":"2018-06-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}