{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T22:16:00Z","timestamp":1765232160569},"reference-count":20,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2012,8]]},"abstract":"<jats:p>Main Memory Map Reduce (M3R) is a new implementation of the Hadoop Map Reduce (HMR) API targeted at online analytics on high mean-time-to-failure clusters. It does not support resilience, and supports only those workloads which can fit into cluster memory. In return, it can run HMR jobs unchanged -- including jobs produced by compilers for higher-level languages such as Pig, Jaql, and SystemML and interactive front-ends like IBM BigSheets -- while providing significantly better performance than the Hadoop engine on several workloads (e.g. 45x on some input sizes for sparse matrix vector multiply). M3R also supports extensions to the HMR API which can enable Map Reduce jobs to run faster on the M3R engine, while not affecting their performance under the Hadoop engine.<\/jats:p>","DOI":"10.14778\/2367502.2367513","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"1736-1747","source":"Crossref","is-referenced-by-count":94,"title":["M3R"],"prefix":"10.14778","volume":"5","author":[{"given":"Avraham","family":"Shinnar","sequence":"first","affiliation":[{"name":"IBM Research, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Cunningham","sequence":"additional","affiliation":[{"name":"IBM Research, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vijay","family":"Saraswat","sequence":"additional","affiliation":[{"name":"IBM Research, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Herta","sequence":"additional","affiliation":[{"name":"IBM Research, Hawthorne, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"IBM BigSheets. http:\/\/www-01.ibm.com\/software\/data\/infosphere\/biginsights\/. IBM BigSheets. http:\/\/www-01.ibm.com\/software\/data\/infosphere\/biginsights\/."},{"key":"e_1_2_1_2_1","unstructured":"IBM InfoSphere BigInsights. http:\/\/www-01.ibm.com\/software\/ebusiness\/jstart\/bigsheets\/. IBM InfoSphere BigInsights. http:\/\/www-01.ibm.com\/software\/ebusiness\/jstart\/bigsheets\/."},{"key":"e_1_2_1_3_1","unstructured":"MapR Hadoop distribution. http:\/\/www.mapr.com\/products. MapR Hadoop distribution. http:\/\/www.mapr.com\/products."},{"key":"e_1_2_1_4_1","unstructured":"MapReduce tutorial. http:\/\/hadoop.apache.org\/common\/docs\/current\/mapred_tutorial.html. MapReduce tutorial. http:\/\/hadoop.apache.org\/common\/docs\/current\/mapred_tutorial.html."},{"key":"e_1_2_1_5_1","unstructured":"Platform Symphony MapReduce. http:\/\/www.platform.com\/Products\/MapReduce\/overview. Platform Symphony MapReduce. http:\/\/www.platform.com\/Products\/MapReduce\/overview."},{"key":"e_1_2_1_6_1","unstructured":"Welcome to Apache Hadoop. http:\/\/hadoop.apache.org. Welcome to Apache Hadoop. http:\/\/hadoop.apache.org."},{"issue":"12","key":"e_1_2_1_7_1","first-page":"1272","article-title":"Jaql: A scripting language for large scale semistructured data analysis","volume":"4","author":"Beyer K. S.","year":"2011","unstructured":"K. S. Beyer , V. Ercegovac , R. Gemulla , A. Balmin , M. Y. Eltabakh , C.-C. Kanne , F. \u00d6zcan , and E. J. Shekita . Jaql: A scripting language for large scale semistructured data analysis . PVLDB , 4 ( 12 ): 1272 -- 1283 , 2011 . K. S. Beyer, V. Ercegovac, R. Gemulla, A. Balmin, M. Y. Eltabakh, C.-C. Kanne, F. \u00d6zcan, and E. J. Shekita. Jaql: A scripting language for large scale semistructured data analysis. PVLDB, 4(12):1272--1283, 2011.","journal-title":"PVLDB"},{"key":"e_1_2_1_8_1","first-page":"1071","volume-title":"SIGMOD","author":"Borthakur D.","year":"2011","unstructured":"D. Borthakur , J. Gray , J. S. Sarma , K. Muthukkaruppan , N. Spiegelberg , H. Kuang , K. Ranganathan , D. Molkov , A. Menon , S. Rash , R. Schmidt , and A. Aiyer . Apache hadoop goes realtime at facebook . In SIGMOD , pages 1071 -- 1080 , 2011 . 10.1145\/1989323.1989438 D. Borthakur, J. Gray, J. S. Sarma, K. Muthukkaruppan, N. Spiegelberg, H. Kuang, K. Ranganathan, D. Molkov, A. Menon, S. Rash, R. Schmidt, and A. Aiyer. Apache hadoop goes realtime at facebook. In SIGMOD, pages 1071--1080, 2011. 10.1145\/1989323.1989438"},{"key":"e_1_2_1_9_1","first-page":"285","volume-title":"VLDB","author":"Bu Y.","year":"2010","unstructured":"Y. Bu , B. Howe , M. Balazinska , and M. D. Ernst . HaLoop: Efficient iterative data processing on large clusters . In VLDB , pages 285 -- 296 , 2010 . Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: Efficient iterative data processing on large clusters. In VLDB, pages 285--296, 2010."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1145\/1094811.1094852","volume-title":"OOPSLA","author":"Charles P.","year":"2005","unstructured":"P. Charles , C. Grothoff , V. Saraswat , C. Donawa , A. Kielstra , K. Ebcioglu , C. von Praun , and V. Sarkar . X10: an object-oriented approach to non-uniform cluster computing . In OOPSLA , pages 519 -- 538 , 2005 . 10.1145\/1094811.1094852 P. Charles, C. Grothoff, V. Saraswat, C. Donawa, A. Kielstra, K. Ebcioglu, C. von Praun, and V. Sarkar. X10: an object-oriented approach to non-uniform cluster computing. In OOPSLA, pages 519--538, 2005. 10.1145\/1094811.1094852"},{"key":"e_1_2_1_11_1","first-page":"21","volume-title":"NSDI","author":"Condie T.","year":"2010","unstructured":"T. Condie , N. Conway , P. Alvaro , J. M. Hellerstein , K. Elmeleegy , and R. Sears . Mapreduce online . In NSDI , pages 21 -- 21 , 2010 . T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. Mapreduce online. In NSDI, pages 21--21, 2010."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_2_1_13_1","first-page":"810","volume-title":"HPDC","author":"Ekanayake J.","year":"2010","unstructured":"J. Ekanayake , H. Li , B. Zhang , T. Gunarathne , S.-H. Bae , J. Qiu , and G. Fox . Twister: a runtime for iterative mapreduce . In HPDC , pages 810 -- 818 , 2010 . 10.1145\/1851476.1851593 J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox. Twister: a runtime for iterative mapreduce. In HPDC, pages 810--818, 2010. 10.1145\/1851476.1851593"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1165389.945450"},{"key":"e_1_2_1_15_1","first-page":"231","volume-title":"ICDE","author":"Ghoting A.","year":"2011","unstructured":"A. Ghoting , R. Krishnamurthy , E. Pednault , B. Reinwald , V. Sindhwani , S. Tatikonda , Y. Tian , and S. Vaithyanathan . Systemml: Declarative machine learning on mapreduce . In ICDE , pages 231 -- 242 , 2011 . 10.1109\/ICDE.2011.5767930 A. Ghoting, R. Krishnamurthy, E. Pednault, B. Reinwald, V. Sindhwani, S. Tatikonda, Y. Tian, and S. Vaithyanathan. Systemml: Declarative machine learning on mapreduce. In ICDE, pages 231--242, 2011. 10.1109\/ICDE.2011.5767930"},{"key":"e_1_2_1_16_1","first-page":"1099","volume-title":"SIGMOD","author":"Olston C.","year":"2008","unstructured":"C. Olston , B. Reed , U. Srivastava , R. Kumar , and A. Tomkins . Pig latin: a not-so-foreign language for data processing . In SIGMOD , pages 1099 -- 1110 , 2008 . 10.1145\/1376616.1376726 C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: a not-so-foreign language for data processing. In SIGMOD, pages 1099--1110, 2008. 10.1145\/1376616.1376726"},{"key":"e_1_2_1_17_1","volume-title":"The X10 reference manual, v2.2","author":"Saraswat V.","year":"2011","unstructured":"V. Saraswat , B. Bloom , I. Peshansky , O. Tardieu , and D. Grove . The X10 reference manual, v2.2 . June 2011 . V. Saraswat, B. Bloom, I. Peshansky, O. Tardieu, and D. Grove. The X10 reference manual, v2.2. June 2011."},{"key":"e_1_2_1_18_1","volume-title":"Welcome to hbase! http:\/\/hbase.apache.org","author":"Software Foundation The Apache","year":"2010","unstructured":"The Apache Software Foundation . Welcome to hbase! http:\/\/hbase.apache.org , 2010 . The Apache Software Foundation. Welcome to hbase! http:\/\/hbase.apache.org, 2010."},{"issue":"2","key":"e_1_2_1_19_1","first-page":"1626","article-title":"Hive: a warehousing solution over a map-reduce framework","volume":"2","author":"Thusoo A.","year":"2009","unstructured":"A. Thusoo , J. S. Sarma , N. Jain , Z. Shao , P. Chakka , S. Anthony , H. Liu , P. Wyckoff , and R. Murthy . Hive: a warehousing solution over a map-reduce framework . PVLDB , 2 ( 2 ): 1626 -- 1629 , 2009 . A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy. Hive: a warehousing solution over a map-reduce framework. PVLDB, 2(2):1626--1629, 2009.","journal-title":"PVLDB"},{"key":"e_1_2_1_20_1","volume-title":"Hadoop: The Definitive Guide","author":"White T.","year":"2009","unstructured":"T. White . Hadoop: The Definitive Guide . O'Reilly Media , original edition, 2009 . T. White. Hadoop: The Definitive Guide. O'Reilly Media, original edition, 2009."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2367502.2367513","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T14:43:07Z","timestamp":1689345787000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2367502.2367513"}},"subtitle":["increased performance for in-memory Hadoop jobs"],"short-title":[],"issued":{"date-parts":[[2012,8]]},"references-count":20,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2012,8]]}},"alternative-id":["10.14778\/2367502.2367513"],"URL":"https:\/\/doi.org\/10.14778\/2367502.2367513","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2012,8]]}}}