{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T11:38:21Z","timestamp":1784029101220,"version":"3.55.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"13","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2016,9]]},"abstract":"<jats:p>In this paper we introduce LDBC Graphalytics, a new industrial-grade benchmark for graph analysis platforms. It consists of six deterministic algorithms, standard datasets, synthetic dataset generators, and reference output, that enable the objective comparison of graph analysis platforms. Its test harness produces deep metrics that quantify multiple kinds of system scalability, such as horizontal\/vertical and weak\/strong, and of robustness, such as failures and performance variability. The benchmark comes with open-source software for generating data and monitoring performance. We describe and analyze six implementations of the benchmark (three from the community, three from the industry), providing insights into the strengths and weaknesses of the platforms. Key to our contribution, vendors perform the tuning and benchmarking of their platforms.<\/jats:p>","DOI":"10.14778\/3007263.3007270","type":"journal-article","created":{"date-parts":[[2016,11,1]],"date-time":"2016-11-01T13:47:47Z","timestamp":1478008067000},"page":"1317-1328","source":"Crossref","is-referenced-by-count":121,"title":["LDBC graphalytics"],"prefix":"10.14778","volume":"9","author":[{"given":"Alexandru","family":"Iosup","sequence":"first","affiliation":[{"name":"Delft University of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"Hegeman","sequence":"additional","affiliation":[{"name":"Delft University of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wing Lung","family":"Ngai","sequence":"additional","affiliation":[{"name":"Delft University of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stijn","family":"Heldens","sequence":"additional","affiliation":[{"name":"Delft University of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arnau","family":"Prat-P\u00e9rez","sequence":"additional","affiliation":[{"name":"UPC Barcelona"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Manhardto","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hassan","family":"Chafio","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mihai","family":"Capot\u0103","sequence":"additional","affiliation":[{"name":"Intel Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Narayanan","family":"Sundaram","sequence":"additional","affiliation":[{"name":"Intel Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Anderson","sequence":"additional","affiliation":[{"name":"Intel Labs"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilie Gabriel","family":"T\u0103nase","sequence":"additional","affiliation":[{"name":"IBM Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yinglong","family":"Xia","sequence":"additional","affiliation":[{"name":"Huawei Research America"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lifeng","family":"Nai","sequence":"additional","affiliation":[{"name":"Georgia Tech"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Boncz","sequence":"additional","affiliation":[{"name":"CWI Amsterdam"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,9]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Apache Giraph. http:\/\/giraph.apache.org.  Apache Giraph. http:\/\/giraph.apache.org."},{"key":"e_1_2_1_2_1","unstructured":"DAS-5: Distributed ASCI Supercomputer 5. http:\/\/cs.vu.nl\/das5.  DAS-5: Distributed ASCI Supercomputer 5. http:\/\/cs.vu.nl\/das5."},{"key":"e_1_2_1_3_1","unstructured":"Oracle Big Data Spatial and Graph. http:\/\/oracle.com\/database\/big-data-spatial-and-graph.  Oracle Big Data Spatial and Graph. http:\/\/oracle.com\/database\/big-data-spatial-and-graph."},{"key":"e_1_2_1_4_1","unstructured":"Oracle Labs PGX: Parallel Graph Analytics Overview. http:\/\/oracle.com\/technetwork\/oracle-labs\/parallel-graph-analytics.  Oracle Labs PGX: Parallel Graph Analytics Overview. http:\/\/oracle.com\/technetwork\/oracle-labs\/parallel-graph-analytics."},{"key":"e_1_2_1_5_1","unstructured":"SNAP Datasets: Stanford large network dataset collection. http:\/\/snap.stanford.edu\/data.  SNAP Datasets: Stanford large network dataset collection. http:\/\/snap.stanford.edu\/data."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11964-9_13"},{"key":"e_1_2_1_7_1","first-page":"58","volume-title":"WBDB","author":"Ammar K.","year":"2013","unstructured":"K. Ammar and M. T. \u00d6zsu . WGB : towards a universal graph benchmark . In WBDB , pages 58 -- 72 , 2013 . K. Ammar and M. T. \u00d6zsu. WGB: towards a universal graph benchmark. In WBDB, pages 58--72, 2013."},{"key":"e_1_2_1_8_1","volume-title":"IPDPS","author":"Anderson M.","year":"2016","unstructured":"M. Anderson : optimized graph primitives for parallel and distr. platforms . In IPDPS , 2016 . M. Anderson et al. GraphPad: optimized graph primitives for parallel and distr. platforms. In IPDPS, 2016."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465296"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/11602569_48"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.4018\/jswis.2009040101"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2764947.2764954"},{"key":"e_1_2_1_13_1","volume-title":"ICWSM, page 30","author":"Cha M.","year":"2010","unstructured":"M. Cha Measuring User Influence in Twitter: The Million Follower Fallacy . In ICWSM, page 30 , 2010 . M. Cha et al. Measuring User Influence in Twitter: The Million Follower Fallacy. In ICWSM, page 30, 2010."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-013-0138-7"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851553.2851572"},{"key":"e_1_2_1_16_1","first-page":"60","volume-title":"Big Data","author":"Elser B.","year":"2013","unstructured":"B. Elser and A. Montresor . An evaluation study of bigdata frameworks for graph processing . In Big Data , pages 60 -- 67 , 2013 . B. Elser and A. Montresor. An evaluation study of bigdata frameworks for graph processing. In Big Data, pages 60--67, 2013."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742786"},{"key":"e_1_2_1_18_1","volume-title":"CIDR","author":"Fan J.","year":"2015","unstructured":"J. Fan The case against specialized graph analytics engines . In CIDR , 2015 . J. Fan et al. The case against specialized graph analytics engines. In CIDR, 2015."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2150976.2150982"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2463712"},{"key":"e_1_2_1_21_1","first-page":"17","volume-title":"OSDI","author":"Gonzalez J. E.","year":"2012","unstructured":"J. E. Gonzalez : Distributed graph parallel computation on natural graphs . In OSDI , pages 17 -- 30 , 2012 . J. E. Gonzalez et al. PowerGraph: Distributed graph parallel computation on natural graphs. In OSDI, pages 17--30, 2012."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/2501560.2501566"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2005.06.005"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2014.49"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2015.20"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732977.2732980"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807620"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733057"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735508.2735517"},{"key":"e_1_2_1_31_1","first-page":"138","volume-title":"WBDB","author":"Ming Z.","year":"2013","unstructured":"Z. Ming : A scalable big data generator suite in big data benchmarking . In WBDB , pages 138 -- 154 , 2013 . Z. Ming et al. BDGS: A scalable big data generator suite in big data benchmarking. In WBDB, pages 138--154, 2013."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807626"},{"key":"e_1_2_1_33_1","volume-title":"Fine-grained Performance Evaluation of Large-scale Graph Processing Systems. Master's thesis","author":"Ngai W. L.","year":"2015","unstructured":"W. L. Ngai . Fine-grained Performance Evaluation of Large-scale Graph Processing Systems. Master's thesis , Delft University of Technology , the Netherlands, 2015 . W. L. Ngai. Fine-grained Performance Evaluation of Large-scale Graph Processing Systems. Master's thesis, Delft University of Technology, the Netherlands, 2015."},{"key":"e_1_2_1_34_1","volume-title":"The pagerank citation ranking: bringing order to the web","author":"Page L.","year":"1999","unstructured":"L. Page The pagerank citation ranking: bringing order to the web . 1999 . L. Page et al. The pagerank citation ranking: bringing order to the web. 1999."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2799562.2799642"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.76.036106"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610518"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2009.28"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.14778\/2809974.2809983"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2014.6835958"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484425.2484427"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3007263.3007270","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T09:36:47Z","timestamp":1672220207000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3007263.3007270"}},"subtitle":["a benchmark for large-scale graph analysis on parallel and distributed platforms"],"short-title":[],"issued":{"date-parts":[[2016,9]]},"references-count":40,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2016,9]]}},"alternative-id":["10.14778\/3007263.3007270"],"URL":"https:\/\/doi.org\/10.14778\/3007263.3007270","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2016,9]]}}}