{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T14:30:50Z","timestamp":1775745050961,"version":"3.50.1"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2015,8]]},"abstract":"<jats:p>We present an overview of our work on the SAP HANA Scale-out Extension, a novel distributed database architecture designed to support large scale analytics over real-time data. This platform permits high performance OLAP with massive scale-out capabilities, while concurrently allowing OLTP workloads. This dual capability enables analytics over real-time changing data and allows fine grained user-specified service level agreements (SLAs) on data freshness. We advocate the decoupling of core database components such as query processing, concurrency control, and persistence, a design choice made possible by advances in high-throughput low-latency networks and storage devices. We provide full ACID guarantees and build on a logical timestamp mechanism to provide MVCC-based snapshot isolation, while not requiring synchronous updates of replicas. Instead, we use asynchronous update propagation guaranteeing consistency with timestamp validation.<\/jats:p>\n          <jats:p>We provide a view into the design and development of a large scale data management platform for real-time analytics, driven by the needs of modern enterprise customers.<\/jats:p>","DOI":"10.14778\/2824032.2824069","type":"journal-article","created":{"date-parts":[[2015,9,16]],"date-time":"2015-09-16T12:18:17Z","timestamp":1442405897000},"page":"1716-1727","source":"Crossref","is-referenced-by-count":36,"title":["Towards scalable real-time analytics"],"prefix":"10.14778","volume":"8","author":[{"given":"Anil K.","family":"Goel","sequence":"first","affiliation":[{"name":"SAP Labs Canada, Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey","family":"Pound","sequence":"additional","affiliation":[{"name":"SAP Labs Canada, Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nathan","family":"Auch","sequence":"additional","affiliation":[{"name":"SAP Labs Canada, Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Bumbulis","sequence":"additional","affiliation":[{"name":"SAP Labs Canada, Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Scott","family":"MacLean","sequence":"additional","affiliation":[{"name":"SAP Labs Canada, Waterloo, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Franz","family":"F\u00e4rber","sequence":"additional","affiliation":[{"name":"SAP SE, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francis","family":"Gropengiesser","sequence":"additional","affiliation":[{"name":"SAP SE, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Mathis","sequence":"additional","affiliation":[{"name":"SAP SE, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Bodner","sequence":"additional","affiliation":[{"name":"SAP SE, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wolfgang","family":"Lehner","sequence":"additional","affiliation":[{"name":"TU Dresden, Dresden, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735508.2735509"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2535930"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/2517349.2522732","volume-title":"Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles","author":"Balakrishnan M.","year":"2013","unstructured":"M. Balakrishnan , D. Malkhi , T. Wobber , M. Wu , V. Prabhakaran , M. Wei , J. D. Davis , S. Rao , T. Zou , and A. Zuck . Tango: Distributed data structures over a shared log . In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles , pages 325 -- 340 . ACM, 2013 . 10.1145\/2517349.2522732 M. Balakrishnan, D. Malkhi, T. Wobber, M. Wu, V. Prabhakaran, M. Wei, J. D. Davis, S. Rao, T. Zou, and A. Zuck. Tango: Distributed data structures over a shared log. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, pages 325--340. ACM, 2013. 10.1145\/2517349.2522732"},{"key":"e_1_2_1_4_1","volume-title":"Delivering Continuity and Extreme Capacity with the IBM DB2 pureScale Feature","author":"Barshai V.","year":"2012","unstructured":"V. Barshai , Y. Chan , H. Lu , and S. Sohal . Delivering Continuity and Extreme Capacity with the IBM DB2 pureScale Feature , chapter 1. IBM Redbooks , 2012 . V. Barshai, Y. Chan, H. Lu, and S. Sohal. Delivering Continuity and Extreme Capacity with the IBM DB2 pureScale Feature, chapter 1. IBM Redbooks, 2012."},{"key":"e_1_2_1_5_1","first-page":"9","volume-title":"CIDR","volume":"11","author":"Bernstein P. A.","year":"2011","unstructured":"P. A. Bernstein , C. W. Reid , and S. Das . Hyder-a transactional record manager for shared flash . In CIDR , volume 11 , pages 9 -- 20 , 2011 . P. A. Bernstein, C. W. Reid, and S. Das. Hyder-a transactional record manager for shared flash. In CIDR, volume 11, pages 9--20, 2011."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732967.2732970"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491245"},{"key":"e_1_2_1_8_1","first-page":"715","volume-title":"Proceedings of the 32nd international conference on Very large data bases","author":"Daudjee K.","year":"2006","unstructured":"K. Daudjee and K. Salem . Lazy database replication with snapshot isolation . In Proceedings of the 32nd international conference on Very large data bases , pages 715 -- 726 . VLDB Endowment , 2006 . K. Daudjee and K. Salem. Lazy database replication with snapshot isolation. In Proceedings of the 32nd international conference on Very large data bases, pages 715--726. VLDB Endowment, 2006."},{"key":"e_1_2_1_9_1","first-page":"350","volume-title":"29th IEEE International Conference on Data Engineering, ICDE 2013","author":"Dees J.","year":"2013","unstructured":"J. Dees and P. Sanders . Efficient many-core query execution in main memory column-stores. In C. S. Jensen, C. M. Jermaine, and X. Zhou, editors , 29th IEEE International Conference on Data Engineering, ICDE 2013 , Brisbane, Australia, April 8--12 , 2013 , pages 350 -- 361 . IEEE Computer Society, 2013. 10.1109\/ICDE.2013.6544838 J. Dees and P. Sanders. Efficient many-core query execution in main memory column-stores. In C. S. Jensen, C. M. Jermaine, and X. Zhou, editors, 29th IEEE International Conference on Data Engineering, ICDE 2013, Brisbane, Australia, April 8--12, 2013, pages 350--361. IEEE Computer Society, 2013. 10.1109\/ICDE.2013.6544838"},{"issue":"1","key":"e_1_2_1_10_1","first-page":"28","article-title":"The SAP HANA database -- an architecture overview","volume":"35","author":"F\u00e4rber F.","year":"2012","unstructured":"F. F\u00e4rber , N. May , W. Lehner , P. Gro\u00dfe , I. M\u00fcller , H. Rauhe , and J. Dees . The SAP HANA database -- an architecture overview . IEEE Data Eng. Bull. , 35 ( 1 ): 28 -- 33 , 2012 . F. F\u00e4rber, N. May, W. Lehner, P. Gro\u00dfe, I. M\u00fcller, H. Rauhe, and J. Dees. The SAP HANA database -- an architecture overview. IEEE Data Eng. Bull., 35(1):28--33, 2012.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433140.2433144"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/1454159.1454211"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1109\/ICDE.2011.5767867","volume-title":"Data Engineering (ICDE), 2011 IEEE 27th International Conference on","author":"Kemper A.","year":"2011","unstructured":"A. Kemper and T. Neumann . HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots . In Data Engineering (ICDE), 2011 IEEE 27th International Conference on , pages 195 -- 206 . IEEE, 2011 . 10.1109\/ICDE.2011.5767867 A. Kemper and T. Neumann. HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots. In Data Engineering (ICDE), 2011 IEEE 27th International Conference on, pages 195--206. IEEE, 2011. 10.1109\/ICDE.2011.5767867"},{"key":"e_1_2_1_14_1","volume-title":"Proc. CIDR","volume":"15","author":"Kornacker M.","year":"2015","unstructured":"M. Kornacker , A. Behm , V. Bittorf , T. Bobrovytsky , C. Ching , A. Choi , J. Erickson , M. Grund , and D. Hecht . Impala: A modern, open-source sql engine for hadoop . In Proc. CIDR , volume 15 , 2015 . M. Kornacker, A. Behm, V. Bittorf, T. Bobrovytsky, C. Ching, A. Choi, J. Erickson, M. Grund, and D. Hecht. Impala: A modern, open-source sql engine for hadoop. In Proc. CIDR, volume 15, 2015."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of 6th International Workshop on Networking Meets Databases (NetDB)","author":"Kreps J.","year":"2011","unstructured":"J. Kreps , N. Narkhede , J. Rao , : A distributed messaging system for log processing . In Proceedings of 6th International Workshop on Networking Meets Databases (NetDB) , Athens, Greece , 2011 . J. Kreps, N. Narkhede, J. Rao, et al. Kafka: A distributed messaging system for log processing. In Proceedings of 6th International Workshop on Networking Meets Databases (NetDB), Athens, Greece, 2011."},{"key":"e_1_2_1_16_1","first-page":"123","volume-title":"CIDR","volume":"11","author":"Levandoski J. J.","year":"2011","unstructured":"J. J. Levandoski , D. B. Lomet , M. F. Mokbel , and K. Zhao . Deuteronomy: Transaction support for cloud data . In CIDR , volume 11 , pages 123 -- 133 , 2011 . J. J. Levandoski, D. B. Lomet, M. F. Mokbel, and K. Zhao. Deuteronomy: Transaction support for cloud data. In CIDR, volume 11, pages 123--133, 2011."},{"key":"e_1_2_1_17_1","volume-title":"CIDR 2009, Fourth Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4--7, 2009, Online Proceedings","author":"Lomet D. B.","year":"2009","unstructured":"D. B. Lomet , A. Fekete , G. Weikum , and M. J. Zwilling . Unbundling transaction services in the cloud . In CIDR 2009, Fourth Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4--7, 2009, Online Proceedings , 2009 . D. B. Lomet, A. Fekete, G. Weikum, and M. J. Zwilling. Unbundling transaction services in the cloud. In CIDR 2009, Fourth Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4--7, 2009, Online Proceedings, 2009."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1145\/2486767.2486770","volume-title":"Proceedings of the Second Workshop on Data Analytics in the Cloud","author":"M\u00fchlbauer T.","year":"2013","unstructured":"T. M\u00fchlbauer , W. R\u00f6diger , A. Reiser , A. Kemper , and T. Neumann . ScyPer: Elastic OLAP throughput on transactional data . In Proceedings of the Second Workshop on Data Analytics in the Cloud , pages 11 -- 15 . ACM, 2013 . 10.1145\/2486767.2486770 T. M\u00fchlbauer, W. R\u00f6diger, A. Reiser, A. Kemper, and T. Neumann. ScyPer: Elastic OLAP throughput on transactional data. In Proceedings of the Second Workshop on Data Analytics in the Cloud, pages 11--15. ACM, 2013. 10.1145\/2486767.2486770"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.14778\/2002938.2002940"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of SIGMOD","author":"Neumann T.","year":"2015","unstructured":"T. Neumann , T. M\u00fchlbauer , and A. Kemper . Fast serializable multi-version concurrency control for main-memory database systems . In Proceedings of SIGMOD , 2015 . to appear. 10.1145\/2723372.2749436 T. Neumann, T. M\u00fchlbauer, and A. Kemper. Fast serializable multi-version concurrency control for main-memory database systems. In Proceedings of SIGMOD, 2015. to appear. 10.1145\/2723372.2749436"},{"key":"e_1_2_1_21_1","first-page":"1","volume-title":"Proceedings of SIGMOD","author":"Plattner H.","year":"2009","unstructured":"H. Plattner . A common database approach for OLTP and OLAP using an in-memory column database . In Proceedings of SIGMOD , pages 1 -- 2 , 2009 . 10.1145\/1559845.1559846 H. Plattner. A common database approach for OLTP and OLAP using an in-memory column database. In Proceedings of SIGMOD, pages 1--2, 2009. 10.1145\/1559845.1559846"},{"key":"e_1_2_1_22_1","volume-title":"IEEE 31st International Conference on Data Engineering","author":"Plattner H.","year":"2015","unstructured":"H. Plattner , F. F\u00e4rber , J. Dees , M. Weidner , S. Baeuerle , and W. Lehner . Towards a web-scale data management ecosystem demonstrated by SAP HANA . In IEEE 31st International Conference on Data Engineering , To Appear , 2015 . H. Plattner, F. F\u00e4rber, J. Dees, M. Weidner, S. Baeuerle, and W. Lehner. Towards a web-scale data management ecosystem demonstrated by SAP HANA. In IEEE 31st International Conference on Data Engineering, To Appear, 2015."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536232"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/964723.383071"},{"key":"e_1_2_1_25_1","volume-title":"USENIX Annual Technical Conference","author":"Terrace J.","year":"2009","unstructured":"J. Terrace and M. J. Freedman . Object storage on CRAQ: High-throughput chain replication for read-mostly workloads . In USENIX Annual Technical Conference . San Diego, CA , 2009 . J. Terrace and M. J. Freedman. Object storage on CRAQ: High-throughput chain replication for read-mostly workloads. In USENIX Annual Technical Conference. San Diego, CA, 2009."},{"key":"e_1_2_1_26_1","first-page":"1","volume-title":"Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data","author":"Thomson A.","year":"2012","unstructured":"A. Thomson , T. Diamond , S.-C. Weng , K. Ren , P. Shao , and D. J. Abadi . Calvin: fast distributed transactions for partitioned database systems . In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data , pages 1 -- 12 . ACM, 2012 . 10.1145\/2213836.2213838 A. Thomson, T. Diamond, S.-C. Weng, K. Ren, P. Shao, and D. J. Abadi. Calvin: fast distributed transactions for partitioned database systems. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, pages 1--12. ACM, 2012. 10.1145\/2213836.2213838"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687609"},{"key":"e_1_2_1_28_1","first-page":"91","volume-title":"OSDI","volume":"4","author":"van Renesse R.","year":"2004","unstructured":"R. van Renesse and F. B. Schneider . Chain replication for supporting high throughput and availability . In OSDI , volume 4 , pages 91 -- 104 , 2004 . R. van Renesse and F. B. Schneider. Chain replication for supporting high throughput and availability. In OSDI, volume 4, pages 91--104, 2004."},{"key":"e_1_2_1_29_1","first-page":"518","volume-title":"X. Hu","author":"Weidner M.","year":"2013","unstructured":"M. Weidner , J. Dees , and P. Sanders . Fast OLAP query execution in main memory on large data in a cluster . In X. Hu , T. Y. Lin, V. Raghavan, B. W. Wah, R. A. Baeza-Yates, G. Fox, C. Shahabi, M. Smith, Q. Yang, R. Ghani, W. Fan, R. Lempel, and R. Nambiar, editors, Proceedings of the 2013 IEEE International Conference on Big Data, 6--9 October 2013, Santa Clara, CA, USA, pages 518 -- 524 . IEEE , 2013. M. Weidner, J. Dees, and P. Sanders. Fast OLAP query execution in main memory on large data in a cluster. In X. Hu, T. Y. Lin, V. Raghavan, B. W. Wah, R. A. Baeza-Yates, G. Fox, C. Shahabi, M. Smith, Q. Yang, R. Ghani, W. Fan, R. Lempel, and R. Nambiar, editors, Proceedings of the 2013 IEEE International Conference on Big Data, 6--9 October 2013, Santa Clara, CA, USA, pages 518--524. IEEE, 2013."},{"key":"e_1_2_1_30_1","first-page":"518","volume-title":"IEEE Big Data","author":"Weidner M.","year":"2013","unstructured":"M. Weidner , J. Dees , and P. Sanders . Fast olap query execution in main memory on large data in a cluster . In IEEE Big Data , pages 518 -- 524 , Oct 2013 . M. Weidner, J. Dees, and P. Sanders. Fast olap query execution in main memory on large data in a cluster. In IEEE Big Data, pages 518--524, Oct 2013."},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/2463676.2465288","volume-title":"Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, SIGMOD '13","author":"Xin R. S.","year":"2013","unstructured":"R. S. Xin , J. Rosen , M. Zaharia , M. J. Franklin , S. Shenker , and I. Stoica . Shark: Sql and rich analytics at scale . In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, SIGMOD '13 , pages 13 -- 24 , New York, NY, USA , 2013 . ACM. 10.1145\/2463676.2465288 R. S. Xin, J. Rosen, M. Zaharia, M. J. Franklin, S. Shenker, and I. Stoica. Shark: Sql and rich analytics at scale. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, SIGMOD '13, pages 13--24, New York, NY, USA, 2013. ACM. 10.1145\/2463676.2465288"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2824032.2824069","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:12:17Z","timestamp":1672222337000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2824032.2824069"}},"subtitle":["an architecture for scale-out of OLxP workloads"],"short-title":[],"issued":{"date-parts":[[2015,8]]},"references-count":31,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2015,8]]}},"alternative-id":["10.14778\/2824032.2824069"],"URL":"https:\/\/doi.org\/10.14778\/2824032.2824069","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2015,8]]}}}