{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T01:58:52Z","timestamp":1770515932058,"version":"3.49.0"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,1,22]],"date-time":"2019-01-22T00:00:00Z","timestamp":1548115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01IS12057"],"award-info":[{"award-number":["01IS12057"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006463","name":"Bayerisches Staatsministerium f\u00fcr Wirtschaft und Medien, Energie und Technologie","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006463","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Database Syst."],"published-print":{"date-parts":[[2019,3,31]]},"abstract":"<jats:p>\n            Today\u2019s streaming applications demand increasingly high event throughput rates and are often subject to strict latency constraints. To allow for more complex workloads, such as window-based aggregations, streaming systems need to support\n            <jats:italic>stateful<\/jats:italic>\n            event processing. This introduces new challenges for streaming engines as the state needs to be maintained in a consistent and durable manner and simultaneously accessed by complex queries for real-time analytics.\n          <\/jats:p>\n          <jats:p>Modern streaming systems, such as Apache Flink, do not allow for efficiently exposing the state to analytical queries. Thus, data engineers are forced to keep the state in external data stores, which significantly increases the latencies until events become visible to analytical queries. Proprietary solutions have been created to meet data freshness constraints. These solutions are expensive, error-prone, and difficult to maintain. Main-memory database systems, such as HyPer, achieve extremely low query response times while maintaining high update rates, which makes them well-suited for analytical streaming workloads. In this article, we explore extensions to database systems to match the performance and usability of streaming systems.<\/jats:p>","DOI":"10.1145\/3283811","type":"journal-article","created":{"date-parts":[[2019,1,23]],"date-time":"2019-01-23T13:02:14Z","timestamp":1548248534000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Scalable Analytics on Fast Data"],"prefix":"10.1145","volume":"44","author":[{"given":"Andreas","family":"Kipf","sequence":"first","affiliation":[{"name":"Technical University of Munich, Garching, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Varun","family":"Pandey","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Garching, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan","family":"B\u00f6ttcher","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Garching, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lucas","family":"Braun","sequence":"additional","affiliation":[{"name":"Oracle Labs, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Neumann","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Garching, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alfons","family":"Kemper","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Garching, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,1,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/645927.672367"},{"key":"e_1_2_1_2_1","unstructured":"Jeff Barr. 2016. Elastic Network Adapter\u2014High Performance Network Interface for Amazon EC2. Retrieved from https:\/\/aws.amazon.com\/blogs\/aws\/elastic-network-adapter-high-performance-network-interface-for-amazon-ec2\/.  Jeff Barr. 2016. Elastic Network Adapter\u2014High Performance Network Interface for Amazon EC2. Retrieved from https:\/\/aws.amazon.com\/blogs\/aws\/elastic-network-adapter-high-performance-network-interface-for-amazon-ec2\/."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742783"},{"key":"e_1_2_1_5_1","first-page":"28","article-title":"Apache Flink: Stream and batch processing in a single engine","volume":"38","author":"Carbone Paris","year":"2015","unstructured":"Paris Carbone , Asterios Katsifodimos , Stephan Ewen , Volker Markl , Seif Haridi , and Kostas Tzoumas . 2015 . Apache Flink: Stream and batch processing in a single engine . IEEE Data Eng. Bull. 38 , 4 (2015), 28 -- 38 . Retrieved from http:\/\/sites.computer.org\/debull\/A15dec\/p28.pdf. Paris Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2015. Apache Flink: Stream and batch processing in a single engine. IEEE Data Eng. Bull. 38, 4 (2015), 28--38. Retrieved from http:\/\/sites.computer.org\/debull\/A15dec\/p28.pdf.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735496.2735503"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2016.138"},{"key":"e_1_2_1_8_1","first-page":"28","article-title":"The SAP HANA database\u2014An architecture overview","volume":"35","author":"F\u00e4rber Franz","year":"2012","unstructured":"Franz F\u00e4rber , Norman May , Wolfgang Lehner , Philipp Gro\u00dfe , Ingo M\u00fcller , Hannes Rauhe , and Jonathan Dees . 2012 . The SAP HANA database\u2014An architecture overview . IEEE Data Eng. Bull. 35 , 1 (2012), 28 -- 33 . Franz F\u00e4rber, Norman May, Wolfgang Lehner, Philipp Gro\u00dfe, Ingo M\u00fcller, Hannes Rauhe, and Jonathan Dees. 2012. The SAP HANA database\u2014An architecture overview. IEEE Data Eng. Bull. 35, 1 (2012), 28--33.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_1_9_1","volume-title":"Will Be in Use in 2016, Up 30 Percent From","author":"Billion Connected Gartner Says","year":"2015","unstructured":"Gartner. 2015. Gartner Says 6.4 Billion Connected \u201c Things \u201d Will Be in Use in 2016, Up 30 Percent From 2015 . Retrieved from https:\/\/www.gartner.com\/newsroom\/id\/3165317. Gartner. 2015. Gartner Says 6.4 Billion Connected \u201cThings\u201d Will Be in Use in 2016, Up 30 Percent From 2015. Retrieved from https:\/\/www.gartner.com\/newsroom\/id\/3165317."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732977.2732999"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the USENIX Conference on Networked Systems Design and Implementation (NSDI\u201914)","author":"Jeong Eunyoung","year":"2014","unstructured":"Eunyoung Jeong , Shinae Woo , Muhammad Asim Jamshed , Haewon Jeong , Sunghwan Ihm , Dongsu Han , and KyoungSoo Park . 2014 . mTCP: A highly scalable user-level TCP stack for multicore systems . In Proceedings of the USENIX Conference on Networked Systems Design and Implementation (NSDI\u201914) . 489--502. Eunyoung Jeong, Shinae Woo, Muhammad Asim Jamshed, Haewon Jeong, Sunghwan Ihm, Dongsu Han, and KyoungSoo Park. 2014. mTCP: A highly scalable user-level TCP stack for multicore systems. In Proceedings of the USENIX Conference on Networked Systems Design and Implementation (NSDI\u201914). 489--502."},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Jeyhun Karimov Tilmann Rabl Asterios Katsifodimos Roman Samarev Henri Heiskanen and Volker Markl. 2018. Benchmarking distributed stream processing engines. CoRR abs\/1802.08496. Retrieved from http:\/\/arxiv.org\/abs\/1802.08496.  Jeyhun Karimov Tilmann Rabl Asterios Katsifodimos Roman Samarev Henri Heiskanen and Volker Markl. 2018. Benchmarking distributed stream processing engines. CoRR abs\/1802.08496. Retrieved from http:\/\/arxiv.org\/abs\/1802.08496.","DOI":"10.1109\/ICDE.2018.00169"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767867"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 20th International Conference on Extending Database Technology (EDBT\u201917)","author":"Kipf Andreas","year":"2017","unstructured":"Andreas Kipf , Varun Pandey , Jan B\u00f6ttcher , Lucas Braun , Thomas Neumann , and Alfons Kemper . 2017 . Analytics on fast data: Main-memory database systems versus modern streaming systems . In Proceedings of the 20th International Conference on Extending Database Technology (EDBT\u201917) 49--60. Andreas Kipf, Varun Pandey, Jan B\u00f6ttcher, Lucas Braun, Thomas Neumann, and Alfons Kemper. 2017. Analytics on fast data: Main-memory database systems versus modern streaming systems. In Proceedings of the 20th International Conference on Extending Database Technology (EDBT\u201917) 49--60."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/2047485.2047491"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2013.6544812"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2933349.2933352"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3064015"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2751519"},{"key":"e_1_2_1_20_1","volume-title":"From Active Data Management to Event-based Systems and More","author":"Mattern Friedemann","unstructured":"Friedemann Mattern and Christian Floerkemeier . 2010. From the internet of computers to the internet of things . In From Active Data Management to Event-based Systems and More . Springer , 242--259. Friedemann Mattern and Christian Floerkemeier. 2010. From the internet of computers to the internet of things. In From Active Data Management to Event-based Systems and More. Springer, 242--259."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.14778\/2831360.2831367"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW), 15","author":"M\u00fchlbauer T.","unstructured":"T. M\u00fchlbauer , W. R\u00f6diger , A. Reiser , A. Kemper , and T. Neumann . 2013. ScyPer: A hybrid OLTP8OLAP distributed main memory database system for scalable real-time analytics . In Proceedings of the Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW), 15 . Fachtagung des GI-Fachbereichs \u201cDatenbanken und Informationssysteme\u201d (DBIS\u201913). GI, 499--502. T. M\u00fchlbauer, W. R\u00f6diger, A. Reiser, A. Kemper, and T. Neumann. 2013. ScyPer: A hybrid OLTP8OLAP distributed main memory database system for scalable real-time analytics. In Proceedings of the Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW), 15. Fachtagung des GI-Fachbereichs \u201cDatenbanken und Informationssysteme\u201d (DBIS\u201913). GI, 499--502."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2685048.2685088"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.14778\/2002938.2002940"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW), 16","author":"Neumann Thomas","year":"2015","unstructured":"Thomas Neumann and Alfons Kemper . 2015 . Unnesting arbitrary queries . In Proceedings of the Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW), 16 . Fachtagung des GI-Fachbereichs \u201cDatenbanken und Informationssysteme\u201d (DBIS\u201915). GI, 383--402. Retrieved from http:\/\/subs.emis.de\/LNI\/Proceedings\/Proceedings241\/article10.html. Thomas Neumann and Alfons Kemper. 2015. Unnesting arbitrary queries. In Proceedings of the Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW), 16. Fachtagung des GI-Fachbereichs \u201cDatenbanken und Informationssysteme\u201d (DBIS\u201915). GI, 383--402. Retrieved from http:\/\/subs.emis.de\/LNI\/Proceedings\/Proceedings241\/article10.html."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2749436"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137628.3137659"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/3115404.3115408"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/2856318.2856319"},{"key":"e_1_2_1_31_1","unstructured":"Gabriel Silva. 2018. Maximize your VM\u2019s Performance with Accelerated Networking. Retrieved from https:\/\/azure.microsoft.com\/en-us\/blog\/maximize-your-vm-s-performance-with-accelerated-networking-now-generally-available-for-both-windows-and-linux\/.  Gabriel Silva. 2018. Maximize your VM\u2019s Performance with Accelerated Networking. Retrieved from https:\/\/azure.microsoft.com\/en-us\/blog\/maximize-your-vm-s-performance-with-accelerated-networking-now-generally-available-for-both-windows-and-linux\/."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1107499.1107504"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595641"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687707"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/3067421.3067427"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882935"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522737"},{"key":"e_1_2_1_38_1","unstructured":"Erfan Zamanian Carsten Binnig Tim Kraska and Tim Harris. 2016. The end of a myth: Distributed transactions can scale. CoRR abs\/1607.00655. Retrieved from http:\/\/arxiv.org\/abs\/1607.00655.  Erfan Zamanian Carsten Binnig Tim Kraska and Tim Harris. 2016. The end of a myth: Distributed transactions can scale. CoRR abs\/1607.00655. Retrieved from http:\/\/arxiv.org\/abs\/1607.00655."}],"container-title":["ACM Transactions on Database Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3283811","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3283811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:10Z","timestamp":1750207450000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3283811"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,22]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,3,31]]}},"alternative-id":["10.1145\/3283811"],"URL":"https:\/\/doi.org\/10.1145\/3283811","relation":{},"ISSN":["0362-5915","1557-4644"],"issn-type":[{"value":"0362-5915","type":"print"},{"value":"1557-4644","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,22]]},"assertion":[{"value":"2017-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}