{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,30]],"date-time":"2025-09-30T04:25:58Z","timestamp":1759206358669},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:p>Modern database management systems employ sophisticated query optimization techniques that enable the generation of efficient plans for queries over very large data sets. A variety of other applications also process large data sets, but cannot leverage database-style query optimization for their code. We therefore identify an opportunity to enhance an open-source programming language compiler with database-style query optimization. Our system dynamically generates execution plans at query time, and runs those plans on chunks of data at a time. Based on feedback from earlier chunks, alternative plans might be used for later chunks. The compiler extension could be used for a variety of data-intensive applications, allowing all of them to benefit from this class of performance optimizations.<\/jats:p>","DOI":"10.14778\/3447689.3447697","type":"journal-article","created":{"date-parts":[[2021,4,12]],"date-time":"2021-04-12T16:20:06Z","timestamp":1618244406000},"page":"929-942","source":"Crossref","is-referenced-by-count":9,"title":["Adaptive code generation for data-intensive analytics"],"prefix":"10.14778","volume":"14","author":[{"given":"Wangda","family":"Zhang","sequence":"first","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junyoung","family":"Kim","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kenneth A.","family":"Ross","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Sedlar","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lukas","family":"Stadler","sequence":"additional","affiliation":[{"name":"Oracle Labs"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,4,12]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n.d.]. The TPC-H Benchmark. http:\/\/www.tpc.org\/tpch.  [n.d.]. The TPC-H Benchmark. http:\/\/www.tpc.org\/tpch."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335420"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732219.2732227"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2013.6544839"},{"key":"e_1_2_1_5_1","first-page":"9","article-title":"Business Analytics in (a) Blink","volume":"35","author":"Barber Ronald","year":"2012","unstructured":"Ronald Barber , Peter Bendel , Marco Czech , Oliver Draese , Frederick Ho , Namik Hrle , Stratos Idreos , Min-Soo Kim , Oliver Koeth , Jae-Gil Lee , Tianchao Tim Li , Guy M. Lohman , Konstantinos Morfonios , Ren\u00e9 M\u00fcller , Keshava Murthy , Ippokratis Pandis , Lin Qiao , Vijayshankar Raman , Richard Sidle , Knut Stolze , and Sandor Szabo . 2012 . Business Analytics in (a) Blink . IEEE Data Eng. Bull. 35 , 1 (2012), 9 -- 14 . Ronald Barber, Peter Bendel, Marco Czech, Oliver Draese, Frederick Ho, Namik Hrle, Stratos Idreos, Min-Soo Kim, Oliver Koeth, Jae-Gil Lee, Tianchao Tim Li, Guy M. Lohman, Konstantinos Morfonios, Ren\u00e9 M\u00fcller, Keshava Murthy, Ippokratis Pandis, Lin Qiao, Vijayshankar Raman, Richard Sidle, Knut Stolze, and Sandor Szabo. 2012. Business Analytics in (a) Blink. IEEE Data Eng. Bull. 35, 1 (2012), 9--14.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989328"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409360.1409380"},{"key":"e_1_2_1_8_1","unstructured":"Peter A. Boncz Marcin Zukowski and Niels Nes. 2005. MonetDB\/X100: Hyper-pipelining query execution. In CIDR.  Peter A. Boncz Marcin Zukowski and Niels Nes. 2005. MonetDB\/X100: Hyper-pipelining query execution. In CIDR."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137765.3137782"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/1454159.1454171"},{"key":"e_1_2_1_11_1","unstructured":"Confluent Inc. 2019. Streaming SQL for Apache Kafka. https:\/\/www.confluent.io\/product\/ksql.  Confluent Inc. 2019. Streaming SQL for Apache Kafka. https:\/\/www.confluent.io\/product\/ksql."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824045"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1316689.1316771"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/1331939.1331940"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/1325851.1325973"},{"key":"e_1_2_1_16_1","volume-title":"arXiv preprint arXiv:1909.03291","author":"Duta Christian","year":"2019","unstructured":"Christian Duta , Denis Hirn , and Torsten Grust . 2019. Compiling PL\/SQL Away . arXiv preprint arXiv:1909.03291 ( 2019 ). Christian Duta, Denis Hirn, and Torsten Grust. 2019. Compiling PL\/SQL Away. arXiv preprint arXiv:1909.03291 (2019)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2588566"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/3165215"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2094114.2094126"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.14778\/1921071.1921077"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742795"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1921027"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/292481.277627"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3384678"},{"key":"e_1_2_1_25_1","unstructured":"InfluxData Inc. 2019. Time series database (TSDB) explained. https:\/\/www.influxdata.com\/time-series-database.  InfluxData Inc. 2019. Time series database (TSDB) explained. https:\/\/www.influxdata.com\/time-series-database."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/1299042.1299047"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.14778\/2735703.2735704"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/276305.276315"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/1454159.1454211"},{"key":"e_1_2_1_30_1","unstructured":"Michael Kalloniatis and Charles Luu. [n.d.]. Temporal Resolution. https:\/\/webvision.med.utah.edu\/book\/part-viii-psychophysics-of-vision\/temporal-resolution\/.  Michael Kalloniatis and Charles Luu. [n.d.]. Temporal Resolution. https:\/\/webvision.med.utah.edu\/book\/part-viii-psychophysics-of-vision\/temporal-resolution\/."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/3275366.3284964"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767867"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3275366.3284966"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687564"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732951.2732959"},{"key":"e_1_2_1_36_1","volume-title":"Adaptive Execution of Compiled Queries. In 34th IEEE International Conference on Data Engineering, ICDE 2018","author":"Kohn Andr\u00e9","year":"2018","unstructured":"Andr\u00e9 Kohn , Viktor Leis , and Thomas Neumann . 2018 . Adaptive Execution of Compiled Queries. In 34th IEEE International Conference on Data Engineering, ICDE 2018 , Paris, France , April 16-19, 2018. 197--208. Andr\u00e9 Kohn, Viktor Leis, and Thomas Neumann. 2018. Adaptive Execution of Compiled Queries. In 34th IEEE International Conference on Data Engineering, ICDE 2018, Paris, France, April 16-19, 2018. 197--208."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2010.5447892"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Konstantinos Krikellas Stratis Viglas and Marcelo Cintra. 2010. Generating code for holistic query evaluation. In ICDE. 613--624.  Konstantinos Krikellas Stratis Viglas and Marcelo Cintra. 2010. Generating code for holistic query evaluation. In ICDE. 613--624.","DOI":"10.1109\/ICDE.2010.5447892"},{"key":"e_1_2_1_39_1","first-page":"6","article-title":"Oracle TimesTen: An In-Memory Database for Enterprise Applications","volume":"36","author":"Lahiri Tirthankar","year":"2013","unstructured":"Tirthankar Lahiri , Marie-Anne Neimat , and Steve Folkman . 2013 . Oracle TimesTen: An In-Memory Database for Enterprise Applications . IEEE Data Eng. Bull. 36 , 2 (2013), 6 -- 13 . Tirthankar Lahiri, Marie-Anne Neimat, and Steve Folkman. 2013. Oracle TimesTen: An In-Memory Database for Enterprise Applications. IEEE Data Eng. Bull. 36, 2 (2013), 6--13.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882925"},{"key":"e_1_2_1_41_1","first-page":"34","article-title":"The Hekaton Memory-Optimized OLTP Engine","volume":"36","author":"Larson Per-\u00c5ke","year":"2013","unstructured":"Per-\u00c5ke Larson , Mike Zwilling , and Kevin Farlee . 2013 . The Hekaton Memory-Optimized OLTP Engine . IEEE Data Eng. Bull. 36 , 2 (2013), 34 -- 40 . http:\/\/sites.computer.org\/debull\/A13june\/Hekaton1.pdf Per-\u00c5ke Larson, Mike Zwilling, and Kevin Farlee. 2013. The Hekaton Memory-Optimized OLTP Engine. IEEE Data Eng. Bull. 36, 2 (2013), 34--40. http:\/\/sites.computer.org\/debull\/A13june\/Hekaton1.pdf","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007780000031"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2002.1019210"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.14778\/2002938.2002940"},{"key":"e_1_2_1_45_1","unstructured":"Oracle Corp. 2019. GraalVM. https:\/\/www.graalvm.org\/.  Oracle Corp. 2019. GraalVM. https:\/\/www.graalvm.org\/."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/1267847.1267848"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5555\/3199517.3199518"},{"key":"e_1_2_1_48_1","volume-title":"Self-Driving Database Management Systems. In CIDR 2017, Conference on Innovative Data Systems Research. http:\/\/db.cs.cmu.edu\/papers\/2017\/p42-pavlo-cidr17","author":"Pavlo Andrew","year":"2017","unstructured":"Andrew Pavlo , Gustavo Angulo , Joy Arulraj , Haibin Lin , Jiexi Lin , Lin Ma , Prashanth Menon , Todd Mowry , Matthew Perron , Ian Quah , Siddharth Santurkar , Anthony Tomasic , Skye Toor , Dana Van Aken , Ziqi Wang , Yingjun Wu , Ran Xian , and Tieying Zhang . 2017 . Self-Driving Database Management Systems. In CIDR 2017, Conference on Innovative Data Systems Research. http:\/\/db.cs.cmu.edu\/papers\/2017\/p42-pavlo-cidr17 .pdf Andrew Pavlo, Gustavo Angulo, Joy Arulraj, Haibin Lin, Jiexi Lin, Lin Ma, Prashanth Menon, Todd Mowry, Matthew Perron, Ian Quah, Siddharth Santurkar, Anthony Tomasic, Skye Toor, Dana Van Aken, Ziqi Wang, Yingjun Wu, Ran Xian, and Tieying Zhang. 2017. Self-Driving Database Management Systems. In CIDR 2017, Conference on Innovative Data Systems Research. http:\/\/db.cs.cmu.edu\/papers\/2017\/p42-pavlo-cidr17.pdf"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2747645"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610522"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2619228.2619234"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771937.2771943"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536222.2536233"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/974750.974755"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465292"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807207"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.14778\/3377369.3377382"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882917"},{"key":"e_1_2_1_59_1","unstructured":"Doug Simon. [n.d.]. libgraal: GraalVM compiler as a precompiled GraalVM native image. https:\/\/medium.com\/graalvm\/libgraal-graalvm-compiler-as-a-precompiled-graalvm-native-image-26e354bee5c.  Doug Simon. [n.d.]. libgraal: GraalVM compiler as a precompiled GraalVM native image. https:\/\/medium.com\/graalvm\/libgraal-graalvm-compiler-as-a-precompiled-graalvm-native-image-26e354bee5c."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/2032397.2032399"},{"key":"e_1_2_1_61_1","unstructured":"Tableau Inc. 2019. Tableau. https:\/\/www.tableau.com.  Tableau Inc. 2019. Tableau. https:\/\/www.tableau.com."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687671"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384716.2384723"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2509578.2509581"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007328.3007332"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2020.3006446"},{"key":"e_1_2_1_68_1","volume-title":"Permutation Index: Exploiting Data Skew for Improved Query Performance. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE","author":"Zhang Wangda","year":"2020","unstructured":"Wangda Zhang and Kenneth A Ross . 2020 . Permutation Index: Exploiting Data Skew for Improved Query Performance. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE , 1982--1985. Wangda Zhang and Kenneth A Ross. 2020. Permutation Index: Exploiting Data Skew for Improved Query Performance. In 2020 IEEE 36th International Conference on Data Engineering (ICDE). IEEE, 1982--1985."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/564691.564709"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2012.148"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3447689.3447697","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:18:21Z","timestamp":1672226301000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3447689.3447697"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2]]},"references-count":69,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["10.14778\/3447689.3447697"],"URL":"https:\/\/doi.org\/10.14778\/3447689.3447697","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2021,2]]}}}