{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T16:28:53Z","timestamp":1776443333868,"version":"3.51.2"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSF","award":["IIS-2141506"],"award-info":[{"award-number":["IIS-2141506"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2024,3,12]]},"abstract":"<jats:p>Supporting the interactive exploration of large datasets is a popular and challenging use case for data management systems. Traditionally, the interface and the back-end system are built and optimized separately, and interface design and system optimization require different skill sets that are difficult for one person to master. To enable analysts to focus on visualization design, we contribute VegaPlus, a system that automatically optimizes interactive dashboards to support large datasets. To achieve this, VegaPlus leverages two core ideas. First, we introduce an optimizer that can reason about execution plans in Vega, a back-end DBMS, or a mix of both environments. The optimizer also considers how user interactions may alter execution plan performance, and can partially or fully rewrite the plans when needed. Through a series of benchmark experiments on seven different dashboard designs, our results show that VegaPlus provides superior performance and versatility compared to standard dashboard optimization techniques.<\/jats:p>","DOI":"10.1145\/3639276","type":"journal-article","created":{"date-parts":[[2024,3,26]],"date-time":"2024-03-26T18:51:32Z","timestamp":1711479092000},"page":"1-25","source":"Crossref","is-referenced-by-count":8,"title":["Optimizing Dataflow Systems for Scalable Interactive Visualization"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8467-2917","authenticated-orcid":false,"given":"Junran","family":"Yang","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6387-5686","authenticated-orcid":false,"given":"Hyekang Kevin","family":"Joo","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0848-6351","authenticated-orcid":false,"given":"Sai","family":"Yerramreddy","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, MD, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3110-1053","authenticated-orcid":false,"given":"Dominik","family":"Moritz","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3870-636X","authenticated-orcid":false,"given":"Leilani","family":"Battle","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,3,26]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882919"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389732"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389732"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13678"},{"key":"e_1_2_1_5_1","volume-title":"A Structured Review of Data Management Technology for Interactive Visualization and Analysis","author":"Battle Leilani","year":"2020","unstructured":"Leilani Battle and Carlos Scheidegger. 2020. A Structured Review of Data Management Technology for Interactive Visualization and Analysis. IEEE Transactions on Visualization and Computer Graphics (2020)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/VISUAL.2005.1532788"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.185"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142574"},{"key":"e_1_2_1_9_1","unstructured":"Mackinlay Card. 1999. Readings in information visualization: using vision to think. Morgan Kaufmann."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2008.4677357"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/872757.872857"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610523"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3324957"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2016.7498315"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3380574"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2015.7113427"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.226"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-012-0507-8"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.14778\/3115404.3115418"},{"key":"e_1_2_1_20_1","volume-title":"Martin Ek, Eddie Kohler, M. Frans Kaashoek, and Robert Morris.","author":"Gjengset Jon","year":"2018","unstructured":"Jon Gjengset, Malte Schwarzkopf, Jonathan Behrens, Lara Timb\u00f3 Ara\u00fajo, Martin Ek, Eddie Kohler, M. Frans Kaashoek, and Robert Morris. 2018. Noria: dynamic, partially-stateful data-flow for high-performance web applications. 213--231. https:\/\/www.usenix.org\/conference\/osdi18\/presentation\/gjengset"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1049\/cp:19991091"},{"key":"e_1_2_1_22_1","first-page":"68","article-title":"Database Cracking","volume":"7","author":"Idreos Stratos","year":"2007","unstructured":"Stratos Idreos, Martin Kersten, and Stefan Manegold. 2007. Database Cracking. In CIDR, Vol. 7. 68--78.","journal-title":"CIDR"},{"key":"e_1_2_1_23_1","unstructured":"Plotly Technologies Inc. 2015. Collaborative data science. https:\/\/plot.ly. https:\/\/plot.ly"},{"key":"e_1_2_1_24_1","unstructured":"Quansight Inc. [n. d.]. ibis-vega-transform. https:\/\/github.com\/Quansight\/ibis-vega-transform"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00132"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","unstructured":"Nicolas Kruchten Jon Mease and Dominik Moritz. 2022. VegaFusion: Automatic Server-Side Scaling for Interactive Vega Visualizations. In 2022 IEEE Visualization and Visual Analytics (VIS). 11--15. https:\/\/doi.org\/10.1109\/VIS54862.2022.00011","DOI":"10.1109\/VIS54862.2022.00011"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2871139"},{"key":"e_1_2_1_28_1","volume-title":"P6: A Declarative Language for Integrating Machine Learning in Visual Analytics. arXiv:2009.01399 [cs] (Sept","author":"Li Jianping Kelvin","year":"2020","unstructured":"Jianping Kelvin Li and Kwan-Liu Ma. 2020b. P6: A Declarative Language for Integrating Machine Learning in Visual Analytics. arXiv:2009.01399 [cs] (Sept. 2020). http:\/\/arxiv.org\/abs\/2009.01399 arXiv: 2009.01399."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/2886444.2886453"},{"key":"e_1_2_1_30_1","volume-title":"Computer graphics forum","author":"Liu Zhicheng","unstructured":"Zhicheng Liu, Biye Jiang, and Jeffrey Heer. 2013. imMens: Real-time visual querying of big data. In Computer graphics forum, Vol. 32. Wiley Online Library, 421--430."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.26599\/BDMA.2019.9020015"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/3342263.3342644"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/3342263.3342646"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3196899"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3384405"},{"key":"e_1_2_1_36_1","volume-title":"Dynamic Client-Server Optimization for Scalable Interactive Visualization on the Web. In Workshop on Data Systems for Interactive Analysis (DSIA) at IEEE VIS 2015","author":"Moritz Dominik","year":"2015","unstructured":"Dominik Moritz, Jeff Heer, and Bill Howe. 2015. Dynamic Client-Server Optimization for Scalable Interactive Visualization on the Web. In Workshop on Data Systems for Interactive Analysis (DSIA) at IEEE VIS 2015 (Chicago, IL)."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300924"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522738"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983551"},{"key":"e_1_2_1_40_1","unstructured":"Bureau of Transportation Statistics. [n. d.]. http:\/\/web.archive.org\/web\/20080207010024\/http:\/\/www.808multimedia.com\/winnt\/kernel.htm. Accessed: 2010-09--30."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13670"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2948674.2948677"},{"key":"e_1_2_1_43_1","volume-title":"Postgresql: The world's most advanced open source relational database. https:\/\/www.postgresql.org\/.","author":"SQL.","year":"2019","unstructured":"PostgreSQL. 2019. Postgresql: The world's most advanced open source relational database. https:\/\/www.postgresql.org\/."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.14778\/3199517.3199522"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3320212"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13178"},{"key":"e_1_2_1_47_1","unstructured":"Neal Richardson Ian Cook Nic Crane Dewey Dunnington Romain Fran\u00e7ois Jonathan Keane Drago? Moldovan-Gr\u00fcnfeld Jeroen Ooms and Apache Arrow. 2023. arrow: Integration to 'Apache' 'Arrow'. https:\/\/github.com\/apache\/arrow\/ https:\/\/arrow.apache.org\/docs\/r\/."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2599030"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467091"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/VISUAL.1996.567752"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3127479.3131613"},{"key":"e_1_2_1_52_1","volume-title":"Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings. CoRR","author":"Siddiqui Tarique","year":"2020","unstructured":"Tarique Siddiqui, Alekh Jindal, Shi Qiao, Hiren Patel, and Wangchao Le. 2020. Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings. CoRR, Vol. abs\/2002.12393 (2020). showeprint[arXiv]2002.12393 https:\/\/arxiv.org\/abs\/2002.12393"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.14778\/3025111.3025126"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213858"},{"key":"e_1_2_1_55_1","unstructured":"Observable standard library. [n. d.]. https:\/\/github.com\/observablehq\/stdlib."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.981851"},{"key":"e_1_2_1_57_1","volume-title":"Kyrix: Interactive Visual Data Exploration at Scale. arXiv:1905.04638 [cs] (May","author":"Tao Wenbo","year":"2019","unstructured":"Wenbo Tao, Xiaoyu Liu, Remco Chang, and Michael Stonebraker. 2019a. Kyrix: Interactive Visual Data Exploration at Scale. arXiv:1905.04638 [cs] (May 2019). http:\/\/arxiv.org\/abs\/1905.04638 arXiv: 1905.04638."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13708"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742799"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1097\/01445442-198507000-00012"},{"key":"e_1_2_1_61_1","volume-title":"Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16)","author":"Venkataraman Shivaram","year":"2016","unstructured":"Shivaram Venkataraman, Zongheng Yang, Michael Franklin, Benjamin Recht, and Ion Stoica. 2016. Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16). USENIX Association, Santa Clara, CA, 363--378. https:\/\/www.usenix.org\/conference\/nsdi16\/technical-sessions\/presentation\/venkataraman"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3457286"},{"key":"e_1_2_1_63_1","doi-asserted-by":"crossref","unstructured":"Kanit Wongsuphasawat Zening Qu Dominik Moritz Riley Chang Felix Ouk Anushka Anand Jock Mackinlay Bill Howe and Jeffrey Heer. 2017. Voyager 2: Augmenting Visual Analysis with Partial View Specifications. In ACM Human Factors in Computing Systems (CHI). http:\/\/idl.cs.washington.edu\/papers\/voyager2","DOI":"10.1145\/3025453.3025768"},{"key":"e_1_2_1_64_1","volume-title":"Lero: A Learning-to-Rank Query Optimizer.","author":"Zhu Rong","year":"2023","unstructured":"Rong Zhu, Wei Chen, Bolin Ding, Xingguang Chen, Andreas Pfadler, Ziniu Wu, and Jingren Zhou. 2023. Lero: A Learning-to-Rank Query Optimizer."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610498"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639276","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3639276","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T15:14:08Z","timestamp":1755789248000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639276"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":65,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3,12]]}},"alternative-id":["10.1145\/3639276"],"URL":"https:\/\/doi.org\/10.1145\/3639276","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,12]]}}}