{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T19:48:15Z","timestamp":1774986495392,"version":"3.50.1"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1845638,1740305,2008295,2106197,2103794,2312991"],"award-info":[{"award-number":["1845638,1740305,2008295,2106197,2103794,2312991"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Amazon"},{"name":"Adobe"},{"name":"CAIT"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2025,6,17]]},"abstract":"<jats:p>Interactive visualization interfaces enable users to efficiently explore, analyze, and make sense of their datasets. However, as data grows in size, it becomes increasingly challenging to build data interfaces that meet the interface designer's desired latency expectations and resource constraints. Cloud DBMSs, while optimized for scalability, often fail to meet latency expectations, necessitating complex, bespoke query execution and optimization techniques for data interfaces. This involves manually navigating a huge optimization space that is sensitive to interface design and resource constraints, such as client vs server data and compute placement, choosing which computations are done offline vs online, and selecting from a large library of visualization-optimized data structures.<\/jats:p>\n                  <jats:p>This paper advocates for a Physical Visualization Design (PVD) tool that decouples interface design from system design to provide design independence. Given an interfaces underlying data flow, interactions with latency expectations, and resource constraints, PVD checks if the interface is feasible and, if so, proposes and instantiates a middleware architecture spanning the client, server, and cloud DBMS that meets the expectations.<\/jats:p>\n                  <jats:p>To this end, this paper presents Jade, the first prototype PVD tool that enables design independence. Jade proposes an intermediate representation called Diffplans to represent the data flows, develops cost estimation models that trade off between latency guarantees and plan feasibility, and implements an optimization framework to search for the middleware architecture that meets the guarantees. We evaluate Jade on six representative data interfaces as compared to Mosaic and Azure SQL database. We find Jade supports a wider range of interfaces, makes better use of available resources, and can meet a wider range of data, latency, and resource conditions.<\/jats:p>","DOI":"10.1145\/3725334","type":"journal-article","created":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:23:29Z","timestamp":1750281809000},"page":"1-27","source":"Crossref","is-referenced-by-count":1,"title":["Physical Visualization Design: Decoupling Interface and System Design"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4488-6785","authenticated-orcid":false,"given":"Yiru","family":"Chen","sequence":"first","affiliation":[{"name":"Columbia University, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9954-008X","authenticated-orcid":false,"given":"Xupeng","family":"Li","sequence":"additional","affiliation":[{"name":"Columbia University, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6407-1316","authenticated-orcid":false,"given":"Jeffrey","family":"Tao","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9547-6681","authenticated-orcid":false,"given":"Lana","family":"Ramjit","sequence":"additional","affiliation":[{"name":"Cornell Tech, Manhattan, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8436-3119","authenticated-orcid":false,"given":"Subrata","family":"Mitra","sequence":"additional","affiliation":[{"name":"Adobe Research, Bangalore, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8038-550X","authenticated-orcid":false,"given":"Javad","family":"Ghaderi","sequence":"additional","affiliation":[{"name":"Columbia University, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7002-5033","authenticated-orcid":false,"given":"Ravi","family":"Netravali","sequence":"additional","affiliation":[{"name":"Princeton University, Princeton, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4538-4752","authenticated-orcid":false,"given":"Aditya","family":"Parameswaran","sequence":"additional","affiliation":[{"name":"University of California, Berkeley, Berkeley, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3747-9946","authenticated-orcid":false,"given":"Dan","family":"Rubenstein","sequence":"additional","affiliation":[{"name":"Columbia University, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4254-6688","authenticated-orcid":false,"given":"Eugene","family":"Wu","sequence":"additional","affiliation":[{"name":"Columbia University, New York, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,6,18]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"https:\/\/jupyter.org. Accessed","author":"Jupyter Project","year":"2025","unstructured":"2014. Project Jupyter. https:\/\/jupyter.org. Accessed: 14 January 2025."},{"key":"e_1_2_1_2_1","volume-title":"https:\/\/www.metabase.com. Accessed","year":"2025","unstructured":"2020. Metabase. https:\/\/www.metabase.com. Accessed: 14 January 2025."},{"key":"e_1_2_1_3_1","volume-title":"https:\/\/retool.com. Accessed","year":"2025","unstructured":"2020. Retool. https:\/\/retool.com. Accessed: 14 January 2025."},{"key":"e_1_2_1_4_1","volume-title":"Coronavirus in the U.S.: Latest Map and Case Count. https:\/\/www.nytimes.com\/interactive\/2021\/us\/covid-cases.html. Accessed","year":"2025","unstructured":"2021. Coronavirus in the U.S.: Latest Map and Case Count. https:\/\/www.nytimes.com\/interactive\/2021\/us\/covid-cases.html. Accessed: 14 January 2025."},{"key":"e_1_2_1_5_1","unstructured":"2021. COVID-19 Dashboard by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University (JHU). https:\/\/coronavirus.jhu.edu\/map.html."},{"key":"e_1_2_1_6_1","volume-title":"https:\/\/www.tableau.com. Accessed","year":"2025","unstructured":"2021. Tableau. https:\/\/www.tableau.com. Accessed: 14 January 2025."},{"key":"e_1_2_1_7_1","unstructured":"2024. Bring everyone together with data. https:\/\/hex.tech."},{"key":"e_1_2_1_8_1","unstructured":"2024. A faster way to build and share data apps. https:\/\/streamlit.io\/."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465355"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807314"},{"key":"e_1_2_1_11_1","unstructured":"Apache Arrow Developers. 2025. Streaming Execution in Apache Arrow. https:\/\/arrow.apache.org\/docs\/9.0\/cpp\/streaming_execution.html. Accessed: 2025-01--20."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA597352"},{"key":"e_1_2_1_13_1","volume-title":"Deictic codes for the embodiment of cognition. Behavioral and brain sciences","author":"Ballard Dana H","year":"1997","unstructured":"Dana H Ballard, Mary M Hayhoe, Polly K Pook, and Rajesh PN Rao. 1997. Deictic codes for the embodiment of cognition. Behavioral and brain sciences, Vol. 20, 4 (1997), 723-742."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882919"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389732"},{"key":"e_1_2_1_16_1","volume-title":"A structured review of data management technology for interactive visualization and analysis","author":"Battle Leilani","year":"2020","unstructured":"Leilani Battle and Carlos Scheidegger. 2020. A structured review of data management technology for interactive visualization and analysis. IEEE transactions on visualization and computer graphics, Vol. 27, 2 (2020), 1128-1138."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190662"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2008.160"},{"key":"e_1_2_1_19_1","volume-title":"2007 IEEE 23rd International Conference on Data Engineering. IEEE, 826-835","author":"Bruno Nicolas","year":"2006","unstructured":"Nicolas Bruno and Surajit Chaudhuri. 2006. An online approach to physical design tuning. In 2007 IEEE 23rd International Conference on Data Engineering. IEEE, 826-835."},{"key":"e_1_2_1_20_1","volume-title":"DBSP: Automatic incremental view maintenance for rich query languages. arXiv preprint arXiv:2203.16684","author":"Budiu Mihai","year":"2022","unstructured":"Mihai Budiu, Frank McSherry, Leonid Ryzhyk, and Val Tannen. 2022. DBSP: Automatic incremental view maintenance for rich query languages. arXiv preprint arXiv:2203.16684, (2022)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2452376.2452445"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3906\/elk-1707-6"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597465.3605223"},{"key":"e_1_2_1_24_1","volume-title":"Monte Carlo Tree Search for Generating Interactive Data Analysis Interfaces. ArXiv","author":"Chen Yiru","year":"1902","unstructured":"Yiru Chen and Eugene Wu. 2020. Monte Carlo Tree Search for Generating Interactive Data Analysis Interfaces. ArXiv, Vol. abs\/2001.01902 (2020)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526166"},{"key":"e_1_2_1_26_1","volume-title":"Introduction to algorithms","author":"Cormen Thomas H","unstructured":"Thomas H Cormen, Charles E Leiserson, Ronald L Rivest, and Clifford Stein. 2022. Introduction to algorithms. MIT press."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2903741"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1792734.1792766"},{"key":"e_1_2_1_29_1","volume-title":"Advances in Computers.","author":"Defanti Thomas A","unstructured":"Thomas A Defanti and Maxine D Brown. 1991. Visualization in scientific computing. In Advances in Computers. Vol. 33. Elsevier, 247-307."},{"key":"e_1_2_1_30_1","volume-title":"Cube: The Semantic Layer for Building Data Applications. https:\/\/cube.dev\/ Accessed: 2024-07--22.","author":"Dev Cube","year":"2024","unstructured":"Cube Dev. 2024. Cube: The Semantic Layer for Building Data Applications. https:\/\/cube.dev\/ Accessed: 2024-07--22."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3380574"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/42201.42205"},{"key":"e_1_2_1_33_1","unstructured":"Google. 2022. Google COVID Interface Search. https:\/\/www.google.com\/search?q=googlecovidinterface. Accessed: 2022-08--13."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.1993.344061"},{"key":"e_1_2_1_35_1","unstructured":"Stanford Visualization Group. 2024. ImMens: Brightkite Dataset Demo. https:\/\/vis.stanford.edu\/projects\/immens\/demo\/brightkite\/. Accessed: 2024-08--13."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142560"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.144"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2023.3327189"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-155860869-6\/50023-8"},{"key":"e_1_2_1_40_1","unstructured":"Iowa. 2024. Iowa Liquor Dataset \/ Data Analysis. https:\/\/observablehq.com\/d\/3ce1ac2526c20515"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767867"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.14778\/3554821.3554847"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346452"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12129"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1739041.1739131"},{"key":"e_1_2_1_46_1","volume-title":"Rebecca Isaacs, and Michael Isard.","author":"McSherry Frank","year":"2013","unstructured":"Frank McSherry, Derek Gordon Murray, Rebecca Isaacs, and Michael Isard. 2013. Differential dataflow. In CIDR."},{"key":"e_1_2_1_47_1","unstructured":"Microsoft. 2024a. Automatic tuning in Azure SQL Database. https:\/\/learn.microsoft.com\/en-us\/azure\/azure-sql\/database\/automatic-tuning-overview?view=azuresql Accessed: 2024-07--22."},{"key":"e_1_2_1_48_1","unstructured":"Microsoft. 2024b. Azure SQL Database. https:\/\/azure.microsoft.com\/en-us\/products\/azure-sql\/database. Accessed: 2024-09-02."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3384405"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300924"},{"key":"e_1_2_1_51_1","volume-title":"Response Times: The 3 Important Limits. https:\/\/www.nngroup.com\/articles\/response-times-3-important-limits\/. Accessed: 2024-07--28.","author":"Nielsen Jakob","year":"1993","unstructured":"Jakob Nielsen. 1993. Response Times: The 3 Important Limits. https:\/\/www.nngroup.com\/articles\/response-times-3-important-limits\/. Accessed: 2024-07--28."},{"key":"e_1_2_1_52_1","unstructured":"Nushoin. 2025. RTree - A C Implementation of R-Tree Data Structure. https:\/\/github.com\/nushoin\/RTree. Accessed: 2025-01--20."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.14778\/3407790.3407834"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3051013"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3320212"},{"key":"e_1_2_1_56_1","unstructured":"Nithin Reddy. 2023. Weather Data Insights. https:\/\/www.kaggle.com\/code\/nithinreddy90\/weather-data-insights. Accessed: 2024--10-07."},{"key":"e_1_2_1_57_1","volume-title":"InfoVis","author":"Satyanarayan Arvind","year":"2015","unstructured":"Arvind Satyanarayan, Ryan Russell, Jane Hoffswell, and Jeffrey Heer. 2015. Reactive Vega: A Streaming Dataflow Architecture for Declarative Interactive Visualization. InfoVis, (2015)."},{"key":"e_1_2_1_58_1","unstructured":"Sloan Digital Sky Survey. 2024. Sloan Digital Sky Survey. https:\/\/www.sdss.org\/. Accessed: 2024-08--13."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.981851"},{"key":"e_1_2_1_60_1","volume-title":"Kyrix: Interactive pan\/zoom visualizations at scale. In Computer Graphics Forum","author":"Tao Wenbo","year":"2019","unstructured":"Wenbo Tao, Xiaoyu Liu, Yedi Wang, Leilani Battle, \u00c7a\u011fatay Demiralp, Remco Chang, and Michael Stonebraker. 2019. Kyrix: Interactive pan\/zoom visualizations at scale. In Computer Graphics Forum, , Vol. 38. Wiley Online Library, 529-540."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2949741.2949748"},{"key":"e_1_2_1_62_1","unstructured":"Synthetic Data Vault. 2024. The Synthetic Data Vault. Put synthetic data to work! https:\/\/sdv.dev\/"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3639276"},{"key":"e_1_2_1_64_1","first-page":"1087","volume-title":"Proceedings of the Thirtieth international conference on Very large data bases-Volume 30","author":"Zilio Daniel C","year":"2004","unstructured":"Daniel C Zilio, Jun Rao, Sam Lightstone, Guy Lohman, Adam Storm, Christian Garcia-Arellano, and Scott Fadden. 2004. DB2 design advisor: Integrated automatic physical database design. In Proceedings of the Thirtieth international conference on Very large data bases-Volume 30. 1087-1097."}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3725334","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T18:51:11Z","timestamp":1774983071000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3725334"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,17]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6,17]]}},"alternative-id":["10.1145\/3725334"],"URL":"https:\/\/doi.org\/10.1145\/3725334","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,17]]}}}