{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T19:00:47Z","timestamp":1774983647470,"version":"3.50.1"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T00:00:00Z","timestamp":1739145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2141506, 2313998"],"award-info":[{"award-number":["2141506, 2313998"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2025,2,10]]},"abstract":"<jats:p>\n                    In this paper, we present a new DBMS performance benchmark that can\n                    <jats:italic toggle=\"yes\">simulate<\/jats:italic>\n                    user exploration with any specified dashboard design made of standard visualization and interaction components. The distinguishing feature of our SImulation-BAsed (or SIMBA) benchmark is its ability to\n                    <jats:italic toggle=\"yes\">model user analysis goals<\/jats:italic>\n                    as a set of SQL queries to be generated through a valid sequence of user interactions, as well as\n                    <jats:italic toggle=\"yes\">measure the completion of analysis goals<\/jats:italic>\n                    by testing for equivalence between the user's previous queries and their goal queries. In this way, the SIMBA benchmark can simulate how an analyst opportunistically searches for interesting insights at the beginning of an exploration session and eventually hones in on specific goals towards the end. To demonstrate the versatility of the SIMBA benchmark, we use it to test the performance of four DBMSs with six different dashboard specifications and compare our results with IDEBench. Our results show how goal-driven simulation can reveal gaps in DBMS performance missed by existing benchmarking methods and across a range of data exploration scenarios.\n                  <\/jats:p>","DOI":"10.1145\/3709658","type":"journal-article","created":{"date-parts":[[2025,2,11]],"date-time":"2025-02-11T15:45:06Z","timestamp":1739288706000},"page":"1-24","source":"Crossref","is-referenced-by-count":1,"title":["An Adaptive Benchmark for Modeling User Exploration of Large Datasets"],"prefix":"10.1145","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-7736-3597","authenticated-orcid":false,"given":"Joanna","family":"Purich","sequence":"first","affiliation":[{"name":"University of Maryland, College Park, MD, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5594-819X","authenticated-orcid":false,"given":"Anthony","family":"Wise","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3870-636X","authenticated-orcid":false,"given":"Leilani","family":"Battle","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,2,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Adobe. 2022. Panels Overview | Adobe Analytics. https:\/\/experienceleague.adobe.com\/docs\/analytics\/analyze\/analysisworkspace\/panels\/panels.html?lang=en."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3209448"},{"key":"e_1_2_1_4_1","volume-title":"TPC-H and SSB. In New Contributions in Information Systems and Technologies","author":"Barata Melyssa","unstructured":"Melyssa Barata, Jorge Bernardino, and Pedro Furtado. 2015. An overview of decision support benchmarks: TPC-DS, TPC-H and SSB. In New Contributions in Information Systems and Technologies. Springer, 619--628."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209900.3209901"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSIA"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2882919"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389732"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2008.4677357"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526166"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939502.2939513"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2610523"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3380574"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2865117"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139583923"},{"key":"e_1_2_1_17_1","volume-title":"White-box Compression: Learning and Exploiting Compact Table Representations.. In CIDR.","author":"Ghita Bogdan","year":"2020","unstructured":"Bogdan Ghita, Diego G Tom\u00e9, and Peter A Boncz. 2020. White-box Compression: Learning and Exploiting Compact Table Representations.. In CIDR."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1502650.1502695"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2023.3327189"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2731084"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3197386"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816674"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744319"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13678"},{"key":"e_1_2_1_25_1","first-page":"2376","article-title":"A Multi-Level Typology of Abstract Visualization Tasks","volume":"19","author":"Brehmer Matthew","year":"2013","unstructured":"Matthew Brehmer and Tamara Munzner. 2013. A Multi-Level Typology of Abstract Visualization Tasks. IEEE TVCG 19, 12 (2013), 2376--2385.","journal-title":"IEEE TVCG"},{"key":"e_1_2_1_26_1","unstructured":"Microsoft. 2022. Data Visualization | Microsoft Power BI. https:\/\/powerbi.microsoft.com\/en-us\/."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300924"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-10424-4_17"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137628.3137637"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389782"},{"key":"e_1_2_1_32_1","unstructured":"Salesforce. 2022. Visualize Your Data With Dashboards and Charts. https:\/\/trailhead.salesforce.com\/content\/learn\/ modules\/reports_dashboards\/reports_dashboards_visualizing_data."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864903"},{"key":"e_1_2_1_34_1","volume-title":"Vega-Lite: A Grammar of Interactive Graphics","author":"Satyanarayan Arvind","year":"2017","unstructured":"Arvind Satyanarayan, Dominik Moritz, Kanit Wongsuphasawat, and Jeffrey Heer. 2017. Vega-Lite: A Grammar of Interactive Graphics. IEEE Trans. Visualization & Comp. Graphics (Proc. InfoVis) (2017). http:\/\/idl.cs.washington.edu\/papers\/vega-lite"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of IEEE Symposium on Visual Languages","volume":"96","author":"Shneiderman Ben","unstructured":"Ben Shneiderman. [n.d.]. The Eyes Have It: A Task by Data Type Taxonomy for. In Proceedings of IEEE Symposium on Visual Languages, Vol. 96."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.14778\/3025111.3025126"},{"key":"e_1_2_1_37_1","first-page":"52","article-title":"Polaris: A system for query, analysis, and visualization of multidimensional relational databases","volume":"8","author":"Stolte Chris","year":"2002","unstructured":"Chris Stolte, Diane Tang, and Pat Hanrahan. 2002. Polaris: A system for query, analysis, and visualization of multidimensional relational databases. IEEE TVCG 8, 1 (2002), 52--65.","journal-title":"IEEE TVCG"},{"key":"e_1_2_1_38_1","unstructured":"Tableau Software. 2022. Tableau Desktop | Connect analyze and visualize any data. https:\/\/www.tableau.com\/products\/desktop."},{"key":"e_1_2_1_39_1","unstructured":"TPC-DS 2022. TPC-DS. https:\/\/www.tpc.org\/tpcds\/. Accessed: 2022--10-05."},{"key":"e_1_2_1_40_1","unstructured":"TPC-H 2022. TPC-H. http:\/\/www.tpc.org\/tpch\/. Accessed: 2022--10-05."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209950.3209952"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025768"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445728"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114814"},{"key":"e_1_2_1_45_1","volume-title":"How Progressive Visualizations Affect Exploratory Analysis","author":"Zgraggen Emanuel","year":"2016","unstructured":"Emanuel Zgraggen, Alex Galakatos, Andrew Crotty, Jean-Daniel Fekete, and Tim Kraska. 2016. How Progressive Visualizations Affect Exploratory Analysis. IEEE TVCG (2016)."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174053"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319872"},{"key":"e_1_2_1_48_1","first-page":"2122","article-title":"The Effects of Interactive Latency on Exploratory Visual Analysis","volume":"20","author":"Liu Zhicheng","year":"2014","unstructured":"Zhicheng Liu and Jeffrey Heer. 2014. The Effects of Interactive Latency on Exploratory Visual Analysis. IEEE TVCG 20, 12 (2014), 2122--2131.","journal-title":"IEEE TVCG"},{"key":"e_1_2_1_49_1","volume-title":"SPES: A Two-Stage Query Equivalence Verifier.","author":"Zhou Qi","year":"2020","unstructured":"Qi Zhou, Joy Arulraj, Shamkant Navathe, William Harris, and JinpengWu. 2020. SPES: A Two-Stage Query Equivalence Verifier. (2020)."}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3709658","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3709658","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T18:17:03Z","timestamp":1774981023000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3709658"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,10]]},"references-count":49,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,2,10]]}},"alternative-id":["10.1145\/3709658"],"URL":"https:\/\/doi.org\/10.1145\/3709658","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,10]]}}}