{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:21:15Z","timestamp":1776104475006,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,5,2]],"date-time":"2017-05-02T00:00:00Z","timestamp":1493683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,5,2]]},"DOI":"10.1145\/3025453.3025456","type":"proceedings-article","created":{"date-parts":[[2017,5,2]],"date-time":"2017-05-02T14:37:22Z","timestamp":1493735842000},"page":"2904-2915","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":61,"title":["Trust, but Verify: Optimistic Visualizations of Approximate Queries for Exploring Big Data"],"prefix":"10.1145","author":[{"given":"Dominik","family":"Moritz","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danyel","family":"Fisher","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bolin","family":"Ding","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chi","family":"Wang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,5,2]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2593667"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2465351.2465355"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.185"},{"key":"e_1_3_2_2_4_1","volume-title":"Eurographics Symposium on Parallel Graphics and Visualization","author":"Budiu Mihai","year":"2015","unstructured":"4 . Mihai Budiu , Rebecca Isaacs , Derek Murray , Gordon Plotkin , Paul Barham , Samer Al-Kiswany , Yazan Boshmaf , Qingzhou Luo , and Alexandr Andoni . 2015 . Interacting with large distributed datasets using Sketch . In Eurographics Symposium on Parallel Graphics and Visualization . University of Wisconsin-Madison. DOI: http:\/\/dx.doi.org\/10\/f3tvr9 4. Mihai Budiu, Rebecca Isaacs, Derek Murray, Gordon Plotkin, Paul Barham, Samer Al-Kiswany, Yazan Boshmaf, Qingzhou Luo, and Alexandr Andoni. 2015. Interacting with large distributed datasets using Sketch. In Eurographics Symposium on Parallel Graphics and Visualization. University of Wisconsin-Madison. DOI: http:\/\/dx.doi.org\/10\/f3tvr9"},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of the Conference on Human Factors in Computing Systems (CHI '91)","author":"Card Stuart K.","unstructured":"5 . Stuart K. Card , George G. Robertson , and Jock D. Mackinlay . 1991. The Information Visualizer, an Information Workspace . In Proceedings of the Conference on Human Factors in Computing Systems (CHI '91) . ACM. DOI:http:\/\/dx.doi.org\/10\/cvtdps 5. Stuart K. Card, George G. Robertson, and Jock D. Mackinlay. 1991. The Information Visualizer, an Information Workspace. In Proceedings of the Conference on Human Factors in Computing Systems (CHI '91). ACM. DOI:http:\/\/dx.doi.org\/10\/cvtdps"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/248603.248616"},{"key":"e_1_3_2_2_7_1","unstructured":"7\n  .  Geoff Cumming and Sue Finch. 2005. Inference by eye: confidence intervals and how to read pictures of data. (2005). DOI:http:\/\/dx.doi.org\/10\/c4nsck  7. Geoff Cumming and Sue Finch. 2005. Inference by eye: confidence intervals and how to read pictures of data. (2005). DOI:http:\/\/dx.doi.org\/10\/c4nsck"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2915249"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.84"},{"key":"e_1_3_2_2_10_1","volume-title":"Progressive Analytics: A Computation Paradigm for Exploratory Data Analysis.","author":"Fekete Jean-Daniel","year":"2016","unstructured":"10 . Jean-Daniel Fekete and Romain Primet . 2016 . Progressive Analytics: A Computation Paradigm for Exploratory Data Analysis. (2016). https:\/\/arxiv.org\/abs\/1607.05162 10. Jean-Daniel Fekete and Romain Primet. 2016. Progressive Analytics: A Computation Paradigm for Exploratory Data Analysis. (2016). https:\/\/arxiv.org\/abs\/1607.05162"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557131"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939502.2939518"},{"key":"e_1_3_2_2_13_1","volume-title":"Proceedings of the Conference on Human Factors in Computing Systems (CHI '12)","author":"Fisher Danyel","unstructured":"13 . Danyel Fisher , Igor O. Popov , Steven M. Drucker , and Monica M. C. Schraefel . 2012. Trust me, I'm partially right: incremental visualization lets analysts explore large datasets faster . In Proceedings of the Conference on Human Factors in Computing Systems (CHI '12) . ACM. DOI:http:\/\/dx.doi.org\/10\/f3tvr5 13. Danyel Fisher, Igor O. Popov, Steven M. Drucker, and Monica M. C. Schraefel. 2012. Trust me, I'm partially right: incremental visualization lets analysts explore large datasets faster. In Proceedings of the Conference on Human Factors in Computing Systems (CHI '12). ACM. DOI:http:\/\/dx.doi.org\/10\/f3tvr5"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"14\n  .  P. Godfrey J. Gryz and P. Lasek. 2016. Interactive Visualization of Large Data Sets. In IEEE Transactions on Knowledge and Data Engineering. DOI: http:\/\/dx.doi.org\/10\/f3tvr8  14. P. Godfrey J. Gryz and P. Lasek. 2016. Interactive Visualization of Large Data Sets. In IEEE Transactions on Knowledge and Data Engineering. DOI: http:\/\/dx.doi.org\/10\/f3tvr8","DOI":"10.1109\/TKDE.2016.2557324"},{"key":"e_1_3_2_2_15_1","volume-title":"Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals. In Data Mining Knowedge Discovery","author":"Gray Jim","year":"1997","unstructured":"15 . Jim Gray , Surajit Chaudhuri , Adam Bosworth , Andrew Layman , Don Reichart , Murali Venkatrao , Frank Pellow , and Hamid Pirahesh . 1997 . Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals. In Data Mining Knowedge Discovery . Kluwer Academic Publishers . DOI: http:\/\/dx.doi.org\/10\/brp273 15. Jim Gray, Surajit Chaudhuri, Adam Bosworth, Andrew Layman, Don Reichart, Murali Venkatrao, Frank Pellow, and Hamid Pirahesh. 1997. Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals. In Data Mining Knowedge Discovery. Kluwer Academic Publishers. DOI: http:\/\/dx.doi.org\/10\/brp273"},{"key":"e_1_3_2_2_16_1","volume-title":"Proceedings of the International Conference on Management of Data (SIGMOD '99)","author":"Peter","unstructured":"16 . Peter J. Haas and Joseph M. Hellerstein. 1999. Ripple Joins for Online Aggregation . In Proceedings of the International Conference on Management of Data (SIGMOD '99) . ACM. DOI:http:\/\/dx.doi.org\/10\/dqgn68 16. Peter J. Haas and Joseph M. Hellerstein. 1999. Ripple Joins for Online Aggregation. In Proceedings of the International Conference on Management of Data (SIGMOD '99). ACM. DOI:http:\/\/dx.doi.org\/10\/dqgn68"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2008.137"},{"key":"e_1_3_2_2_18_1","volume":"199","author":"Hellerstein Joseph M.","unstructured":"18 . Joseph M. Hellerstein , Ron Avnur , Andy Chou , Christian Hidber , Chris Olston , Vijayshankar Raman , Tali Roth , and Peter J. Haas. 199 9. Interactive Data Analysis: The Control Project. (1999). DOI: http:\/\/dx.doi.org\/10\/bsjgrh 18. Joseph M. Hellerstein, Ron Avnur, Andy Chou, Christian Hidber, Chris Olston, Vijayshankar Raman, Tali Roth, and Peter J. Haas. 1999. Interactive Data Analysis: The Control Project. (1999). DOI: http:\/\/dx.doi.org\/10\/bsjgrh","journal-title":"Peter J. Haas."},{"key":"e_1_3_2_2_19_1","volume":"199","author":"Hellerstein Joseph M.","unstructured":"19 . Joseph M. Hellerstein , Peter J. Haas , and Helen J. Wang. 199 7. Online Aggregation. In Proceedings of the International Conference on Management of Data (SIGMOD '97). ACM. DOI:http:\/\/dx.doi.org\/10\/bbk4fr 19. Joseph M. Hellerstein, Peter J. Haas, and Helen J. Wang. 1997. Online Aggregation. In Proceedings of the International Conference on Management of Data (SIGMOD '97). ACM. DOI:http:\/\/dx.doi.org\/10\/bbk4fr","journal-title":"Helen J. Wang."},{"key":"e_1_3_2_2_20_1","volume-title":"Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering (PloS one)","author":"Hullman Jessica","unstructured":"20 . Jessica Hullman , Paul Resnick , and Eytan Adar . 2015. Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering (PloS one) . Public Library of Science . DOI: http:\/\/dx.doi.org\/10\/f3tvsd 20. Jessica Hullman, Paul Resnick, and Eytan Adar. 2015. Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering (PloS one). Public Library of Science. DOI: http:\/\/dx.doi.org\/10\/f3tvsd"},{"key":"e_1_3_2_2_21_1","unstructured":"21\n  .  Susan Joslyn and Jared LeClerc. 2013. Decisions with uncertainty: the glass half full. (2013). DOI: http:\/\/dx.doi.org\/10\/f3tvrx  21. Susan Joslyn and Jared LeClerc. 2013. Decisions with uncertainty: the glass half full. (2013). DOI: http:\/\/dx.doi.org\/10\/f3tvrx"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816674"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.179"},{"key":"e_1_3_2_2_24_1","volume-title":"The effects of interactive latency on exploratory visual analysis","author":"Liu Zhicheng","unstructured":"24 . Zhicheng Liu and Jeffrey Heer . 2014. The effects of interactive latency on exploratory visual analysis . In IEEE transactions on visualization and computer graphics (INFOVIS '14). DOI:http:\/\/dx.doi.org\/10\/f3tvrw 24. Zhicheng Liu and Jeffrey Heer. 2014. The effects of interactive latency on exploratory visual analysis. In IEEE transactions on visualization and computer graphics (INFOVIS '14). DOI:http:\/\/dx.doi.org\/10\/f3tvrw"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12129"},{"key":"e_1_3_2_2_26_1","unstructured":"26\n  .  Jerzy Neyman. 1937. Outline of a theory of statistical estimation based on the classical theory of probability. (1937). DOI:http:\/\/dx.doi.org\/10\/b79jvq  26. Jerzy Neyman. 1937. Outline of a theory of statistical estimation based on the classical theory of probability. (1937). DOI:http:\/\/dx.doi.org\/10\/b79jvq"},{"key":"e_1_3_2_2_27_1","unstructured":"27\n  .  Jakob Nielsen. 1993. Response times: The 3 important limits. (1993).  27. Jakob Nielsen. 1993. Response times: The 3 important limits. (1993)."},{"key":"e_1_3_2_2_28_1","unstructured":"28\n  .  Chris North. 2006. Toward Measuring Visualization Insight. (2006). DOI:http:\/\/dx.doi.org\/10\/b2758v  28. Chris North. 2006. Toward Measuring Visualization Insight. (2006). DOI:http:\/\/dx.doi.org\/10\/b2758v"},{"key":"e_1_3_2_2_29_1","unstructured":"29\n  .  Bureau of Transportation Statistics. 2016. Airline Delays Cancellations and Tarmac Times. (2016). http:\/\/www.rita.dot.gov\/bts\/data_and_statistics\/by_ mode\/airline_and_airports\/airline_delay.html  29. Bureau of Transportation Statistics. 2016. Airline Delays Cancellations and Tarmac Times. (2016). http:\/\/www.rita.dot.gov\/bts\/data_and_statistics\/by_ mode\/airline_and_airports\/airline_delay.html"},{"key":"e_1_3_2_2_30_1","unstructured":"30\n  .  Frank Olken and Doron Rotem. 1986. Simple Random Sampling from Relational Databases (VLDB '86). http:\/\/dl.acm.org\/citation.cfm?id=645913.671474  30. Frank Olken and Doron Rotem. 1986. Simple Random Sampling from Relational Databases (VLDB '86). http:\/\/dl.acm.org\/citation.cfm?id=645913.671474"},{"key":"e_1_3_2_2_31_1","volume-title":"Proceedings of the IEEE Symposium on Information Visualization (INFOVIS '02)","author":"Olston Chris","unstructured":"31 . Chris Olston and Jock D. Mackinlay . 2002. Visualizing Data with Bounded Uncertainty . In Proceedings of the IEEE Symposium on Information Visualization (INFOVIS '02) . http:\/\/dl.acm.org\/citation.cfm?id=857191.857754 31. Chris Olston and Jock D. Mackinlay. 2002. Visualizing Data with Bounded Uncertainty. In Proceedings of the IEEE Symposium on Information Visualization (INFOVIS '02). http:\/\/dl.acm.org\/citation.cfm?id=857191.857754"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/LDAV.2015.7348077"},{"key":"e_1_3_2_2_33_1","volume-title":"Approximated and User Steerable tSNE for Progressive Visual Analytics","author":"Pezzotti Nicola","unstructured":"33 . Nicola Pezzotti , Boudewijn Lelieveldt , Laurens van der Maaten , Thomas Hollt , Elmar Eisemann , and Anna Vilanova . 2015. Approximated and User Steerable tSNE for Progressive Visual Analytics . In IEEE Transactions on Visualization and Computer Graphics (INFOVIS '16). IEEE. DOI :http:\/\/dx.doi.org\/10\/f3tvrt 33. Nicola Pezzotti, Boudewijn Lelieveldt, Laurens van der Maaten, Thomas Hollt, Elmar Eisemann, and Anna Vilanova. 2015. Approximated and User Steerable tSNE for Progressive Visual Analytics. In IEEE Transactions on Visualization and Computer Graphics (INFOVIS '16). IEEE. DOI:http:\/\/dx.doi.org\/10\/f3tvrt"},{"key":"e_1_3_2_2_34_1","volume-title":"Proceedings of international conference on intelligence analysis.","author":"Pirolli Peter","year":"2005","unstructured":"34 . Peter Pirolli and Stuart Card . 2005 . The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis . In Proceedings of international conference on intelligence analysis. 34. Peter Pirolli and Stuart Card. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of international conference on intelligence analysis."},{"key":"e_1_3_2_2_35_1","volume-title":"Jigsaw: Supporting Investigative Analysis Through Interactive Visualization.","author":"Stasko John","year":"2008","unstructured":"35 . John Stasko , Carsten G\u00f6rg , and Zhicheng Liu . 2008 . Jigsaw: Supporting Investigative Analysis Through Interactive Visualization. (2008). 35. John Stasko, Carsten G\u00f6rg, and Zhicheng Liu. 2008. Jigsaw: Supporting Investigative Analysis Through Interactive Visualization. (2008)."},{"key":"e_1_3_2_2_36_1","unstructured":"36\n  .  Charles D Stolper Adam Perer and David Gotz. 2014. Progressive visual analytics: User-driven visual exploration of in-progress analytics. (2014). DOI: http:\/\/dx.doi.org\/10\/f3tvrv  36. Charles D Stolper Adam Perer and David Gotz. 2014. Progressive visual analytics: User-driven visual exploration of in-progress analytics. (2014). DOI: http:\/\/dx.doi.org\/10\/f3tvrv"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.981851"},{"key":"e_1_3_2_2_38_1","unstructured":"38\n  .  John W Tukey. 1977. Exploratory data analysis. (1977).  38. John W Tukey. 1977. Exploratory data analysis. (1977)."},{"key":"e_1_3_2_2_39_1","volume-title":"Designing Progressive and Interactive Analytics Processes for High-Dimensional Data Analysis. In IEEE Transactions on Visualization and Computer Graphics (INFOVIS '16)","author":"Turkay Cagatay","year":"2017","unstructured":"39 . Cagatay Turkay , Erdem Kaya , Selim Balcisoy , and Helwig Hauser . 2017 . Designing Progressive and Interactive Analytics Processes for High-Dimensional Data Analysis. In IEEE Transactions on Visualization and Computer Graphics (INFOVIS '16) . IEEE. DOI: http:\/\/dx.doi.org\/10\/f3tvsc 39. Cagatay Turkay, Erdem Kaya, Selim Balcisoy, and Helwig Hauser. 2017. Designing Progressive and Interactive Analytics Processes for High-Dimensional Data Analysis. In IEEE Transactions on Visualization and Computer Graphics (INFOVIS '16). IEEE. DOI: http:\/\/dx.doi.org\/10\/f3tvsc"},{"key":"e_1_3_2_2_40_1","unstructured":"40\n  .  Hadley Wickham. 2013. Bin-summarise-smooth: a framework for visualising large data. (2013).  40. Hadley Wickham. 2013. Bin-summarise-smooth: a framework for visualising large data. (2013)."},{"key":"e_1_3_2_2_41_1","unstructured":"41\n  .  Hadley Wickham and Lisa Stryjewski. 2011. 40 years of boxplots. (2011).  41. Hadley Wickham and Lisa Stryjewski. 2011. 40 years of boxplots. (2011)."},{"key":"e_1_3_2_2_42_1","volume":"201","author":"Wongsuphasawat K.","unstructured":"42 . K. Wongsuphasawat , D. Moritz , A. Anand , J. Mackinlay , B. Howe , and J. Heer. 201 6. Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations. In IEEE Transactions on Visualization and Computer Graphics (INFOVIS '15). DOI:http:\/\/dx.doi.org\/10\/bdsz https:\/\/idl.cs.washington.edu\/papers\/voyager\/. 42. K. Wongsuphasawat, D. Moritz, A. Anand, J. Mackinlay, B. Howe, and J. Heer. 2016. Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations. In IEEE Transactions on Visualization and Computer Graphics (INFOVIS '15). DOI:http:\/\/dx.doi.org\/10\/bdsz https:\/\/idl.cs.washington.edu\/papers\/voyager\/.","journal-title":"J. Heer."},{"key":"e_1_3_2_2_43_1","volume-title":"Proceedings of the Workshop on BEyond Time and Errors: Novel evaLuation Methods for Information Visualization (BELIV '08)","author":"Yi Ji Soo","unstructured":"43 . Ji Soo Yi , Youn-ah Kang, John T. Stasko , and Julie A. Jacko . 2008. Understanding and Characterizing Insights: How Do People Gain Insights Using Information Visualization? . In Proceedings of the Workshop on BEyond Time and Errors: Novel evaLuation Methods for Information Visualization (BELIV '08) . ACM. DOI: http:\/\/dx.doi.org\/10\/c7m5hm 43. Ji Soo Yi, Youn-ah Kang, John T. Stasko, and Julie A. Jacko. 2008. Understanding and Characterizing Insights: How Do People Gain Insights Using Information Visualization?. In Proceedings of the Workshop on BEyond Time and Errors: Novel evaLuation Methods for Information Visualization (BELIV '08). ACM. DOI: http:\/\/dx.doi.org\/10\/c7m5hm"}],"event":{"name":"CHI '17: CHI Conference on Human Factors in Computing Systems","location":"Denver Colorado USA","acronym":"CHI '17","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3025453.3025456","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3025453.3025456","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:38:43Z","timestamp":1750207123000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3025453.3025456"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,2]]},"references-count":43,"alternative-id":["10.1145\/3025453.3025456","10.1145\/3025453"],"URL":"https:\/\/doi.org\/10.1145\/3025453.3025456","relation":{"has-preprint":[{"id-type":"doi","id":"10.31219\/osf.io\/tfwqj","asserted-by":"object"}]},"subject":[],"published":{"date-parts":[[2017,5,2]]},"assertion":[{"value":"2017-05-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}