{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T22:06:06Z","timestamp":1780524366441,"version":"3.54.1"},"reference-count":57,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2018,7,3]],"date-time":"2018-07-03T00:00:00Z","timestamp":1530576000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Progressive Visual Analytics (PVA) has gained increasing attention over the past years. It brings the user into the loop during otherwise long-running and non-transparent computations by producing intermediate partial results. These partial results can be shown to the user for early and continuous interaction with the emerging end result even while it is still being computed. Yet as clear-cut as this fundamental idea seems, the existing body of literature puts forth various interpretations and instantiations that have created a research domain of competing terms, various definitions, as well as long lists of practical requirements and design guidelines spread across different scientific communities. This makes it more and more difficult to get a succinct understanding of PVA\u2019s principal concepts, let alone an overview of this increasingly diverging field. The review and discussion of PVA presented in this paper address these issues and provide (1) a literature collection on this topic, (2) a conceptual characterization of PVA, as well as (3) a consolidated set of practical recommendations for implementing and using PVA-based visual analytics solutions.<\/jats:p>","DOI":"10.3390\/informatics5030031","type":"journal-article","created":{"date-parts":[[2018,7,3]],"date-time":"2018-07-03T11:12:58Z","timestamp":1530616378000},"page":"31","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":54,"title":["A Review and Characterization of Progressive Visual Analytics"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9051-6972","authenticated-orcid":false,"given":"Marco","family":"Angelini","sequence":"first","affiliation":[{"name":"Sapienza University of Rome, 00185 Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4350-1123","authenticated-orcid":false,"given":"Giuseppe","family":"Santucci","sequence":"additional","affiliation":[{"name":"Sapienza University of Rome, 00185 Rome, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heidrun","family":"Schumann","sequence":"additional","affiliation":[{"name":"University of Rostock, 18059 Rostock, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9974-535X","authenticated-orcid":false,"given":"Hans-J\u00f6rg","family":"Schulz","sequence":"additional","affiliation":[{"name":"Aarhus University, 8000 Aarhus Aarhus, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,7,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1109\/TVCG.2014.2346574","article-title":"Progressive visual analytics: User-driven visual exploration of in-progress analytics","volume":"20","author":"Stolper","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_2","unstructured":"Fekete, J.D., and Primet, R. (arXiv, 2016). Progressive Analytics: A Computation Paradigm for Exploratory Data Analysis, arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1830","DOI":"10.1109\/TVCG.2015.2462356","article-title":"An Enhanced Visualization Process Model for Incremental Visualization","volume":"22","author":"Schulz","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_4","unstructured":"Schmidt, A., and Grossman, T. (May, January 26). Dive in! Enabling progressive loading for real-time navigation of data visualizations. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), Toronto, ON, Canada."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.1109\/TVCG.2014.2346578","article-title":"Opening the black box: Strategies for increased user involvement in existing algorithm implementations","volume":"20","author":"Piringer","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_6","unstructured":"B\u00f6rner, K., and Park, J. (2009, January 18\u201322). Progressive refinement: more than a means to overcome limited bandwidth. Proceedings of the Conference on Visualization and Data Analysis (VDA), San Jose, CA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/TVCG.2016.2598470","article-title":"Designing Progressive and Interactive Analytics Processes for High-Dimensional Data Analysis","volume":"23","author":"Turkay","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_8","unstructured":"Konstan, J.A., Chi, E.H., and H\u00f6\u00f6k, K. (2012, January 5\u201310). Trust Me, I\u2019m Partially Right: Incremental Visualization Lets Analysts Explore Large Datasets Faster. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), Austin, TX, USA."},{"key":"ref_9","unstructured":"Nielson, G.M., and Bergeron, D. (1993, January 25\u201329). Fine-grain visualization algorithms in dataflow environments. Proceedings of the IEEE Conference on Visualization (VIS), San Jose, CA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1109\/2.781635","article-title":"Interactive Data Analysis: The Control Project","volume":"32","author":"Hellerstein","year":"1999","journal-title":"IEEE Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2397","DOI":"10.1109\/TVCG.2014.2346319","article-title":"Interactive Progressive Visualization with Space-Time Error Control","volume":"20","author":"Frey","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_12","unstructured":"Singh, S., and Markovitch, S. (2017, January 1\u20139). PIVE: Per-Iteration Visualization Environment for Real-time Interactions with Dimension Reduction and Clustering. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA."},{"key":"ref_13","unstructured":"Lampe, C., Schraefel, M.C., Hourcade, J.P., Appert, C., and Wigdor, D. (2017, January 6\u201311). Trust, but Verify: Optimistic Visualizations of Approximate Queries for Exploring Big Data. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), Denver, CO, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/MCG.2017.6","article-title":"Sampling for Scalable Visual Analytics","volume":"37","author":"Kwon","year":"2017","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1977","DOI":"10.1109\/TVCG.2016.2607714","article-title":"How Progressive Visualizations Affect Exploratory Analysis","volume":"23","author":"Zgraggen","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2456","DOI":"10.1109\/TVCG.2013.179","article-title":"Nanocubes for Real-Time Exploration of Spatiotemporal Datasets","volume":"19","author":"Lins","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_17","unstructured":"Wohlgemuth, V. (2008, January 25\u201326). Visualization of Biosphere Changes in the Context of Climate Change. Proceedings of the International Conference on IT and Climate Change (ITCC), Berlin, Germany."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1604","DOI":"10.1109\/TVCG.2014.2346481","article-title":"Knowledge Generation Model for Visual Analytics","volume":"20","author":"Sacha","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1111\/cgf.13205","article-title":"Steering the Craft: UI Elements and Visualizations for Supporting Progressive Visual Analytics","volume":"36","author":"Badam","year":"2017","journal-title":"Comput. Graph. Forum"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1109\/TVCG.2017.2744459","article-title":"Activity-Centered Domain Characterization for Problem-Driven Scientific Visualization","volume":"24","author":"Marai","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1109\/TVCG.2005.63","article-title":"Knowledge Precepts for Design and Evaluation of Information Visualizations","volume":"11","author":"Amar","year":"2005","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_22","unstructured":"Fink, A. (2014). Conducting Research Literature Reviews: From the Internet to Paper, SAGE Publishing. [4th ed.]."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1145\/253262.253291","article-title":"Online Aggregation","volume":"26","author":"Hellerstein","year":"1997","journal-title":"SIGMOD Record"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1448","DOI":"10.1109\/TKDE.2011.77","article-title":"Efficient and Progressive Algorithms for Distributed Skyline Queries over Uncertain Data","volume":"24","author":"Ding","year":"2012","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1726","DOI":"10.14778\/2556549.2556557","article-title":"Scalable Progressive Analytics on Big Data in the Cloud","volume":"6","author":"Chandramouli","year":"2013","journal-title":"Proc. VLDB Endow."},{"key":"ref_26","unstructured":"Hu, X., Lin, T.Y., Raghavan, V., Wah, B., Baeza-Yates, R., Fox, G., Shahabi, C., Smith, M., Yang, Q., and Ghani, R. (2013, January 6\u20139). VisReduce: Fast and responsive incremental information visualization of large datasets. Proceedings of the IEEE International Conference on Big Data (BigData), Silicon Valley, CA, USA."},{"key":"ref_27","unstructured":"Procopio, M., Scheidegger, C., Wu, E., and Chang, R. (2017, January 1\u20132). Load-n-Go: Fast Approximate Join Visualizations That Improve Over Time. Proceedings of the Workshop on Data Systems for Interactive Analysis (DSIA), Phoenix, AZ, USA."},{"key":"ref_28","unstructured":"Stasko, J., and Ward, M.O. (2005, January 23\u201325). Turning the bucket of text into a pipe. Proceedings of the IEEE Symposium on Information Visualization (InfoVis), Minneapolis, MN, USA."},{"key":"ref_29","unstructured":"Munzner, T., and North, S. (2003, January 20\u201321). Dynamic visualization of transient data streams. Proceedings of the IEEE Symposium on Information Visualization (InfoVis), Seattle, WA, USA."},{"key":"ref_30","unstructured":"Younas, M., Awan, I., and Haddad, J.E. (2016, January 22\u201324). An Incremental Approach for Real-Time Big Data Visual Analytics. Proceedings of the IEEE International Conference on Future Internet of Things and Cloud Workshops (FiCloudW), Vienna, Austria."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/MIC.2017.2911428","article-title":"Rethinking Visual Analytics for Streaming Data Applications","volume":"21","author":"Crouser","year":"2017","journal-title":"IEEE Int. Comput."},{"key":"ref_32","unstructured":"Andrienko, N., and Sedlmair, M. (2016, January 6\u20137). A Visual Analytics System for Mobile Telecommunication Marketing Analysis. Proceedings of the International EuroVis Workshop on Visual Analytics (EuroVA), Groningen, The Netherlands."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1177\/1473871611413180","article-title":"Fluid interaction for information visualization","volume":"10","author":"Elmqvist","year":"2011","journal-title":"Inform. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1145\/2514.2517","article-title":"Response time and display rate in human performance with computers","volume":"16","author":"Shneiderman","year":"1984","journal-title":"ACM Comput. Surv."},{"key":"ref_35","unstructured":"Robertson, S.P., Olson, G.M., and Olson, J.S. (May, January 27). The information visualizer, an information workspace. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), New Orleans, LA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2122","DOI":"10.1109\/TVCG.2014.2346452","article-title":"The Effects of Interactive Latency on Exploratory Visual Analysis","volume":"20","author":"Liu","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_37","unstructured":"Kaufmann, M., and Wagner, D. (2007). Controllable and Progressive Edge Clustering for Large Networks. Graph Drawing. GD 2006. Lecture Notes in Computer Science, Springer."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Chang, R., Scheidegger, C., Fisher, D., and Heer, J. (2017, January 1\u20132). A Progressive k-d tree for Approximate k-Nearest Neighbors. Proceedings of the Workshop on Data Systems for Interactive Analysis (DSIA), Phoenix, AZ, USA.","DOI":"10.1109\/DSIA.2017.8339084"},{"key":"ref_39","unstructured":"Binnig, C., Fekete, A., and Nandi, A. (July, January 26). Big Data Exploration Requires Collaboration Between Visualization and Data Infrastructures. Proceedings of the Workshop on Human-In-the-Loop Data Analytics (HILDA), San Francisco, CA, USA."},{"key":"ref_40","unstructured":"Binnig, C., Fekete, A., and Nandi, A. (July, January 26). The Case for Interactive Data Exploration Accelerators (IDEAs). Proceedings of the Workshop on Human-In-the-Loop Data Analytics (HILDA), San Francisco, CA, USA."},{"key":"ref_41","unstructured":"Linsen, L., Telea, A., and Braz, J. (March, January 27). On Visual Stability and Visual Consistency for Progressive Visual Analytics. Proceedings of the International Conference on Information Visualization Theory and Applications (IVAPP), Porto, Portugal."},{"key":"ref_42","unstructured":"Schmidt, A., and Grossman, T. (May, January 27). Sample-oriented task-driven visualizations: Allowing users to make better, more confident decisions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), Paris, France."},{"key":"ref_43","unstructured":"Pohl, M., and Schumann, H. (2013, January 17\u201318). Modeling Incremental Visualizations. Proceedings of the International EuroVis Workshop on Visual Analytics (EuroVA), Leipzig, Germany."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1109\/TVCG.2008.11","article-title":"Online Dynamic Graph Drawing","volume":"14","author":"Frishman","year":"2008","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_45","unstructured":"Wu, Y., Xu, L., Chang, R., Hellerstein, J.M., and Wu, E. (arXiv, 2018). Making Sense of Asynchrony in Interactive Data Visualizations, arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.14778\/3137628.3137637","article-title":"I\u2019ve Seen \u201cEnough\u201d: Incrementally Improving Visualizations to Support Rapid Decision Making","volume":"10","author":"Rahman","year":"2017","journal-title":"Proc. VLDB Endow."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1126\/science.220.4598.671","article-title":"Optimization by Simulated Annealing","volume":"220","author":"Kirkpatrick","year":"1983","journal-title":"Science"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Tamassia, R. (2013). Force-Directed Drawing Algorithms. Handbook of Graph Drawing and Visualization, CRC Press. Chapter 12.","DOI":"10.1201\/b15385"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/TVCG.2017.2744358","article-title":"DeepEyes: Progressive Visual Analytics for Designing Deep Neural Networks","volume":"24","author":"Pezzotti","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.jvlc.2017.05.004","article-title":"Pattern Discovery: A Progressive Visual Analytic Design to Support Categorical Data Analysis","volume":"43","author":"Zhao","year":"2017","journal-title":"J. Vis. Lang. Comput."},{"key":"ref_51","unstructured":"Lampe, C., Schraefel, M.C., Hourcade, J.P., Appert, C., and Wigdor, D. (2017, January 6\u201311). How Data Workers Cope with Uncertainty: A Task Characterisation Study. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), Denver, CO, USA."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1243\/0954406041319509","article-title":"An Incremental k-means Algorithm","volume":"218","author":"Pham","year":"2004","journal-title":"Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci."},{"key":"ref_53","unstructured":"Ward, M.O., and Munzner, T. (2004, January 10\u201312). Steerable, Progressive Multidimensional Scaling. Proceedings of the IEEE Symposium on Information Visualization (InfoVis), Austin, TX, USA."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1739","DOI":"10.1109\/TVCG.2016.2570755","article-title":"Approximated and user steerable tSNE for progressive visual analytics","volume":"23","author":"Pezzotti","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Bebis, G., Boyle, R., Parvin, B., Koracin, D., Kuno, Y., Wang, J., Pajarola, R., Lindstrom, P., Hinkenjann, A., and Encarna\u00e7\u00e3o, M.L. (2009). Progressive Presentation of Large Hierarchies Using Treemaps. Advances in Visual Computing, Springer. Number 5876 in Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-642-10520-3"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1111\/j.1467-8659.2011.01914.x","article-title":"Progressive Splatting of Continuous Scatterplots and Parallel Coordinates","volume":"30","author":"Heinrich","year":"2011","journal-title":"Comput. Graph. Forum"},{"key":"ref_57","unstructured":"Hauser, H., Kobourov, S., and Qu, H. (March, January 28). Progressive parallel coordinates. Proceedings of the IEEE Pacific Visualization Symposium (PacificVis), Songdo, Korea."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/3\/31\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:11:07Z","timestamp":1760195467000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/3\/31"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,3]]},"references-count":57,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["informatics5030031"],"URL":"https:\/\/doi.org\/10.3390\/informatics5030031","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,3]]}}}