{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T03:05:15Z","timestamp":1740107115126,"version":"3.37.3"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T00:00:00Z","timestamp":1717718400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T00:00:00Z","timestamp":1717718400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008678","name":"Universit\u00e4t Leipzig","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008678","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Visual analytics (VA) is a paradigm for insight generation by using visual analysis techniques and automated reasoning by transforming data into hypotheses and visualization to extract new insights. The insights are fed back into the data to enhance it until the desired insight is found. Many applications use this principle to provide meaningful mechanisms to assist decision-makers in achieving their goals. This process can be affected by various uncertainties that can interfere with the user decision-making process. Currently, there are no methodical description and handling tool to include uncertainty in VA systematically. We provide a unified workflow to transform the classic VA cycle into an <jats:italic>uncertainty-aware visual analytics (UAVA)<\/jats:italic> cycle consisting of five steps. To prove its usability, three real-world applications represent examples of the UAVA cycle implementation and the described workflow.<\/jats:p>","DOI":"10.1007\/s00371-024-03435-x","type":"journal-article","created":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T07:02:06Z","timestamp":1717743726000},"page":"1485-1498","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A workflow to systematically design uncertainty-aware visual analytics applications"],"prefix":"10.1007","volume":"41","author":[{"given":"Robin G. C.","family":"Maack","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Felix","family":"Raith","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan F.","family":"P\u00e9rez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerik","family":"Scheuermann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9087-205X","authenticated-orcid":false,"given":"Christina","family":"Gillmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,6,7]]},"reference":[{"key":"3435_CR1","doi-asserted-by":"crossref","unstructured":"Cui,W.: Visual analytics: A comprehensive overview, IEEE Access (2019)","DOI":"10.1109\/ACCESS.2019.2923736"},{"key":"3435_CR2","doi-asserted-by":"crossref","unstructured":"Keim,D.A., Mansmann,F., Schneidewind,J., Thomas,J., Ziegler,H.: Visual analytics: scope and challenges. In: Visual data mining (2008)","DOI":"10.1007\/978-0-387-39940-9_1122"},{"key":"3435_CR3","doi-asserted-by":"crossref","unstructured":"Kohlhammer, J., May, T., Hoffmann, M.: Visual analytics for the strategic decision making process. In: GeoSpatial Visual Analytics (2009)","DOI":"10.1007\/978-90-481-2899-0_23"},{"key":"3435_CR4","unstructured":"Griethe, H., Schumann, H. et\u00a0al.: The visualization of uncertain data: methods and problems. In: SimVis (2006)"},{"key":"3435_CR5","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-022-02733-6","author":"RGC Maack","year":"2022","unstructured":"Maack, R.G.C., Scheuermann, G., Hernandez, J., Gillmann, C.: Uncertainty-aware visual analytics: scope, opportunities, and challenges. Vis. Comput. (2022). https:\/\/doi.org\/10.1007\/s00371-022-02733-6","journal-title":"Vis. Comput."},{"key":"3435_CR6","doi-asserted-by":"crossref","unstructured":"Keim, D., Zhang, L.: Solving problems with visual analytics: challenges and applications. In: Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies (2011)","DOI":"10.1145\/2024288.2024290"},{"key":"3435_CR7","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/MCG.2023.3299297","volume":"43","author":"C Gillmann","year":"2023","unstructured":"Gillmann, C., Maack, R.G.C., Raith, F., P\u00e9rez, J.F., Scheuermann, G.: A taxonomy of uncertainty events in visual analytics. IEEE Comput. Gr. Appl. 43, 62 (2023)","journal-title":"IEEE Comput. Gr. Appl."},{"key":"3435_CR8","unstructured":"Bors, C., Bernard, J., B\u00f6gl, M., Gschwandtner, T., Kohlhammer, J., Miksch, S.: Quantifying uncertainty in multivariate time series pre-processing. In: EuroVis Workshop on Visual Analytics (2019)"},{"key":"3435_CR9","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1109\/TVCG.2019.2934812","volume":"26","author":"J G\u00f6rtler","year":"2020","unstructured":"G\u00f6rtler, J., Spinner, T., Streeb, D., Weiskopf, D., Deussen, O.: Uncertainty-aware principal component analysis. IEEE Trans. Vis. Comput. Gr. 26, 822 (2020)","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"3435_CR10","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1109\/TVCG.2019.2934242","volume":"26","author":"L Yan","year":"2019","unstructured":"Yan, L., Wang, Y., Munch, E., Gasparovic, E., Wang, B.: A structural average of labeled merge trees for uncertainty visualization. IEEE Trans. Vis. Comput. Gr. 26, 832 (2019)","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"3435_CR11","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1111\/cgf.13692","volume":"38","author":"T Gerrits","year":"2019","unstructured":"Gerrits, T., R\u00f6ssl, C., Theisel, H.: Towards glyphs for uncertain symmetric second-order tensors. Comput. Gra. Forum. 38, 325 (2019)","journal-title":"Comput. Gra. Forum."},{"key":"3435_CR12","doi-asserted-by":"crossref","unstructured":"Gillmann, C., Maack, R.G.C., Post, T., Wischgoll, T., Hagen, H.: An uncertainty-aware workflow for keyhole surgery planning using hierarchical image semantics. In: Proceedings of PacificVAST 2018 (2018)","DOI":"10.1016\/j.visinf.2018.04.004"},{"key":"3435_CR13","doi-asserted-by":"publisher","first-page":"2576","DOI":"10.1109\/TVCG.2019.2892483","volume":"26","author":"Z Huang","year":"2019","unstructured":"Huang, Z., Lu, Y., Mack, E., Chen, W., Maciejewski, R.: Exploring the sensitivity of choropleths under attribute uncertainty. IEEE Trans. Vis. Comput. Gr. 26, 2576 (2019)","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"3435_CR14","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1109\/MCG.2019.2918158","volume":"39","author":"A Preston","year":"2019","unstructured":"Preston, A., Gomov, M., Ma, K.: Uncertainty-aware visualization for analyzing heterogeneous wildfire detections. IEEE Comput. Gr. Appl. 39, 72 (2019)","journal-title":"IEEE Comput. Gr. Appl."},{"key":"3435_CR15","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1109\/TVCG.2015.2467591","volume":"22","author":"D Sacha","year":"2016","unstructured":"Sacha, D., Senaratne, H., Kwon, B.C., Ellis, G., Keim, D.A.: The role of uncertainty, awareness, and trust in visual analytics. IEEE Trans. Vis. Comput. Gr. 22, 240 (2016)","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"3435_CR16","doi-asserted-by":"crossref","unstructured":"Correa, C.D., Chan, Y., Ma, K.: A framework for uncertainty-aware visual analytics. In: 2009 IEEE Symposium on Visual Analytics Science and Technology (2009)","DOI":"10.1109\/VAST.2009.5332611"},{"key":"3435_CR17","unstructured":"Karami, A.: A framework for uncertainty-aware visual analytics in big data. In: CEUR Workshop Proceedings (2015)"},{"key":"3435_CR18","unstructured":"Senaratne, H.V.: Uncertainty-aware visual analytics for spatio-temporal data exploration, Ph.D. thesis, Universit\u00e4t Konstanz (2017)"},{"key":"3435_CR19","doi-asserted-by":"publisher","first-page":"2853","DOI":"10.1109\/TVCG.2018.2853721","volume":"25","author":"J Wang","year":"2018","unstructured":"Wang, J., Hazarika, S., Li, C., Shen, H.-W.: Visualization and visual analysis of ensemble data: a survey. IEEE Trans. Vis. Comput. Gr. 25, 2853 (2018)","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"3435_CR20","first-page":"191","volume":"2","author":"S Liu","year":"2018","unstructured":"Liu, S., Andrienko, G., Wu, Y., Cao, N., Jiang, L., Shi, C., Wang, Y.-S., Hong, S.: Steering data quality with visual analytics: the complexity challenge. Vis. Inf. 2, 191 (2018)","journal-title":"Vis. Inf."},{"issue":"4\u20135","key":"3435_CR21","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1515\/itit-2022-0033","volume":"64","author":"D H\u00e4gele","year":"2022","unstructured":"H\u00e4gele, D., Schulz, C., Beschle, C., Booth, H., Butt, M., Barth, A., Deussen, O., Weiskopf, D.: Uncertainty visualization: fundamentals and recent developments. it Inf. Technol. 64(4\u20135), 121\u2013132 (2022). https:\/\/doi.org\/10.1515\/itit-2022-0033","journal-title":"it Inf. Technol."},{"key":"3435_CR22","volume-title":"Computational Statistics in Data Science","author":"L Padilla","year":"2022","unstructured":"Padilla, L., Kay, M., Hullman, J.: Uncertainty visualization. In: Piegorsch, W.W., Levine, R.A., Zhang, H.H., Lee, T.C.M. (eds.) Computational Statistics in Data Science. Wiley, Oxford (2022)"},{"issue":"3","key":"3435_CR23","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1177\/0272989X9601600312","volume":"16","author":"G Gigerenzer","year":"1996","unstructured":"Gigerenzer, G.: The psychology of good judgment: frequency formats and simple algorithms. Med. Decis. Mak. 16(3), 273\u2013280 (1996). https:\/\/doi.org\/10.1177\/0272989X9601600312","journal-title":"Med. Decis. Mak."},{"key":"3435_CR24","volume-title":"Heuristics & Biases: The Psychology of Intuitive Judgment","author":"D Kahneman","year":"2002","unstructured":"Kahneman, D., Frederick, S.: Representativeness revisited: attribute substitution in intuitive judgment. In: Gilovich, T., Griffin, D., Kahneman, D. (eds.) Heuristics & Biases: The Psychology of Intuitive Judgment. Cambridge University Press, New York (2002)"},{"key":"3435_CR25","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1186\/s41235-018-0120-9","volume":"3","author":"LM Padilla","year":"2018","unstructured":"Padilla, L.M., Creem-Regehr, S.H., Hegarty, M., Stefanucci, J.K.: Decision making with visualizations: a cognitive framework across disciplines. Cogn. Res. Princip. Impl. 3, 29 (2018). https:\/\/doi.org\/10.1186\/s41235-018-0120-9","journal-title":"Cogn. Res. Princip. Impl."},{"issue":"12","key":"3435_CR26","doi-asserted-by":"publisher","first-page":"2496","DOI":"10.1109\/TVCG.2012.279","volume":"18","author":"AM MacEachren","year":"2012","unstructured":"MacEachren, A.M., Roth, R.E., O\u2019Brien, J., Li, B., Swingley, D., Gahegan, M.: Visual semiotics & uncertainty visualization: an empirical study. IEEE Trans. Vis. Comput. Gr. 18(12), 2496\u20132505 (2012). https:\/\/doi.org\/10.1109\/TVCG.2012.279","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"issue":"4","key":"3435_CR27","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1109\/MCG.2023.3267213","volume":"43","author":"M Gleicher","year":"2023","unstructured":"Gleicher, M., Riveiro, M., von Landesberger, T., Deussen, O., Chang, R., Gillman, C.: A problem space for designing visualizations. IEEE Comput. Gr. Appl. 43(4), 111\u2013120 (2023)","journal-title":"IEEE Comput. Gr. Appl."},{"key":"3435_CR28","doi-asserted-by":"crossref","unstructured":"Booth, P., Gibbins, N., Galanis, S.: Design spaces in visual analytics based on goals: analytical behaviour, exploratory investigation, information design & perceptual tasks. In: Hawaii International Conference on System Sciences (2019)","DOI":"10.24251\/HICSS.2019.193"},{"key":"3435_CR29","doi-asserted-by":"publisher","unstructured":"Conlen, M., Stalla, S., Jin, C., Hendrie, M., Mushkin, H., Lombeyda, S., Davidoff, S.: Towards design principles for visual analytics in operations contexts. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI \u201918, Association for Computing Machinery, New York, NY, USA, 2018, 1\u20137. https:\/\/doi.org\/10.1145\/3173574.3173712","DOI":"10.1145\/3173574.3173712"},{"key":"3435_CR30","doi-asserted-by":"publisher","unstructured":"Federico, P., Amor-Amor\u00f3s, A., Miksch, S.: A nested workflow model for visual analytics design and validation. In: Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization, BELIV \u201916, Association for Computing Machinery, New York, NY, USA, 2016, p. 104-111. https:\/\/doi.org\/10.1145\/2993901.2993915","DOI":"10.1145\/2993901.2993915"},{"key":"3435_CR31","doi-asserted-by":"crossref","unstructured":"Wang, X., Butkiewicez, T., Dou, W., Bier, E.A., Ribarsky, W.: Designing knowledge-assisted visual analytics systems for organizational environments (2011)","DOI":"10.1145\/2016656.2016657"},{"key":"3435_CR32","doi-asserted-by":"publisher","first-page":"1397","DOI":"10.1007\/s00607-018-0679-5","volume":"101","author":"S Cai","year":"2018","unstructured":"Cai, S., Gallina, B., Nystr\u00f6m, D., Seceleanu, C.: Data aggregation processes: a survey, a taxonomy, and design guidelines. Computing 101, 1397 (2018)","journal-title":"Computing"},{"key":"3435_CR33","unstructured":"Ghilani, C.: Statistics and adjustments explained part 3: Error propagation, Lecture Notes (2004)"},{"key":"3435_CR34","doi-asserted-by":"crossref","unstructured":"Varga, M., Varga, C.: Visual analytics: data, analytical and reasoning provenance. In: Building Trust in Information (2016)","DOI":"10.1007\/978-3-319-40226-0_9"},{"key":"3435_CR35","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1007\/s00778-017-0486-1","volume":"26","author":"M Herschel","year":"2017","unstructured":"Herschel, M., Diestelk\u00e4mper, R., Ben Lahmar, H.: A survey on provenance: What for? what form? what from? VLDB J. 26, 881 (2017)","journal-title":"VLDB J."},{"key":"3435_CR36","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/TVCG.2015.2467551","volume":"22","author":"ED Ragan","year":"2015","unstructured":"Ragan, E.D., Endert, A., Sanyal, J., Chen, J.: Characterizing provenance in visualization and data analysis: an organizational framework of provenance types and purposes. IEEE Trans. Vis. Comput. Gr. 22, 31 (2015)","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"3435_CR37","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1111\/cgf.14035","volume":"39","author":"K Xu","year":"2020","unstructured":"Xu, K., Ottley, A., Walchshofer, C., Streit, M., Chang, R., Wenskovitch, J.: Survey on the analysis of user interactions and visualization provenance. Comput. Gr. Forum 39, 757 (2020)","journal-title":"Comput. Gr. Forum"},{"key":"3435_CR38","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1016\/j.cag.2021.05.011","volume":"98","author":"RGC Maack","year":"2021","unstructured":"Maack, R.G.C., Raymer, M.L., Wischgoll, T., Hagen, H., Gillmann, C.: A framework for uncertainty-aware visual analytics of proteins. Comput. Graph. 98, 293 (2021)","journal-title":"Comput. Graph."},{"issue":"1","key":"3435_CR39","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1002\/pro.3943","volume":"30","author":"EF Pettersen","year":"2021","unstructured":"Pettersen, E.F., Goddard, T.D., Huang, C.C., Meng, E.C., Couch, G.S., Croll, T.I., Morris, J.H., Ferrin, T.E., ChimeraX, U.C.S.F.: Structure visualization for researchers, educators, and developers. Protein Sci. 30(1), 70\u201382 (2021). https:\/\/doi.org\/10.1002\/pro.3943","journal-title":"Protein Sci."},{"issue":"1","key":"3435_CR40","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1186\/1471-2105-8-316","volume":"8","author":"A Porollo","year":"2007","unstructured":"Porollo, A., Meller, J.: Versatile annotation and publication quality visualization of protein complexes using POLYVIEW-3D. BMC Bioinf. 8(1), 316 (2007). https:\/\/doi.org\/10.1186\/1471-2105-8-316","journal-title":"BMC Bioinf."},{"key":"3435_CR41","unstructured":"Piotr,R.: iMol Overview (2007). https:\/\/www.pirx.com\/iMol\/overview.shtml"},{"key":"3435_CR42","doi-asserted-by":"publisher","DOI":"10.1109\/tvcg.2019.2934812","author":"J Gortler","year":"2020","unstructured":"Gortler, J., Spinner, T., Streeb, D., Weiskopf, D., Deussen, O.: Uncertainty-aware principal component analysis. IEEE Trans. Vis. Comput. Gr. (2020). https:\/\/doi.org\/10.1109\/tvcg.2019.2934812","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"issue":"5","key":"3435_CR43","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCG.2021.3099881","volume":"41","author":"C Gillmann","year":"2021","unstructured":"Gillmann, C., Peter, L., Schmidt, C., Saur, D., Scheuermann, G.: Visualizing multimodal deep learning for lesion prediction. IEEE Comput. Gr. Appl. 41(5), 90\u201398 (2021). https:\/\/doi.org\/10.1109\/MCG.2021.3099881","journal-title":"IEEE Comput. Gr. Appl."},{"key":"3435_CR44","doi-asserted-by":"crossref","unstructured":"Welle, F., Stoll, K., Gillmann, C., Henkelmann, J., Prasse, G., Kaiser, D.P., Kellner, E., Reisert, M., Schneider, H.R., Klingbeil, J. et\u00a0al.: Tissue outcome prediction in patients with proximal vessel occlusion and mechanical thrombectomy using logistic models, Transl. Stroke Res. pp. 1\u201311 (2023)","DOI":"10.1007\/s12975-023-01160-6"},{"key":"3435_CR45","doi-asserted-by":"crossref","unstructured":"Sperling, L., L\u00e4mmer, S., Hagen, H., Scheuermann, G., Gillmann, C.: Uncertainty-aware evaluation of machine learning performance in binary classification tasks (2022)","DOI":"10.24132\/JWSCG.2022.8"}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03435-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00371-024-03435-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03435-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T14:54:48Z","timestamp":1739372088000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00371-024-03435-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,7]]},"references-count":45,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["3435"],"URL":"https:\/\/doi.org\/10.1007\/s00371-024-03435-x","relation":{},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"type":"print","value":"0178-2789"},{"type":"electronic","value":"1432-2315"}],"subject":[],"published":{"date-parts":[[2024,6,7]]},"assertion":[{"value":"8 April 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 June 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest to declare.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}