{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T14:31:10Z","timestamp":1768314670473,"version":"3.49.0"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>Data visualization (DataViz) libraries play a crucial role in presentation, data analysis, and application development, underscoring the importance of their accuracy in transforming data into visual representations. Incorrect visualizations can adversely impact user experience, distort information conveyance, and influence user perception and decision-making processes. Visual bugs in these libraries can be particularly insidious as they may not cause obvious errors like crashes, but instead mislead users of the underlying data graphically, resulting in wrong decision making. Consequently, a good understanding of the unique characteristics of bugs in DataViz libraries is essential for researchers and developers to detect and fix bugs in DataViz libraries.<\/jats:p>\n          <jats:p>This study presents the first comprehensive analysis of bugs in DataViz libraries, examining 564 bugs collected from five widely-used libraries. Our study systematically analyzes their symptoms and root causes, and provides a detailed taxonomy. We found that incorrect\/inaccurate plots are pervasive in DataViz libraries and incorrect graphic computation is the major root cause, which necessitates further automated testing methods for DataViz libraries. Moreover, we identified eight key steps to trigger such bugs and two test oracles specific to DataViz libraries, which may inspire future research in designing effective automated testing techniques. Furthermore, with the recent advancements in Vision Language Models (VLMs), we explored the feasibility of applying these models to detect incorrect\/inaccurate plots. The results show that the effectiveness of VLMs in bug detection varies from 29% to 57%, depending on the prompts, and adding more information in prompts does not necessarily increase the effectiveness. Our findings offer valuable insights into the nature and patterns of bugs in DataViz libraries, providing a foundation for developers and researchers to improve library reliability, and ultimately benefit more accurate and reliable data visualizations across various domains.<\/jats:p>","DOI":"10.1145\/3729363","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:15:34Z","timestamp":1750346134000},"page":"2075-2098","source":"Crossref","is-referenced-by-count":1,"title":["An Empirical Study of Bugs in Data Visualization Libraries"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-3454-8464","authenticated-orcid":false,"given":"Weiqi","family":"Lu","sequence":"first","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1644-2965","authenticated-orcid":false,"given":"Yongqiang","family":"Tian","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8018-9391","authenticated-orcid":false,"given":"Xiaohan","family":"Zhong","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7411-9288","authenticated-orcid":false,"given":"Haoyang","family":"Ma","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9451-4031","authenticated-orcid":false,"given":"Zhenyang","family":"Xu","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3508-7172","authenticated-orcid":false,"given":"Shing-Chi","family":"Cheung","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0862-2491","authenticated-orcid":false,"given":"Chengnian","family":"Sun","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n. d.]. Anti-Grain Geometry Library \/ SVN \/ [r141] \/agg-2.4 \u2014 sourceforge.net. https:\/\/sourceforge.net\/p\/agg\/svn\/HEAD\/tree\/agg-2.4\/ [Accessed 01-09-2024]"},{"key":"e_1_2_1_2_1","unstructured":"[n. d.]. Chart.js Samples | Chart.js \u2014 chartjs.org. https:\/\/www.chartjs.org\/docs\/latest\/samples\/information.html [Accessed 17-02-2025]"},{"key":"e_1_2_1_3_1","volume-title":"d.]. Examples","year":"2025","unstructured":"[n. d.]. Examples; Matplotlib 3.10.0 documentation \u2014 matplotlib.org. https:\/\/matplotlib.org\/stable\/gallery\/index.html [Accessed 17-02-2025]"},{"key":"e_1_2_1_4_1","unstructured":"[n. d.]. Find and fix problems in your JavaScript code - ESLint - Pluggable JavaScript Linter \u2014 eslint.org. https:\/\/eslint.org\/ [Accessed 24-02-2025]"},{"key":"e_1_2_1_5_1","unstructured":"[n. d.]. Function reference \u2014 ggplot2.tidyverse.org. https:\/\/ggplot2.tidyverse.org\/reference\/index.html [Accessed 17-02-2025]"},{"key":"e_1_2_1_6_1","unstructured":"[n. d.]. GitHub - hal9ai\/awesome-dataviz: :chart_with_upwards_trend: A curated list of awesome data visualization libraries and resources. \u2014 github.com. https:\/\/github.com\/hal9ai\/awesome-dataviz [Accessed 18-08-2024]"},{"key":"e_1_2_1_7_1","unstructured":"[n. d.]. grid package - RDocumentation \u2014 rdocumentation.org. https:\/\/www.rdocumentation.org\/packages\/grid\/versions\/3.6.2 [Accessed 01-09-2024]"},{"key":"e_1_2_1_8_1","unstructured":"[n. d.]. plotters - Rust \u2014 docs.rs. https:\/\/docs.rs\/plotters\/latest\/plotters\/ [Accessed 17-02-2025]"},{"key":"e_1_2_1_9_1","unstructured":"[n. d.]. Riverbank Computing | Introduction \u2014 riverbankcomputing.com. https:\/\/riverbankcomputing.com\/software\/pyqt\/intro [Accessed 01-09-2024]"},{"key":"e_1_2_1_10_1","unstructured":"[n. d.]. The Architecture of Open Source Applications (Volume 2)matplotlib \u2014 aosabook.org. https:\/\/aosabook.org\/en\/v2\/matplotlib.html [Accessed 26-08-2024]"},{"key":"e_1_2_1_11_1","unstructured":"[n. d.]. Tutorial \u00b7 Plots \u2014 docs.juliaplots.org. https:\/\/docs.juliaplots.org\/stable\/tutorial\/ [Accessed 17-02-2025]"},{"key":"e_1_2_1_12_1","unstructured":"2021. broken colorbar when using contourf+cmap+norm+extend. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/20963 [Accessed 20-08-2024]"},{"key":"e_1_2_1_13_1","unstructured":"2021. [Bug]: Additive offset with trailing zeros \u00b7 Issue #22065 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22065\/ [Accessed 20-08-2024]"},{"key":"e_1_2_1_14_1","unstructured":"2021. [Bug]: cm fontset in log scale does not use Unicode minus \u00b7 Issue #21540 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/21540\/ [Accessed 19-02-2025]"},{"key":"e_1_2_1_15_1","unstructured":"2021. [Bug]: Error when removing colorbar in constrained layout \u00b7 Issue #20978 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/20978 [Accessed 20-08-2024]"},{"key":"e_1_2_1_16_1","unstructured":"2021. [Bug]: Some styles trigger pcolormesh grid deprecation \u00b7 Issue #21723 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/21723\/ [Accessed 20-08-2024]"},{"key":"e_1_2_1_17_1","unstructured":"2021. [Bug]: transform keyword in ax.plot. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/21008\/"},{"key":"e_1_2_1_18_1","unstructured":"2021. Dots misaligned in geom_dotplot \u00b7 Issue #4614 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/4614 [Accessed 19-02-2025]"},{"key":"e_1_2_1_19_1","unstructured":"2021. eps greyscale hatching of patches when lw=0. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22792 [Accessed 20-08-2024]"},{"key":"e_1_2_1_20_1","unstructured":"2021. geom_point(): when stroke=NA cannot change size of the point \u00b7 Issue #4624 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/4624 [Accessed 20-08-2024]"},{"key":"e_1_2_1_21_1","unstructured":"2021. Last slice polar Area does not animate \u00b7 Issue #10019 \u00b7 chartjs\/Chart.js \u2014 github.com. https:\/\/github.com\/chartjs\/Chart.js\/issues\/10019 [Accessed 20-08-2024]"},{"key":"e_1_2_1_22_1","unstructured":"2021. Tooltip doesn\u2019t utilize scale number formatting \u00b7 Issue #9830 \u00b7 chartjs\/Chart.js \u2014 github.com. https:\/\/github.com\/chartjs\/Chart.js\/issues\/9830 [Accessed 20-08-2024]"},{"key":"e_1_2_1_23_1","unstructured":"2022. [Bug]: Cannot toggle set_tight_layout \u00b7 Issue #22847 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22847\/ [Accessed 20-08-2024]"},{"key":"e_1_2_1_24_1","unstructured":"2022. [Bug]: Changing Linestyle in plot window swaps some plotted lines \u00b7 Issue #22823 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22823\/ [Accessed 19-02-2025]"},{"key":"e_1_2_1_25_1","unstructured":"2022. [BUG] image tick positions drifting\/ misplaced \u00b7 Issue #4087 \u00b7 JuliaPlots\/Plots.jl \u2014 github.com. https:\/\/github.com\/JuliaPlots\/Plots.jl\/issues\/4087 [Accessed 19-02-2025]"},{"key":"e_1_2_1_26_1","unstructured":"2022. [Bug]: \u2018offsetbox\u2018 classes have optional arguments that are really not optional \u00b7 Issue #24623 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/24623\/ [Accessed 20-08-2024]"},{"key":"e_1_2_1_27_1","unstructured":"2022. [Bug]:Newer versions of matplotlib ignore xlabel on colorbar axis. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/23398 [Accessed 20-08-2024]"},{"key":"e_1_2_1_28_1","unstructured":"2022. geom_hex color representation is wrong \u00b7 Issue #5044 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/5044 [Accessed 19-02-2025]"},{"key":"e_1_2_1_29_1","unstructured":"2022. hexbin is broken \u00b7 Issue #5037 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/5037 [Accessed 02-09-2024]"},{"key":"e_1_2_1_30_1","unstructured":"2023. [Bug]: offsetText is colored based on tick.color instead of tick.labelcolor \u00b7 Issue #25165 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/25165\/ [Accessed 19-02-2025]"},{"key":"e_1_2_1_31_1","unstructured":"2023. [Bug]: Suptitle not visible with subfigures \u00b7 Issue #24910 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/24910\/ [Accessed 20-08-2024]"},{"key":"e_1_2_1_32_1","unstructured":"2023. [Bug]: unexpected thetalim behavior in polar plot \u00b7 Issue #25568 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/25568\/ [Accessed 20-08-2024]"},{"key":"e_1_2_1_33_1","unstructured":"2023. Legend label click (& other events) use wrong label with multi-line gets worse the more labels there are \u00b7 Issue #11272 \u00b7 chartjs\/Chart.js \u2014 github.com. https:\/\/github.com\/chartjs\/Chart.js\/issues\/11272 [Accessed 20-08-2024]"},{"key":"e_1_2_1_34_1","volume-title":"Best Data Visualization Libraries for","year":"2024","unstructured":"2024. Best Data Visualization Libraries for 2024. https:\/\/www.nobledesktop.com\/classes-near-me\/blog\/best-data-visualization-libraries [Accessed 18-08-2024]"},{"key":"e_1_2_1_35_1","volume-title":"Incorrect pcolormesh when shading=\u2019nearest","year":"2025","unstructured":"2024. [Bug]: Incorrect pcolormesh when shading=\u2019nearest\u2019 and only the mesh data C is provided. \u00b7 Issue #29179 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/29179 [Accessed 23-02-2025]"},{"key":"e_1_2_1_36_1","unstructured":"2024. [Bug]: Poly3DCollection initialization cannot properly handle parameter verts when it is a list of nested tuples and shade is False \u00b7 Issue #29156 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/29156 [Accessed 23-02-2025]"},{"key":"e_1_2_1_37_1","unstructured":"2025. GitHub - williamlus\/dataviz-lib-bugs: An Empirical Study of Bugs in Data Visualization Libraries \u2014 github.com. https:\/\/github.com\/williamlus\/dataviz-lib-bugs [Accessed 04-04-2025]"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/iV.2018.00038"},{"key":"e_1_2_1_39_1","volume-title":"IEEE Symposium on Information Visualization, 2005. INFOVIS 2005.. 133\u2013140","author":"Bendix Fabian","year":"2005","unstructured":"Fabian Bendix, Robert Kosara, and Helwig Hauser. 2005. Parallel sets: visual analysis of categorical data. In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005.. 133\u2013140."},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.ascom.2013.06.002","article-title":"Filtergraph: An interactive web application for visualization of astronomy datasets","volume":"2","author":"Burger Dan","year":"2013","unstructured":"Dan Burger, Keivan G Stassun, Joshua Pepper, Robert J Siverd, Martin Paegert, Nathan M De Lee, and William H Robinson. 2013. Filtergraph: An interactive web application for visualization of astronomy datasets. Astronomy and Computing, 2 (2013), 40\u201345.","journal-title":"Astronomy and Computing"},{"key":"e_1_2_1_41_1","volume-title":"SonarQube in action","author":"Ann Campbell G","unstructured":"G Ann Campbell and Patroklos P Papapetrou. 2013. SonarQube in action. Manning Publications Co.."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2006.71"},{"key":"e_1_2_1_43_1","volume-title":"Simple HTML5 Charts. https:\/\/github.com\/chartjs\/Chart.js Accessed on","year":"2024","unstructured":"Chart.js. 2023. Chart.js: Simple HTML5 Charts. https:\/\/github.com\/chartjs\/Chart.js Accessed on July 15, 2024"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3587155"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3092036"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","DOI":"10.1016\/j.jss.2023.111797","article-title":"Snapshot testing in practice: Benefits and drawbacks","author":"Gazzinelli Cruz Victor Pezzi","year":"2023","unstructured":"Victor Pezzi Gazzinelli Cruz, Henrique Rocha, and Marco Tulio Valente. 2023. Snapshot testing in practice: Benefits and drawbacks. Journal of Systems and Software, 111797.","journal-title":"Journal of Systems and Software, 111797."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133917"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517193"},{"key":"e_1_2_1_49_1","volume-title":"3D game engine design: a practical approach to real-time computer graphics","author":"Eberly David","unstructured":"David Eberly. 2006. 3D game engine design: a practical approach to real-time computer graphics. CRC Press."},{"key":"e_1_2_1_50_1","volume-title":"Schapire","author":"Freund Yoav","year":"1995","unstructured":"Yoav Freund and Robert E. Schapire. 1995. A desicion-theoretic generalization of on-line learning and an application to boosting. In Computational Learning Theory, Paul Vit\u00e1nyi (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg. 23\u201337. isbn:978-3-540-49195-8"},{"key":"e_1_2_1_51_1","volume-title":"An implementation of the Grammar of Graphics in R. https:\/\/github.com\/tidyverse\/ggplot2 Accessed on","year":"2024","unstructured":"ggplot. 2023. An implementation of the Grammar of Graphics in R. https:\/\/github.com\/tidyverse\/ggplot2 Accessed on July 15, 2024"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2004.180"},{"key":"e_1_2_1_53_1","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). 147\u2013158","author":"Guan Hao","year":"2023","unstructured":"Hao Guan, Ying Xiao, Jiaying Li, Yepang Liu, and Guangdong Bai. 2023. A comprehensive study of real-world bugs in machine learning model optimization. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). 147\u2013158."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00024"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1093\/bioinformatics\/btx793","article-title":"Gene Graphics: a genomic neighborhood data visualization web application","volume":"34","author":"Harrison Katherine J","year":"2018","unstructured":"Katherine J Harrison, Val\u00e9rie de Cr\u00e9cy-Lagard, and R\u00e9mi Zallot. 2018. Gene Graphics: a genomic neighborhood data visualization web application. Bioinformatics, 34, 8 (2018), 1406\u20131408.","journal-title":"Bioinformatics"},{"key":"e_1_2_1_56_1","volume-title":"European Conference on Computer Vision. 257\u2013275","author":"Hoyer Lukas","year":"2024","unstructured":"Lukas Hoyer, David Joseph Tan, Muhammad Ferjad Naeem, Luc Van Gool, and Federico Tombari. 2024. SemiVL: semi-supervised semantic segmentation with vision-language guidance. In European Conference on Computer Vision. 257\u2013275."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380395"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.110"},{"key":"e_1_2_1_59_1","volume-title":"Storytelling with data: A data visualization guide for business professionals","author":"Knaflic Cole Nussbaumer","unstructured":"Cole Nussbaumer Knaflic. 2015. Storytelling with data: A data visualization guide for business professionals. John Wiley & Sons."},{"key":"e_1_2_1_60_1","volume-title":"Java 2D graphics. \" O\u2019Reilly Media","author":"Knudsen Jonathan","unstructured":"Jonathan Knudsen. 1999. Java 2D graphics. \" O\u2019Reilly Media, Inc.\"."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2016.2"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2015.7102582"},{"key":"e_1_2_1_63_1","volume-title":"Effective GUI testing automation: Developing an automated GUI testing tool","author":"Li Kanglin","unstructured":"Kanglin Li and Mengqi Wu. 2006. Effective GUI testing automation: Developing an automated GUI testing tool. John Wiley & Sons."},{"key":"e_1_2_1_64_1","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 630\u2013641","author":"Liu Lu","year":"2021","unstructured":"Lu Liu, Lili Wei, Wuqi Zhang, Ming Wen, Yepang Liu, and Shing-Chi Cheung. 2021. Characterizing transaction-reverting statements in ethereum smart contracts. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). 630\u2013641."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568229"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2018.10270"},{"key":"e_1_2_1_67_1","volume-title":"GUI Misbehavior Example. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/24089 Accessed on","year":"2024","unstructured":"matplotlib. 2023. GUI Misbehavior Example. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/24089 Accessed on July 15, 2024"},{"key":"e_1_2_1_68_1","volume-title":"matplotlib: plotting with Python. https:\/\/github.com\/matplotlib\/matplotlib Accessed on","year":"2024","unstructured":"matpltlib. 2023. matplotlib: plotting with Python. https:\/\/github.com\/matplotlib\/matplotlib Accessed on July 15, 2024"},{"key":"e_1_2_1_69_1","volume-title":"Principles of effective data visualization. Patterns, 1, 9","author":"Midway Stephen R","year":"2020","unstructured":"Stephen R Midway. 2020. Principles of effective data visualization. Patterns, 1, 9 (2020)."},{"key":"e_1_2_1_70_1","first-page":"1","article-title":"Examining data visualization pitfalls in scientific publications","volume":"4","author":"Nguyen Vinh T","year":"2021","unstructured":"Vinh T Nguyen, Kwanghee Jung, and Vibhuti Gupta. 2021. Examining data visualization pitfalls in scientific publications. Visual Computing for Industry, Biomedicine, and Art, 4 (2021), 1\u201315.","journal-title":"Visual Computing for Industry, Biomedicine, and Art"},{"key":"e_1_2_1_71_1","unstructured":"Flemming Nielson Hanne R Nielson and Chris Hankin. 2015. Principles of program analysis. springer."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/271775.271793"},{"key":"e_1_2_1_73_1","volume-title":"Proceedings of the Australasian Computer Science Week Multiconference. 1\u20138.","author":"Patterson Dale","year":"2016","unstructured":"Dale Patterson. 2016. Interactive 3D web applications for visualization of world health organization data. In Proceedings of the Australasian Computer Science Week Multiconference. 1\u20138."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132785"},{"key":"e_1_2_1_75_1","volume-title":"Powerful convenience for Julia visualizations and data analysis. https:\/\/github.com\/JuliaPlots\/Plots.jl Accessed on","year":"2024","unstructured":"plots.jl. 2023. Powerful convenience for Julia visualizations and data analysis. https:\/\/github.com\/JuliaPlots\/Plots.jl Accessed on July 15, 2024"},{"key":"e_1_2_1_76_1","volume-title":"A rust drawing library. https:\/\/github.com\/plotters-rs\/plotters Accessed on","year":"2024","unstructured":"plotters. 2023. A rust drawing library. https:\/\/github.com\/plotters-rs\/plotters Accessed on July 15, 2024"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3561160"},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. 17542\u201317552","author":"Saha Oindrila","year":"2024","unstructured":"Oindrila Saha, Grant Van Horn, and Subhransu Maji. 2024. Improved zero-shot classification by adapting vlms with text descriptions. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. 17542\u201317552."},{"key":"e_1_2_1_79_1","volume-title":"Vega-lite: A grammar of interactive graphics","author":"Satyanarayan Arvind","year":"2016","unstructured":"Arvind Satyanarayan, Dominik Moritz, Kanit Wongsuphasawat, and Jeffrey Heer. 2016. Vega-lite: A grammar of interactive graphics. IEEE transactions on visualization and computer graphics, 23, 1 (2016), 341\u2013350."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647360"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"e_1_2_1_82_1","doi-asserted-by":"crossref","first-page":"7782","DOI":"10.3390\/app14177782","article-title":"Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency","volume":"14","author":"Shahriar Sakib","year":"2024","unstructured":"Sakib Shahriar, Brady D Lund, Nishith Reddy Mannuru, Muhammad Arbab Arshad, Kadhim Hayawi, Ravi Varma Kumar Bevara, Aashrith Mannuru, and Laiba Batool. 2024. Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency. Applied Sciences, 14, 17 (2024), 7782.","journal-title":"Applied Sciences"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468591"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931074"},{"key":"e_1_2_1_85_1","volume-title":"The good, the bad, and the biased: Five ways visualizations can mislead (and how to fix them). interactions, 25, 4","author":"Szafir Danielle Albers","year":"2018","unstructured":"Danielle Albers Szafir. 2018. The good, the bad, and the biased: Five ways visualizations can mislead (and how to fix them). interactions, 25, 4 (2018), 26\u201333."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1007\/S10664-021-09985-1"},{"key":"e_1_2_1_87_1","doi-asserted-by":"crossref","unstructured":"Randle Aaron M Villanueva and Zhuo Job Chen. 2019. ggplot2: elegant graphics for data analysis.","DOI":"10.1080\/15366367.2019.1565254"},{"key":"e_1_2_1_88_1","volume-title":"Data changes everything: Challenges and opportunities in data visualization design handoff","author":"Walny Jagoda","year":"2019","unstructured":"Jagoda Walny, Christian Frisson, Mieka West, Doris Kosminsky, S\u00f8ren Knudsen, Sheelagh Carpendale, and Wesley Willett. 2019. Data changes everything: Challenges and opportunities in data visualization design handoff. IEEE transactions on visualization and computer graphics, 26, 1 (2019), 12\u201322."},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2017.59"},{"key":"e_1_2_1_90_1","volume-title":"Visionllm: Large language model is also an open-ended decoder for vision-centric tasks. Advances in Neural Information Processing Systems, 36","author":"Wang Wenhai","year":"2024","unstructured":"Wenhai Wang, Zhe Chen, Xiaokang Chen, Jiannan Wu, Xizhou Zhu, Gang Zeng, Ping Luo, Tong Lu, Jie Zhou, and Yu Qiao. 2024. Visionllm: Large language model is also an open-ended decoder for vision-centric tasks. Advances in Neural Information Processing Systems, 36 (2024)."},{"key":"e_1_2_1_91_1","volume-title":"The grammar of graphics","author":"Wilkinson Leland","unstructured":"Leland Wilkinson. 2012. The grammar of graphics. Springer."},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSS.2023.3288671"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534220"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598138"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/1993498.1993532"},{"key":"e_1_2_1_96_1","volume-title":"The dawn of lmms: Preliminary explorations with gpt-4v (ision). arXiv preprint arXiv:2309.17421, 9, 1","author":"Yang Zhengyuan","year":"2023","unstructured":"Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, and Lijuan Wang. 2023. The dawn of lmms: Preliminary explorations with gpt-4v (ision). arXiv preprint arXiv:2309.17421, 9, 1 (2023), 1."},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1145\/3453483.3454054"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/3213846.3213866"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3729363","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T15:21:29Z","timestamp":1750346489000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3729363"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":98,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3729363"],"URL":"https:\/\/doi.org\/10.1145\/3729363","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}