{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T11:21:05Z","timestamp":1787484065447,"version":"build-2736575974"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:00:00Z","timestamp":1750291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2025,6,19]]},"abstract":"<jats:p>Data visualization (DataViz) libraries play a crucial role in presentation, data analysis, and application development, underscoring the importance of their accuracy in transforming data into visual representations. Incorrect visualizations can adversely impact user experience, distort information conveyance, and influence user perception and decision-making processes. Visual bugs in these libraries can be particularly insidious as they may not cause obvious errors like crashes, but instead mislead users of the underlying data graphically, resulting in wrong decision making. Consequently, a good understanding of the unique characteristics of bugs in DataViz libraries is essential for researchers and developers to detect and fix bugs in DataViz libraries.<\/jats:p>\n                  <jats:p>This study presents the first comprehensive analysis of bugs in DataViz libraries, examining 564 bugs collected from five widely-used libraries. Our study systematically analyzes their symptoms and root causes, and provides a detailed taxonomy. We found that incorrect\/inaccurate plots are pervasive in DataViz libraries and incorrect graphic computation is the major root cause, which necessitates further automated testing methods for DataViz libraries. Moreover, we identified eight key steps to trigger such bugs and two test oracles specific to DataViz libraries, which may inspire future research in designing effective automated testing techniques. Furthermore, with the recent advancements in Vision Language Models (VLMs), we explored the feasibility of applying these models to detect incorrect\/inaccurate plots. The results show that the effectiveness of VLMs in bug detection varies from 29% to 57%, depending on the prompts, and adding more information in prompts does not necessarily increase the effectiveness. Our findings offer valuable insights into the nature and patterns of bugs in DataViz libraries, providing a foundation for developers and researchers to improve library reliability, and ultimately benefit more accurate and reliable data visualizations across various domains.<\/jats:p>","DOI":"10.1145\/3729363","type":"journal-article","created":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T11:15:34Z","timestamp":1750331734000},"page":"2075-2098","source":"Crossref","is-referenced-by-count":1,"title":["An Empirical Study of Bugs in Data Visualization Libraries"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-3454-8464","authenticated-orcid":false,"given":"Weiqi","family":"Lu","sequence":"first","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1644-2965","authenticated-orcid":false,"given":"Yongqiang","family":"Tian","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8018-9391","authenticated-orcid":false,"given":"Xiaohan","family":"Zhong","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7411-9288","authenticated-orcid":false,"given":"Haoyang","family":"Ma","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9451-4031","authenticated-orcid":false,"given":"Zhenyang","family":"Xu","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3508-7172","authenticated-orcid":false,"given":"Shing-Chi","family":"Cheung","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0862-2491","authenticated-orcid":false,"given":"Chengnian","family":"Sun","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,19]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"[n. d.]. Anti-Grain Geometry Library \/ SVN \/ [r141] \/agg-2.4 \u2014 sourceforge.net. https:\/\/sourceforge.net\/p\/agg\/svn\/HEAD\/tree\/agg-2.4\/. [Accessed 01-09-2024]."},{"key":"e_1_3_1_3_2","unstructured":"[n. d.]. Chart.js Samples | Chart.js \u2014 chartjs.org. https:\/\/www.chartjs.org\/docs\/latest\/samples\/information.html. [Accessed 17-02-2025]."},{"key":"e_1_3_1_4_2","unstructured":"[n. d.]. Examples; Matplotlib 3.10.0 documentation \u2014 matplotlib.org. https:\/\/matplotlib.org\/stable\/gallery\/index.html. [Accessed 17-02-2025]."},{"key":"e_1_3_1_5_2","unstructured":"[n. d.]. Find and fix problems in your JavaScript code - ESLint - Pluggable JavaScript Linter \u2014 eslint.org. https:\/\/eslint.org\/. [Accessed 24-02-2025]."},{"key":"e_1_3_1_6_2","unstructured":"[n. d.]. Function reference \u2014 ggplot2.tidyverse.org. https:\/\/ggplot2.tidyverse.org\/reference\/index.html. [Accessed 17-02-2025]."},{"key":"e_1_3_1_7_2","unstructured":"[n. d.]. GitHub - hal9ai\/awesome-dataviz: :chart_with_upwards_trend: A curated list of awesome data visualization libraries and resources. \u2014 github.com. https:\/\/github.com\/hal9ai\/awesome-dataviz. [Accessed 18-08-2024]."},{"key":"e_1_3_1_8_2","unstructured":"[n. d.]. grid package - RDocumentation \u2014 rdocumentation.org. https:\/\/www.rdocumentation.org\/packages\/grid\/versions\/3.6.2. [Accessed 01-09-2024]."},{"key":"e_1_3_1_9_2","unstructured":"[n. d.]. plotters - Rust \u2014 docs.rs. https:\/\/docs.rs\/plotters\/latest\/plotters\/. [Accessed 17-02-2025]."},{"key":"e_1_3_1_10_2","unstructured":"[n. d.]. Riverbank Computing | Introduction \u2014 riverbankcomputing.com. https:\/\/riverbankcomputing.com\/software\/pyqt\/intro. [Accessed 01-09-2024]."},{"key":"e_1_3_1_11_2","unstructured":"[n. d.]. The Architecture of Open Source Applications (Volume 2)matplotlib \u2014 aosabook.org. https:\/\/aosabook.org\/en\/v2\/matplotlib.html. [Accessed 26-08-2024]."},{"key":"e_1_3_1_12_2","unstructured":"[n. d.]. Tutorial \u00b7 Plots \u2014 docs.juliaplots.org. https:\/\/docs.juliaplots.org\/stable\/tutorial\/. [Accessed 17-02-2025]."},{"key":"e_1_3_1_13_2","unstructured":"2021. broken colorbar when using contourf+cmap+norm+extend. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/20963. [Accessed 20-08-2024]."},{"key":"e_1_3_1_14_2","unstructured":"2021. [Bug]: Additive offset with trailing zeros \u00b7 Issue #22065 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22065\/. [Accessed 20-08-2024]."},{"key":"e_1_3_1_15_2","unstructured":"2021. [Bug]: cm fontset in log scale does not use Unicode minus \u00b7 Issue #21540 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/21540\/. [Accessed 19-02-2025]."},{"key":"e_1_3_1_16_2","unstructured":"2021. [Bug]: Error when removing colorbar in constrained layout \u00b7 Issue #20978 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/20978. [Accessed 20-08-2024]."},{"key":"e_1_3_1_17_2","unstructured":"2021. [Bug]: Some styles trigger pcolormesh grid deprecation \u00b7 Issue #21723 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/21723\/. [Accessed 20-08-2024]."},{"key":"e_1_3_1_18_2","unstructured":"2021. [Bug]: transform keyword in ax.plot. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/21008\/ last accessed on Aug\/19\/2024."},{"key":"e_1_3_1_19_2","unstructured":"2021. Dots misaligned in geom_dotplot \u00b7 Issue #4614 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/4614. [Accessed 19-02-2025]."},{"key":"e_1_3_1_20_2","unstructured":"2021. eps greyscale hatching of patches when lw=0. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22792. [Accessed 20-08-2024]."},{"key":"e_1_3_1_21_2","unstructured":"2021. geom_point(): when stroke=NA cannot change size of the point \u00b7 Issue #4624 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/4624. [Accessed 20-08-2024]."},{"key":"e_1_3_1_22_2","unstructured":"2021. Last slice polar Area does not animate \u00b7 Issue #10019 \u00b7 chartjs\/Chart.js \u2014 github.com. https:\/\/github.com\/chartjs\/Chart.js\/issues\/10019. [Accessed 20-08-2024]."},{"key":"e_1_3_1_23_2","unstructured":"2021. Tooltip doesn\u2019t utilize scale number formatting \u00b7 Issue #9830 \u00b7 chartjs\/Chart.js \u2014 github.com. https:\/\/github.com\/chartjs\/Chart.js\/issues\/9830. [Accessed 20-08-2024]."},{"key":"e_1_3_1_24_2","unstructured":"2022. [Bug]: Cannot toggle set_tight_layout \u00b7 Issue #22847 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22847\/. [Accessed 20-08-2024]."},{"key":"e_1_3_1_25_2","unstructured":"2022. [Bug]: Changing Linestyle in plot window swaps some plotted lines \u00b7 Issue #22823 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/22823\/. [Accessed 19-02-2025]."},{"key":"e_1_3_1_26_2","unstructured":"2022. [BUG] image tick positions drifting\/ misplaced \u00b7 Issue #4087 \u00b7 JuliaPlots\/Plots.jl \u2014 github.com. https:\/\/github.com\/JuliaPlots\/Plots.jl\/issues\/4087. [Accessed 19-02-2025]."},{"key":"e_1_3_1_27_2","unstructured":"2022. [Bug]: \u2018offsetbox\u2019 classes have optional arguments that are really not optional \u00b7 Issue #24623 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/24623\/. [Accessed 20-08-2024]."},{"key":"e_1_3_1_28_2","unstructured":"2022. [Bug]:Newer versions of matplotlib ignore xlabel on colorbar axis. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/23398. [Accessed 20-08-2024]."},{"key":"e_1_3_1_29_2","unstructured":"2022. geom_hex color representation is wrong \u00b7 Issue #5044 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/5044. [Accessed 19-02-2025]."},{"key":"e_1_3_1_30_2","unstructured":"2022. hexbin is broken \u00b7 Issue #5037 \u00b7 tidyverse\/ggplot2 \u2014 github.com. https:\/\/github.com\/tidyverse\/ggplot2\/issues\/5037. [Accessed 02-09-2024]."},{"key":"e_1_3_1_31_2","unstructured":"2023. [Bug]: offsetText is colored based on tick.color instead of tick.labelcolor \u00b7 Issue #25165 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/25165\/. [Accessed 19-02-2025]."},{"key":"e_1_3_1_32_2","unstructured":"2023. [Bug]: Suptitle not visible with subfigures \u00b7 Issue #24910 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/24910\/. [Accessed 20-08-2024]."},{"key":"e_1_3_1_33_2","unstructured":"2023. [Bug]: unexpected thetalim behavior in polar plot \u00b7 Issue #25568 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/25568\/. [Accessed 20-08-2024]."},{"key":"e_1_3_1_34_2","unstructured":"2023. Legend label click (& other events) use wrong label with multi-line gets worse the more labels there are \u00b7 Issue #11272 \u00b7 chartjs\/Chart.js \u2014 github.com. https:\/\/github.com\/chartjs\/Chart.js\/issues\/11272. [Accessed 20-08-2024]."},{"key":"e_1_3_1_35_2","unstructured":"2024. Best Data Visualization Libraries for 2024. https:\/\/www.nobledesktop.com\/classes-near-me\/blog\/best-data-visualization-libraries. [Accessed 18-08-2024]."},{"key":"e_1_3_1_36_2","unstructured":"2024. [Bug]: Incorrect pcolormesh when shading=\u2018nearest\u2019 and only the mesh data C is provided. \u00b7 Issue #29179 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/29179. [Accessed 23-02-2025]."},{"key":"e_1_3_1_37_2","unstructured":"2024. [Bug]: Poly3DCollection initialization cannot properly handle parameter verts when it is a list of nested tuples and shade is False \u00b7 Issue #29156 \u00b7 matplotlib\/matplotlib \u2014 github.com. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/29156. [Accessed 23-02-2025]."},{"key":"e_1_3_1_38_2","unstructured":"2025. GitHub - williamlus\/dataviz-lib-bugs: An Empirical Study of Bugs in Data Visualization Libraries \u2014 github.com. https:\/\/github.com\/williamlus\/dataviz-lib-bugs. [Accessed 04-04-2025]."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","unstructured":"Raissa Barcellos Jose Viterbo Flavia Bernardini and Daniela Trevisan. 2018. An Instrument for Evaluating the Quality of Data Visualizations. In 2018 22nd International Conference Information Visualisation (IV). 169\u2013174. doi:10.1109\/iV.2018.00038","DOI":"10.1109\/iV.2018.00038"},{"key":"e_1_3_1_40_2","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1109\/INFVIS.2005.1532139","volume-title":"IEEE Symposium on Information Visualization, 2005. INFOVIS 2005","author":"Bendix Fabian","year":"2005","unstructured":"Fabian Bendix, Robert Kosara, and Helwig Hauser. 2005. Parallel sets: visual analysis of categorical data. In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005. IEEE, 133\u2013140."},{"key":"e_1_3_1_41_2","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.ascom.2013.06.002","article-title":"Filtergraph: An interactive web application for visualization of astronomy datasets","volume":"2","author":"Burger Dan","year":"2013","unstructured":"Dan Burger, Keivan G Stassun, Joshua Pepper, Robert J Siverd, Martin Paegert, Nathan M De Lee, and William H Robinson. 2013. Filtergraph: An interactive web application for visualization of astronomy datasets. Astronomy and Computing 2 (2013), 40\u201345.","journal-title":"Astronomy and Computing"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.5555\/2601770"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2006.71"},{"key":"e_1_3_1_44_2","unstructured":"Chart.js. 2023. Chart.js: Simple HTML5 Charts. https:\/\/github.com\/chartjs\/Chart.js Accessed on July 15 2024."},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3587155"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3092036"},{"key":"e_1_3_1_47_2","doi-asserted-by":"crossref","unstructured":"Victor Pezzi Gazzinelli Cruz Henrique Rocha and Marco Tulio Valente. 2023. Snapshot testing in practice: Benefits and drawbacks. Journal of Systems and Software (2023) 111797.","DOI":"10.1016\/j.jss.2023.111797"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3133917"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3517193"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1201\/b18212"},{"key":"e_1_3_1_51_2","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/3-540-59119-2_166","volume-title":"Computational Learning Theory","author":"Freund Yoav","year":"1995","unstructured":"Yoav Freund and Robert E. Schapire. 1995. A desicion-theoretic generalization of on-line learning and an application to boosting. In Computational Learning Theory, Paul Vit\u00e1nyi (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 23\u201337."},{"key":"e_1_3_1_52_2","unstructured":"ggplot. 2023. An implementation of the Grammar of Graphics in R. https:\/\/github.com\/tidyverse\/ggplot2 Accessed on July 15 2024."},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2004.180"},{"key":"e_1_3_1_54_2","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1109\/ICSE48619.2023.00024","volume-title":"2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE)","author":"Guan Hao","year":"2023","unstructured":"Hao Guan, Ying Xiao, Jiaying Li, Yepang Liu, and Guangdong Bai. 2023. A comprehensive study of real-world bugs in machine learning model optimization. In 2023 IEEE\/ACM 45th International Conference on Software Engineering (ICSE). IEEE, 147\u2013158."},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE48619.2023.00024"},{"issue":"8","key":"e_1_3_1_56_2","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1093\/bioinformatics\/btx793","article-title":"Gene Graphics: a genomic neighborhood data visualization web application","volume":"34","author":"Harrison Katherine J","year":"2018","unstructured":"Katherine J Harrison, Val\u00e9rie de Cr\u00e9cy-Lagard, and R\u00e9mi Zallot. 2018. Gene Graphics: a genomic neighborhood data visualization web application. Bioinformatics 34, 8 (2018), 1406\u20131408.","journal-title":"Bioinformatics"},{"key":"e_1_3_1_57_2","first-page":"257","volume-title":"European Conference on Computer Vision","author":"Hoyer Lukas","year":"2024","unstructured":"Lukas Hoyer, David Joseph Tan, Muhammad Ferjad Naeem, Luc Van Gool, and Federico Tombari. 2024. SemiVL: semi-supervised semantic segmentation with vision-language guidance. In European Conference on Computer Vision. Springer, 257\u2013275."},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380395"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.110"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781119055259"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.5555\/304620"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2016.2"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2015.7102582"},{"key":"e_1_3_1_64_2","volume-title":"Effective GUI testing automation: Developing an automated GUI testing tool","author":"Li Kanglin","year":"2006","unstructured":"Kanglin Li and Mengqi Wu. 2006. Effective GUI testing automation: Developing an automated GUI testing tool. John Wiley & Sons."},{"key":"e_1_3_1_65_2","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1109\/ASE51524.2021.9678597","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Liu Lu","year":"2021","unstructured":"Lu Liu, Lili Wei, Wuqi Zhang, Ming Wen, Yepang Liu, and Shing-Chi Cheung. 2021. Characterizing transactionreverting statements in ethereum smart contracts. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE). IEEE, 630\u2013641."},{"key":"e_1_3_1_66_2","doi-asserted-by":"crossref","unstructured":"Yepang Liu Chang Xu and Shing-Chi Cheung. 2014. Characterizing and detecting performance bugs for smartphone applications. In Proceedings of the 36th international conference on software engineering. 1013\u20131024.","DOI":"10.1145\/2568225.2568229"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2018.10270"},{"key":"e_1_3_1_68_2","unstructured":"matplotlib. 2023. GUI Misbehavior Example. https:\/\/github.com\/matplotlib\/matplotlib\/issues\/24089 Accessed on July 15 2024."},{"key":"e_1_3_1_69_2","unstructured":"matpltlib. 2023. matplotlib: plotting with Python. https:\/\/github.com\/matplotlib\/matplotlib Accessed on July 15 2024."},{"issue":"9","key":"e_1_3_1_70_2","article-title":"Principles of effective data visualization","volume":"1","author":"Midway Stephen R","year":"2020","unstructured":"Stephen R Midway. 2020. Principles of effective data visualization. Patterns 1, 9 (2020).","journal-title":"Patterns"},{"key":"e_1_3_1_71_2","first-page":"1","article-title":"Examining data visualization pitfalls in scientific publications","volume":"4","author":"Nguyen Vinh T","year":"2021","unstructured":"Vinh T Nguyen, Kwanghee Jung, and Vibhuti Gupta. 2021. Examining data visualization pitfalls in scientific publications. Visual Computing for Industry, Biomedicine, and Art 4 (2021), 1\u201315.","journal-title":"Visual Computing for Industry, Biomedicine, and Art"},{"key":"e_1_3_1_72_2","volume-title":"Principles of program analysis","author":"Nielson Flemming","year":"2015","unstructured":"Flemming Nielson, Hanne R Nielson, and Chris Hankin. 2015. Principles of program analysis. springer."},{"key":"e_1_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/271775.271793"},{"key":"e_1_3_1_74_2","doi-asserted-by":"crossref","unstructured":"Dale Patterson. 2016. Interactive 3D web applications for visualization of world health organization data. In Proceedings of the Australasian Computer Science Week Multiconference. 1\u20138.","DOI":"10.1145\/2843043.2843477"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132785"},{"key":"e_1_3_1_76_2","unstructured":"plots.jl. 2023. Powerful convenience for Julia visualizations and data analysis. https:\/\/github.com\/JuliaPlots\/Plots.jl Accessed on July 15 2024."},{"key":"e_1_3_1_77_2","unstructured":"plotters. 2023. A rust drawing library. https:\/\/github.com\/plotters-rs\/plotters Accessed on July 15 2024."},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3561160"},{"key":"e_1_3_1_79_2","doi-asserted-by":"crossref","unstructured":"Oindrila Saha Grant Van Horn and Subhransu Maji. 2024. Improved zero-shot classification by adapting vlms with text descriptions. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. 17542\u201317552.","DOI":"10.1109\/CVPR52733.2024.01661"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2599030"},{"key":"e_1_3_1_81_2","doi-asserted-by":"crossref","unstructured":"Arvind Satyanarayan Kanit Wongsuphasawat and Jeffrey Heer. 2014. Declarative interaction design for data visualization. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 669\u2013678.","DOI":"10.1145\/2642918.2647360"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.3390\/app14177782"},{"key":"e_1_3_1_84_2","doi-asserted-by":"crossref","unstructured":"Qingchao Shen Haoyang Ma Junjie Chen Yongqiang Tian Shing-Chi Cheung and Xiang Chen. 2021. A comprehensive study of deep learning compiler bugs. In Proceedings of the 29th ACM Joint meeting on european software engineering conference and symposium on the foundations of software engineering. 968\u2013980.","DOI":"10.1145\/3468264.3468591"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931074"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3231772"},{"key":"e_1_3_1_87_2","doi-asserted-by":"publisher","DOI":"10.1007\/S10664-021-09985-1"},{"key":"e_1_3_1_88_2","doi-asserted-by":"crossref","unstructured":"Randle Aaron M Villanueva and Zhuo Job Chen. 2019. ggplot2: elegant graphics for data analysis.","DOI":"10.1080\/15366367.2019.1565254"},{"issue":"1","key":"e_1_3_1_89_2","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/TVCG.2019.2934538","article-title":"Data changes everything: Challenges and opportunities in data visualization design handoff","volume":"26","author":"Walny Jagoda","year":"2019","unstructured":"Jagoda Walny, Christian Frisson, Mieka West, Doris Kosminsky, S\u00f8ren Knudsen, Sheelagh Carpendale, and Wesley Willett. 2019. Data changes everything: Challenges and opportunities in data visualization design handoff. IEEE transactions on visualization and computer graphics 26, 1 (2019), 12\u201322.","journal-title":"IEEE transactions on visualization and computer graphics"},{"key":"e_1_3_1_90_2","doi-asserted-by":"publisher","unstructured":"Zhiyuan Wan David Lo Xin Xia and Liang Cai. 2017. Bug Characteristics in Blockchain Systems: A Large-Scale Empirical Study. In 2017 IEEE\/ACM 14th International Conference on Mining Software Repositories (MSR). 413\u2013424. doi:10.1109\/MSR.2017.59","DOI":"10.1109\/MSR.2017.59"},{"key":"e_1_3_1_91_2","article-title":"Visionllm: Large language model is also an open-ended decoder for vision-centric tasks","volume":"36","author":"Wang Wenhai","year":"2024","unstructured":"Wenhai Wang, Zhe Chen, Xiaokang Chen, Jiannan Wu, Xizhou Zhu, Gang Zeng, Ping Luo, Tong Lu, Jie Zhou, Yu Qiao, et al. 2024. Visionllm: Large language model is also an open-ended decoder for vision-centric tasks. Advances in Neural Information Processing Systems 36 (2024).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_92_2","volume-title":"The grammar of graphics","author":"Wilkinson Leland","year":"2012","unstructured":"Leland Wilkinson. 2012. The grammar of graphics. Springer."},{"key":"e_1_3_1_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSS.2023.3288671"},{"key":"e_1_3_1_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534220"},{"key":"e_1_3_1_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598138"},{"key":"e_1_3_1_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/1993498.1993532"},{"issue":"1","key":"e_1_3_1_97_2","first-page":"1","article-title":"The dawn of lmms: Preliminary explorations with gpt-4v (ision)","volume":"9","author":"Yang Zhengyuan","year":"2023","unstructured":"Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, and Lijuan Wang. 2023. The dawn of lmms: Preliminary explorations with gpt-4v (ision). arXiv preprint arXiv:2309.17421 9, 1 (2023), 1.","journal-title":"arXiv preprint arXiv:2309.17421"},{"key":"e_1_3_1_98_2","doi-asserted-by":"publisher","DOI":"10.1145\/3453483.3454054"},{"key":"e_1_3_1_99_2","doi-asserted-by":"crossref","unstructured":"Yuhao Zhang Yifan Chen Shing-Chi Cheung Yingfei Xiong and Lu Zhang. 2018. An empirical study on tensorflow program bugs. In Proceedings of the 27th ACM SIGSOFT international symposium on software testing and analysis. 129\u2013140.","DOI":"10.1145\/3213846.3213866"}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3729363","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T10:58:53Z","timestamp":1787482733000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3729363"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,19]]},"references-count":98,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2025,6,19]]}},"alternative-id":["10.1145\/3729363"],"URL":"https:\/\/doi.org\/10.1145\/3729363","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,19]]}}}