{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T00:48:36Z","timestamp":1760402916159,"version":"build-2065373602"},"reference-count":26,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,4,9]],"date-time":"2021-04-09T00:00:00Z","timestamp":1617926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Annotations produced by analysts during the exploration of a data visualization are a precious source of knowledge. Harnessing this knowledge requires a thorough structure of annotations, but also a means to acquire them without harming user engagement. The main contribution of this article is a method, taking the form of an interface, that offers a comprehensive \u201csubject-verb-complement\u201d set of steps for analysts to take annotations, and seamlessly translate these annotations within a prior classification framework. Technical considerations are also an integral part of this study: through a concrete web implementation, we prove the feasibility of our method, but also highlight some of the unresolved challenges that remain to be addressed. After explaining all concepts related to our work, from a literature review to JSON Specifications, we follow by showing two use cases that illustrate how the interface can work in concrete situations. We conclude with a substantial discussion of the limitations, the current state of the method and the upcoming steps for this annotation interface.<\/jats:p>","DOI":"10.3390\/info12040158","type":"journal-article","created":{"date-parts":[[2021,4,9]],"date-time":"2021-04-09T10:05:21Z","timestamp":1617962721000},"page":"158","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Colvis\u2014A Structured Annotation Acquisition System for Data Visualization"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5176-8579","authenticated-orcid":false,"given":"Pierre","family":"Vanhulst","sequence":"first","affiliation":[{"name":"Human-IST Institute, University of Fribourg, 1700 Fribourg, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5276-2459","authenticated-orcid":false,"given":"Rapha\u00ebl","family":"Tuor","sequence":"additional","affiliation":[{"name":"Human-IST Institute, University of Fribourg, 1700 Fribourg, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6052-2252","authenticated-orcid":false,"given":"Florian","family":"\u00c9v\u00e9quoz","sequence":"additional","affiliation":[{"name":"Institute Business Information Systems, University of Applied Sciences Western Switzerland, HES-SO Valais-Wallis, 3960 Sierre, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7834-0417","authenticated-orcid":false,"given":"Denis","family":"Lalanne","sequence":"additional","affiliation":[{"name":"Human-IST Institute, University of Fribourg, 1700 Fribourg, Switzerland"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,9]]},"reference":[{"key":"ref_1","unstructured":"Costabile, M.F. (2004, January 25\u201328). The challenge of information visualization evaluation. Proceedings of the Working Conference on Advanced Visual Interfaces, AVI 2004, Gallipoli, Italy."},{"key":"ref_2","first-page":"143","article-title":"A Descriptive Attribute-Based Framework for Annotations in Data Visualization","volume":"Volume 997","author":"Bechmann","year":"2018","journal-title":"Computer Vision, Imaging and Computer Graphics Theory and Applications\u201413th International Joint Conference, VISIGRAPP 2018, Funchal, Madeira, Portugal, 27\u201329 January 2018, Revised Selected Papers"},{"key":"ref_3","unstructured":"Tan, D.S., Amershi, S., Begole, B., Kellogg, W.A., and Tungare, M. (2011, January 7\u201312). CommentSpace: Structured support for collaborative visual analysis. Proceedings of the International Conference on Human Factors in Computing Systems, CHI 2011, Vancouver, BC, Canada."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1057\/ivs.2008.31","article-title":"Characterizing users\u2019 visual analytic activity for insight provenance","volume":"8","author":"Gotz","year":"2009","journal-title":"Inf. Vis."},{"key":"ref_5","unstructured":"Telea, A.C., Kerren, A., and Braz, J. (2018). Annotations as a Support for Knowledge Generation\u2014Supporting Visual Analytics in the Field of Ophthalmology. VISIGRAPP 2018, Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications\u2014Volume 3: IVAPP, Funchal, Madeira, Portugal, 27\u201329 January 2018, SciTePress."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1109\/TVCG.2016.2598543","article-title":"Annotation Graphs: A Graph-Based Visualization for Meta-Analysis of Data Based on User-Authored Annotations","volume":"23","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1145\/2133806.2133821","article-title":"Interactive dynamics for visual analysis","volume":"55","author":"Heer","year":"2012","journal-title":"Commun. ACM"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Munzner, T. (2014). Visualization Analysis and Design, A K Peters.","DOI":"10.1201\/b17511"},{"key":"ref_9","unstructured":"Bertin, J. (1967). S\u00e9miologie Graphique: Les Diagrammes, les R\u00e9seaux, les Cartes, Gauthier-VillarsMouton & Cie."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"124","DOI":"10.2307\/749671","article-title":"Making Sense of Graphs: Critical Factors Influencing Comprehension and Instructional Implications","volume":"32","author":"Friel","year":"2001","journal-title":"J. Res. Math. Educ."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"382","DOI":"10.2307\/749086","article-title":"Comprehension of Mathematical Relationships Expressed in Graphs","volume":"18","author":"Curcio","year":"1987","journal-title":"J. Res. Math. Educ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1109\/TVCG.2014.2346984","article-title":"A Principled Way of Assessing Visualization Literacy","volume":"20","author":"Boy","year":"2014","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1177\/1473871611433713","article-title":"Note-taking in co-located collaborative visual analytics: Analysis of an observational study","volume":"11","author":"Mahyar","year":"2012","journal-title":"Inf. Vis."},{"key":"ref_14","unstructured":"Sanderson, R., Ciccarese, P., and Young, B. (2021, March 29). Web Annotation Data Model. W3C Recommendation, W3C. Available online: https:\/\/www.w3.org\/TR\/2017\/REC-annotation-model-20170223\/."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1109\/TVCG.2007.70577","article-title":"ManyEyes: A Site for Visualization at Internet Scale","volume":"13","author":"Wattenberg","year":"2007","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_16","unstructured":"Lu, S. (2021, March 29). D3-Annotation. Available online: https:\/\/d3-annotation.susielu.com\/."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2301","DOI":"10.1109\/TVCG.2011.185","article-title":"D3 Data-Driven Documents","volume":"17","author":"Bostock","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1111\/cgf.13717","article-title":"InsideInsights: Integrating Data-Driven Reporting in Collaborative Visual Analytics","volume":"38","author":"Mathisen","year":"2019","journal-title":"Comput. Graph. Forum"},{"key":"ref_19","unstructured":"Gajos, K., Mankoff, J., and Harrison, C. (2017, January 22\u201325). Codestrates: Literate Computing with Webstrates. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017, Quebec City, QC, Canada."},{"key":"ref_20","unstructured":"Benko, H., Dontcheva, M., and Wigdor, D. (2014, January 5\u20138). Declarative interaction design for data visualization. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, UIST\u201914, Honolulu, HI, USA."},{"key":"ref_21","unstructured":"Binnig, C., Fekete, A.D., and Nandi, A. (July, January 26). Towards a general-purpose query language for visualization recommendation. Proceedings of the Workshop on Human-In-the-Loop Data Analytics, HILDA@SIGMOD 2016, San Francisco, CA, USA."},{"key":"ref_22","unstructured":"Mark, G., Fussell, S.R., Lampe, C., Schraefel, M.C., Hourcade, J.P., Appert, C., and Wigdor, D. (2017, January 6\u201311). Voyager 2: Augmenting Visual Analysis with Partial View Specifications. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TVCG.2019.2934668","article-title":"FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow System","volume":"26","author":"Yu","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_24","first-page":"161","article-title":"English grammar as a sentence model for conceptual modelling using NIAM","volume":"Volume 26","author":"Falkenberg","year":"1995","journal-title":"Information System Concepts: Towards a Consolidation of Views, Proceedings of the IFIP International Working Conference on Information System Concepts (ISCO 1995), Marburg, Germany, 28\u201330 March 1995"},{"key":"ref_25","unstructured":"Chipana, M.L., Verma, H., Ev\u00e9quoz, F., Vanhulst, P., and Lalanne, D. (2019, January 10\u201313). Vasco: Interactive tool for early-exploration of data. Proceedings of the 31st Conference on l\u2019Interaction Homme-Machine: Adjunct, IHM 2019, Grenoble, France."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1111\/cgf.12391","article-title":"Lyra: An Interactive Visualization Design Environment","volume":"33","author":"Satyanarayan","year":"2014","journal-title":"Comput. Graph. Forum"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/4\/158\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:12:13Z","timestamp":1760364733000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/4\/158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,9]]},"references-count":26,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["info12040158"],"URL":"https:\/\/doi.org\/10.3390\/info12040158","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2021,4,9]]}}}