{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T06:53:51Z","timestamp":1781765631523,"version":"3.54.5"},"reference-count":54,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T00:00:00Z","timestamp":1781654400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T00:00:00Z","timestamp":1781654400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Vetenskapsr\u00e5det","doi-asserted-by":"publisher","award":["2024\u201005726"],"award-info":[{"award-number":["2024\u201005726"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004063","name":"Knut och Alice Wallenbergs Stiftelse","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004063","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["NSF OAC 1835904"],"award-info":[{"award-number":["NSF OAC 1835904"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Graphics Forum"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Decades of advocacy for reproducibility and replication have advanced open, transparent practices in the sciences. However, traditional notions of reproducibility fit poorly with design\u2010oriented visualization research, where insights emerge through subjective, situated, and iterative work. So how can we ensure rigor and transparency in processes that are inherently unreproducible? To introduce transparency in design\u2010oriented research, we propose to focus on traceability: surfacing the origin and development of research contributions based on rich sets of artifacts documenting the design process. We investigated traceability through a collaborative autoethnographic reflection that builds on several years of work exploring ways to make design\u2010oriented research transparent. This exploration includes an experiment to build a tool to support traceability, which we called tRRRacer. The tRRRacer tool provided a testbed for us to operationalize the three tenets of a traceable process: (1) Record abundant, annotated artifacts representative of research activities; (2) Report curated research threads that articulate rationale and evolution of the process, allowing others to (3) Read via interfaces that help retrace claims and assess plausibility. Reflecting on our experiences, we contribute a theorization of traceability and reflections on how we might support it.<\/jats:p>","DOI":"10.1111\/cgf.70445","type":"journal-article","created":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T06:15:28Z","timestamp":1781763328000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reflections on Traceability for Visualization Research"],"prefix":"10.1111","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9568-469X","authenticated-orcid":false,"given":"J.","family":"Rogers","sequence":"first","affiliation":[{"name":"University of Utah  USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9419-3402","authenticated-orcid":false,"given":"D.","family":"Akbaba","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology  Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5642-8346","authenticated-orcid":false,"given":"J. S.","family":"Brown","sequence":"additional","affiliation":[{"name":"University of Edinburgh  UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6930-5468","authenticated-orcid":false,"given":"A.","family":"Lex","sequence":"additional","affiliation":[{"name":"Graz University of Technology  Austria"},{"name":"University of Utah  USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8971-6245","authenticated-orcid":false,"given":"M.","family":"Meyer","sequence":"additional","affiliation":[{"name":"Link\u00f6ping University  Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,6,17]]},"reference":[{"key":"e_1_2_8_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2024.3456171"},{"key":"e_1_2_8_3_2","doi-asserted-by":"crossref","unstructured":"AkbabaD. LangeD. CorrellM. LexA. MeyerM.: Troubling collaboration: Matters of care for visualization design study. InProceedings of the 2023 CHI Conference on Human Factors in Computing Systems(2023) pp.1\u201315. 4","DOI":"10.1145\/3544548.3581168"},{"key":"e_1_2_8_4_2","doi-asserted-by":"crossref","unstructured":"AkbabaD. SvenssonC. TorelliC. CallmerydM. MeyerM.: Thinking inside the box: Considerations for putting data physicalization workshops in a box.to appear(2026). 8","DOI":"10.1111\/cgf.70453"},{"key":"e_1_2_8_5_2","doi-asserted-by":"crossref","unstructured":"BaradK.:Meeting the universe halfway: Quantum physics and the entanglement of matter and meaning.Duke University Press 2007. 3","DOI":"10.2307\/j.ctv12101zq"},{"key":"e_1_2_8_6_2","volume-title":"Proceedings of the alt.VIS workshop","author":"Besan\u00e7on L.","year":"2021"},{"key":"e_1_2_8_7_2","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2012.678878"},{"key":"e_1_2_8_8_2","doi-asserted-by":"publisher","DOI":"10.1177\/1744987107081254"},{"key":"e_1_2_8_9_2","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1145\/2317956.2317968","volume-title":"Proceedings of the Designing Interactive Systems Conference","author":"Bowers J.","year":"2012"},{"key":"e_1_2_8_9_3","doi-asserted-by":"crossref","unstructured":"doi:10.1145\/2317956.2317968. 3","DOI":"10.1145\/2317956.2317968"},{"key":"e_1_2_8_10_2","doi-asserted-by":"publisher","DOI":"10.34190\/JBRM.18.2.008"},{"key":"e_1_2_8_11_2","doi-asserted-by":"crossref","unstructured":"Ciolfi FeliceM. FeldfeberI. Glasserman ApicellaC. QuirogaY. B. AnsaldoJ. LapennaL. BezchinskyS. Barriga RubioR. Garc\u00edaM.: Doing the feminist work in ai: Reflections from an ai project in latin america. InProceedings of the 2025 CHI Conference on Human Factors in Computing Systems(2025) pp.1\u201318. 4","DOI":"10.1145\/3706598.3713681"},{"key":"e_1_2_8_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/VIS47514.2020.00030"},{"key":"e_1_2_8_13_2","volume-title":"Constructing grounded theory: A practical guide through qualitative analysis","author":"Charmaz K.","year":"2006"},{"key":"e_1_2_8_14_2","doi-asserted-by":"publisher","DOI":"10.2307\/1511837"},{"key":"e_1_2_8_15_2","article-title":"Revisit 2: A full experiment life cycle user study framework","volume":"32","author":"Cutler Z.","year":"2026","journal-title":"IEEE Transactions on Visualization and Computer Graphics (VIS)"},{"issue":"2","key":"e_1_2_8_16_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MCG.2009.22","article-title":"Defining insight for visual analytics","volume":"29","author":"Chang R.","year":"2009","journal-title":"IEEE Computer Graphics and Applications"},{"key":"e_1_2_8_17_2","unstructured":"DastonL. GalisonP.:Objectivity.Princeton University Press 2021. 3"},{"key":"e_1_2_8_18_2","doi-asserted-by":"crossref","unstructured":"D'ignazioC. KleinL. F.:Data feminism.MIT Press 2020. 3","DOI":"10.7551\/mitpress\/11805.001.0001"},{"key":"e_1_2_8_19_2","volume-title":"The stuff of bits: An essay on the materialities of information","author":"Dourish P.","year":"2022"},{"key":"e_1_2_8_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2020.3006412"},{"key":"e_1_2_8_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2212877.2212889"},{"key":"e_1_2_8_22_2","first-page":"41","volume-title":"The cultural geography reader","author":"Geertz C.","year":"2008"},{"key":"e_1_2_8_23_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12925"},{"key":"e_1_2_8_24_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12925"},{"key":"e_1_2_8_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3458723"},{"key":"e_1_2_8_25_3","doi-asserted-by":"crossref","unstructured":"doi:10.1145\/3458723. 3","DOI":"10.1145\/3458723"},{"key":"e_1_2_8_26_2","first-page":"455","volume-title":"Women, science, and technology","author":"Haraway D.","year":"2013"},{"issue":"6","key":"e_1_2_8_27_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3462447","article-title":"Cracks in the success narrative: Rethinking failure in design research through a retrospective trioethnography","volume":"28","author":"Howell N.","year":"2021","journal-title":"ACM Transactions on Computer\u2010Human Interaction (TOCHI)"},{"key":"e_1_2_8_28_2","unstructured":"LilyW. G. CabouatA.\u2010F. BonillaK. CuiY. DingY. RakotondravonyN. CreamerM. M. OttoJ. T. HedayatiM. KwonB. C. et al.: An autoethnography on visualization literacy: A wicked measurement problem.IEEE Transactions on Visualization and Computer Graphics(2025). 1 4"},{"key":"e_1_2_8_29_2","first-page":"289","article-title":"Establishing trustworthiness","volume":"289","author":"Lincoln Y. S.","year":"1985","journal-title":"Naturalistic Inquiry"},{"key":"e_1_2_8_30_2","doi-asserted-by":"publisher","DOI":"10.5172\/mra.455.2.1.105"},{"key":"e_1_2_8_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2934539"},{"key":"e_1_2_8_32_2","doi-asserted-by":"crossref","unstructured":"National Academies of Sciences Engineering and Medicine: Reproducibility and replicability in science.National Academies of Sciences Engineering and Medicine(2019). doi:https:\/\/doi.org\/10.17226\/25303. 1 2","DOI":"10.17226\/25303"},{"key":"e_1_2_8_33_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1708274114"},{"key":"e_1_2_8_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2934788"},{"key":"e_1_2_8_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467551"},{"key":"e_1_2_8_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/bult.2012.1720390110"},{"key":"e_1_2_8_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3030405"},{"key":"e_1_2_8_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3158675"},{"key":"e_1_2_8_39_2","first-page":"1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems","author":"Rule A.","year":"2018"},{"key":"e_1_2_8_39_3","doi-asserted-by":"crossref","unstructured":"doi:10.1145\/3173574.3173606. 3","DOI":"10.1145\/3173574.3173606"},{"key":"e_1_2_8_40_2","doi-asserted-by":"crossref","DOI":"10.4324\/9781315237473","volume-title":"The reflective practitioner: How professionals think in action","author":"Sch\u00f6n D. A.","year":"2017"},{"key":"e_1_2_8_41_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562\u2010021\u201001142\u20104"},{"key":"e_1_2_8_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2007.106"},{"issue":"1","key":"e_1_2_8_43_2","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1109\/TVCG.2018.2865024","article-title":"KnowledgePearls: Provenance\u2010based visualization retrieval","volume":"25","author":"Stitz H.","year":"2018","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_2_8_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.213"},{"key":"e_1_2_8_45_2","volume-title":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems","author":"Salehzadeh Niksirat K.","year":"2023"},{"key":"e_1_2_8_45_3","doi-asserted-by":"crossref","unstructured":"doi:10.1145\/3544548.3580848. 2","DOI":"10.1145\/3544548.3580848"},{"key":"e_1_2_8_46_2","doi-asserted-by":"publisher","DOI":"10.1177\/1077800410383121"},{"issue":"3","key":"e_1_2_8_47_2","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.visinf.2022.05.005","article-title":"Forseti: A visual analysis environment enabling provenance awareness for the accountability of e\u2010autopsy reports","volume":"6","author":"Wang B.","year":"2022","journal-title":"Visual Informatics"},{"key":"e_1_2_8_48_2","doi-asserted-by":"crossref","unstructured":"WacharamanothamC. EisenringL. HarozS. EchtlerF.: Transparency of chi research artifacts: Results of a self\u2010reported survey. InProceedings of the 2020 CHI Conference on Human Factors in Computing Systems(2020) pp.1\u201314. doi:10.1145\/3313831.3376448. 2","DOI":"10.1145\/3313831.3376448"},{"key":"e_1_2_8_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864836"},{"key":"e_1_2_8_50_2","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14035"},{"key":"e_1_2_8_51_2","doi-asserted-by":"publisher","DOI":"10.1080\/17493460802276893"}],"container-title":["Computer Graphics Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.70445","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/cgf.70445","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.70445","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T06:15:38Z","timestamp":1781763338000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/cgf.70445"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,17]]},"references-count":54,"alternative-id":["10.1111\/cgf.70445"],"URL":"https:\/\/doi.org\/10.1111\/cgf.70445","archive":["Portico"],"relation":{},"ISSN":["0167-7055","1467-8659"],"issn-type":[{"value":"0167-7055","type":"print"},{"value":"1467-8659","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,17]]},"assertion":[{"value":"2026-06-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70445"}}