{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T15:15:05Z","timestamp":1778944505961,"version":"3.51.4"},"reference-count":119,"publisher":"Association for Computing Machinery (ACM)","issue":"2","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2026,6,30]]},"abstract":"<jats:p>\n                    Computer Vision (CV) models can become outdated after deployment as real-world data evolves, requiring intensive attention from AI engineers to address degraded performance through tasks like data relabeling to update models with new human perceptions. Interactive human-in-the-loop systems have considerable potential to enhance model-steering practices. However, such workflows reveal two challenges: (1) scalability, where labor demands increase with data size, and (2) actionability, where human insights do not readily transform into model revisions. Based on our formative study (S1) on the current challenges faced by CV professionals, we developed De-Decay, an end-to-end\n                    <jats:italic toggle=\"yes\">Human-Data Alignment<\/jats:italic>\n                    system offering\n                    <jats:italic toggle=\"yes\">scalable label-less assessment<\/jats:italic>\n                    and\n                    <jats:italic toggle=\"yes\">actionable insight transformation<\/jats:italic>\n                    . This enables engineers to investigate degradation and auto-retrain models with AI support, such as image clustering and regeneration. Our summative study (S2) showed that De-Decay helped engineers effectively identify and address CV degradation. We discuss how future research can enhance scalability and actionability in AI evaluation systems for aligning AI behaviors with human mental models.\n                  <\/jats:p>","DOI":"10.1145\/3797953","type":"journal-article","created":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T15:08:54Z","timestamp":1771513734000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["De-Decay: Defusing Computer Vision Model Degradation through Scalable and Actionable Human-Data Alignment"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7298-0333","authenticated-orcid":false,"given":"Tong Steven","family":"Sun","sequence":"first","affiliation":[{"name":"George Mason University, Fairfax, Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2717-9438","authenticated-orcid":false,"given":"Huining","family":"Feng","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7780-7943","authenticated-orcid":false,"given":"Jinwei","family":"Ye","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0417-8450","authenticated-orcid":false,"given":"Sangdoo","family":"Yun","sequence":"additional","affiliation":[{"name":"NAVER AI Lab, Seongnam, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2681-2774","authenticated-orcid":false,"given":"Young-Ho","family":"Kim","sequence":"additional","affiliation":[{"name":"NAVER AI Lab, Seongnam, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6050-5404","authenticated-orcid":false,"given":"Sungsoo Ray","family":"Hong","sequence":"additional","affiliation":[{"name":"George Mason University, Fairfax, Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,5,11]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad Ilge Akkaya Florencia Leoni Aleman Diogo Almeida Janko Altenschmidt Sam Altman Shyamal Anadkat et al. 2023. GPT-4 technical report. arXiv:2303.08774. Retrieved from https:\/\/arxiv.org\/abs\/2303.08774"},{"key":"e_1_3_3_3_2","unstructured":"Samuel Ackerman Orna Raz Marcel Zalmanovici and Aviad Zlotnick. 2021. Automatically detecting data drift in machine learning classifiers. arXiv:2111.05672. Retrieved from https:\/\/arxiv.org\/abs\/2111.05672"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.69.2.334"},{"key":"e_1_3_3_5_2","first-page":"24","volume-title":"Proceedings of the 10th International Symposium on NDT in Aerospace","author":"Adhikari Partha","year":"2018","unstructured":"Partha Adhikari, Harsha Gururaja Rao, and M. Buderath. 2018. Machine learning based data driven diagnostics & prognostics framework for aircraft predictive maintenance. In Proceedings of the 10th International Symposium on NDT in Aerospace, 24\u201326."},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_3_3_7_2","unstructured":"Dario Amodei Chris Olah Jacob Steinhardt Paul Christiano John Schulman and Dan Man\u00e9. 2016. Concrete problems in AI safety. arXiv:1606.06565. Retrieved from https:\/\/arxiv.org\/abs\/1606.06565"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3640543.3645214"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340960"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.5555\/2835587.2835589"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.108632"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.4314"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00976"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744683"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.5555\/2817912.2817913"},{"key":"e_1_3_3_17_2","first-page":"189","article-title":"SUS\u2014A quick and dirty usability scale","author":"Brooke John","year":"1996","unstructured":"John Brooke. 1996. SUS\u2014A quick and dirty usability scale. In Usability Evaluation in Industry. Patrick W. Jordan, B. Thomas, Ian Lyall McClelland, and Bernard Weerdmeester (Eds.), CRC Press, 189\u2013194. DOI: https:\/\/doi.org\/10.1201\/9781498710411","journal-title":"Usability Evaluation in Industry."},{"key":"e_1_3_3_18_2","doi-asserted-by":"crossref","unstructured":"Arif Budiman Mohamad Ivan Fanany and Chan Basaruddin. 2016. Adaptive convolutional ELM for concept drift handling in online stream data. arXiv:1610.02348. Retrieved from https:\/\/arxiv.org\/abs\/1610.02348","DOI":"10.1155\/2016\/8091267"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858498"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026044"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/1148020.1148024"},{"key":"e_1_3_3_22_2","first-page":"1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"5","author":"Chung Chaeyeon","year":"2021","unstructured":"Chaeyeon Chung, Jung Soo Lee, Kyungmin Park, Junsoo Lee, Jaegul Choo, and Sungsoo Ray Hong. 2021. Understanding human-side impact of sequencing images in batch labeling for subjective tasks. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1\u201326."},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359164"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1984.10478080"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.1999.815577"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00432"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2020.103298"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2599168"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2019.8851731"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3185517"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1198\/106186002317375604"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208294"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1080\/08838151.2013.875018"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3654777.3676332"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3644073"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM51629.2021.00023"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539419"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3555590"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3134687"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3392878"},{"key":"e_1_3_3_42_2","article-title":"Correcting sample selection bias by unlabeled data","volume":"19","author":"Huang Jiayuan","year":"2006","unstructured":"Jiayuan Huang, Arthur Gretton, Karsten Borgwardt, Bernhard Sch\u00f6lkopf, and Alex Smola. 2006. Correcting sample selection bias by unlabeled data. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 19.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-0378-8_4"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2020.0110127"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753529"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533135"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-71080-6_6"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/312129.312285"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-018-2093-8"},{"key":"e_1_3_3_50_2","article-title":"BatchBALD: Efficient and diverse batch acquisition for deep Bayesian active learning","volume":"32","author":"Kirsch Andreas","year":"2019","unstructured":"Andreas Kirsch, Joost Van Amersfoort, and Yarin Gal. 2019. BatchBALD: Efficient and diverse batch acquisition for deep Bayesian active learning. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 32.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2019.00058"},{"key":"e_1_3_3_52_2","volume-title":"Proceedings of 16th European Conference on Computer-Supported Cooperative Work-Exploratory Papers","author":"Koch Michael","year":"2018","unstructured":"Michael Koch, Kai von Luck, Jan Schwarzer, and Susanne Draheim. 2018. The novelty effect in large display deployments\u2013experiences and lessons-learned for evaluating prototypes. In Proceedings of 16th European Conference on Computer-Supported Cooperative Work-Exploratory Papers. European Society for Socially Embedded Technologies (EUSSET)."},{"key":"e_1_3_3_53_2","article-title":"ImageNet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 25.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2024.3401547"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3637288"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","unstructured":"Derek Layder. 1998. Sociological Practice: Linking Theory and Social Research. SAGE Publications Ltd. DOI: 10.4135\/9781849209946","DOI":"10.4135\/9781849209946"},{"key":"e_1_3_3_57_2","volume-title":"Research Methods in Human-Computer Interaction","author":"Lazar Jonathan","year":"2017","unstructured":"Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research Methods in Human-Computer Interaction. Morgan Kaufmann."},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000073"},{"key":"e_1_3_3_60_2","article-title":"Visual instruction tuning","volume":"36","author":"Liu Haotian","year":"2024","unstructured":"Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. 2024. Visual instruction tuning. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 36.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598831"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00622"},{"issue":"12","key":"e_1_3_3_63_2","first-page":"2346","article-title":"Learning under concept drift: A review","volume":"31","author":"Lu Jie","year":"2018","unstructured":"Jie Lu, Anjin Liu, Fan Dong, Feng Gu, Joao Gama, and Guangquan Zhang. 2018. Learning under concept drift: A review. IEEE Transactions on Knowledge and Data Engineering 31, 12 (2018), 2346\u20132363.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.14419\/ijet.v7i2.14.11464"},{"key":"e_1_3_3_65_2","doi-asserted-by":"crossref","unstructured":"Jennifer Mason. 2017. Qualitative Researching. SAGE Publications Ltd.","DOI":"10.4135\/9781036234492"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.65"},{"key":"e_1_3_3_67_2","unstructured":"Leland McInnes John Healy and James Melville. 2018. UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv:1802.03426. Retrieved from https:\/\/arxiv.org\/abs\/1802.03426"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1002\/9780470479216.corpsy0524"},{"key":"e_1_3_3_69_2","volume-title":"Human-in-the-Loop Machine Learning: Active Learning and Annotation for Human-Centered AI","author":"Monarch Robert Munro","year":"2021","unstructured":"Robert Munro Monarch. 2021. Human-in-the-Loop Machine Learning: Active Learning and Annotation for Human-Centered AI. Simon and Schuster."},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.06.019"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510209"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCCNT51525.2021.9580110"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10029-019-02093-6"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2022.3221290"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.5555\/2631405"},{"key":"e_1_3_3_76_2","article-title":"Can you trust your model\u2019s uncertainty? Evaluating predictive uncertainty under dataset shift","volume":"32","author":"Ovadia Yaniv","year":"2019","unstructured":"Yaniv Ovadia, Emily Fertig, Jie Ren, Zachary Nado, David Sculley, Sebastian Nowozin, Joshua Dillon, Balaji Lakshminarayanan, and Jasper Snoek. 2019. Can you trust your model\u2019s uncertainty? Evaluating predictive uncertainty under dataset shift. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 32.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335384"},{"key":"e_1_3_3_78_2","article-title":"PyTorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. PyTorch: An imperative style, high-performance deep learning library. In Proceedings of the Advances in Neural Information Processing Systems, Vol. 32.","journal-title":"Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_79_2","first-page":"1563","volume-title":"Proceedings of the 23rd AAAI Conference on Artificial Intelligence (AAAI)","author":"Patel Kayur","year":"2008","unstructured":"Kayur Patel, James Fogarty, James A. Landay, and Beverly L. Harrison. 2008. Examining difficulties software developers encounter in the adoption of statistical machine learning. In Proceedings of the 23rd AAAI Conference on Artificial Intelligence (AAAI), 1563\u20131566."},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-24876-0"},{"key":"e_1_3_3_81_2","volume-title":"Dataset Shift in Machine Learning","author":"Qui\u00f1onero-Candela Joaquin","year":"2022","unstructured":"Joaquin Qui\u00f1onero-Candela, Masashi Sugiyama, Anton Schwaighofer, and Neil D. Lawrence. 2022. Dataset Shift in Machine Learning. MIT Press."},{"key":"e_1_3_3_82_2","first-page":"8748","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In Proceedings of the International Conference on Machine Learning. PMLR, 8748\u20138763."},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598828"},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472291"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_3_3_86_2","volume-title":"The Coding Manual for Qualitative Researchers","author":"Salda\u00f1a Johnny","year":"2015","unstructured":"Johnny Salda\u00f1a. 2015. The Coding Manual for Qualitative Researchers. Sage."},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3152494.3152501"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-804753-8.00008-7"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_3_90_2","unstructured":"Burr Settles. 2009. Active learning literature survey. Technical Report University of Wisconsin-Madison Department of Computer Sciences. Retrieved from http:\/\/digital.library.wisc.edu\/1793\/60660"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451798"},{"key":"e_1_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.nlpcss-1.19"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-155860915-0\/50046-9"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.3390\/e23060759"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126261"},{"key":"e_1_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-020-05903-6"},{"key":"e_1_3_3_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3582688"},{"key":"e_1_3_3_98_2","doi-asserted-by":"crossref","unstructured":"Amos Storkey. 2008. When training and test sets are different: Characterizing learning transfer (2008).","DOI":"10.7551\/mitpress\/7921.003.0004"},{"key":"e_1_3_3_99_2","first-page":"2611","volume-title":"Proceedings of the International Conference on Artificial Intelligence and Statistics","author":"Subbaswamy Adarsh","year":"2021","unstructured":"Adarsh Subbaswamy, Roy Adams, and Suchi Saria. 2021. Evaluating model robustness and stability to dataset shift. In Proceedings of the International Conference on Artificial Intelligence and Statistics. PMLR, 2611\u20132619."},{"key":"e_1_3_3_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610187"},{"key":"e_1_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518895"},{"key":"e_1_3_3_102_2","doi-asserted-by":"publisher","DOI":"10.4135\/9781526405555.n2"},{"key":"e_1_3_3_103_2","volume-title":"Illuminating the Path: The Research and Development Agenda for Visual Analytics","author":"Thomas James J.","year":"2005","unstructured":"James J. Thomas. 2005. Illuminating the Path: The Research and Development Agenda for Visual Analytics. IEEE Computer Society."},{"key":"e_1_3_3_104_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2013.6706768"},{"key":"e_1_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.1109\/VAST50239.2020.00006"},{"key":"e_1_3_3_106_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641960"},{"key":"e_1_3_3_107_2","doi-asserted-by":"publisher","DOI":"10.1145\/3386252"},{"key":"e_1_3_3_108_2","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382899"},{"key":"e_1_3_3_109_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-015-0448-4"},{"issue":"1","key":"e_1_3_3_110_2","first-page":"56","article-title":"The What-If Tool: Interactive probing of machine learning models","volume":"26","author":"Wexler James","year":"2019","unstructured":"James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The What-If Tool: Interactive probing of machine learning models. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2019), 56\u201365.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_3_111_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744878"},{"key":"e_1_3_3_112_2","doi-asserted-by":"publisher","DOI":"10.3390\/app12168103"},{"key":"e_1_3_3_113_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2022.05.014"},{"key":"e_1_3_3_114_2","doi-asserted-by":"publisher","DOI":"10.3390\/app13116515"},{"key":"e_1_3_3_115_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209889.3209897"},{"key":"e_1_3_3_116_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502075"},{"key":"e_1_3_3_117_2","doi-asserted-by":"publisher","DOI":"10.1109\/VAST50239.2020.00007"},{"key":"e_1_3_3_118_2","unstructured":"Fisher Yu Ari Seff Yinda Zhang Shuran Song Thomas Funkhouser and Jianxiong Xiao. 2015. LSUN: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv:1506.03365. Retrieved from https:\/\/arxiv.org\/abs\/1506.03365"},{"key":"e_1_3_3_119_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23125"},{"key":"e_1_3_3_120_2","unstructured":"Daniel M. Ziegler Nisan Stiennon Jeffrey Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano and Geoffrey Irving. 2019. Fine-tuning language models from human preferences. arXiv:1909.08593. Retrieved from https:\/\/arxiv.org\/abs\/1909.08593"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3797953","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T14:32:48Z","timestamp":1778941968000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3797953"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,11]]},"references-count":119,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,6,30]]}},"alternative-id":["10.1145\/3797953"],"URL":"https:\/\/doi.org\/10.1145\/3797953","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,11]]},"assertion":[{"value":"2025-03-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-05-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}