{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T08:51:33Z","timestamp":1782377493948,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T00:00:00Z","timestamp":1776038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,13]]},"DOI":"10.1145\/3772318.3791356","type":"proceedings-article","created":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T04:12:26Z","timestamp":1776053546000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["DALL: Data Labeling via Data Programming and Active Learning Enhanced by Large Language Models"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6663-6712","authenticated-orcid":false,"given":"Guozheng","family":"Li","sequence":"first","affiliation":[{"name":"Beijing Institute of Technology, Beijing, 493, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8569-4473","authenticated-orcid":false,"given":"Ao","family":"Wang","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6274-2958","authenticated-orcid":false,"given":"Shaoxiang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9035-0463","authenticated-orcid":false,"given":"Yu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Oxford, Oxford, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2007-6944","authenticated-orcid":false,"given":"Pengcheng","family":"Cao","sequence":"additional","affiliation":[{"name":"People's Daily, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7589-6114","authenticated-orcid":false,"given":"Yang","family":"Bai","sequence":"additional","affiliation":[{"name":"People's Daily, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0252-329X","authenticated-orcid":false,"given":"Chi Harold","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,4,13]]},"reference":[{"key":"e_1_3_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3746059.3747719"},{"key":"e_1_3_3_2_3_2","doi-asserted-by":"publisher","unstructured":"M\u00e9lanie Bernhardt Daniel\u00a0C. Castro Ryutaro Tanno Anton Schwaighofer Kerem\u00a0C. Tezcan Miguel Monteiro Shruthi Bannur Matthew\u00a0P. Lungren Aditya Nori Ben Glocker Javier Alvarez-Valle and Ozan Oktay. 2022. Active Label Cleaning for Improved Dataset Quality under Resource Constraints. Nature Communications 13 1 (March 2022) 1161. 10.1038\/s41467-022-28818-3","DOI":"10.1038\/s41467-022-28818-3"},{"key":"e_1_3_3_2_4_2","series-title":"(ICLR \u201921)","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Boecking Benedikt","year":"2021","unstructured":"Benedikt Boecking, Willie Neiswanger, Eric Xing, and Artur Dubrawski. 2021. Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling. In Proceedings of the International Conference on Learning Representations(ICLR \u201921). 27\u00a0pages."},{"key":"e_1_3_3_2_5_2","volume-title":"Usability Evaluation In Industry (1st ed.)","author":"Brooke John","year":"1996","unstructured":"John Brooke. 1996. SUS: A \u2018Quick and Dirty\u2019 Usability Scale. In Usability Evaluation In Industry (1st ed.). Taylor & Francis, London, UK."},{"key":"e_1_3_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026044"},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"publisher","unstructured":"Mohammad Chegini J\u00fcrgen Bernard Philip Berger Alexei Sourin Keith Andrews and Tobias Schreck. 2019. Interactive labelling of a multivariate dataset for supervised machine learning using linked visualisations clustering and active learning. Visual Informatics 3 1 (2019) 9\u201317. 10.1016\/j.visinf.2019.03.002","DOI":"10.1016\/j.visinf.2019.03.002"},{"key":"e_1_3_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442442.3458602"},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-377-6.50027-X"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.181"},{"key":"e_1_3_3_2_11_2","doi-asserted-by":"publisher","unstructured":"Fabrizio Gilardi Meysam Alizadeh and Ma\u00ebl Kubli. 2023. ChatGPT Outperforms Crowd Workers for Text-Annotation Tasks. Proceedings of the National Academy of Sciences 120 30 (July 2023) e2305016120. 10.1073\/pnas.2305016120","DOI":"10.1073\/pnas.2305016120"},{"key":"e_1_3_3_2_12_2","unstructured":"Alec Go Richa Bhayani and Lei Huang. 2009. Twitter Sentiment Classification Using Distant Supervision. https:\/\/huggingface.co\/datasets\/stanfordnlp\/sentiment140"},{"key":"e_1_3_3_2_13_2","doi-asserted-by":"publisher","unstructured":"Kate Goddard Abdul Roudsari and Jeremy\u00a0C. Wyatt. 2012. Automation Bias: A Systematic Review of Frequency Effect Mediators and Mitigators. Journal of the American Medical Informatics Association 19 1 (Jan. 2012) 121\u2013127. 10.1136\/amiajnl-2011-000089","DOI":"10.1136\/amiajnl-2011-000089"},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.48786\/EDBT.2024.44"},{"key":"e_1_3_3_2_15_2","doi-asserted-by":"publisher","unstructured":"Jianben He Xingbo Wang Kam\u00a0Kwai Wong Xijie Huang Changjian Chen Zixin Chen Fengjie Wang Min Zhu and Huamin Qu. 2024. VideoPro: A Visual Analytics Approach for Interactive Video Programming. IEEE Transactions on Visualization and Computer Graphics 30 1 (Jan. 2024) 87\u201397. 10.1109\/TVCG.2023.3326586","DOI":"10.1109\/TVCG.2023.3326586"},{"key":"e_1_3_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3713741"},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"publisher","unstructured":"Md\u00a0Naimul Hoque Wenbin He Arvind\u00a0Kumar Shekar Liang Gou and Liu Ren. 2023. Visual Concept Programming: A Visual Analytics Approach to Injecting Human Intelligence at Scale. IEEE Transactions on Visualization and Computer Graphics 29 1 (Jan. 2023) 74\u201383. 10.1109\/TVCG.2022.3209466","DOI":"10.1109\/TVCG.2022.3209466"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"publisher","unstructured":"Cheng-Yu Hsieh Jieyu Zhang and Alexander Ratner. 2022. Nemo: Guiding and Contextualizing Weak Supervision for Interactive Data Programming. Proceedings of the VLDB Endowment 15 13 (Sept. 2022) 4093\u20134105. 10.14778\/3565838.3565859","DOI":"10.14778\/3565838.3565859"},{"key":"e_1_3_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.eacl-demo.18"},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-335-6.50026-X"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2408.16173"},{"key":"e_1_3_3_2_22_2","doi-asserted-by":"publisher","unstructured":"Guozheng Li Shiyu Han Jihe Wu Jiale Hu Yu Zhang and Chi\u00a0Harold Liu. 2025. BiaSeer: A Visual Analytics System for Identifying and Understanding Media Bias. Proceedings of the ACM on Human-Computer Interaction 9 2 Article CSCW038 (May 2025) 28\u00a0pages. 10.1145\/3710936","DOI":"10.1145\/3710936"},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"publisher","unstructured":"Sisi Li Guanzhong Liu Tianxiang Wei Shichao Jia and Jiawan Zhang. 2025. EvoVis: A Visual Analytics Method to Understand the Labeling Iterations in Data Programming. IEEE Transactions on Visualization and Computer Graphics 31 3 (March 2025) 1802\u20131817. 10.1109\/TVCG.2024.3370654","DOI":"10.1109\/TVCG.2024.3370654"},{"key":"e_1_3_3_2_24_2","doi-asserted-by":"publisher","unstructured":"Hongsen Liao Li Chen Yibo Song and Hao Ming. 2016. Visualization-Based Active Learning for Video Annotation. IEEE Transactions on Multimedia 18 11 (Nov. 2016) 2196\u20132205. 10.1109\/TMM.2016.2614227","DOI":"10.1109\/TMM.2016.2614227"},{"key":"e_1_3_3_2_25_2","doi-asserted-by":"publisher","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. arxiv:https:\/\/arXiv.org\/abs\/1907.11692\u00a0[cs] 10.48550\/arXiv.1907.11692","DOI":"10.48550\/arXiv.1907.11692"},{"key":"e_1_3_3_2_26_2","doi-asserted-by":"publisher","unstructured":"Yuxuan Lu Bingsheng Yao Shao Zhang Yun Wang Peng Zhang Tun Lu Toby Jia-Jun Li and Dakuo Wang. 2023. Human Still Wins over LLM: An Empirical Study of Active Learning on Domain-Specific Annotation Tasks. arxiv:https:\/\/arXiv.org\/abs\/2311.09825\u00a0[cs] 10.48550\/arXiv.2311.09825","DOI":"10.48550\/arXiv.2311.09825"},{"key":"e_1_3_3_2_27_2","series-title":"Proceedings of Machine Learning Research","first-page":"38","volume-title":"Proceedings on \u201cI Can\u2019t Believe It\u2019s Not Better: Failure Modes in the Age of Foundation Models\u201d at NeurIPS 2023 Workshops","volume":"239","author":"Mohta Jay","year":"2023","unstructured":"Jay Mohta, Kenan Ak, Yan Xu, and Mingwei Shen. 2023. Are Large Language Models Good Annotators?. In Proceedings on \u201cI Can\u2019t Believe It\u2019s Not Better: Failure Modes in the Age of Foundation Models\u201d at NeurIPS 2023 Workshops(Proceedings of Machine Learning Research, Vol.\u00a0239), Javier Antor\u00e1n, Arno Blaas, Kelly Buchanan, Fan Feng, Vincent Fortuin, Sahra Ghalebikesabi, Andreas Kriegler, Ian Mason, David Rohde, Francisco J.\u00a0R. Ruiz, Tobias Uelwer, Yubin Xie, and Rui Yang (Eds.). PMLR, 38\u201348. https:\/\/proceedings.mlr.press\/v239\/mohta23a.html"},{"key":"e_1_3_3_2_28_2","unstructured":"Hiroki Nakayama Takahiro Kubo Junya Kamura Yasufumi Taniguchi and Xu Liang. 2018. doccano: Text Annotation Tool for Human. https:\/\/github.com\/doccano\/doccano"},{"key":"e_1_3_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8622459"},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015349"},{"key":"e_1_3_3_2_31_2","unstructured":"OpenAI. 2023. GPT-3.5 Turbo. https:\/\/platform.openai.com\/docs\/models\/gpt-3-5-turbo"},{"key":"e_1_3_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/S14-2004"},{"key":"e_1_3_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.14778\/3157794.3157797"},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33014763"},{"key":"e_1_3_3_2_35_2","series-title":"(NIPS \u201916)","first-page":"3574","volume-title":"Proceedings of the International Conference on Neural Information Processing Systems","author":"Ratner Alexander","year":"2016","unstructured":"Alexander Ratner, Christopher\u00a0De Sa, Sen Wu, Daniel Selsam, and Christopher R\u00e9. 2016. Data Programming: Creating Large Training Sets, Quickly. In Proceedings of the International Conference on Neural Information Processing Systems (Barcelona, Spain) (NIPS \u201916). Curran Associates Inc., Red Hook, NY, USA, 3574\u20133582."},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44816-0_31"},{"key":"e_1_3_3_2_37_2","volume-title":"Active Learning Literature Survey","author":"Settles Burr","year":"2009","unstructured":"Burr Settles. 2009. Active Learning Literature Survey. Technical Report. University of Wisconsin\u2013Madison."},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/130385.130417"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData59044.2023.10386190"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.97"},{"key":"e_1_3_3_2_41_2","unstructured":"Maxim Tkachenko Mikhail Malyuk Nikita Shevchenko Andrey Holmanyuk and Nikolai Liubimov. 2020. Label Studio: Data Labeling Software. https:\/\/github.com\/heartexlabs\/label-studio"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"publisher","unstructured":"Meng Wang and Xian-Sheng Hua. 2011. Active Learning in Multimedia Annotation and Retrieval: A Survey. ACM Transactions on Intelligent Systems and Technology 2 2 Article 10 (Feb. 2011) 21\u00a0pages. 10.1145\/1899412.1899414","DOI":"10.1145\/1899412.1899414"},{"key":"e_1_3_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641960"},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"publisher","unstructured":"Xinyu Wang Chenwei Liang Shunyuan Zheng Jinyuan Liang Guozheng Li Yu Zhang and Chi\u00a0Harold Liu. 2024. Visualization Generation with Large Language Models: An Evaluation. arXiv:2401.11255 (2024). arxiv:https:\/\/arXiv.org\/abs\/2401.11255\u00a0[cs] 10.48550\/arXiv.2401.11255","DOI":"10.48550\/arXiv.2401.11255"},{"key":"e_1_3_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.592"},{"key":"e_1_3_3_2_46_2","doi-asserted-by":"publisher","unstructured":"Wenxuan Zhang Xin Li Yang Deng Lidong Bing and Wai Lam. 2023. A Survey on Aspect-Based Sentiment Analysis: Tasks Methods and Challenges. IEEE Transactions on Knowledge and Data Engineering 35 11 (Nov. 2023) 11019\u201311038. 10.1109\/TKDE.2022.3230975","DOI":"10.1109\/TKDE.2022.3230975"},{"key":"e_1_3_3_2_47_2","series-title":"NIPS \u201915","first-page":"649","volume-title":"Proceedings of the International Conference on Neural Information Processing Systems","volume":"1","author":"Zhang Xiang","year":"2015","unstructured":"Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015. Character-Level Convolutional Networks for Text Classification. In Proceedings of the International Conference on Neural Information Processing Systems (Montreal, Canada) (NIPS \u201915, Vol.\u00a01). MIT Press, Cambridge, MA, USA, 649\u2013657."},{"key":"e_1_3_3_2_48_2","doi-asserted-by":"publisher","unstructured":"Yu Zhang Bob Coecke and Min Chen. 2021. MI3: Machine-Initiated Intelligent Interaction for Interactive Classification and Data Reconstruction. ACM Transactions on Interactive Intelligent Systems 11 3\u20134 Article 18 (Aug. 2021) 34\u00a0pages. 10.1145\/3412848","DOI":"10.1145\/3412848"},{"key":"e_1_3_3_2_49_2","doi-asserted-by":"publisher","unstructured":"Yu Zhang Martijn Tennekes Tim De\u00a0Jong Lyana Curier Bob Coecke and Min Chen. 2024. Simulation-Based Optimization of User Interfaces for Quality-Assuring Machine Learning Model Predictions. ACM Transactions on Interactive Intelligent Systems 14 1 Article 1 (Jan. 2024) 32\u00a0pages. 10.1145\/3594552","DOI":"10.1145\/3594552"},{"key":"e_1_3_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517612"},{"key":"e_1_3_3_2_51_2","volume-title":"Proceedings of the IEEE VIS Workshop on GenAI, Agents, and the Future of VIS","author":"Zhang Yu","year":"2025","unstructured":"Yu Zhang, Yuheng Zhao, Yuhan Guo, Guozheng Li, Siming Chen, and Xiaoru Yuan. 2025. Position Paper: Validatory Visualization for Human-GenAI Co-Creation. In Proceedings of the IEEE VIS Workshop on GenAI, Agents, and the Future of VIS (Vienna, Austria). IEEE, Piscataway, NJ, USA, 5\u00a0pages."}],"event":{"name":"CHI 2026: CHI Conference on Human Factors in Computing Systems","location":"Barcelona Spain","acronym":"CHI '26","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3772318.3791356","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T08:39:26Z","timestamp":1782376766000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3772318.3791356"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,13]]},"references-count":50,"alternative-id":["10.1145\/3772318.3791356","10.1145\/3772318"],"URL":"https:\/\/doi.org\/10.1145\/3772318.3791356","relation":{},"subject":[],"published":{"date-parts":[[2026,4,13]]},"assertion":[{"value":"2026-04-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}