{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T10:21:06Z","timestamp":1790245266890,"version":"4.1.0"},"publisher-location":"New York, NY, USA","reference-count":64,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T00:00:00Z","timestamp":1715558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,5,13]]},"DOI":"10.1145\/3589334.3645642","type":"proceedings-article","created":{"date-parts":[[2024,5,8]],"date-time":"2024-05-08T07:08:13Z","timestamp":1715152093000},"page":"245-255","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["APT-Pipe: A Prompt-Tuning Tool for Social Data Annotation using ChatGPT"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7537-5582","authenticated-orcid":false,"given":"Yiming","family":"Zhu","sequence":"first","affiliation":[{"name":"The Hong Kong University of Science and Technology, Hong Kong, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4700-7774","authenticated-orcid":false,"given":"Zhizhuo","family":"Yin","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (GZ), Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3010-791X","authenticated-orcid":false,"given":"Gareth","family":"Tyson","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (GZ), Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4578-5302","authenticated-orcid":false,"given":"Ehsan-Ul","family":"Haq","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (GZ), Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1361-1612","authenticated-orcid":false,"given":"Lik-Hang","family":"Lee","sequence":"additional","affiliation":[{"name":"The Hong Kong Polytechnic University, Hong Kong, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6026-1083","authenticated-orcid":false,"given":"Pan","family":"Hui","sequence":"additional","affiliation":[{"name":"The Hong Kong University of Science and Technology (GZ), Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,13]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Can we trust the evaluation on ChatGPT? arXiv preprint arXiv:2303.12767","author":"Aiyappa Rachith","year":"2023","unstructured":"Rachith Aiyappa, Jisun An, Haewoon Kwak, and Yong-Yeol Ahn. 2023. Can we trust the evaluation on ChatGPT? arXiv preprint arXiv:2303.12767 (2023)."},{"key":"e_1_3_2_2_2_1","volume-title":"Maria Korobeynikova, and Fabrizio Gilardi.","author":"Alizadeh Meysam","year":"2023","unstructured":"Meysam Alizadeh, Ma\u00ebl Kubli, Zeynab Samei, Shirin Dehghani, Juan Diego Bermeo, Maria Korobeynikova, and Fabrizio Gilardi. 2023. Open-Source Large Language Models Outperform Crowd Workers and Approach ChatGPT in Text- Annotation Tasks. arXiv:2307.02179 [cs.CL]"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2023.3254179"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Yejin Bang Samuel Cahyawijaya Nayeon Lee Wenliang Dai Dan Su Bryan Wilie Holy Lovenia Ziwei Ji Tiezheng Yu Willy Chung Quyet V. Do Yan Xu and Pascale Fung. 2023. A Multitask Multilingual Multimodal Evaluation of ChatGPT on Reasoning Hallucination and Interactivity. arXiv:2302.04023 [cs.CL]","DOI":"10.18653\/v1\/2023.ijcnlp-main.45"},{"key":"e_1_3_2_2_5_1","volume-title":"Luis Espinosa Anke, and Jose Camacho-Collados","author":"Barbieri Francesco","year":"2021","unstructured":"Francesco Barbieri, Luis Espinosa Anke, and Jose Camacho-Collados. 2021. Xlm-t: Multilingual language models in twitter for sentiment analysis and beyond. arXiv preprint arXiv:2104.12250 (2021)."},{"key":"e_1_3_2_2_6_1","volume-title":"A categorical archive of chatgpt failures. arXiv preprint arXiv:2302.03494","author":"Borji Ali","year":"2023","unstructured":"Ali Borji. 2023. A categorical archive of chatgpt failures. arXiv preprint arXiv:2302.03494 (2023)."},{"key":"e_1_3_2_2_7_1","volume-title":"Lin (Eds.)","volume":"33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 1877--1901. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/ 1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASONAM.2016.7752207"},{"key":"e_1_3_2_2_9_1","volume-title":"An empirical study on largescale multi-label text classification including few and zero-shot labels. arXiv preprint arXiv:2010.01653","author":"Chalkidis Ilias","year":"2020","unstructured":"Ilias Chalkidis, Manos Fergadiotis, Sotiris Kotitsas, Prodromos Malakasiotis, Nikolaos Aletras, and Ion Androutsopoulos. 2020. An empirical study on largescale multi-label text classification including few and zero-shot labels. arXiv preprint arXiv:2010.01653 (2020)."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18--5102"},{"key":"e_1_3_2_2_13_1","volume-title":"Shafiq Joty, Boyang Li, and Lidong Bing.","author":"Ding Bosheng","year":"2023","unstructured":"Bosheng Ding, Chengwei Qin, Linlin Liu, Yew Ken Chia, Shafiq Joty, Boyang Li, and Lidong Bing. 2023. Is GPT-3 a Good Data Annotator? arXiv:2212.10450 [cs.CL]"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Paul Ekman et al. 1999. Basic emotions. Handbook of cognition and emotion 98 45--60 (1999) 16.","DOI":"10.1002\/0470013494.ch3"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0251415"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2305016120"},{"key":"e_1_3_2_2_17_1","volume-title":"BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint arXiv:2203.05794","author":"Grootendorst Maarten","year":"2022","unstructured":"Maarten Grootendorst. 2022. BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint arXiv:2203.05794 (2022)."},{"key":"e_1_3_2_2_18_1","unstructured":"Biyang Guo Xin Zhang Ziyuan Wang Minqi Jiang Jinran Nie Yuxuan Ding Jianwei Yue and Yupeng Wu. 2023. How Close is ChatGPT to Human Experts? Comparison Corpus Evaluation and Detection. arXiv:2301.07597 [cs.CL]"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.aiopen.2022.11.003"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555636"},{"key":"e_1_3_2_2_21_1","unstructured":"Jochen Hartmann. 2022. Emotion English DistilRoBERTa-base. https:\/\/ huggingface.co\/j-hartmann\/emotion-english-distilroberta-base\/."},{"key":"e_1_3_2_2_22_1","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Hartvigsen Thomas","year":"1865","unstructured":"Thomas Hartvigsen, Saadia Gabriel, Hamid Palangi, Maarten Sap, Dipankar Ray, and Ece Kamar. 2022. ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Smaranda Muresan, Preslav Nakov, and Aline Villavicencio (Eds.). Association for Computational Linguistics, Dublin, Ireland, 3309--3326. https:\/\/doi.org\/10. 18653\/v1\/2022.acl-long.234"},{"key":"e_1_3_2_2_23_1","unstructured":"Spencer Holley. 2023. Fake Or Real. https:\/\/www.kaggle.com\/datasets\/ spencerholley\/fake-or-real."},{"key":"e_1_3_2_2_24_1","volume-title":"Knowledgeable prompt-tuning: Incorporating knowledge into prompt verbalizer for text classification. arXiv preprint arXiv:2108.02035","author":"Hu Shengding","year":"2021","unstructured":"Shengding Hu, Ning Ding, Huadong Wang, Zhiyuan Liu, Jingang Wang, Juanzi Li, Wei Wu, and Maosong Sun. 2021. Knowledgeable prompt-tuning: Incorporating knowledge into prompt verbalizer for text classification. arXiv preprint arXiv:2108.02035 (2021)."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1084"},{"key":"e_1_3_2_2_26_1","volume-title":"Is chatgpt better than human annotators? potential and limitations of chatgpt in explaining implicit hate speech. arXiv preprint arXiv:2302.07736","author":"Huang Fan","year":"2023","unstructured":"Fan Huang, Haewoon Kwak, and Jisun An. 2023. Is chatgpt better than human annotators? potential and limitations of chatgpt in explaining implicit hate speech. arXiv preprint arXiv:2302.07736 (2023)."},{"key":"e_1_3_2_2_27_1","unstructured":"Dave Hulbert. 2023. Tree of Knowledge: ToK aka Tree of Knowledge dataset for Large Language Models LLM. https:\/\/github.com\/dave1010\/tree-of-thoughtprompting."},{"key":"e_1_3_2_2_28_1","unstructured":"Google Jigsaw. 2017. Perpective API. https:\/\/perspectiveapi.com\/."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S19--2145"},{"key":"e_1_3_2_2_30_1","volume-title":"Oh (Eds.)","volume":"35","author":"Kojima Takeshi","year":"2022","unstructured":"Takeshi Kojima, Shixiang (Shane) Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. Large Language Models are Zero-Shot Reasoners. In Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.), Vol. 35. Curran Associates, Inc., 22199--22213. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/ 8bb0d291acd4acf06ef112099c16f326-Paper-Conference.pdf"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369026"},{"key":"e_1_3_2_2_32_1","volume-title":"Watch Your Language: Large Language Models and Content Moderation. arXiv preprint arXiv:2309.14517","author":"Kumar Deepak","year":"2023","unstructured":"Deepak Kumar, Yousef AbuHashem, and Zakir Durumeric. 2023. Watch Your Language: Large Language Models and Content Moderation. arXiv preprint arXiv:2309.14517 (2023)."},{"key":"e_1_3_2_2_33_1","volume-title":"Chatgpt: beginning of an end of manual annotation? Use case of automatic genre identification. arXiv preprint arXiv:2303.03953","author":"Kuzman Taja","year":"2023","unstructured":"Taja Kuzman, Nikola Ljubecic, and Igor Mozetic. 2023. Chatgpt: beginning of an end of manual annotation? Use case of automatic genre identification. arXiv preprint arXiv:2303.03953 (2023)."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.findings-acl.208"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3532048"},{"key":"e_1_3_2_2_36_1","unstructured":"Jieyi Long. 2023. Large Language Model Guided Tree-of-Thought. arXiv:2305.08291 [cs.AI]"},{"key":"e_1_3_2_2_37_1","volume-title":"Chatgpt as a factual inconsistency evaluator for abstractive text summarization. arXiv preprint arXiv:2303.15621","author":"Luo Zheheng","year":"2023","unstructured":"Zheheng Luo, Qianqian Xie, and Sophia Ananiadou. 2023. Chatgpt as a factual inconsistency evaluator for abstractive text summarization. arXiv preprint arXiv:2303.15621 (2023)."},{"key":"e_1_3_2_2_38_1","volume-title":"Template-free prompt tuning for few-shot NER. arXiv preprint arXiv:2109.13532","author":"Ma Ruotian","year":"2021","unstructured":"Ruotian Ma, Xin Zhou, Tao Gui, Yiding Tan, Linyang Li, Qi Zhang, and Xuanjing Huang. 2021. Template-free prompt tuning for few-shot NER. arXiv preprint arXiv:2109.13532 (2021)."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"crossref","unstructured":"Mahdi Maktab Dar Oghaz Kshipra Dhame Gayathri Singaram and Lakshmi Babu Saheer. 2023. Detection and Classification of ChatGPT Generated Contents Using Deep Transformer Models. (2023).","DOI":"10.36227\/techrxiv.23895951"},{"key":"e_1_3_2_2_40_1","volume-title":"Noisy channel language model prompting for few-shot text classification. arXiv preprint arXiv:2108.04106","author":"Min Sewon","year":"2021","unstructured":"Sewon Min, Mike Lewis, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2021. Noisy channel language model prompting for few-shot text classification. arXiv preprint arXiv:2108.04106 (2021)."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3439726"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.aiopen.2023.01.001"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1003"},{"key":"e_1_3_2_2_44_1","volume-title":"Jerry Tworek, Qiming Yuan, Nikolas Tezak, Jong Wook Kim, Chris Hallacy, et al.","author":"Neelakantan Arvind","year":"2022","unstructured":"Arvind Neelakantan, Tao Xu, Raul Puri, Alec Radford, Jesse Michael Han, Jerry Tworek, Qiming Yuan, Nikolas Tezak, Jong Wook Kim, Chris Hallacy, et al. 2022. Text and code embeddings by contrastive pre-training. arXiv preprint arXiv:2201.10005 (2022)."},{"key":"e_1_3_2_2_45_1","volume-title":"True few-shot learning with language models. Advances in neural information processing systems 34","author":"Perez Ethan","year":"2021","unstructured":"Ethan Perez, Douwe Kiela, and Kyunghyun Cho. 2021. True few-shot learning with language models. Advances in neural information processing systems 34 (2021), 11054--11070."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Fabio Petroni Tim Rockt\u00e4schel Patrick Lewis Anton Bakhtin Yuxiang Wu Alexander H. Miller and Sebastian Riedel. 2019. Language Models as Knowledge Bases? arXiv:1909.01066 [cs.CL]","DOI":"10.18653\/v1\/D19-1250"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v16i1.19334"},{"key":"e_1_3_2_2_48_1","volume-title":"Testing the reliability of chatgpt for text annotation and classification: A cautionary remark. arXiv preprint arXiv:2304.11085","author":"Reiss Michael V","year":"2023","unstructured":"Michael V Reiss. 2023. Testing the reliability of chatgpt for text annotation and classification: A cautionary remark. arXiv preprint arXiv:2304.11085 (2023)."},{"key":"e_1_3_2_2_49_1","volume-title":"ChatGPT output regarding compulsory vaccination and COVID-19 vaccine conspiracy: A descriptive study at the outset of a paradigm shift in online search for information. Cureus 15, 2","author":"Sallam Malik","year":"2023","unstructured":"Malik Sallam, Nesreen A Salim, B Ala'a, Muna Barakat, Diaa Fayyad, Souheil Hallit, Harapan Harapan, Rabih Hallit, Azmi Mahafzah, and B Ala'a. 2023. ChatGPT output regarding compulsory vaccination and COVID-19 vaccine conspiracy: A descriptive study at the outset of a paradigm shift in online search for information. Cureus 15, 2 (2023)."},{"key":"e_1_3_2_2_50_1","unstructured":"Xinyue Shen Zeyuan Chen Michael Backes and Yang Zhang. 2023. In chatgpt we trust? measuring and characterizing the reliability of chatgpt. arXiv preprint arXiv:2304.08979 (2023)."},{"key":"e_1_3_2_2_51_1","volume-title":"DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning. arXiv preprint arXiv:2309.05173","author":"Shi Zhengxiang","year":"2023","unstructured":"Zhengxiang Shi and Aldo Lipani. 2023. DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning. arXiv preprint arXiv:2309.05173 (2023)."},{"key":"e_1_3_2_2_52_1","volume-title":"Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data. arXiv preprint arXiv:2302.12822","author":"Shum KaShun","year":"2023","unstructured":"KaShun Shum, Shizhe Diao, and Tong Zhang. 2023. Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data. arXiv preprint arXiv:2302.12822 (2023)."},{"key":"e_1_3_2_2_53_1","volume-title":"Coco-text: Dataset and benchmark for text detection and recognition in natural images. arXiv preprint arXiv:1601.07140","author":"Veit Andreas","year":"2016","unstructured":"Andreas Veit, Tomas Matera, Lukas Neumann, Jiri Matas, and Serge Belongie. 2016. Coco-text: Dataset and benchmark for text detection and recognition in natural images. arXiv preprint arXiv:1601.07140 (2016)."},{"key":"e_1_3_2_2_54_1","volume-title":"Oh (Eds.)","volume":"35","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed Chi, Quoc V Le, and Denny Zhou. 2022. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. In Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.), Vol. 35. Curran Associates, Inc., 24824--24837. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/ 9d5609613524ecf4f15af0f7b31abca4-Paper-Conference.pdf"},{"key":"e_1_3_2_2_55_1","volume-title":"Proceedings of the 29th International Conference on Computational Linguistics. 902--911","author":"Xiang Wei","year":"2022","unstructured":"Wei Xiang, Zhenglin Wang, Lu Dai, and Bang Wang. 2022. ConnPrompt: Connective-cloze prompt learning for implicit discourse relation recognition. In Proceedings of the 29th International Conference on Computational Linguistics. 902--911."},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i3.20215"},{"key":"e_1_3_2_2_57_1","unstructured":"Shunyu Yao Dian Yu Jeffrey Zhao Izhak Shafran Thomas L. Griffiths Yuan Cao and Karthik Narasimhan. 2023. Tree of Thoughts: Deliberate Problem Solving with Large Language Models. arXiv:2305.10601 [cs.CL]"},{"key":"e_1_3_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3511921"},{"key":"e_1_3_2_2_59_1","volume-title":"Jean Francois Godbout, and Reihaneh Rabbany","author":"Yu Hao","year":"2023","unstructured":"Hao Yu, Zachary Yang, Kellin Pelrine, Jean Francois Godbout, and Reihaneh Rabbany. 2023. Open, Closed, or Small Language Models for Text Classification? arXiv preprint arXiv:2308.10092 (2023)."},{"key":"e_1_3_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.141"},{"key":"e_1_3_2_2_61_1","volume-title":"Garnett (Eds.)","volume":"28","author":"Zhang Xiang","year":"2015","unstructured":"Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015. Character-level Convolutional Networks for Text Classification. In Advances in Neural Information Processing Systems, C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett (Eds.), Vol. 28. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/ 2015\/file\/250cf8b51c773f3f8dc8b4be867a9a02-Paper.pdf"},{"key":"e_1_3_2_2_62_1","volume-title":"International Conference on Machine Learning. PMLR, 12697--12706","author":"Zhao Zihao","year":"2021","unstructured":"Zihao Zhao, EricWallace, Shi Feng, Dan Klein, and Sameer Singh. 2021. Calibrate before use: Improving few-shot performance of language models. In International Conference on Machine Learning. PMLR, 12697--12706."},{"key":"e_1_3_2_2_63_1","volume-title":"Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba.","author":"Zhou Yongchao","year":"2022","unstructured":"Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, Keiran Paster, Silviu Pitis, Harris Chan, and Jimmy Ba. 2022. Large language models are human-level prompt engineers. arXiv preprint arXiv:2211.01910 (2022)."},{"key":"e_1_3_2_2_64_1","unstructured":"Yiming Zhu Peixian Zhang Ehsan-Ul Haq Pan Hui and Gareth Tyson. 2023. Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Tasks. arXiv:2304.10145 [cs.AI]"}],"event":{"name":"WWW '24: The ACM Web Conference 2024","location":"Singapore Singapore","acronym":"WWW '24","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the ACM Web Conference 2024"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589334.3645642","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3589334.3645642","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T00:23:20Z","timestamp":1755822200000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589334.3645642"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,13]]},"references-count":64,"alternative-id":["10.1145\/3589334.3645642","10.1145\/3589334"],"URL":"https:\/\/doi.org\/10.1145\/3589334.3645642","relation":{},"subject":[],"published":{"date-parts":[[2024,5,13]]},"assertion":[{"value":"2024-05-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}