{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:09:46Z","timestamp":1750219786397,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T00:00:00Z","timestamp":1691107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-19-56151, IIS-17-41317, IIS 17-04532, 2019897, 2118329"],"award-info":[{"award-number":["IIS-19-56151, IIS-17-41317, IIS 17-04532, 2019897, 2118329"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["FA8750-19-2-1004, HR001121C0165"],"award-info":[{"award-number":["FA8750-19-2-1004, HR001121C0165"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,6]]},"DOI":"10.1145\/3580305.3599569","type":"proceedings-article","created":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T18:13:58Z","timestamp":1691172838000},"page":"5817-5818","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Pretrained Language Representations for Text Understanding: A Weakly-Supervised Perspective"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2554-2888","authenticated-orcid":false,"given":"Yu","family":"Meng","sequence":"first","affiliation":[{"name":"UIUC, Urbana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8095-3343","authenticated-orcid":false,"given":"Jiaxin","family":"Huang","sequence":"additional","affiliation":[{"name":"UIUC, Urbana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0540-6758","authenticated-orcid":false,"given":"Yu","family":"Zhang","sequence":"additional","affiliation":[{"name":"UIUC, Urbana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9790-4855","authenticated-orcid":false,"given":"Yunyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"UIUC, Urbana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3629-2696","authenticated-orcid":false,"given":"Jiawei","family":"Han","sequence":"additional","affiliation":[{"name":"UIUC, Urbana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,8,4]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Jordan","author":"Blei David M.","year":"2003","unstructured":"David M. Blei , Andrew Y. Ng , and Michael I . Jordan . 2003 . Latent Dirichlet Allocation. In J. Mach. Learn. Res . David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. In J. Mach. Learn. Res."},{"key":"e_1_3_2_1_2_1","unstructured":"Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell etal 2020. Language Models are Few-Shot Learners. In NeurIPS.  Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language Models are Few-Shot Learners. In NeurIPS."},{"key":"e_1_3_2_1_3_1","volume-title":"Manning","author":"Clark Kevin","year":"2020","unstructured":"Kevin Clark , Minh-Thang Luong , Quoc V. Le , and Christopher D . Manning . 2020 . ELECTRA : Pre-training Text Encoders as Discriminators Rather Than Generators. In ICLR. Kevin Clark, Minh-Thang Luong, Quoc V. Le, and Christopher D. Manning. 2020. ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators. In ICLR."},{"key":"e_1_3_2_1_4_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT.","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT."},{"key":"e_1_3_2_1_5_1","unstructured":"Tianyu Gao Adam Fisch and Danqi Chen. 2021. Making Pre-trained Language Models Better Few-shot Learners. In ACL.  Tianyu Gao Adam Fisch and Danqi Chen. 2021. Making Pre-trained Language Models Better Few-shot Learners. In ACL."},{"key":"e_1_3_2_1_6_1","unstructured":"Xiaotao Gu Zihan Wang Zhenyu Bi Yu Meng Liyuan Liu Jiawei Han and Jingbo Shang. 2021. UCPhrase: Unsupervised Context-aware Quality Phrase Tagging. In KDD.  Xiaotao Gu Zihan Wang Zhenyu Bi Yu Meng Liyuan Liu Jiawei Han and Jingbo Shang. 2021. UCPhrase: Unsupervised Context-aware Quality Phrase Tagging. In KDD."},{"key":"e_1_3_2_1_7_1","volume-title":"Le Hou, Yuexin Wu, Xuezhi Wang, Hongkun Yu, and Jiawei Han.","author":"Huang Jiaxin","year":"2022","unstructured":"Jiaxin Huang , Shixiang Shane Gu , Le Hou, Yuexin Wu, Xuezhi Wang, Hongkun Yu, and Jiawei Han. 2022 a. Large language models can self-improve. arXiv (2022). Jiaxin Huang, Shixiang Shane Gu, Le Hou, Yuexin Wu, Xuezhi Wang, Hongkun Yu, and Jiawei Han. 2022a. Large language models can self-improve. arXiv (2022)."},{"key":"e_1_3_2_1_8_1","volume-title":"Few-Shot Named Entity Recognition: A Comprehensive Study. arXiv","author":"Huang Jiaxin","year":"2020","unstructured":"Jiaxin Huang , Chunyuan Li , Krishan Subudhi , Damien Jose , Shobana Balakrishnan , Weizhu Chen , Baolin Peng , Jianfeng Gao , and Jiawei Han . 2020a. Few-Shot Named Entity Recognition: A Comprehensive Study. arXiv ( 2020 ). Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, and Jiawei Han. 2020a. Few-Shot Named Entity Recognition: A Comprehensive Study. arXiv (2020)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Jiaxin Huang Yu Meng and Jiawei Han. 2022b. Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation. In KDD.  Jiaxin Huang Yu Meng and Jiawei Han. 2022b. Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation. In KDD.","DOI":"10.1145\/3534678.3539443"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Jiaxin Huang Yiqing Xie Yu Meng Yunyi Zhang and Jiawei Han. 2020b. CoRel: Seed-Guided Topical Taxonomy Construction by Concept Learning and Relation Transferring. In KDD.  Jiaxin Huang Yiqing Xie Yu Meng Yunyi Zhang and Jiawei Han. 2020b. CoRel: Seed-Guided Topical Taxonomy Construction by Concept Learning and Relation Transferring. In KDD.","DOI":"10.1145\/3394486.3403244"},{"key":"e_1_3_2_1_11_1","volume-title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In ACL.","author":"Lewis Mike","year":"2019","unstructured":"Mike Lewis , Yinhan Liu , Naman Goyal , Marjan Ghazvininejad , Abdelrahman Mohamed , Omer Levy , Veselin Stoyanov , and Luke Zettlemoyer . 2019 . BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In ACL. Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2019. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In ACL."},{"key":"e_1_3_2_1_12_1","unstructured":"Xiang Lisa Li and Percy Liang. 2021. Prefix-Tuning: Optimizing Continuous Prompts for Generation. In ACL.  Xiang Lisa Li and Percy Liang. 2021. Prefix-Tuning: Optimizing Continuous Prompts for Generation. In ACL."},{"key":"e_1_3_2_1_13_1","volume-title":"RoBERTa: A robustly optimized bert pretraining approach. arXiv","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke Zettlemoyer , and Veselin Stoyanov . 2019. RoBERTa: A robustly optimized bert pretraining approach. arXiv ( 2019 ). Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized bert pretraining approach. arXiv (2019)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Dheeraj Mekala and Jingbo Shang. 2020. Contextualized weak supervision for text classification. In ACL.  Dheeraj Mekala and Jingbo Shang. 2020. Contextualized weak supervision for text classification. In ACL.","DOI":"10.18653\/v1\/2020.emnlp-main.670"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Yu Meng Jiaxin Huang Guangyuan Wang Zihan Wang Chao Zhang Yu Zhang and Jiawei Han. 2020a. Discriminative Topic Mining via Category-Name Guided Text Embedding. In WWW.  Yu Meng Jiaxin Huang Guangyuan Wang Zihan Wang Chao Zhang Yu Zhang and Jiawei Han. 2020a. Discriminative Topic Mining via Category-Name Guided Text Embedding. In WWW.","DOI":"10.1145\/3366423.3380278"},{"key":"e_1_3_2_1_16_1","unstructured":"Yu Meng Jiaxin Huang Yu Zhang and Jiawei Han. 2022a. Generating Training Data with Language Models: Towards Zero-Shot Language Understanding. In NeurIPS.  Yu Meng Jiaxin Huang Yu Zhang and Jiawei Han. 2022a. Generating Training Data with Language Models: Towards Zero-Shot Language Understanding. In NeurIPS."},{"key":"e_1_3_2_1_17_1","unstructured":"Yu Meng Martin Michalski Jiaxin Huang Yu Zhang Tarek Abdelzaher and Jiawei Han. 2023. Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning. In ICML.  Yu Meng Martin Michalski Jiaxin Huang Yu Zhang Tarek Abdelzaher and Jiawei Han. 2023. Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning. In ICML."},{"key":"e_1_3_2_1_18_1","unstructured":"Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul Bennett Jiawei Han and Xia Song. 2021a. COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining. In NeurIPS.  Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul Bennett Jiawei Han and Xia Song. 2021a. COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining. In NeurIPS."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Yu Meng Yunyi Zhang Jiaxin Huang Xuan Wang Yu Zhang Heng Ji and Jiawei Han. 2021b. Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training. In EMNLP.  Yu Meng Yunyi Zhang Jiaxin Huang Xuan Wang Yu Zhang Heng Ji and Jiawei Han. 2021b. Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training. In EMNLP.","DOI":"10.18653\/v1\/2021.emnlp-main.810"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Yu Meng Yunyi Zhang Jiaxin Huang Chenyan Xiong Heng Ji Chao Zhang and Jiawei Han. 2020b. Text Classification Using Label Names Only: A Language Model Self-Training Approach. In EMNLP.  Yu Meng Yunyi Zhang Jiaxin Huang Chenyan Xiong Heng Ji Chao Zhang and Jiawei Han. 2020b. Text Classification Using Label Names Only: A Language Model Self-Training Approach. In EMNLP.","DOI":"10.18653\/v1\/2020.emnlp-main.724"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Yu Meng Yunyi Zhang Jiaxin Huang Yu Zhang and Jiawei Han. 2022b. Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations. In WWW.  Yu Meng Yunyi Zhang Jiaxin Huang Yu Zhang and Jiawei Han. 2022b. Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations. In WWW.","DOI":"10.1145\/3485447.3512034"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Yu Meng Yunyi Zhang Jiaxin Huang Yu Zhang Chao Zhang and Jiawei Han. 2020c. Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding. In KDD.  Yu Meng Yunyi Zhang Jiaxin Huang Yu Zhang Chao Zhang and Jiawei Han. 2020c. Hierarchical Topic Mining via Joint Spherical Tree and Text Embedding. In KDD.","DOI":"10.1145\/3394486.3403242"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Sewon Min Xinxi Lyu Ari Holtzman Mikel Artetxe Mike Lewis Hannaneh Hajishirzi and Luke Zettlemoyer. 2022. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?. In EMNLP.  Sewon Min Xinxi Lyu Ari Holtzman Mikel Artetxe Mike Lewis Hannaneh Hajishirzi and Luke Zettlemoyer. 2022. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?. In EMNLP.","DOI":"10.18653\/v1\/2022.emnlp-main.759"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Jiaming Shen Wenda Qiu Yu Meng Jingbo Shang Xiang Ren and Jiawei Han. 2021. TaxoClass: Hierarchical Multi-Label Text Classification Using Only Class Names. In NAACL-HLT.  Jiaming Shen Wenda Qiu Yu Meng Jingbo Shang Xiang Ren and Jiawei Han. 2021. TaxoClass: Hierarchical Multi-Label Text Classification Using Only Class Names. In NAACL-HLT.","DOI":"10.18653\/v1\/2021.naacl-main.335"},{"key":"e_1_3_2_1_26_1","volume":"202","author":"Sia Suzanna","unstructured":"Suzanna Sia , Ayush Dalmia , and Sabrina J Mielke. 202 0. Tired of Topic Models? Clusters of Pretrained Word Embeddings Make for Fast and Good Topics too!. In EMNLP. Suzanna Sia, Ayush Dalmia, and Sabrina J Mielke. 2020. Tired of Topic Models? Clusters of Pretrained Word Embeddings Make for Fast and Good Topics too!. In EMNLP.","journal-title":"Sabrina J Mielke."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Zihan Wang Dheeraj Mekala and Jingbo Shang. 2021. X-Class: Text Classification with Extremely Weak Supervision. In NAACL-HLT.  Zihan Wang Dheeraj Mekala and Jingbo Shang. 2021. X-Class: Text Classification with Extremely Weak Supervision. In NAACL-HLT.","DOI":"10.18653\/v1\/2021.naacl-main.242"},{"key":"e_1_3_2_1_28_1","unstructured":"Jiacheng Ye Jiahui Gao Qintong Li Hang Xu Jiangtao Feng Zhiyong Wu Tao Yu and Lingpeng Kong. 2022. ZeroGen: Efficient Zero-shot Learning via Dataset Generation. In EMNLP.  Jiacheng Ye Jiahui Gao Qintong Li Hang Xu Jiangtao Feng Zhiyong Wu Tao Yu and Lingpeng Kong. 2022. ZeroGen: Efficient Zero-shot Learning via Dataset Generation. In EMNLP."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Lu Zhang Jiandong Ding Yi Xu Yingyao Liu and Shuigeng Zhou. 2021. Weakly-supervised Text Classification Based on Keyword Graph. In EMNLP.  Lu Zhang Jiandong Ding Yi Xu Yingyao Liu and Shuigeng Zhou. 2021. Weakly-supervised Text Classification Based on Keyword Graph. In EMNLP.","DOI":"10.18653\/v1\/2021.emnlp-main.222"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Yunyi Zhang Fang Guo Jiaming Shen and Jiawei Han. 2022a. Unsupervised Key Event Detection from Massive Text Corpora. In KDD.  Yunyi Zhang Fang Guo Jiaming Shen and Jiawei Han. 2022a. Unsupervised Key Event Detection from Massive Text Corpora. In KDD.","DOI":"10.1145\/3534678.3539395"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Yu Zhang Bowen Jin Qi Zhu Yu Meng and Jiawei Han. 2023 a. The Effect of Metadata on Scientific Literature Tagging: A Cross-Field Cross-Model Study. In WWW.  Yu Zhang Bowen Jin Qi Zhu Yu Meng and Jiawei Han. 2023 a. The Effect of Metadata on Scientific Literature Tagging: A Cross-Field Cross-Model Study. In WWW.","DOI":"10.1145\/3543507.3583354"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Yu Zhang Yu Meng Jiaxin Huang Frank F Xu Xuan Wang and Jiawei Han. 2020. Minimally supervised categorization of text with metadata. In SIGIR.  Yu Zhang Yu Meng Jiaxin Huang Frank F Xu Xuan Wang and Jiawei Han. 2020. Minimally supervised categorization of text with metadata. In SIGIR.","DOI":"10.1145\/3397271.3401168"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Yu Zhang Zhihong Shen Chieh-Han Wu Boya Xie Junheng Hao Ye-Yi Wang Kuansan Wang and Jiawei Han. 2022b. Metadata-Induced Contrastive Learning for Zero-Shot Multi-Label Text Classification. In WWW.  Yu Zhang Zhihong Shen Chieh-Han Wu Boya Xie Junheng Hao Ye-Yi Wang Kuansan Wang and Jiawei Han. 2022b. Metadata-Induced Contrastive Learning for Zero-Shot Multi-Label Text Classification. In WWW.","DOI":"10.1145\/3485447.3512174"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Yu Zhang Yunyi Zhang Martin Michalski Yucheng Jiang Yu Meng and Jiawei Han. 2023 b. Effective Seed-Guided Topic Discovery by Integrating Multiple Types of Contexts. In WSDM. io  Yu Zhang Yunyi Zhang Martin Michalski Yucheng Jiang Yu Meng and Jiawei Han. 2023 b. Effective Seed-Guided Topic Discovery by Integrating Multiple Types of Contexts. In WSDM. io","DOI":"10.1145\/3539597.3570475"}],"event":{"name":"KDD '23: The 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"],"location":"Long Beach CA USA","acronym":"KDD '23"},"container-title":["Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599569","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580305.3599569","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580305.3599569","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:52Z","timestamp":1750178272000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580305.3599569"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,4]]},"references-count":33,"alternative-id":["10.1145\/3580305.3599569","10.1145\/3580305"],"URL":"https:\/\/doi.org\/10.1145\/3580305.3599569","relation":{},"subject":[],"published":{"date-parts":[[2023,8,4]]},"assertion":[{"value":"2023-08-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}