{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T15:02:41Z","timestamp":1774278161518,"version":"3.50.1"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62202221"],"award-info":[{"award-number":["62202221"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"crossref","award":["BK20220331"],"award-info":[{"award-number":["BK20220331"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2026,4,30]]},"abstract":"<jats:p>Joint entity and relation extraction represent a critical task in knowledge representation, but often suffers from the bottleneck of requiring large amounts of labeled data, which is expensive and laborious to obtain. While Semi-Supervised Learning (SSL) offers a way to leverage unlabeled data, traditional methods face limitations in generating high-quality, diverse augmentations for text. This article introduces a novel framework that synergistically combines SSL with Large Language Models (LLMs) to improve joint entity and relation extraction, especially in low-resource settings. Our approach utilizes LLMs to generate semantically coherent and diverse augmented data from unlabeled samples. These augmented samples, along with limited labeled data, are used within an SSL framework employing consistency regularization and pseudo-labeling to train the extraction model. Crucially, the framework incorporates an iterative refinement mechanism where the performance of the SSL component informs the parameter-efficient fine-tuning of the LLM, leading to progressively better data augmentation and model accuracy. We demonstrate through extensive experiments on four benchmark datasets that our proposed method significantly outperforms existing state-of-the-art approaches, particularly when labeled data are scarce. The framework\u2019s design is adaptable and can be integrated with various existing joint extraction models, showcasing its generalizability and practical utility.<\/jats:p>","DOI":"10.1145\/3799423","type":"journal-article","created":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T08:53:21Z","timestamp":1772268801000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Enhancing Low-Resource Joint Entity and Relation Extraction Using Large Language Models within Semi-Supervised Learning"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-3683-3959","authenticated-orcid":false,"given":"Xiaoqi","family":"Wang","sequence":"first","affiliation":[{"name":"College of Computer and Information Sciences, Nanjing Tech University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8804-2787","authenticated-orcid":false,"given":"Hang","family":"Shen","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, Nanjing Tech University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-3564-6023","authenticated-orcid":false,"given":"Honglei","family":"Qi","sequence":"additional","affiliation":[{"name":"Zhongtong Bus Co., Ltd., Liaocheng, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1703-1538","authenticated-orcid":false,"given":"Yuanfei","family":"Dai","sequence":"additional","affiliation":[{"name":"College of Computer and Information Sciences, Nanjing Tech University, Nanjing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,3,23]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"5049","volume-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems","author":"Berthelot David","year":"2019","unstructured":"David Berthelot, Nicholas Carlini, Ian Goodfellow, Avital Oliver, Nicolas Papernot, and Colin Raffel. 2019. MixMatch: A holistic approach to semi-supervised learning. In Proceedings of the 33rd International Conference on Neural Information Processing Systems, 5049\u20135059."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3641289"},{"issue":"2","key":"e_1_3_2_4_2","first-page":"25","article-title":"Transfer learning in natural language processing: Leveraging pretrained models for improved performance on specific tasks","volume":"1","author":"Chatterjee Kabir","year":"2024","unstructured":"Kabir Chatterjee. 2024. Transfer learning in natural language processing: Leveraging pretrained models for improved performance on specific tasks. Shodh Sagar Journal of Artificial Intelligence and Machine Learning 1, 2 (2024), 25\u201330.","journal-title":"Shodh Sagar Journal of Artificial Intelligence and Machine Learning"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.3115\/1220175.1220192"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.137"},{"issue":"8","key":"e_1_3_2_7_2","first-page":"6919","article-title":"Semi-supervised learning under class distribution mismatch","volume":"35","author":"Chen Yining","year":"2021","unstructured":"Yining Chen, Ziyu Wu, Yuanzhi Wang, Haoran Bai, Zheng Che, Xiang Li, Xiaoyu Yang, Shuang Liang, and Aggelos K. Katsaggelos. 2021. Semi-supervised learning under class distribution mismatch. Association for the Advancement of Artificial Intelligence Conference on Artificial Intelligence 35, 8 (2021), 6919\u20136927.","journal-title":"Association for the Advancement of Artificial Intelligence Conference on Artificial Intelligence"},{"key":"e_1_3_2_8_2","first-page":"57296","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Deng Yue","year":"2024","unstructured":"Yue Deng, Wenxuan Zhang, Sinno Jialin Pan, and Lidong Bing. 2024. Multilingual jailbreak challenges in large language models. In Proceedings of the 12th International Conference on Learning Representations, 57296\u201357313."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.52202\/075280-0441"},{"key":"e_1_3_2_10_2","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 4171\u20134186."},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1007\/s10115-017-1100-y","article-title":"Core techniques of question answering systems over knowledge bases: A survey","volume":"55","author":"Diefenbach Dennis","year":"2018","unstructured":"Dennis Diefenbach, Vanessa Lopez, Kamal Singh, and Pierre Maret. 2018. Core techniques of question answering systems over knowledge bases: A survey. Knowledge and Information Systems 55 (2018), 529\u2013569.","journal-title":"Knowledge and Information Systems"},{"key":"e_1_3_2_12_2","first-page":"6045","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing","author":"Ding Bosheng","year":"2020","unstructured":"Bosheng Ding, Linlin Liu, Lidong Bing, Canasai Kruengkrai, Thien Hai Nguyen, Shafiq Joty, Luo Si, and Chunyan Miao. 2020. DAGA: Data augmentation with a generation approach for low-resource tagging tasks. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 6045\u20136057."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-023-00626-4"},{"key":"e_1_3_2_14_2","first-page":"2006","volume-title":"Proceedings of the European Conference on Artificial Intelligence 2020","author":"Eberts Markus","year":"2020","unstructured":"Markus Eberts and Adrian Ulges. 2020. Span-based joint entity and relation extraction with transformer pre-training. In Proceedings of the European Conference on Artificial Intelligence 2020, 2006\u20132013."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.4304\/jetwi.2.3.258-268"},{"key":"e_1_3_2_16_2","first-page":"526","volume-title":"Proceedings of the 2024 4th International Conference on Communication Technology and Information Technology","author":"Hu Jiacheng","year":"2024","unstructured":"Jiacheng Hu, Xiaoxuan Liao, Jia Gao, Zhen Qi, Hongye Zheng, and Chihang Wang. 2024. Optimizing large language models with an enhanced LoRA fine-tuning algorithm for efficiency and robustness in NLP tasks. In Proceedings of the 2024 4th International Conference on Communication Technology and Information Technology, 526\u2013530."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455252"},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","first-page":"102274","DOI":"10.1016\/j.lindif.2023.102274","article-title":"ChatGPT for good? On opportunities and challenges of large language models for education","volume":"103","author":"Kasneci Enkelejda","year":"2023","unstructured":"Enkelejda Kasneci, Kathrin Sessler, Stefan K\u00fcchemann, Maria Bannert, Daryna Dementieva, Frank Fischer, Urs Gasser, Georg Groh, Stephan G\u00fcnnemann, Eyke H\u00fcllermeier, et al. 2023. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences 103 (2023), 102274\u2013102277.","journal-title":"Learning and Individual Differences"},{"key":"e_1_3_2_19_2","first-page":"452","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Kobayashi Sosuke","year":"2018","unstructured":"Sosuke Kobayashi. 2018. Contextual augmentation: Data augmentation by words with paradigmatic relations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 452\u2013457."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3649449"},{"key":"e_1_3_2_21_2","first-page":"9455","volume-title":"Proceedings of the 2021 Institute of Electrical and Electronics Engineers\/Computer Vision Foundation International Conference on Computer Vision","author":"Li Junnan","year":"2021","unstructured":"Junnan Li, Caiming Xiong, and Steven C. H. Hoi. 2021. CoMatch: Semi-supervised learning with contrastive graph regularization. In Proceedings of the 2021 Institute of Electrical and Electronics Engineers\/Computer Vision Foundation International Conference on Computer Vision, 9455\u20139464."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1129"},{"key":"e_1_3_2_23_2","first-page":"7344","volume-title":"Proceedings of the 31st International Conference on Computational Linguistics","author":"Li Zehan","year":"2025","unstructured":"Zehan Li, Fu Zhang, Kailun Lyu, Jingwei Cheng, and Tianyue Peng. 2025. Re-cent: A relation-centric framework for joint zero-shot relation triplet extraction. In Proceedings of the 31st International Conference on Computational Linguistics, 7344\u20137354."},{"key":"e_1_3_2_24_2","first-page":"1003","volume-title":"Proceedings of the Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing","author":"Mintz Mike","year":"2009","unstructured":"Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. 2009. Distant supervision for relation extraction without labeled data. In Proceedings of the Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 1003\u20131011."},{"key":"e_1_3_2_25_2","doi-asserted-by":"crossref","first-page":"26839","DOI":"10.1109\/ACCESS.2024.3365742","article-title":"A review on large language models: Architectures, applications, taxonomies, open issues and challenges","volume":"12","author":"Raiaan Mohaimenul Azam Khan","year":"2024","unstructured":"Mohaimenul Azam Khan Raiaan, Md Saddam Hossain Mukta, Kaniz Fatema, Nur Mohammad Fahad, Sadman Sakib, Most Marufatul Jannat Mim, Jubaer Ahmad, Mohammed Eunus Ali, and Sami Azam. 2024. A review on large language models: Architectures, applications, taxonomies, open issues and challenges. IEEE Access 12 (2024), 26839\u201326874.","journal-title":"IEEE Access"},{"key":"e_1_3_2_26_2","first-page":"74","volume-title":"Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics","author":"Riedel Sebastian","year":"2013","unstructured":"Sebastian Riedel, Limin Yao, Andrew McCallum, and Benjamin M. Marlin. 2013. Relation extraction with matrix factorization and universal schemas. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics, 74\u201384."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i10.21379"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/1870658.1870761"},{"key":"e_1_3_2_29_2","first-page":"596","article-title":"Fixmatch: Simplifying semi-supervised learning with consistency and confidence","volume":"33","author":"Sohn Kihyuk","year":"2020","unstructured":"Kihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang, Han Zhang, Colin A. Raffel, Ekin Dogus Cubuk, Alexey Kurakin, and Chun-Liang Li. 2020. Fixmatch: Simplifying semi-supervised learning with consistency and confidence. Advances in Neural Information Processing Systems 33 (2020), 596\u2013608.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2023.3264735"},{"key":"e_1_3_2_31_2","first-page":"6670","volume-title":"Proceedings of the 31st International Conference on Computational Linguistics","author":"Swarup Anushka","year":"2025","unstructured":"Anushka Swarup, Tianyu Pan, Ronald Wilson, Avanti Bhandarkar, and Damon Woodard. 2025. LLM4RE: A data-centric feasibility study for relation extraction. In Proceedings of the 31st International Conference on Computational Linguistics, 6670\u20136691."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.477"},{"key":"e_1_3_2_33_2","first-page":"41","volume-title":"Proceedings of the 3rd Workshop on Extraction and Evaluation of Knowledge Entities from Scientific Documents","author":"Wang Hao","year":"2022","unstructured":"Hao Wang, Xian-Ling Mao, and Heyan Huang. 2022. A semi-supervised transfer learning framework for low resource entity and relation extraction in scientific domain. In Proceedings of the 3rd Workshop on Extraction and Evaluation of Knowledge Entities from Scientific Documents, 41\u201347."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533017"},{"key":"e_1_3_2_35_2","first-page":"3766","volume-title":"Proceedings of the 10th International Conference on Learning Representations","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le. 2022. Finetuned language models are Zero-Shot learners. In Proceedings of the 10th International Conference on Learning Representations, 3766\u20133811."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1670"},{"key":"e_1_3_2_37_2","first-page":"279","volume-title":"Proceedings of the 28th Association for Computing Machinery International Conference on Information and Knowledge Management","author":"Wei Pengfei","year":"2019","unstructured":"Pengfei Wei and Yiping Ke. 2019. Knowledge transfer based on multiple manifolds assumption. In Proceedings of the 28th Association for Computing Machinery International Conference on Information and Knowledge Management, 279\u2013287."},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.136"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.17"},{"issue":"3","key":"e_1_3_2_40_2","first-page":"8","article-title":"Advancing emotional analysis with large language models","volume":"4","author":"Yang Haowei","year":"2024","unstructured":"Haowei Yang, Yun Zi, Honglin Qin, Hongye Zheng, and Yuxiang Hu. 2024. Advancing emotional analysis with large language models. Journal of Computer Science and Software Applications 4, 3 (2024), 8\u201315.","journal-title":"Journal of Computer Science and Software Applications"},{"key":"e_1_3_2_41_2","first-page":"4904","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics","author":"Ye Deming","year":"2022","unstructured":"Deming Ye, Yankai Lin, Peng Li, and Maosong Sun. 2022. Packed levitated marker for entity and relation extraction. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, 4904\u20134917."},{"key":"e_1_3_2_42_2","first-page":"1321","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing","author":"Yih Wen-Tau","year":"2015","unstructured":"Wen-Tau Yih, Ming-Wei Chang, Xiaodong He, and Jianfeng Gao. 2015. Semantic parsing via staged query graph generation: Question answering with knowledge base. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, 1321\u20131331."},{"key":"e_1_3_2_43_2","first-page":"1399","volume-title":"Proceedings of the Coling 2010: Posters","author":"Yu Xiaofeng","year":"2010","unstructured":"Xiaofeng Yu and Wai Lam. 2010. Jointly identifying entities and extracting relations in encyclopedia text via a graphical model approach. In Proceedings of the Coling 2010: Posters, 1399\u20131407."},{"key":"e_1_3_2_44_2","first-page":"367","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing","author":"Zeng Xiangrong","year":"2019","unstructured":"Xiangrong Zeng, Shizhu He, Daojian Zeng, Kang Liu, Shengping Liu, and Jun Zhao. 2019. Learning the extraction order of multiple relational facts in a sentence with reinforcement learning. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 367\u2013377."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1047"},{"key":"e_1_3_2_46_2","first-page":"1476","volume-title":"Proceedings of the 2019 Institute of Electrical and Electronics Engineers\/Computer Vision Foundation International Conference on Computer Vision","author":"Zhai Xiaohua","year":"2019","unstructured":"Xiaohua Zhai, Avital Oliver, Alexander Kolesnikov, and Lucas Beyer. 2019. S4L: Self-supervised semi-supervised learning. In Proceedings of the 2019 Institute of Electrical and Electronics Engineers\/Computer Vision Foundation International Conference on Computer Vision, 1476\u20131485."},{"key":"e_1_3_2_47_2","first-page":"53087","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Zhang Biao","year":"2024","unstructured":"Biao Zhang, Zhongtao Liu, Colin Cherry, and Orhan Firat. 2024. When scaling meets LLM finetuning: The effect of data, model and finetuning method. In Proceedings of the 12th International Conference on Learning Representations, 53087\u201353106."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3674501"},{"issue":"3","key":"e_1_3_2_49_2","doi-asserted-by":"crossref","first-page":"4971","DOI":"10.1109\/TNNLS.2024.3365858","article-title":"Few-shot relation extraction with automatically generated prompts","volume":"36","author":"Zhao Xiaoyan","year":"2024","unstructured":"Xiaoyan Zhao, Min Yang, Qiang Qu, and Ruifeng Xu. 2024. Few-shot relation extraction with automatically generated prompts. IEEE Transactions on Neural Networks and Learning Systems 36, 3 (2024), 4971\u20134983.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"8","key":"e_1_3_2_50_2","first-page":"7953","article-title":"Exploring privileged features for relation extraction with contrastive student-teacher learning","volume":"35","author":"Zhao Xiaoyan","year":"2022","unstructured":"Xiaoyan Zhao, Min Yang, Qiang Qu, Ruifeng Xu, and Jieke Li. 2022. Exploring privileged features for relation extraction with contrastive student-teacher learning. IEEE Transactions on Knowledge and Data Engineering 35, 8 (2022), 7953\u20137965.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1113"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3799423","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T14:14:15Z","timestamp":1774275255000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3799423"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,23]]},"references-count":50,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,4,30]]}},"alternative-id":["10.1145\/3799423"],"URL":"https:\/\/doi.org\/10.1145\/3799423","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,23]]},"assertion":[{"value":"2025-04-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}