{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T15:16:37Z","timestamp":1767712597128,"version":"3.48.0"},"reference-count":39,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T00:00:00Z","timestamp":1767657600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Relation extraction serves as an essential task for knowledge acquisition and management, defined as determining the relation between two annotated entities from a piece of text. Over recent years, zero-shot learning has been introduced to train relation extraction models due to the expensive cost of incessantly annotating emerging relations. Current methods endeavor to transfer knowledge of seen relations into predictions of unseen relations by conducting relation extraction through different tasks. Nonetheless, the divergence in task formulations prevents relation extraction models from acquiring informative semantic representations, resulting in inferior performance. In this paper, we strive to exploit the relational knowledge contained in pre-trained language models, which may generate enlightening information for the representation of unseen relations from seen relations. To this end, we investigate a Prompt-Contrastive learning perspective for Relation Extraction under a zero-shot setting, namely PCRE. To be specific, based on leveraging semantic knowledge from pre-trained language models with prompt tuning, we augment each instance with different prompt templates to construct two views for an instance-level contrastive objective. Additionally, we devise an instance-description contrastive objective to elicit relational knowledge from relation descriptions. With joint optimization, the relation extraction model can learn how to separate relations. The experimental results show our PCRE method outperforms state-of-the-art baselines in zero-shot relation extraction. The further extensive analysis verifies that our proposal is robust in different datasets, the number of seen relations, and the number of training instances.<\/jats:p>","DOI":"10.3390\/e28010069","type":"journal-article","created":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T15:09:36Z","timestamp":1767712176000},"page":"69","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Prompt-Contrastive Learning for Zero-Shot Relation Extraction"],"prefix":"10.3390","volume":"28","author":[{"given":"Xueyi","family":"Zhong","sequence":"first","affiliation":[{"name":"School of Finance, Southwestern University of Finance and Economics, Chengdu 611130, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liye","family":"Zhao","sequence":"additional","affiliation":[{"name":"Navy Submarine Academy, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Licheng","family":"Peng","sequence":"additional","affiliation":[{"name":"Navy Submarine Academy, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guodong","family":"Yang","sequence":"additional","affiliation":[{"name":"Navy Submarine Academy, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kun","family":"Hu","sequence":"additional","affiliation":[{"name":"Navy Submarine Academy, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0467-3830","authenticated-orcid":false,"given":"Wansen","family":"Wu","sequence":"additional","affiliation":[{"name":"Navy Submarine Academy, Qingdao 266000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,6]]},"reference":[{"key":"ref_1","unstructured":"Hajic, J., and Tsujii, J. (2014). Relation Classification via Convolutional Deep Neural Network. Proceedings of the COLING 2014, 25th International Conference on Computational Linguistics, Proceedings of the Conference: Technical Papers, Dublin, Ireland, 23\u201329 August 2014, ACL."},{"key":"ref_2","unstructured":"M\u00e0rquez, L., Callison-Burch, C., Su, J., Pighin, D., and Marton, Y. (2015). Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, 17\u201321 September 2015, The Association for Computational Linguistics."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"129171","DOI":"10.1016\/j.neucom.2024.129171","article-title":"Named entity recognition and relationship extraction for biomedical text: A comprehensive survey, recent advancements, and future research directions","volume":"618","author":"Goyal","year":"2025","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zheng, C., Wu, Z., Feng, J., Fu, Z., and Cai, Y. (2021). MNRE: A challenge multimodal dataset for neural relation extraction with visual evidence in social media posts. Proceedings of the 2021 IEEE International Conference on Multimedia and Expo (ICME), Shenzhen, China, 5\u20139 July 2021, IEEE Computer Society.","DOI":"10.1109\/ICME51207.2021.9428274"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Rajpoot, P., and Parikh, A. (2023, January 1). GPT-FinRE: In-context learning for financial relation extraction using large language models. Proceedings of the Sixth Workshop on Financial Technology and Natural Language Processing, Bali, Indonesia.","DOI":"10.18653\/v1\/2023.finnlp-2.5"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3674501","article-title":"A comprehensive survey on relation extraction: Recent advances and new frontiers","volume":"56","author":"Zhao","year":"2024","journal-title":"ACM Comput. Surv."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"112948","DOI":"10.1016\/j.eswa.2019.112948","article-title":"A review: Knowledge reasoning over knowledge graph","volume":"141","author":"Chen","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1109\/TNNLS.2021.3070843","article-title":"A Survey on Knowledge Graphs: Representation, Acquisition, and Applications","volume":"33","author":"Ji","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, Y., Wei, F., Li, S., Ji, H., Zhou, M., and Wang, H. (2015). A Dependency-Based Neural Network for Relation Classification. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Short Papers), Beijing, China, 26\u201331 July 2015, The Association for Computer Linguistics.","DOI":"10.3115\/v1\/P15-2047"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zeng, W., Lin, Y., Liu, Z., and Sun, M. (2017). Incorporating Relation Paths in Neural Relation Extraction. Proceedings of the 2017 Conference on Empirical Methods in NATURAL Language Processing, Copenhagen, Denmark, 9\u201311 September 2017, Association for Computational Linguistics.","DOI":"10.18653\/v1\/D17-1186"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gao, T., Han, X., Zhu, H., Liu, Z., Li, P., Sun, M., and Zhou, J. (2019). FewRel 2.0: Towards More Challenging Few-Shot Relation Classification. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 3\u20137 November 2019, Association for Computational Linguistics.","DOI":"10.18653\/v1\/D19-1649"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wu, R., Yao, Y., Han, X., Xie, R., Liu, Z., Lin, F., Lin, L., and Sun, M. (2019). Open Relation Extraction: Relational Knowledge Transfer from Supervised Data to Unsupervised Data. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 3\u20137 November 2019, Association for Computational Linguistics.","DOI":"10.18653\/v1\/D19-1021"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Obamuyide, A., and Vlachos, A. (2018, January 1). Zero-shot relation classification as textual entailment. Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), Brussels, Belgium.","DOI":"10.18653\/v1\/W18-5511"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Levy, O., Seo, M., Choi, E., and Zettlemoyer, L. (2017). Zero-Shot Relation Extraction via Reading Comprehension. Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), Vancouver, BC, Canada, 3\u20134 August 2017, Association for Computational Linguistics.","DOI":"10.18653\/v1\/K17-1034"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chen, C., and Li, C. (2021). ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learning. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online, 6\u201311 June 2021, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2021.naacl-main.272"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Gao, T., Fisch, A., and Chen, D. (2021). Making Pre-trained Language Models Better Few-shot Learners. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Virtual Event, 1\u20136 August 2021, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2021.acl-long.295"},{"key":"ref_17","first-page":"3668","article-title":"Zero-shot relation extraction model via multi-template fusion in Prompt","volume":"43","author":"Xu","year":"2023","journal-title":"J. Comput. Appl."},{"key":"ref_18","first-page":"2010","article-title":"Prompt learning-based unsupervised relation extraction model","volume":"43","author":"Huang","year":"2023","journal-title":"J. Comput. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yan, Y., Li, R., Wang, S., Zhang, F., Wu, W., and Xu, W. (2021). ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Virtual Event, 1\u20136 August 2021, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2021.acl-long.393"},{"key":"ref_20","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Hinton","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chen, X., Zhang, N., Xie, X., Deng, S., Yao, Y., Tan, C., Huang, F., Si, L., and Chen, H. (2022). KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction. Proceedings of the WWW \u201922: ACM Web Conference 2022, Virtual Event, 25\u201329 April 2022, ACM.","DOI":"10.1145\/3485447.3511998"},{"key":"ref_22","unstructured":"Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020, January 6\u201312). Language Models are Few-Shot Learners. Proceedings of the NIPS\u201920: 34th International Conference on Neural Information Processing Systems, Online."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hu, S., Ding, N., Wang, H., Liu, Z., Wang, J., Li, J., Wu, W., and Sun, M. (2022, January 22\u201327). Knowledgeable prompt-tuning: Incorporating knowledge into prompt verbalizer for text classification. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.","DOI":"10.18653\/v1\/2022.acl-long.158"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ding, N., Chen, Y., Han, X., Xu, G., Wang, X., Xie, P., Zheng, H., Liu, Z., Li, J., and Kim, H. (2022). Prompt-learning for Fine-grained Entity Typing. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, 7\u201311 December 2022, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.findings-emnlp.512"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Schick, T., Schmid, H., and Sch\u00fctze, H. (2020, January 8\u201313). Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification. Proceedings of the COLING. International Committee on Computational Linguistics, Barcelona, Spain.","DOI":"10.18653\/v1\/2020.coling-main.488"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shin, T., Razeghi, Y., IV, R.L.L., Wallace, E., and Singh, S. (2020). AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Online, 16\u201320 November 2020, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.emnlp-main.346"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Han, X., Zhao, W., Ding, N., Liu, Z., and Sun, M. (2021). PTR: Prompt Tuning with Rules for Text Classification. arXiv.","DOI":"10.1016\/j.aiopen.2022.11.003"},{"key":"ref_28","first-page":"27730","article-title":"Training language models to follow instructions with human feedback","volume":"35","author":"Ouyang","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wong, M.F., and Tan, C.W. (2024). Aligning crowd-sourced human feedback for reinforcement learning on code generation by large language models. IEEE Trans. Big Data.","DOI":"10.1109\/TBDATA.2024.3524104"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R.B. (2020, January 13\u201319). Momentum Contrast for Unsupervised Visual Representation Learning. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"ref_31","unstructured":"Chen, T., Kornblith, S., Norouzi, M., and Hinton, G.E. (2020, January 13\u201318). A Simple Framework for Contrastive Learning of Visual Representations. Proceedings of the ICML\u201920: 37th International Conference on Machine Learning, PMLR, Virtual. Proceedings of Machine Learning Research."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Fang, H., and Xie, P. (2020). CERT: Contrastive Self-supervised Learning for Language Understanding. arXiv.","DOI":"10.36227\/techrxiv.12308378.v1"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, Y., He, R., Liu, Z., Lim, K.H., and Bing, L. (2020). An Unsupervised Sentence Embedding Method by Mutual Information Maximization. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online, 16\u201320 November 2020, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.emnlp-main.124"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Gao, T., Yao, X., and Chen, D. (2021). SimCSE: Simple Contrastive Learning of Sentence Embeddings. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic, 7\u201311 November 2021, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2021.emnlp-main.552"},{"key":"ref_35","unstructured":"Devlin, J., Chang, M., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the NAACL-HLT (1), Minneapolis, MN, USA, 2\u20137 June 2019, Association for Computational Linguistics."},{"key":"ref_36","first-page":"180","article-title":"Improving Event Temporal Relation Classification via Auxiliary Label-Aware Contrastive Learning","volume":"Volume 13603","author":"Sun","year":"2022","journal-title":"Chinese Computational Linguistics. CCL 2022"},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the ICLR (Poster), San Diego, CA, USA."},{"key":"ref_38","unstructured":"Soares, L.B., FitzGerald, N., Ling, J., and Kwiatkowski, T. (2019). Matching the Blanks: Distributional Similarity for Relation Learning. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, 28 July\u20132 August 2019, Association for Computational Linguistics."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chia, Y.K., Bing, L., Poria, S., and Si, L. (2022). RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, Dublin, Ireland, 22\u201327 May 2022, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.findings-acl.5"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/1\/69\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T15:11:35Z","timestamp":1767712295000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/1\/69"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,6]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["e28010069"],"URL":"https:\/\/doi.org\/10.3390\/e28010069","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2026,1,6]]}}}