{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:03:19Z","timestamp":1760234599288,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,28]],"date-time":"2021-05-28T00:00:00Z","timestamp":1622160000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Independent Scientific Research Program of National University of Defense Science and Technology","award":["NO.ZK18-03-14"],"award-info":[{"award-number":["NO.ZK18-03-14"]}]},{"name":"Anhui Provincial Natural Science Foundation","award":["NO.1908085MF202"],"award-info":[{"award-number":["NO.1908085MF202"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Relation extraction is a crucial task in natural language processing (NLP) that aims to extract all relational triples from a given sentence. Extracting overlapping relational triples from complex texts is challenging and has received extensive research attention. Most existing methods are based on cascade models and employ language models to transform the given sentence into vectorized representations. The cascaded structure can cause exposure bias issue; however, the vectorized representation of each sentence needs to be closely related to the relation extraction with pre-defined relation types. In this paper, we propose a label-aware parallel network (LAPREL) for relation extraction. To solve the exposure bias issue, we apply a parallel network, instead of the cascade framework, based on the table-filling method with a symmetric relation pair tagger. To obtain task-related sentence embedding, we embed the prior label information into the token embedding and adjust the sentence embedding for each relation type. The proposed method can also effectively deal with overlapping relational triples. Compared with 10 baselines, extensive experiments are conducted on two public datasets to verify the performance of our proposed network. The experimental results show that LAPREL outperforms the 10 baselines in extracting relational triples from complex text.<\/jats:p>","DOI":"10.3390\/sym13060961","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T03:45:29Z","timestamp":1622432729000},"page":"961","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["LAPREL: A Label-Aware Parallel Network for Relation Extraction"],"prefix":"10.3390","volume":"13","author":[{"given":"Xiang","family":"Li","sequence":"first","affiliation":[{"name":"College of Electronic Engineering, National University of Defense Technology, Hefei 230009, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junan","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Electronic Engineering, National University of Defense Technology, Hefei 230009, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengjiang","family":"Hu","sequence":"additional","affiliation":[{"name":"College of Electronic Engineering, National University of Defense Technology, Hefei 230009, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Electronic Engineering, National University of Defense Technology, Hefei 230009, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,28]]},"reference":[{"key":"ref_1","first-page":"1083","article-title":"Kernel Methods for Relation Extraction","volume":"3","author":"Zelenko","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_2","unstructured":"Zhou, G., Su, J., Zhang, J., and Zhang, M. (2005, January 25\u201330). Exploring various knowledge in relation extraction. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL\u201905), Ann Arbor, MI, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mintz, M., Bills, S., Snow, R., and Jurafsky, D. (2009, January 2\u20137). Distant supervision for relation extraction without labeled data. Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Singapore.","DOI":"10.3115\/1690219.1690287"},{"key":"ref_4","unstructured":"Chan, Y.S., and Roth, D. (2011, January 19\u201324). Exploiting syntactico-semantic structures for relation extraction. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, OR, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gormley, M.R., Yu, M., and Dredze, M. (2015, January 17\u201321). Improved relation extraction with feature-rich compositional embedding models. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1205"},{"key":"ref_6","unstructured":"Yu, X., and Lam, W. (2010, January 23\u201327). Jointly identifying entities and extracting relations in encyclopedia text via a graphical model approach. Proceedings of the Coling 2010: Posters, Beijing, China."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, Q., and Ji, H. (2014, January 22\u201327). Incremental joint extraction of entity mentions and relations. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-1038"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Miwa, M., and Sasaki, Y. (2014, January 25\u201329). Modeling joint entity and relation extraction with table representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1200"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ren, X., Wu, Z., He, W., Qu, M., Voss, C.R., Ji, H., Abdelzaher, T.F., and Han, J. (2017, January 3\u20137). Cotype: Joint extraction of typed entities and relations with knowledge bases. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.","DOI":"10.1145\/3038912.3052708"},{"key":"ref_10","unstructured":"Gupta, P., Sch\u00fctze, H., and Andrassy, B. (2016, January 11\u201316). Table filling multi-task recurrent neural network for joint entity and relation extraction. Proceedings of the COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Miwa, M., and Bansal, M. (2016, January 7\u201312). End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany.","DOI":"10.18653\/v1\/P16-1105"},{"key":"ref_12","unstructured":"Katiyar, A., and Cardie, C. (August, January 30). Going out on a limb: Joint extraction of entity mentions and relations without dependency trees. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada."},{"key":"ref_13","unstructured":"Zheng, S., Wang, F., Bao, H., Hao, Y., Zhou, P., and Xu, B. (August, January 30). Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zeng, X., Zeng, D., He, S., Liu, K., and Zhao, J. (2018, January 15\u201320). Extracting relational facts by an end-to-end neural model with copy mechanism. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1047"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zeng, X., He, S., Zeng, D., Liu, K., Liu, S., and Zhao, J. (2019, January 3\u20137). Learning the extraction order of multiple relational facts in a sentence with reinforcement learning. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1035"},{"key":"ref_16","unstructured":"Fu, T.J., Li, P.H., and Ma, W.Y. (August, January 28). GraphRel: Modeling text as relational graphs for joint entity and relation extraction. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zeng, D., Zhang, H., and Liu, Q. (2020, January 7\u201312). CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6495"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Nayak, T., and Ng, H.T. (2020, January 7\u201312). Effective modeling of encoder-decoder architecture for joint entity and relation extraction. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6374"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wei, Z., Su, J., Wang, Y., Tian, Y., and Chang, Y. (2020, January 5\u201310). A novel cascade binary tagging framework for relational triple extraction. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Seattle, WA, USA.","DOI":"10.18653\/v1\/2020.acl-main.136"},{"key":"ref_20","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_21","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, J., Chen, S., Wang, B., Zhang, J., Li, N., and Xu, T. (2021, January 7\u201315). Attention as Relation: Learning Supervised Multi-head Self-Attention for Relation Extraction. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan.","DOI":"10.24963\/ijcai.2020\/524"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ma, X., and Hovy, E. (2016, January 7\u201312). End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany.","DOI":"10.18653\/v1\/P16-1101"},{"key":"ref_24","unstructured":"Lafferty, J., McCallum, A., and Pereira, F.C. (1, January 28). Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. Proceedings of the Eighteenth International Conference on Machine Learning, Williamstown, MA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Riedel, S., Yao, L., and McCallum, A. (2010). Modeling relations and their mentions without labeled text. Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Springer.","DOI":"10.1007\/978-3-642-15939-8_10"},{"key":"ref_26","unstructured":"Gardent, C., Shimorina, A., Narayan, S., and Perez-Beltrachini, L. (August, January 30). Creating training corpora for nlg micro-planning. Proceedings of the 55th annual meeting of the Association for Computational Linguistics (ACL), Vancouver, BC, Canada."},{"key":"ref_27","unstructured":"Yu, B., Zhang, Z., Shu, X., Wang, Y., Liu, T., Wang, B., and Li, S. (September, January 29). Joint Extraction of Entities and Relations Based on a Novel Decomposition Strategy. Proceedings of the 24th European Conference on Artificial Intelligence, Santiago de Compostela, Spain."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yuan, Y., Zhou, X., Pan, S., Zhu, Q., Song, Z., and Guo, L. (2021, January 7\u201315). A Relation-Specific Attention Network for Joint Entity and Relation Extraction. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan.","DOI":"10.24963\/ijcai.2020\/561"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Song, L., Zhang, Y., Gildea, D., Yu, M., Wang, Z., and Su, J. (2019). Leveraging dependency forest for neural medical relation extraction. arXiv.","DOI":"10.18653\/v1\/D19-1020"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jin, L., Song, L., Zhang, Y., Xu, K., Ma, W.y., and Yu, D. (2020, January 7\u201312). Relation extraction exploiting full dependency forests. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6313"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Guo, Z., Nan, G., Lu, W., and Cohen, S.B. (2021, January 7\u201315). Learning latent forests for medical relation extraction. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan.","DOI":"10.24963\/ijcai.2020\/505"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/6\/961\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:39Z","timestamp":1760162979000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/6\/961"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,28]]},"references-count":31,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["sym13060961"],"URL":"https:\/\/doi.org\/10.3390\/sym13060961","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2021,5,28]]}}}