{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T02:02:17Z","timestamp":1783476137121,"version":"3.55.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2024,6,26]],"date-time":"2024-06-26T00:00:00Z","timestamp":1719360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2020AAA0109703"],"award-info":[{"award-number":["2020AAA0109703"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62076167, U23B2029"],"award-info":[{"award-number":["62076167, U23B2029"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"14th Five-Year Scientific Research Plan of the National language commission","award":["YB145-16"],"award-info":[{"award-number":["YB145-16"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2024,7,31]]},"abstract":"<jats:p>Document-level relational extraction requires reading, memorization, and reasoning to discover relevant factual information in multiple sentences. It is difficult for the current hierarchical network and graph network methods to fully capture the structural information behind the document and make natural reasoning from the context. Different from the previous methods, this article reconstructs the relation extraction task into a machine reading comprehension task. Each pair of entities and relationships is characterized by a question template, and the extraction of entities and relationships is translated into identifying answers from the context. To enhance the context comprehension ability of the extraction model and achieve more precise extraction, we introduce large language models (LLMs) during question construction, enabling the generation of exemplary answers. Besides, to solve the multi-label and multi-entity problems in documents, we propose a new answer extraction model based on hybrid pointer-sequence labeling, which improves the reasoning ability of the model and realizes the extraction of zero or multiple answers in documents. Extensive experiments on three public datasets show that the proposed method is effective.<\/jats:p>","DOI":"10.1145\/3666042","type":"journal-article","created":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T09:06:57Z","timestamp":1717232817000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Document-Level Relation Extraction Based on Machine Reading Comprehension and Hybrid Pointer-sequence Labeling"],"prefix":"10.1145","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0533-5080","authenticated-orcid":false,"given":"xiaoyi","family":"wang","sequence":"first","affiliation":[{"name":"China Language Intelligence Research Center, Capital Normal University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5953-4566","authenticated-orcid":false,"given":"Jie","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, North China University of Technology, Beijing, China and China Language Intelligence Research Center, Capital Normal University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5003-0445","authenticated-orcid":false,"given":"Jiong","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Capital Normal University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2244-3764","authenticated-orcid":false,"given":"Jianyong","family":"Duan","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, North China University of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-7261-9552","authenticated-orcid":false,"given":"guixia","family":"guan","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Capital Normal University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5368-339X","authenticated-orcid":false,"given":"qing","family":"zhang","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, CNONIX National Standard Application and Promotion Laboratory,, North China University of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6904-3096","authenticated-orcid":false,"given":"Jianshe","family":"Zhou","sequence":"additional","affiliation":[{"name":"China Language Intelligence Research Center, Capital Normal University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,6,26]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"536","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Xu Kun","year":"2015","unstructured":"Kun Xu, Yansong Feng, Songfang Huang, and Dongyan Zhao. 2015. Semantic relation classification via convolutional neural networks with simple negative sampling. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 536\u2013540."},{"key":"e_1_3_2_3_2","first-page":"2335","volume-title":"Proceedings of the 25th International Conference on Computational Linguistics: Technical Papers (COLING\u201914)","author":"Zeng Daojian","year":"2014","unstructured":"Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. 2014. Relation classification via convolutional deep neural network. In Proceedings of the 25th International Conference on Computational Linguistics: Technical Papers (COLING\u201914). 2335\u20132344."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324921000395"},{"key":"e_1_3_2_5_2","first-page":"197","volume-title":"Proceedings of the 24th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining (PAKDD\u201920), Part I 24","author":"Tang Hengzhu","year":"2020","unstructured":"Hengzhu Tang, Yanan Cao, Zhenyu Zhang, Jiangxia Cao, Fang Fang, Shi Wang, and Pengfei Yin. 2020. HIN: Hierarchical inference network for document-level relation extraction. In Proceedings of the 24th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining (PAKDD\u201920), Part I 24. Springer, 197\u2013209."},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","first-page":"3711","DOI":"10.18653\/v1\/2020.emnlp-main.303","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201920)","author":"Wang Difeng","year":"2020","unstructured":"Difeng Wang, Wei Hu, Ermei Cao, and Weijian Sun. 2020. Global-to-local neural networks for document-level relation extraction. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201920). 3711\u20133721."},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","first-page":"1630","DOI":"10.18653\/v1\/2020.emnlp-main.127","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201920)","author":"Zeng Shuang","year":"2020","unstructured":"Shuang Zeng, Runxin Xu, Baobao Chang, and Lei Li. 2020. Double graph based reasoning for document-level relation extraction. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201920). 1630\u20131640."},{"key":"e_1_3_2_8_2","first-page":"872","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)","author":"Verga Patrick","year":"2018","unstructured":"Patrick Verga, Emma Strubell, and Andrew McCallum. 2018. Simultaneously self-attending to all mentions for full-abstract biological relation extraction. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). 872\u2013884."},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"129","DOI":"10.18653\/v1\/W18-2314","volume-title":"Proceedings of the BioNLP 2018 Workshop","author":"Nguyen Dat Quoc","year":"2018","unstructured":"Dat Quoc Nguyen and Karin Verspoor. 2018. Convolutional neural networks for chemical-disease relation extraction are improved with character-based word embeddings. In Proceedings of the BioNLP 2018 Workshop. 129\u2013136."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1074"},{"key":"e_1_3_2_11_2","article-title":"Fine-tune BERT for docred with two-step process","author":"Wang Hong","year":"2019","unstructured":"Hong Wang, Christfried Focke, Rob Sylvester, Nilesh Mishra, and William Wang. 2019. Fine-tune BERT for docred with two-step process. arXiv preprint arXiv:1909.11898 (2019).","journal-title":"arXiv preprint arXiv:1909.11898"},{"key":"e_1_3_2_12_2","first-page":"3999","volume-title":"Proceedings of the 30th International Joint Conference on Artificial Intelligence","author":"Zhang Ningyu","year":"2021","unstructured":"Ningyu Zhang, Xiang Chen, Xin Xie, Shumin Deng, Chuanqi Tan, Mosha Chen, Fei Huang, Luo Si, and Huajun Chen. 2021. Document-level relation extraction as semantic segmentation. In Proceedings of the 30th International Joint Conference on Artificial Intelligence. 3999\u20134006."},{"key":"e_1_3_2_13_2","first-page":"41","volume-title":"2020 International Workshop on Electronic Communication and Artificial Intelligence (IWECAI\u201920)","author":"Yang Lige","year":"2020","unstructured":"Lige Yang, Liping Zheng, and Lijuan Zheng. 2020. Research on extraction of human information entity relationship based on improved capsule network. In 2020 International Workshop on Electronic Communication and Artificial Intelligence (IWECAI\u201920). IEEE, 41\u201345."},{"key":"e_1_3_2_14_2","first-page":"7484","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"33","author":"Zhang Xinsong","year":"2019","unstructured":"Xinsong Zhang, Pengshuai Li, Weijia Jia, and Hai Zhao. 2019. Multi-labeled relation extraction with attentive capsule network. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 7484\u20137491."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00065"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00049"},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","first-page":"2226","DOI":"10.18653\/v1\/D18-1246","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Song Linfeng","year":"2018","unstructured":"Linfeng Song, Yue Zhang, Zhiguo Wang, and Daniel Gildea. 2018. N-ary relation extraction using graph-state LSTM. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 2226\u20132235."},{"key":"e_1_3_2_18_2","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP\u201919)","author":"Christopoulou Fenia","year":"2019","unstructured":"Fenia Christopoulou, Makoto Miwa, and Sophia Ananiadou. 2019. Connecting the dots: Document-level neural relation extraction with edge-oriented graphs. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP\u201919). 4925\u20134936."},{"key":"e_1_3_2_19_2","first-page":"14167","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"35","author":"Xu Wang","year":"2021","unstructured":"Wang Xu, Kehai Chen, and Tiejun Zhao. 2021. Document-level relation extraction with reconstruction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 14167\u201314175."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403092"},{"key":"e_1_3_2_21_2","first-page":"1672","volume-title":"Findings of the Association for Computational Linguistics (ACL\u201922)","author":"Tan Qingyu","year":"2022","unstructured":"Qingyu Tan, Ruidan He, Lidong Bing, and Hwee Tou Ng. 2022. Document-level relation extraction with adaptive focal loss and knowledge distillation. In Findings of the Association for Computational Linguistics (ACL\u201922). 1672\u20131681."},{"issue":"3","key":"e_1_3_2_22_2","doi-asserted-by":"crossref","first-page":"210","DOI":"10.3390\/e26030210","article-title":"Enhanced heterogeneous graph attention network with a novel multilabel focal loss for document-level relation extraction","volume":"26","author":"Chen Yang","year":"2024","unstructured":"Yang Chen and Bowen Shi. 2024. Enhanced heterogeneous graph attention network with a novel multilabel focal loss for document-level relation extraction. Entropy 26, 3 (2024), 210.","journal-title":"Entropy"},{"key":"e_1_3_2_23_2","first-page":"14612","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"35","author":"Zhou Wenxuan","year":"2021","unstructured":"Wenxuan Zhou, Kevin Huang, Tengyu Ma, and Jing Huang. 2021. Document-level relation extraction with adaptive thresholding and localized context pooling. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 14612\u201314620."},{"key":"e_1_3_2_24_2","first-page":"1523","volume-title":"Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Yu Jiaxin","year":"2022","unstructured":"Jiaxin Yu, Deqing Yang, and Shuyu Tian. 2022. Relation-specific attentions over entity mentions for enhanced document-level relation extraction. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1523\u20131529."},{"issue":"4","key":"e_1_3_2_25_2","first-page":"1029","article-title":"Document-level relation extraction method based on path labels","volume":"43","author":"Yuan Quan","year":"2023","unstructured":"Quan Yuan, Yunpeng Xu, and Chengliang Tang. 2023. Document-level relation extraction method based on path labels. Journal of Computer Applications 43, 4 (2023), 1029.","journal-title":"Journal of Computer Applications"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K17-1034"},{"key":"e_1_3_2_27_2","unstructured":"Bryan McCann Nitish Shirish Keskar Caiming Xiong and Richard Socher. 2018. The natural language decathlon: Multitask learning as question answering. arXiv preprint arXiv:1806.08730 (2018)."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.519"},{"key":"e_1_3_2_29_2","first-page":"3948","volume-title":"Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence","author":"Zhao Tianyang","year":"2021","unstructured":"Tianyang Zhao, Zhao Yan, Yunbo Cao, and Zhoujun Li. 2021. Asking effective and diverse questions: A machine reading comprehension based framework for joint entity-relation extraction. In Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence. 3948\u20133954."},{"key":"e_1_3_2_30_2","first-page":"317","volume-title":"2022 12th International Conference on Information Science and Technology (ICIST\u201922)","author":"Feng Zhaoyang","year":"2022","unstructured":"Zhaoyang Feng, Xing Wang, and Deqian Fu. 2022. Dual machine reading comprehension for event extraction. In 2022 12th International Conference on Information Science and Technology (ICIST\u201922). IEEE, 317\u2013324."},{"key":"e_1_3_2_31_2","article-title":"Data programming: Creating large training sets, quickly","volume":"29","author":"Ratner Alexander J.","year":"2016","unstructured":"Alexander J. Ratner, Christopher M. De Sa, Sen Wu, Daniel Selsam, and Christopher R\u00e9. 2016. Data programming: Creating large training sets, quickly. Advances in Neural Information Processing Systems 29 (2016), 3567\u20133575.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_32_2","first-page":"1596","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP\u201919)","author":"Hu Minghao","year":"2019","unstructured":"Minghao Hu, Yuxing Peng, Zhen Huang, and Dongsheng Li. 2019. A multi-type multi-span network for reading comprehension that requires discrete reasoning. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP\u201919). 1596\u20131606."},{"key":"e_1_3_2_33_2","unstructured":"Oriol Vinyals Meire Fortunato and Navdeep Jaitly. 2015. Pointer networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems 2 (2015) 2692\u20132700."},{"key":"e_1_3_2_34_2","first-page":"272","volume-title":"Proceedings of the 23rd Annual International Conference on Research in Computational Molecular Biology (RECOMB\u201919)","author":"Wu Ye","year":"2019","unstructured":"Ye Wu, Ruibang Luo, Henry C. M. Leung, Hing-Fung Ting, and Tak-Wah Lam. 2019. Renet: A deep learning approach for extracting gene-disease associations from literature. In Proceedings of the 23rd Annual International Conference on Research in Computational Molecular Biology (RECOMB\u201919). Springer, 272\u2013284."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.141"},{"key":"e_1_3_2_36_2","first-page":"bax024","article-title":"Chemical-induced disease relation extraction via convolutional neural network","volume":"2017","author":"Gu Jinghang","year":"2017","unstructured":"Jinghang Gu, Fuqing Sun, Longhua Qian, and Guodong Zhou. 2017. Chemical-induced disease relation extraction via convolutional neural network. Database 2017 (2017), bax024.","journal-title":"Database"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"4309","DOI":"10.18653\/v1\/P19-1423","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Sahu Sunil Kumar","year":"2019","unstructured":"Sunil Kumar Sahu, Fenia Christopoulou, Makoto Miwa, and Sophia Ananiadou. 2019. Inter-sentence relation extraction with document-level graph convolutional neural network. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 4309\u20134316."},{"key":"e_1_3_2_38_2","first-page":"231","volume-title":"Asian Conference on Machine Learning","author":"Haotian Chen","year":"2024","unstructured":"Chen Haotian, Chen Yijiang, and Zhou Xiangdong. 2024. Understanding more knowledge makes the transformer perform better in document-level relation extraction. In Asian Conference on Machine Learning. PMLR, 231\u2013246."}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3666042","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3666042","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:05Z","timestamp":1750295885000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3666042"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,26]]},"references-count":37,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,7,31]]}},"alternative-id":["10.1145\/3666042"],"URL":"https:\/\/doi.org\/10.1145\/3666042","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,26]]},"assertion":[{"value":"2023-03-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}