{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T07:33:08Z","timestamp":1775719988636,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T00:00:00Z","timestamp":1721606400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T00:00:00Z","timestamp":1721606400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Key Research and Development Program of China under Grant Agreement","award":["2022YFF0903302"],"award-info":[{"award-number":["2022YFF0903302"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Named entity recognition (NER) stands as a pivotal task in natural language processing, bearing profound implications for diverse downstream applications. Recent scholarship underscores the substantial performance gains attainable by integrating label knowledge into token representations, effectively treating named entity recognition as a machine reading comprehension task. Nevertheless, extant methodologies often inadequately leverage the potential of label knowledge. In response to this limitation, we introduce the Context-based Label Knowledge Enhanced Span Recognition (CLESR) architecture, designed to augment label knowledge through the assimilation of contextual information. We formulate an annotation paradigm tailored to nested scenarios, concurrently training external context-based label knowledge using conventional word association learning algorithms. The ensuing context-based label knowledge is seamlessly integrated into the model via a dedicated label attention module, thereby fortifying label learning capabilities during training. To adeptly manage both flat and nested entities, we implement a global pointer as our decoding strategy, enabling direct predictions of the positions and corresponding categories of named entities. Rigorous experimentation across six widely recognized benchmarks substantiates the efficacy of CLESR in both flat and nested tasks. Impressively, our model achieves performance enhancements surpassing those of the baseline BERT-MRC model, with gains of +\u00a00.29%, +\u00a00.77%, +\u00a00.39%, +\u00a01.9%, and +\u00a00.47% on English CoNLL2003, English OntoNotes 4.0, Chinese MSRA, English ACE2004, and English ACE2005, respectively.<\/jats:p>","DOI":"10.1007\/s44196-024-00595-5","type":"journal-article","created":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T12:01:45Z","timestamp":1721649705000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["CLESR: Context-Based Label Knowledge Enhanced Span Recognition for Named Entity Recognition"],"prefix":"10.1007","volume":"17","author":[{"given":"Xi","family":"Chen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8195-7087","authenticated-orcid":false,"given":"Shuai","family":"Pan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,7,22]]},"reference":[{"key":"595_CR1","doi-asserted-by":"crossref","unstructured":"Li, X., Feng, J., Meng, Y., Han, Q., Wu, F., Li, J.: A unified MRC framework for named entity recognition. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5849\u20135859. Association for Computational Linguistics, Online (2020). https:\/\/aclanthology.org\/2020.acl-main.519","DOI":"10.18653\/v1\/2020.acl-main.519"},{"key":"595_CR2","doi-asserted-by":"crossref","unstructured":"Yang, P., Cong, X., Sun, Z., Liu, X.: Enhanced language representation with label knowledge for span extraction. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 4623\u20134635. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic (2021). https:\/\/aclanthology.org\/2021.emnlp-main.379","DOI":"10.18653\/v1\/2021.emnlp-main.379"},{"key":"595_CR3","doi-asserted-by":"publisher","unstructured":"Wei, Z., Su, J., Wang, Y., Tian, Y., Chang, Y.: A novel cascade binary tagging framework for relational triple extraction. In: Jurafsky, D., Chai, J., Schluter, N., Tetreault, J.R. (eds.) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5\u201310, 2020, pp. 1476\u20131488. Association for Computational Linguistics, Online (2020). https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.136","DOI":"10.18653\/v1\/2020.acl-main.136"},{"key":"595_CR4","doi-asserted-by":"crossref","unstructured":"Le, P., Titov, I.: Improving entity linking by modeling latent relations between mentions. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1595\u20131604. Association for Computational Linguistics, Melbourne, Australia (2018). https:\/\/aclanthology.org\/P18-1148","DOI":"10.18653\/v1\/P18-1148"},{"key":"595_CR5","doi-asserted-by":"crossref","unstructured":"Kirstain, Y., Ram, O., Levy, O.: Coreference resolution without span representations. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 14\u201319. Association for Computational Linguistics, Online (2021). https:\/\/aclanthology.org\/2021.acl-short.3","DOI":"10.18653\/v1\/2021.acl-short.3"},{"key":"595_CR6","doi-asserted-by":"crossref","unstructured":"Yang, H., Sui, D., Chen, Y., Liu, K., Zhao, J., Wang, T.: Document-level event extraction via parallel prediction networks. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp. 6298\u20136308. Association for Computational Linguistics, Online (2021). https:\/\/aclanthology.org\/2021.acl-long.492.pdf","DOI":"10.18653\/v1\/2021.acl-long.492"},{"key":"595_CR7","doi-asserted-by":"crossref","unstructured":"Cui, L., Zhang, Y.: Hierarchically-refined label attention network for sequence labeling. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 4115\u20134128. Association for Computational Linguistics, Hong Kong, China (2019). https:\/\/aclanthology.org\/D19-1422","DOI":"10.18653\/v1\/D19-1422"},{"key":"595_CR8","unstructured":"Ghaddar, A., Langlais, P.: Robust lexical features for improved neural network named-entity recognition. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 1896\u20131907. Association for Computational Linguistics, Santa Fe, New Mexico, USA (2018). https:\/\/aclanthology.org\/C18-1161"},{"key":"595_CR9","doi-asserted-by":"crossref","unstructured":"Ma, R., Peng, M., Zhang, Q., Wei, Z., Huang, X.: Simplify the usage of lexicon in Chinese NER. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5951\u20135960. Association for Computational Linguistics, Online (2020). https:\/\/aclanthology.org\/2020.acl-main.528","DOI":"10.18653\/v1\/2020.acl-main.528"},{"key":"595_CR10","doi-asserted-by":"crossref","unstructured":"Alex, B., Haddow, B., Grover, C.: Recognising nested named entities in biomedical text. In: Biological, Translational, and Clinical Language Processing, pp. 65\u201372. Association for Computational Linguistics, Prague, Czech Republic (2007). https:\/\/aclanthology.org\/W07-1009","DOI":"10.3115\/1572392.1572404"},{"key":"595_CR11","doi-asserted-by":"publisher","unstructured":"Lu, W., Roth, D.: Joint mention extraction and classification with mention hypergraphs. In: M\u00e0rquez, L., Callison-Burch, C., Su, J., Pighin, D., Marton, Y. (eds.) Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, September 17\u201321, 2015, pp. 857\u2013867. The Association for Computational Linguistics, Online (2015). https:\/\/doi.org\/10.18653\/v1\/d15-1102","DOI":"10.18653\/v1\/d15-1102"},{"key":"595_CR12","doi-asserted-by":"crossref","unstructured":"Wang, B., Lu, W.: Neural segmental hypergraphs for overlapping mention recognition. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 204\u2013214. Association for Computational Linguistics, Brussels, Belgium (2018). https:\/\/aclanthology.org\/D18-1019","DOI":"10.18653\/v1\/D18-1019"},{"key":"595_CR13","doi-asserted-by":"crossref","unstructured":"Muis, A.O., Lu, W.: Labeling gaps between words: Recognizing overlapping mentions with mention separators. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 2608\u20132618. Association for Computational Linguistics, Copenhagen, Denmark (2017). https:\/\/aclanthology.org\/D17-1276","DOI":"10.18653\/v1\/D17-1276"},{"key":"595_CR14","unstructured":"Su, J., Murtadha, A., Pan, S., Hou, J., Sun, J., Huang, W., Wen, B., Liu, Y.: Global pointer: novel efficient span-based approach for named entity recognition. arXiv (2022). arXiv:2208.03054"},{"key":"595_CR15","doi-asserted-by":"crossref","unstructured":"Ma, X., Hovy, E.: End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1064\u20131074. Association for Computational Linguistics, Berlin, Germany (2016). https:\/\/aclanthology.org\/P16-1101","DOI":"10.18653\/v1\/P16-1101"},{"key":"595_CR16","doi-asserted-by":"publisher","unstructured":"Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers), pp. 4171\u20134186. Association for Computational Linguistics, Online (2019). https:\/\/doi.org\/10.18653\/v1\/n19-1423","DOI":"10.18653\/v1\/n19-1423"},{"key":"595_CR17","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V.: RoBERTa: a robustly optimized BERT pretraining approach (2019). arXiv:1907.11692"},{"key":"595_CR18","doi-asserted-by":"crossref","unstructured":"Xu, M., Jiang, H., Watcharawittayakul, S.: A local detection approach for named entity recognition and mention detection. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1237\u20131247. Association for Computational Linguistics, Vancouver, Canada (2017). https:\/\/aclanthology.org\/P17-1114","DOI":"10.18653\/v1\/P17-1114"},{"key":"595_CR19","doi-asserted-by":"crossref","unstructured":"Sohrab, M.G., Miwa, M.: Deep exhaustive model for nested named entity recognition. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 2843\u20132849. Association for Computational Linguistics, Brussels, Belgium (2018). https:\/\/aclanthology.org\/D18-1309","DOI":"10.18653\/v1\/D18-1309"},{"key":"595_CR20","doi-asserted-by":"crossref","unstructured":"Lin, H., Lu, Y., Han, X., Sun, L.: Sequence-to-nuggets: nested entity mention detection via anchor-region networks. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5182\u20135192. Association for Computational Linguistics, Florence, Italy (2019). https:\/\/aclanthology.org\/P19-1511","DOI":"10.18653\/v1\/P19-1511"},{"key":"595_CR21","doi-asserted-by":"crossref","unstructured":"Wan, J., Ru, D., Zhang, W., Yu, Y.: Nested named entity recognition with span-level graphs. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 892\u2013903. Association for Computational Linguistics, Dublin, Ireland (2022). https:\/\/aclanthology.org\/2022.acl-long.63","DOI":"10.18653\/v1\/2022.acl-long.63"},{"key":"595_CR22","doi-asserted-by":"crossref","unstructured":"Yu, J., Bohnet, B., Poesio, M.: Named entity recognition as dependency parsing. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 6470\u20136476. Association for Computational Linguistics, Online (2020). https:\/\/aclanthology.org\/2020.acl-main.577","DOI":"10.18653\/v1\/2020.acl-main.577"},{"key":"595_CR23","unstructured":"Su, J., Lu, Y., Pan, S., Murtadha, A., Wen, B., Liu, Y.: RoFormer: enhanced transformer with rotary position embedding. arXiv (2021). arXiv:2104.09864"},{"key":"595_CR24","unstructured":"al., C.: PaLM: Scaling language modeling with pathways. arXiv (2022). arXiv:2204.02311"},{"key":"595_CR25","unstructured":"Hua, W., Dai, Z., Liu, H., Le, Q.: Transformer quality in linear time. In: Chaudhuri, K., Jegelka, S., Song, L., Szepesvari, C., Niu, G., Sabato, S. (eds.) Proceedings of the 39th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 162, pp. 9099\u20139117. PMLR, Online (2022). https:\/\/proceedings.mlr.press\/v162\/hua22a.html"},{"key":"595_CR26","doi-asserted-by":"crossref","unstructured":"Sun, Z., Li, X., Sun, X., Meng, Y., Ao, X., He, Q., Wu, F., Li, J.: ChineseBERT: Chinese pretraining enhanced by glyph and Pinyin information. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 2065\u20132075. Association for Computational Linguistics, Online (2021). https:\/\/aclanthology.org\/2021.acl-long.161","DOI":"10.18653\/v1\/2021.acl-long.161"},{"key":"595_CR27","unstructured":"Meng, Y., Wu, W., Wang, F., Li, X., Nie, P., Yin, F., Li, M., Han, Q., Sun, X., Li, J.: Glyce: Glyph-vectors for chinese character representations. In: Wallach, H.M., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E.B., Garnett, R. (eds.) Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, pp. 2742\u20132753 (2019). https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/452bf208bf901322968557227b8f6efe-Abstract.html"},{"key":"595_CR28","doi-asserted-by":"publisher","first-page":"3504","DOI":"10.1109\/TASLP.2021.3124365","volume":"29","author":"Y Cui","year":"2021","unstructured":"Cui, Y., Che, W., Liu, T., Qin, B., Yang, Z.: Pre-training with whole word masking for Chinese BERT. IEEE\/ACM Trans. Audio Speech Lang. Proc. 29, 3504\u20133514 (2021)","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Proc."},{"key":"595_CR29","unstructured":"Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, 2015, Conference Track Proceedings (2015). arXiv:1412.6980"},{"key":"595_CR30","doi-asserted-by":"crossref","unstructured":"Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., Zettlemoyer, L.: Deep contextualized word representations. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 2227\u20132237. Association for Computational Linguistics, New Orleans, Louisiana (2018). https:\/\/aclanthology.org\/N18-1202","DOI":"10.18653\/v1\/N18-1202"},{"key":"595_CR31","doi-asserted-by":"crossref","unstructured":"Clark, K., Luong, M.-T., Manning, C.D., Le, Q.V.: Semi-supervised sequence modeling with cross-view training. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 1914\u20131925. Association for Computational Linguistics, Online (2018). https:\/\/aclanthology.org\/D18-1217.pdf","DOI":"10.18653\/v1\/D18-1217"},{"key":"595_CR32","doi-asserted-by":"crossref","unstructured":"Shen, Y., Wang, X., Tan, Z., Xu, G., Xie, P., Huang, F., Lu, W., Zhuang, Y.: Parallel instance query network for named entity recognition. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 947\u2013961. Association for Computational Linguistics, Dublin, Ireland (2022). https:\/\/aclanthology.org\/2022.acl-long.67","DOI":"10.18653\/v1\/2022.acl-long.67"},{"key":"595_CR33","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Yang, J.: Chinese NER using lattice LSTM. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1554\u20131564. Association for Computational Linguistics, Melbourne, Australia (2018). https:\/\/aclanthology.org\/P18-1144","DOI":"10.18653\/v1\/P18-1144"},{"key":"595_CR34","doi-asserted-by":"crossref","unstructured":"Katiyar, A., Cardie, C.: Nested named entity recognition revisited. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 861\u2013871. Association for Computational Linguistics, New Orleans, Louisiana (2018). https:\/\/aclanthology.org\/N18-1079","DOI":"10.18653\/v1\/N18-1079"},{"key":"595_CR35","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1162\/tacl_a_00334","volume":"8","author":"T Shibuya","year":"2020","unstructured":"Shibuya, T., Hovy, E.: Nested named entity recognition via second-best sequence learning and decoding. Trans. Assoc. Comput. Linguist. 8, 605\u2013620 (2020)","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"595_CR36","doi-asserted-by":"crossref","unstructured":"Luan, Y., Wadden, D., He, L., Shah, A., Ostendorf, M., Hajishirzi, H.: A general framework for information extraction using dynamic span graphs. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 3036\u20133046. Association for Computational Linguistics, Minneapolis, Minnesota (2019). https:\/\/aclanthology.org\/N19-1308","DOI":"10.18653\/v1\/N19-1308"},{"key":"595_CR37","doi-asserted-by":"crossref","unstructured":"Strakov\u00e1, J., Straka, M., Hajic, J.: Neural architectures for nested NER through linearization. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5326\u20135331. Association for Computational Linguistics, Florence, Italy (2019). https:\/\/aclanthology.org\/P19-1527","DOI":"10.18653\/v1\/P19-1527"}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00595-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-024-00595-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00595-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,22]],"date-time":"2024-07-22T12:32:21Z","timestamp":1721651541000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-024-00595-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,22]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["595"],"URL":"https:\/\/doi.org\/10.1007\/s44196-024-00595-5","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,22]]},"assertion":[{"value":"16 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The data employed in this study has been obtained with proper ethical considerations and informed consent.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical and informed consent for data used"}}],"article-number":"190"}}