{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T00:38:41Z","timestamp":1759970321191,"version":"build-2065373602"},"reference-count":19,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T00:00:00Z","timestamp":1736726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>We assessed whether constructing a mathematical knowledge graph for a knowledge question-answering system or a course recommendation system, Named Entity Recognition (NER), is indispensable. The accuracy of its recognition directly affects the actual performance of these subsequent tasks. In order to improve the accuracy of mathematical knowledge entity recognition and provide effective support for subsequent functionalities, this paper adopts the latest pre-trained language model, LERT, combined with a Bidirectional Gated Recurrent Unit (BiGRU), Iterated Dilated Convolutional Neural Networks (IDCNNs), and Conditional Random Fields (CRFs), to construct the LERT-BiGRU-IDCNN-CRF model. First, LERT provides context-related word vectors, and then the BiGRU captures both long-distance and short-distance information, the IDCNN retrieves local information, and finally the CRF is decoded to output the corresponding labels. Experimental results show that the accuracy of this model when recognizing mathematical concepts and theorem entities is 97.22%, the recall score is 97.47%, and the F1 score is 97.34%. This model can accurately recognize the required entities, and, through comparison, this method outperforms the current state-of-the-art entity recognition models.<\/jats:p>","DOI":"10.3390\/info16010042","type":"journal-article","created":{"date-parts":[[2025,1,13]],"date-time":"2025-01-13T06:42:15Z","timestamp":1736750535000},"page":"42","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Chinese Mathematical Knowledge Entity Recognition Based on Linguistically Motivated Bidirectional Encoder Representation from Transformers"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0649-8850","authenticated-orcid":false,"given":"Wei","family":"Song","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, North China University of Technology, Beijing 100144, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"He","family":"Zheng","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, North China University of Technology, Beijing 100144, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuaiqi","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, North China University of Technology, Beijing 100144, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingze","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Grid Jilin Electric Power Research Institute, Changchun 130015, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Electrical and Control Engineering, North China University of Technology, Beijing 100144, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keqing","family":"Ning","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, North China University of Technology, Beijing 100144, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhao, S. (2004, January 28\u201329). Named entity recognition in biomedical texts using an HMM model. Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and Its Applications (NLPBA\/BioNLP), Geneva, Switzerland.","DOI":"10.3115\/1567594.1567613"},{"key":"ref_2","unstructured":"Lafferty, J., McCallum, A., and Pereira, F. (July, January 28). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proceedings of the ICML 2001, Williamstown, MA, USA."},{"key":"ref_3","unstructured":"Chen, W., Zhang, Y., and Isahara, H. (2006, January 22\u201323). Chinese named entity recognition with conditional random fields. Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, Sydney, Australia."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"S12","DOI":"10.1186\/1758-2946-7-S1-S12","article-title":"Chemical entity extraction using CRF and an ensemble of extractors","volume":"7","author":"Khabsa","year":"2015","journal-title":"J. Cheminform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1207\/s15516709cog1402_1","article-title":"Finding structure in time","volume":"14","author":"Elman","year":"1990","journal-title":"Cogn. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hochreiter, S. (1997). Long Short-Term Memory, Neural Computation MIT-Press.","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zeng, D., Sun, C., Lin, L., and Liu, B. (2017). LSTM-CRF for drug-named entity recognition. Entropy, 19.","DOI":"10.3390\/e19060283"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"113942","DOI":"10.1109\/ACCESS.2019.2935223","article-title":"An attention-based BiLSTM-CRF model for Chinese clinic named entity recognition","volume":"7","author":"Wu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_9","unstructured":"de Castro, Q., Vitor, P., da Silva, N.F.F., and da Silva Soares, A. (2018). Portuguese named entity recognition using lstm-crf. Computational Processing of the Portuguese Language: 13th International Conference, PROPOR 2018, Canela, Brazil, 24\u201326 September 2018, Springer International Publishing. Proceedings 13."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1007\/s12145-019-00390-3","article-title":"BiLSTM-CRF for geological named entity recognition from the geoscience literature","volume":"12","author":"Qiu","year":"2019","journal-title":"Earth Sci. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Strubell, E., Verga, P., Belanger, D., and McCallum, A. (2017). Fast and accurate entity recognition with iterated dilated convolutions. arXiv.","DOI":"10.18653\/v1\/D17-1283"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yu, B., and Wei, J. (2020, January 14\u201316). IDCNN-CRF-based domain named entity recognition method. Proceedings of the 2020 IEEE 2nd International Conference on Civil Aviation Safety and Information Technology (ICCASIT), Weihai, China.","DOI":"10.1109\/ICCASIT50869.2020.9368795"},{"key":"ref_13","unstructured":"Devlin, J. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"154290","DOI":"10.1109\/ACCESS.2019.2946594","article-title":"Target-dependent sentiment classification with BERT","volume":"7","author":"Gao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"104156","DOI":"10.1109\/ACCESS.2022.3210119","article-title":"Chinese named entity recognition of epidemiological investigation of information on COVID-19 based on BERT","volume":"10","author":"Yang","year":"2022","journal-title":"IEEE Access"},{"key":"ref_16","unstructured":"Clark, K. (2020). Electra: Pre-training text encoders as discriminators rather than generators. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3504","DOI":"10.1109\/TASLP.2021.3124365","article-title":"Pre-training with whole word masking for chinese bert","volume":"29","author":"Cui","year":"2021","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_18","unstructured":"Cui, Y., Yang, Z., and Liu, T. (2022). PERT: Pre-training BERT with permuted language model. arXiv."},{"key":"ref_19","unstructured":"Cui, Y., Che, W., Wang, S., and Liu, T. (2022). Lert: A linguistically-motivated pre-trained language model. arXiv."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/1\/42\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:27:36Z","timestamp":1759919256000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/1\/42"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,13]]},"references-count":19,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["info16010042"],"URL":"https:\/\/doi.org\/10.3390\/info16010042","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2025,1,13]]}}}