{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T12:52:05Z","timestamp":1763643125256,"version":"3.40.5"},"reference-count":39,"publisher":"World Scientific Pub Co Pte Ltd","issue":"09","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2021,7]]},"abstract":"<jats:p> The current named entity recognition (NER) is mainly based on joint convolution or recurrent neural network. In order to achieve high performance, these networks need to provide a large amount of training data in the form of feature engineering corpus and lexicons. Chinese NER is very challenging because of the high contextual relevance of Chinese characters, that is, Chinese characters and phrases may have many possible meanings in different contexts. To this end, we propose a model that leverages a pre-trained and bi-directional encoder representations-from-transformers language model and a joint bi-directional long short-term memory (Bi-LSTM) and conditional random fields (CRF) model for Chinese NER. The underlying network layer embeds Chinese characters and outputs character-level representations. The output is then fed into a bidirectional long short-term memory to capture contextual sequence information. The top layer of the proposed model is CRF, which is used to take into account the dependencies of adjacent tags and jointly decode the optimal chain of tags. A series of extensive experiments were conducted to research the useful improvements of the proposed neural network architecture on different datasets without relying heavily on handcrafted features and domain-specific knowledge. Experimental results show that the proposed model is effective, and character-level representation is of great significance for Chinese NER tasks. In addition, through this work, we have composed a new informal conversation message corpus called the autonomous bus information inquiry dataset, and compared to the advanced baseline, our method has been significantly improved. <\/jats:p>","DOI":"10.1142\/s0218001421530037","type":"journal-article","created":{"date-parts":[[2021,2,18]],"date-time":"2021-02-18T09:47:24Z","timestamp":1613641644000},"page":"2153003","source":"Crossref","is-referenced-by-count":6,"title":["Joint Pre-Trained Chinese Named Entity Recognition Based on Bi-Directional Language Model"],"prefix":"10.1142","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0603-5493","authenticated-orcid":false,"given":"Changxia","family":"Ma","sequence":"first","affiliation":[{"name":"School of Computer Engineering, Jiangsu Ocean University, Lianyungang 222005, P.\u00a0R.\u00a0China"}]},{"given":"Chen","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, National University of Singapore, 117583, Singapore"}]}],"member":"219","published-online":{"date-parts":[[2021,4,5]]},"reference":[{"issue":"7","key":"S0218001421530037BIB001","first-page":"357","volume":"4","author":"Chiu J. P.","year":"2016","journal-title":"Trans. Assoc. Comput. Ling."},{"key":"S0218001421530037BIB002","first-page":"103","volume-title":"Proc. 8th Workshop Syntax, Semant. Struct. Statist. Transl.","author":"Cho K.","year":"2014"},{"key":"S0218001421530037BIB003","first-page":"2493","volume":"12","author":"Collobert R.","year":"2011","journal-title":"J. Machine Learn. Res."},{"key":"S0218001421530037BIB004","first-page":"4171","volume-title":"Proc. NAACL-HLT","author":"Devlin J.","year":"2019"},{"key":"S0218001421530037BIB006","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-50496-4_20"},{"key":"S0218001421530037BIB007","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1033"},{"key":"S0218001421530037BIB008","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300015015"},{"key":"S0218001421530037BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1996.548916"},{"key":"S0218001421530037BIB010","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"S0218001421530037BIB011","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010019"},{"key":"S0218001421530037BIB012","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2113"},{"key":"S0218001421530037BIB013","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"S0218001421530037BIB014","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1228"},{"key":"S0218001421530037BIB016","first-page":"282","volume-title":"Proc. ICML","author":"Lafferty J.","year":"2001"},{"key":"S0218001421530037BIB018","first-page":"108","volume-title":"Proc. 5th SIGHAN Workshop Chinese Lang.","author":"Levow G. A.","year":"2006"},{"key":"S0218001421530037BIB019","first-page":"2532","volume-title":"Proc. 9th I.C. Lang. Resourc. Eval.","author":"Li H.","year":"2014"},{"key":"S0218001421530037BIB020","first-page":"96","volume-title":"Proc. SSPS (2nd Symp. Signal Processing Systems)","author":"Li J.","year":"2020"},{"key":"S0218001421530037BIB021","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1200"},{"key":"S0218001421530037BIB022","first-page":"5253","volume-title":"Proc. 32nd AAAI Conf. A.I.","author":"Liu L.","year":"2018"},{"issue":"21","key":"S0218001421530037BIB023","first-page":"46","volume":"338","author":"Liu J.","year":"2019","journal-title":"Neurocomputing"},{"key":"S0218001421530037BIB024","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14932-0_78"},{"key":"S0218001421530037BIB025","first-page":"1064","volume":"1","author":"Ma X.","year":"2016","journal-title":"ACL"},{"key":"S0218001421530037BIB026","first-page":"591","volume-title":"Proc. 17th I.C. Machine Learn.","author":"McCallum A.","year":"2000"},{"key":"S0218001421530037BIB027","doi-asserted-by":"publisher","DOI":"10.3115\/1119176.1119206"},{"issue":"26","key":"S0218001421530037BIB028","first-page":"3111","volume":"10","author":"Mikolov T.","year":"2013","journal-title":"Advanc. Neur. Info. Proc. Sys."},{"key":"S0218001421530037BIB029","doi-asserted-by":"publisher","DOI":"10.1075\/li.30.1.03nad"},{"key":"S0218001421530037BIB030","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-2025"},{"key":"S0218001421530037BIB031","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1064"},{"key":"S0218001421530037BIB033","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"S0218001421530037BIB034","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"S0218001421530037BIB036","doi-asserted-by":"publisher","DOI":"10.3115\/1596374.1596399"},{"issue":"56","key":"S0218001421530037BIB038","first-page":"1929","volume":"15","author":"Srivastava N.","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"S0218001421530037BIB039","doi-asserted-by":"publisher","DOI":"10.3115\/1118853.1118882"},{"key":"S0218001421530037BIB040","first-page":"173","volume-title":"Proc. EACL","author":"Tjong E. F.","year":"1999"},{"key":"S0218001421530037BIB041","first-page":"5998","volume-title":"Proc. 31st Conf. Neur. Inform. Proc. Sys.","author":"Vaswani A.","year":"2017"},{"key":"S0218001421530037BIB042","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313743"},{"key":"S0218001421530037BIB043","first-page":"2720","volume-title":"Proc. NAACL (Proc. 2019 Conf. North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1)","author":"Yang J.","year":"2019"},{"key":"S0218001421530037BIB044","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1144"},{"issue":"2","key":"S0218001421530037BIB045","first-page":"225","volume":"22","author":"Zhou J.","year":"2013","journal-title":"J. Electron."}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001421530037","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,26]],"date-time":"2021-08-26T12:07:51Z","timestamp":1629979671000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218001421530037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,5]]},"references-count":39,"journal-issue":{"issue":"09","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["10.1142\/S0218001421530037"],"URL":"https:\/\/doi.org\/10.1142\/s0218001421530037","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2021,4,5]]}}}