{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T03:55:46Z","timestamp":1772942146153,"version":"3.50.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"S5","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,12,5]],"date-time":"2019-12-05T00:00:00Z","timestamp":1575504000000},"content-version":"vor","delay-in-days":4,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Clinical named entity recognition (CNER) is important for medical information mining and establishment of high-quality knowledge map. Due to the different text features from natural language and a large number of professional and uncommon clinical terms in Chinese electronic medical records (EMRs), there are still many difficulties in clinical named entity recognition of Chinese EMRs. It is of great importance to eliminate semantic interference and improve the ability of autonomous learning of internal features of the model under the small training corpus.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>From the perspective of deep learning, we integrated the attention mechanism into neural network, and proposed an improved clinical named entity recognition method for Chinese electronic medical records called BiLSTM-Att-CRF, which could capture more useful information of the context and avoid the problem of missing information caused by long-distance factors. In addition, medical dictionaries and part-of-speech (POS) features were also introduced to improve the performance of the model.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Based on China Conference on Knowledge Graph and Semantic Computing (CCKS) 2017 and 2018 Chinese EMRs corpus, our BiLSTM-Att-CRF model finally achieved better performance than other widely-used models without additional features(F1-measure of 85.4% in CCKS 2018, F1-measure of 90.29% in CCKS 2017), and achieved the best performance with POS and dictionary features (F1-measure of 86.11% in CCKS 2018, F1-measure of 90.48% in CCKS 2017). In particular, the BiLSTM-Att-CRF model had significant effect on the improvement of Recall.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Our work preliminarily confirmed the validity of attention mechanism in discovering key information and mining text features, which might provide useful ideas for future research in clinical named entity recognition of Chinese electronic medical records. In the future, we will explore the deeper application of attention mechanism in neural network.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-019-0933-6","type":"journal-article","created":{"date-parts":[[2019,12,5]],"date-time":"2019-12-05T01:02:23Z","timestamp":1575507743000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":50,"title":["An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records"],"prefix":"10.1186","volume":"19","author":[{"given":"Luqi","family":"Li","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li","family":"Hou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunkai","family":"Zhai","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinming","family":"Shi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fangfang","family":"Cui","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,12,5]]},"reference":[{"key":"933_CR1","doi-asserted-by":"crossref","unstructured":"Lossio-Ventura JA, Hogan W, Modave F, Hicks A, Hanna J, Guo Y, et al. Towards an obesity-Cancer Knowledge Base: biomedical entity identification and relation detection. IEEE International Conference on Bioinformatics and Biomedicine. 2016. p. 1081\u20138.","DOI":"10.1109\/BIBM.2016.7822672"},{"issue":"6","key":"933_CR2","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1038\/nrg3208","volume":"13","author":"PB Jensen","year":"2012","unstructured":"Jensen PB, Jensen LJ, Brunak S. Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet. 2012;13(6):395\u2013405.","journal-title":"Nat Rev Genet"},{"issue":"2","key":"933_CR3","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1136\/jamia.1994.95236146","volume":"1","author":"C Friedman","year":"1994","unstructured":"Friedman C, Alderson PO, Austin JHM, Cimino JJ, Johnson SB. A general natural-language text processor for clinical radiology. J Am Med Inform Assn. 1994;1(2):161\u201374.","journal-title":"J Am Med Inform Assn"},{"key":"933_CR4","unstructured":"i2b2. i2b2: Informatics for Integrating Biology & the Bedside. https:\/\/www.i2b2.org\/NLP\/DataSets\/Main.php. Date Accessed: 3\/25\/2019."},{"key":"933_CR5","doi-asserted-by":"crossref","unstructured":"Liu KX, Hu QC, Liu JW, Xing CX. Named Entity Recognition in Chinese Electronic Medical Records Based on CRF. 2017 14th Web Information Systems and Applications Conference (Wisa 2017). 2017:105\u2013110.","DOI":"10.1109\/WISA.2017.8"},{"key":"933_CR6","doi-asserted-by":"crossref","unstructured":"Tang BZ, Cao HX, Wu YH, Jiang M, Xu H. Clinical entity recognition using structural support vector machines with rich features.\u00a0 Proceedings of the Acm Sixth International Workshop on Data and Text Mining in Biomedical Informatics. 2012. p. 13\u20139.","DOI":"10.1145\/2390068.2390073"},{"key":"933_CR7","first-page":"624","volume":"216","author":"YH Wu","year":"2015","unstructured":"Wu YH, Jiang M, Lei JB, Xu H. Named entity recognition in Chinese clinical text using deep neural network. Stud Health Technol. 2015;216:624\u20138.","journal-title":"Stud Health Technol"},{"key":"933_CR8","doi-asserted-by":"publisher","first-page":"283","DOI":"10.3390\/e19060283","volume":"19","author":"D Zeng","year":"2017","unstructured":"Zeng D, et al. LSTM-CRF for drug-named entity recognition. Entropy. 2017;19:283\u201391.","journal-title":"Entropy."},{"key":"933_CR9","unstructured":"Chalapathy R, Borzeshi EZ, Piccardi MJ. Bidirectional LSTM-CRF for clinical concept extraction. Proceedings of COLING. 2016."},{"key":"933_CR10","unstructured":"CCKS 2018. China Conference on Knowledge Graph and Semantic Computing 2018. http:\/\/www.ccks2018.cn. Date Accessed: 12\/21\/2018."},{"key":"933_CR11","doi-asserted-by":"crossref","unstructured":"Cao, et al. cw2vec: learning Chinese word embeddings with stroke n-gram information. Proceedings of the 32th AAAI Conference on Artificial Intelligence. 2018.","DOI":"10.1609\/aaai.v32i1.12029"},{"key":"933_CR12","unstructured":"Tmtpost. With the cw2vec method, Alibaba Health won the national champion of Chinese electronic medical record entity recognition. http:\/\/www.tmtpost.com\/nictation\/3424059.html. Date Accessed: 3\/22\/2019."},{"key":"933_CR13","unstructured":"Luo L, Li N, Li S, Yang Z. DUTIR at the CCKS-2018 Task1: A Neural Network Ensemble Approach for Chinese Clinical Named Entity Recognition. Proceedings of the Evaluation Tasks at the China Conference on Knowledge Graph and Semantic Computing (CCKS 2018). 2018. p. 7-12."},{"key":"933_CR14","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention Is All You Need. arXiv:1706.03762 [cs.CV]. https:\/\/arxiv.org\/abs\/1706.03762."},{"key":"933_CR15","unstructured":"Bahdanau D, Cho K, Bengio YJ. Neural machine translation by jointly learning to align and translate. Proceedings of International Conference on Learning Representations. 2014."},{"key":"933_CR16","doi-asserted-by":"crossref","unstructured":"Tan Z, Wang M, Xie J, Chen Y, Shi X, editors. Deep semantic role labeling with self-attention. Thirty-Second AAAI Conference on Artificial Intelligence. 2018.","DOI":"10.1609\/aaai.v32i1.11928"},{"key":"933_CR17","volume-title":"Research of Chinese named entity recognition based on deep learning","author":"C Sui","year":"2017","unstructured":"Sui C. Research of Chinese named entity recognition based on deep learning. Hang Zhou: Zhejiang University; 2017."},{"key":"933_CR18","unstructured":"Ma J, Zhang Y, Yao S, et al. Terminology extraction for new energy vehicle based on BiLSTM_Attention_CRF model. Application Research of Computers. 2019;36(05):1385-9."},{"issue":"8","key":"933_CR19","doi-asserted-by":"publisher","first-page":"1381","DOI":"10.1093\/bioinformatics\/btx761","volume":"34","author":"L Luo","year":"2018","unstructured":"Luo L, Yang Z, Yang P, Zhang Y, Wang L, Lin H, et al. An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition. Bioinformatics. 2018;34(8):1381\u20138.","journal-title":"Bioinformatics."},{"key":"933_CR20","first-page":"612","volume-title":"Natural Language Processing and Chinese Computing","author":"Z Rui","year":"2017","unstructured":"Rui Z, Wang Z, Mai D. Building Emotional Conversation Systems Using Multi-task Seq2Seq Learning. In: Natural Language Processing and Chinese Computing; 2017. p. 612\u201321."},{"issue":"6","key":"933_CR21","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1109\/MIS.2016.45","volume":"31","author":"SW Lai","year":"2016","unstructured":"Lai SW, Liu K, He SZ, Zhao J. How to generate a good word embedding. IEEE Intell Syst. 2016;31(6):5\u201314.","journal-title":"IEEE Intell Syst"},{"key":"933_CR22","first-page":"3111","volume":"2","author":"T Mikolov","year":"2013","unstructured":"Mikolov T, et al. Distributed representations of words and phrases and their compositionality. Adv Neural Inf Process Syst. 2013;2:3111\u20139.","journal-title":"Adv Neural Inf Process Syst"},{"key":"933_CR23","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning C, editors. Glove: Global vectors for word representation. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014.","DOI":"10.3115\/v1\/D14-1162"},{"key":"933_CR24","unstructured":"CCKS 2017. China Conference on Knowledge Graph and Semantic Computing 2017. http:\/\/www.ccks2017.cn. Date Accessed: 3\/25\/2019."},{"key":"933_CR25","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.jbi.2019.103133","volume":"92","author":"Q Wang","year":"2019","unstructured":"Wang Q, Zhou Y, Ruan T, et al. Incorporating dictionaries into deep neural networks for the Chinese clinical named entity recognition. J Biomed Inform. 2019;92:103\u201333.","journal-title":"J Biomed Inform"},{"key":"933_CR26","unstructured":"Sogou pinyin. Sogou Dict. https:\/\/pinyin.sogou.com\/dict. Date Accessed: 3\/25\/2019."},{"key":"933_CR27","unstructured":"Jieba. Chinese Words Segementation Utilities. https:\/\/pypi.org\/project\/jieba. Date Accessed: 3\/25\/2019."},{"key":"933_CR28","unstructured":"Jozefowicz R, Zaremba W, Sutskever I, editors. An empirical exploration of recurrent network architectures. International Conference on International Conference on Machine Learning. 2015."},{"issue":"65","key":"933_CR29","first-page":"102","volume":"19","author":"X Cai","year":"2019","unstructured":"Cai X, Dong S, Hu J. A deep learning model incorporating part of speech and self-matching attention for named entity recognition of Chinese electronic medical records. BMC Med Inform Decis Making. 2019;19(65):102\u20139.","journal-title":"BMC Med Inform Decis Making"},{"key":"933_CR30","unstructured":"Devlin J, Chang MW, Lee K, et al. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv:1810.04805 [cs.CL].\u00a0https:\/\/arxiv.org\/abs\/1810.04805."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0933-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-019-0933-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0933-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,7]],"date-time":"2022-10-07T18:35:11Z","timestamp":1665167711000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-019-0933-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":30,"journal-issue":{"issue":"S5","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["933"],"URL":"https:\/\/doi.org\/10.1186\/s12911-019-0933-6","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]},"assertion":[{"value":"5 December 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"235"}}