{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:44:17Z","timestamp":1760240657495,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2019,8,26]],"date-time":"2019-08-26T00:00:00Z","timestamp":1566777600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Named Entity Recognition (NER) on Clinical Electronic Medical Records (CEMR) is a fundamental step in extracting disease knowledge by identifying specific entity terms such as diseases, symptoms, etc. However, the state-of-the-art NER methods based on Long Short-Term Memory (LSTM) fail to exploit GPU parallelism fully under the massive medical records. Although a novel NER method based on Iterated Dilated CNNs (ID-CNNs) can accelerate network computing, it tends to ignore the word-order feature and semantic information of the current word. In order to enhance the performance of ID-CNNs-based models on NER tasks, an attention-based ID-CNNs-CRF model, which combines the word-order feature and local context, is proposed. Firstly, position embedding is utilized to fuse word-order information. Secondly, the ID-CNNs architecture is used to extract global semantic information rapidly. Simultaneously, the attention mechanism is employed to pay attention to the local context. Finally, we apply the CRF to obtain the optimal tag sequence. Experiments conducted on two CEMR datasets show that our model outperforms traditional ones. The F1-scores of 94.55% and 91.17% are obtained respectively on these two datasets, and both are better than LSTM-based models.<\/jats:p>","DOI":"10.3390\/fi11090185","type":"journal-article","created":{"date-parts":[[2019,8,26]],"date-time":"2019-08-26T10:54:53Z","timestamp":1566816893000},"page":"185","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["An Improved Method for Named Entity Recognition and Its Application to CEMR"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5359-6213","authenticated-orcid":false,"given":"Ming","family":"Gao","sequence":"first","affiliation":[{"name":"Department of Intelligent Information Processing, Shanghai University, Shanghai 200444, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1759-9246","authenticated-orcid":false,"given":"Qifeng","family":"Xiao","sequence":"additional","affiliation":[{"name":"Department of Intelligent Information Processing, Shanghai University, Shanghai 200444, China"}]},{"given":"Shaochun","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Intelligent Information Processing, Shanghai University, Shanghai 200444, China"}]},{"given":"Kun","family":"Deng","sequence":"additional","affiliation":[{"name":"Department of Intelligent Information Processing, Shanghai University, Shanghai 200444, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,26]]},"reference":[{"key":"ref_1","unstructured":"Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., and Dyer, C. (2004). Neural architectures for named entity recognition. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ma, X., and Hovy, E. (2016). End-to-end sequence labeling via bi-directional lstm-cnns-crf. arXiv.","DOI":"10.18653\/v1\/P16-1101"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rondeau, M.A., and Su, Y. (2016, January 8\u201312). LSTM-Based NeuroCRFs for Named Entity Recognition. Proceedings of the Interspeech, San Francisco, SF, USA.","DOI":"10.21437\/Interspeech.2016-288"},{"key":"ref_4","unstructured":"Rei, M., Crichton, G.K., and Pyysalo, S. (2016). Attending to characters in neural sequence labeling models. arXiv."},{"key":"ref_5","unstructured":"Yin, W., Kann, K., Yu, M., and Sch\u00fctze, H. (2017). Comparative study of CNN and RNN for natural language processing. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"55392","DOI":"10.1109\/ACCESS.2018.2868970","article-title":"Deep learning approach for short-term stock trends prediction based on two-stream gated recurrent unit network","volume":"6","author":"Minh","year":"2018","journal-title":"IEEE Access"},{"key":"ref_7","first-page":"2493","article-title":"Natural language processing (almost) from scratch","volume":"12","author":"Collobert","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, C., Chen, W., and Xu, B. (2017). Named entity recognition with gated convolutional neural networks. Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data, Springer.","DOI":"10.1007\/978-3-319-69005-6_10"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Strubell, E., Verga, P., Belanger, D., and McCallum, A. (2017). Fast and accurate sequence labeling with iterated dilated convolutions. arXiv.","DOI":"10.18653\/v1\/D17-1283"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/S1532-0464(03)00014-5","article-title":"Rutabaga by any other name: extracting biological names","volume":"35","author":"Hirschman","year":"2002","journal-title":"J. Biomed. Inf."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tsai, R.T.H., Sung, C.L., Dai, H.J., Hung, H.C., Sung, T.Y., and Hsu, W.L. (2006, January 18\u201320). NERBio: Using selected word conjunctions, term normalization, and global patterns to improve biomedical named entity recognition. Proceedings of the Fifth International Conference on Bioinformatics, New Delhi, India.","DOI":"10.1186\/1471-2105-7-S5-S11"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tsuruoka, Y., and Tsujii, J.I. (2003, January 11). Boosting precision and recall of dictionary-based protein name recognition. Proceedings of the ACL 2003 workshop on Natural language processing in biomedicine, Sapporo, Japan.","DOI":"10.3115\/1118958.1118964"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.compbiolchem.2008.03.008","article-title":"Exploiting the performance of dictionary-based bio-entity name recognition in biomedical literature","volume":"32","author":"Yang","year":"2008","journal-title":"Comput. Biol. Chem."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Han, X., and Ruonan, R. (2011, January 24\u201326). The method of medical named entity recognition based on semantic model and improved svm-knn algorithm. Proceedings of the 2011 Seventh International Conference on Semantics, Knowledge and Grids, Beijing, China.","DOI":"10.1109\/SKG.2011.24"},{"key":"ref_15","unstructured":"Collier, N., Nobata, C., and Tsujii, J.I. (August, January 31). Extracting the names of genes and gene products with a hidden markov model. Proceedings of the 18th conference on Computational linguistics, Saarbr\u00fccken, Germany."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"GuoDong, Z., and Jian, S. (2004, January 28\u201329). Exploring deep knowledge resources in biomedical name recognition. Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and its Applications, Geneva, Switzerland.","DOI":"10.3115\/1567594.1567616"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chieu, H.L., and Ng, H.T. (June, January 27). Named entity recognition with a maximum entropy approach. Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, Edmonton, AB, Canada.","DOI":"10.3115\/1119176.1119199"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2909","DOI":"10.1093\/bioinformatics\/btt474","article-title":"Dnorm: disease name normalization with pairwise learning to rank","volume":"29","author":"Leaman","year":"2013","journal-title":"Bioinformatics"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1093\/bioinformatics\/btv570","article-title":"Cell line name recognition in support of the identification of synthetic lethality in cancer from text","volume":"32","author":"Kaewphan","year":"2015","journal-title":"Bioinformatics"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1093\/bioinformatics\/btx815","article-title":"Gram-cnn: A deep learning approach with local context for named entity recognition in biomedical text","volume":"34","author":"Zhu","year":"2015","journal-title":"Bioinformatics"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xu, K., Zhou, Z., Gong, T., Hao, T., and Liu, W. (July, January 28). Sblc: a hybrid model for disease named entity recognition based on semantic bidirectional lstms and conditional random fields. Proceedings of the 2018 Sino-US Conference on Health Informatics, Guangzhou, China.","DOI":"10.1186\/s12911-018-0690-y"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chowdhury, S., Dong, X., Qian, L., Li, X., Guan, Y., Yang, J., and Yu, Q. (2018). A multitask bi-directional rnn model for named entity recognition on chinese electronic medical records. BMC Bioinform., 19.","DOI":"10.1186\/s12859-018-2467-9"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1381","DOI":"10.1093\/bioinformatics\/btx761","article-title":"An attention-based bilstm-crf approach to document-level chemical named entity recognition","volume":"34","author":"Luo","year":"2017","journal-title":"Bioinformatics"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sang, E.F., and Veenstra, J. (1999, January 8\u201312). Representing text chunks. Proceedings of the Conference on European Chapter of the Association for Computational Linguistics, Bergen, Norway.","DOI":"10.3115\/977035.977059"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/MIS.2016.45","article-title":"How to generate a good word embedding","volume":"31","author":"Lai","year":"2016","journal-title":"IEEE Intell. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Joulin, A., Grave, E., Bojanowski, P., and Mikolov, T. (2016). Bag of tricks for efficient text classification. arXiv.","DOI":"10.18653\/v1\/E17-2068"},{"key":"ref_27","unstructured":"Le, Q., and Mikolov, T. (2014, January 21\u201326). Distributed representations of sentences and documents. Proceedings of the International Conference on International Conference on Machine Learning, Beijing, China."},{"key":"ref_28","unstructured":"(2019, August 21). (In Chinese)."},{"key":"ref_29","unstructured":"(2019, August 21). Available online: https:\/\/github.com\/fxsjy\/jieba."},{"key":"ref_30","unstructured":"Yu, F., and Koltun, V. (2015). Multi-scale context aggregation by dilated convolutions. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bharadwaj, A., Mortensen, D., Dyer, C., and Carbonell, J. (2016, January 1\u20135). Phonologically aware neural model for named entity recognition in low resource transfer settings. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1153"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Li, J., Zhou, M., Qi, G., Lao, N., Ruan, T., and Du, J. (2018). Knowledge Graph and Semantic Computing. Language, Knowledge, and Intelligence, Springer.","DOI":"10.1007\/978-981-10-7359-5"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhao, J., Van Harmelen, F., Tang, J., Han, X., Wang, Q., and Li, X. (2019). Knowledge Graph and Semantic Computing. Knowledge Computing and Language Understanding, Springer.","DOI":"10.1007\/978-981-13-3146-6"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/9\/185\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:14:00Z","timestamp":1760188440000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/9\/185"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,26]]},"references-count":33,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["fi11090185"],"URL":"https:\/\/doi.org\/10.3390\/fi11090185","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2019,8,26]]}}}