{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T18:16:16Z","timestamp":1771265776335,"version":"3.50.1"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":30,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61802350"],"award-info":[{"award-number":["61802350"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["81701687"],"award-info":[{"award-number":["81701687"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Key Research and Development Program of China","award":["2019YFC0118803"],"award-info":[{"award-number":["2019YFC0118803"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Named entity recognition (NER) on Chinese electronic medical\/healthcare records has attracted significantly attentions as it can be applied to building applications to understand these records. Most previous methods have been purely data-driven, requiring high-quality and large-scale labeled medical data. However, labeled data is expensive to obtain, and these data-driven methods are difficult to handle rare and unseen entities.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>To tackle these problems, this study presents a novel multi-task deep neural network model for Chinese NER in the medical domain. We incorporate dictionary features into neural networks, and a general secondary named entity segmentation is used as auxiliary task to improve the performance of the primary task of named entity recognition.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>In order to evaluate the proposed method, we compare it with other currently popular methods, on three benchmark datasets. Two of the datasets are publicly available, and the other one is constructed by us. Experimental results show that the proposed model achieves 91.07% average f-measure on the two public datasets and 87.05% f-measure on private dataset.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The comparison results of different models demonstrated the effectiveness of our model. The proposed model outperformed traditional statistical models.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-021-01717-1","type":"journal-article","created":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T06:02:34Z","timestamp":1640930554000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Multi-task learning for Chinese clinical named entity recognition with external knowledge"],"prefix":"10.1186","volume":"21","author":[{"given":"Ming","family":"Cheng","sequence":"first","affiliation":[]},{"given":"Shufeng","family":"Xiong","sequence":"additional","affiliation":[]},{"given":"Fei","family":"Li","sequence":"additional","affiliation":[]},{"given":"Pan","family":"Liang","sequence":"additional","affiliation":[]},{"given":"Jianbo","family":"Gao","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,12,31]]},"reference":[{"key":"1717_CR1","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/j.compbiomed.2018.07.019","volume":"101","author":"W Lee","year":"2018","unstructured":"Lee W, Kim K, Lee EY, Choi J. Conditional random fields for clinical named entity recognition: a comparative study using Korean clinical texts. Comput Biol Med. 2018;101:7\u201314.","journal-title":"Comput Biol Med"},{"key":"1717_CR2","doi-asserted-by":"publisher","first-page":"70624","DOI":"10.1109\/ACCESS.2019.2919121","volume":"7","author":"M Cheng","year":"2019","unstructured":"Cheng M, Li L, Ren Y, Lou Y, Gao J. A hybrid method to extract clinical information from Chinese electronic medical records. IEEE Access. 2019;7:70624\u201333.","journal-title":"IEEE Access"},{"key":"1717_CR3","unstructured":"Wu Y, Jiang M, Lei J, Xu H. Named entity recognition in Chinese clinical text using deep neural network. In: MEDINFO: eHealth-enabled Health\u2014proceedings of the 15th world congress on health and biomedical informatics, S\u00e3o Paulo, Brazil. Studies in health technology and informatics, vol. 216; 2015. p. 624\u20138."},{"issue":"15","key":"1717_CR4","doi-asserted-by":"publisher","first-page":"2363","DOI":"10.1093\/bioinformatics\/btx172","volume":"33","author":"Y Lou","year":"2017","unstructured":"Lou Y, Zhang Y, Qian T, Li F, Xiong S, Ji D. A transition-based joint model for disease named entity recognition and normalization. Bioinformatics. 2017;33(15):2363\u201371.","journal-title":"Bioinformatics"},{"issue":"S2","key":"1717_CR5","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1186\/s12911-019-0769-0","volume":"19","author":"Z Zhang","year":"2019","unstructured":"Zhang Z, Zhou T, Zhang Y, Pang Y. Attention-based deep residual learning network for entity relation extraction in Chinese emrs. BMC Med Inform Decis Mak. 2019;19(S2):171\u20137.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"2","key":"1717_CR6","first-page":"53","volume":"17","author":"Z Liu","year":"2017","unstructured":"Liu Z, Yang M, Wang X, Chen Q, Tang B, Wang Z, Xu H. Entity recognition from clinical texts via recurrent neural network. BMC Med Inform Decis Mak. 2017;17(2):53\u201361.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"23","key":"1717_CR7","doi-asserted-by":"publisher","first-page":"4087","DOI":"10.1093\/bioinformatics\/bty449","volume":"34","author":"JM Giorgi","year":"2018","unstructured":"Giorgi JM, Bader GD. Transfer learning for biomedical named entity recognition with neural networks. Bioinformatics. 2018;34(23):4087\u201394.","journal-title":"Bioinformatics"},{"key":"1717_CR8","doi-asserted-by":"crossref","unstructured":"Sun Z, Sun XLX, Meng Y, Ao X, He Q, Wu F, Li J. Chinesebert: Chinese pretraining enhanced by glyph and pinyin information. In: Proceedings of the 59th annual meeting of the association for computational linguistics and the 11th international joint conference on natural language processing, ACL\/IJCNLP (Volume 1: Long Papers); 2021. p. 2065\u201375.","DOI":"10.18653\/v1\/2021.acl-long.161"},{"key":"1717_CR9","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.neucom.2019.09.005","volume":"375","author":"X Mu","year":"2020","unstructured":"Mu X, Wang W, Xu A. Incorporating token-level dictionary feature into neural model for named entity recognition. Neurocomputing. 2020;375:43\u201350.","journal-title":"Neurocomputing"},{"key":"1717_CR10","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1109\/JBHI.2018.2845860","volume":"92","author":"Q Wang","year":"2019","unstructured":"Wang Q, Zhou Y, Ruan T, Gao D, Xia Y, He P. Incorporating dictionaries into deep neural networks for the Chinese clinical named entity recognition. J Biomed Inform. 2019;92:66.","journal-title":"J Biomed Inform"},{"key":"1717_CR11","doi-asserted-by":"publisher","first-page":"113942","DOI":"10.1109\/ACCESS.2019.2935223","volume":"7","author":"G Wu","year":"2019","unstructured":"Wu G, Tang G, Wang Z, Zhang Z, Wang Z. An attention-based bilstm-crf model for Chinese clinic named entity recognition. IEEE Access. 2019;7:113942\u20139.","journal-title":"IEEE Access"},{"issue":"3","key":"1717_CR12","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1109\/TNB.2019.2908678","volume":"18","author":"J. Qin","year":"2019","unstructured":"Qin J., Zhou Q.W.T.R.Y., Gao J. Chinese clinical named entity recognition using residual dilated convolutional neural network with conditional random field. IEEE Trans Nanobiosci. 2019;18(3):306\u201315.","journal-title":"IEEE Trans Nanobiosci"},{"issue":"1","key":"1717_CR13","first-page":"462","volume":"18","author":"L. Chen","year":"2017","unstructured":"Chen L., Chen Y.F.R.D.H.J.B. Long short-term memory rnn for biomedical named entity recognition. Bioinformatics. 2017;18(1):462\u201371.","journal-title":"Bioinformatics"},{"issue":"2","key":"1717_CR14","first-page":"149","volume":"19\u2013S","author":"B. Ji","year":"2019","unstructured":"Ji B., Liu R., Li S., Yu J., Wu Q., Tan Y., Wu J. A hybrid approach for named entity recognition in Chinese electronic medical record. BMC Med Inform Decis Mak. 2019;19\u2013S(2):149\u201358.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1717_CR15","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1186\/1472-6947-6-30","volume":"6","author":"QT Zeng","year":"2006","unstructured":"Zeng QT, Goryachev S, Weiss ST, Sordo M, Murphy SN, Lazarus R. Extracting principal diagnosis, co-morbidity and smoking status for asthma research: evaluation of a natural language processing system. BMC Med Inform Decis Mak. 2006;6:30.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"5","key":"1717_CR16","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1136\/amiajnl-2013-001628","volume":"20","author":"W Sun","year":"2013","unstructured":"Sun W, Rumshisky A, Uzuner \u00d6. Evaluating temporal relations in clinical text: 2012 i2b2 challenge. J Am Med Inform Assoc. 2013;20(5):806\u201313.","journal-title":"J Am Med Inform Assoc"},{"issue":"18","key":"1717_CR17","doi-asserted-by":"publisher","first-page":"2839","DOI":"10.1093\/bioinformatics\/btw343","volume":"32","author":"R Leaman","year":"2016","unstructured":"Leaman R, Lu Z. Taggerone: joint named entity recognition and normalization with semi-Markov models. Bioinformatics. 2016;32(18):2839\u201346.","journal-title":"Bioinformatics"},{"key":"1717_CR18","doi-asserted-by":"crossref","unstructured":"Curran JR, Clark S. Language independent NER using a maximum entropy tagger. In: Proceedings of the seventh conference on natural language learning, CoNLL, Edmonton, Canada; 2003. p. 164\u20137.","DOI":"10.3115\/1119176.1119200"},{"key":"1717_CR19","doi-asserted-by":"crossref","unstructured":"McCallum A. Li W. Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In: Proceedings of the seventh conference on natural language learning, CoNLL, Edmonton, Canada; 2003. p. 188\u201391.","DOI":"10.3115\/1119176.1119206"},{"key":"1717_CR20","doi-asserted-by":"crossref","unstructured":"Klein D, Smarr J, Nguyen H, Manning CD. Named entity recognition with character-level models. In: Proceedings of the seventh conference on natural language learning, CoNLL, Edmonton, Canada; 2003. p. 180\u20133.","DOI":"10.3115\/1119176.1119204"},{"key":"1717_CR21","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1016\/j.jbi.2014.01.012","volume":"49","author":"M Skeppstedt","year":"2014","unstructured":"Skeppstedt M, Kvist G.H.N.H.D.M. Automatic recognition of disorders, findings, pharmaceuticals and body structures from clinical text. J Biomed Inform. 2014;49:148\u201358.","journal-title":"J Biomed Inform"},{"issue":"S\u20131","key":"1717_CR22","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1186\/1472-6947-15-S1-S9","volume":"15","author":"M Song","year":"2015","unstructured":"Song M, Yu H, Han W. Developing a hybrid dictionary-based bio-entity recognition technique. BMC Med Inform Decis Mak. 2015;15(S\u20131):9.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"1717_CR23","first-page":"89","volume":"19\u2013S","author":"B. Tang","year":"2019","unstructured":"Tang B., Wang X., Yan J., Chen Q. Entity recognition in Chinese clinical text using attention-based CNN-LSTM-CRF. BMC Med Inform Decis Mak. 2019;19\u2013S(3):89\u201397.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"8","key":"1717_CR24","doi-asserted-by":"publisher","first-page":"1381","DOI":"10.1093\/bioinformatics\/btx761","volume":"34","author":"L Luo","year":"2018","unstructured":"Luo L, Yang Z, Yang P, Zhang Y, Wang L, Lin H, Wang J. An attention-based bilstm-crf approach to document-level chemical named entity recognition. Bioinformatics. 2018;34(8):1381\u20138.","journal-title":"Bioinformatics"},{"key":"1717_CR25","doi-asserted-by":"crossref","unstructured":"Ma X, Hovy EH. End-to-end sequence labeling via bi-directional lstm-cnns-crf. In: Proceedings of the 54th annual meeting of the association for computational linguistics, ACL, Berlin, Germany; 2016.","DOI":"10.18653\/v1\/P16-1101"},{"key":"1717_CR26","unstructured":"Khan MAAH, Dimitrova N, Shamsuzzaman M, Hasan SA, Sorower MS, Liu J, Datla VV, Milosevic M, Mankovich G, van Ommering R. Improving disease named entity recognition for clinical trial matching. In: IEEE international conference on bioinformatics and biomedicine, BIBM, San Diego, CA, USA; 2019. p. 2541\u20138."},{"key":"1717_CR27","doi-asserted-by":"crossref","unstructured":"Sahu SK, Anand A. Recurrent neural network models for disease name recognition using domain invariant features. In: Proceedings of the 54th annual meeting of the association for computational linguistics, ACL, Berlin, Germany; 2016.","DOI":"10.18653\/v1\/P16-1209"},{"key":"1717_CR28","doi-asserted-by":"crossref","unstructured":"Dong C, Zhang J, Zong C, Hattori M, Di H. Character-based LSTM-CRF with radical-level features for chinese named entity recognition. In: Natural language understanding and intelligent applications\u20145th CCF conference on natural language processing and chinese computing, NLPCC, and 24th international conference on computer processing of oriental languages, ICCPOL, Kunming, China. Lecture Notes in Computer Science, vol. 10102; 2016. p. 239\u201350.","DOI":"10.1007\/978-3-319-50496-4_20"},{"key":"1717_CR29","doi-asserted-by":"crossref","unstructured":"Zhao S, Liu T, Zhao S, Wang F. A neural multi-task learning framework to jointly model medical named entity recognition and normalization. In: The thirty-third AAAI conference on artificial intelligence, AAAI, Honolulu, Hawaii, USA; 2019. p. 817\u201324.","DOI":"10.1609\/aaai.v33i01.3301817"},{"key":"1717_CR30","unstructured":"Luong M, Le QV, Sutskever I, Vinyals O, Kaiser L. Multi-task sequence to sequence learning. In: 4th international conference on learning representations, ICLR, San Juan, Puerto Rico; 2016."},{"key":"1717_CR31","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/j.ins.2019.10.065","volume":"513","author":"H Fei","year":"2020","unstructured":"Fei H, Ren Y, Ji D. Dispatched attention with multi-task learning for nested mention recognition. Inf Sci. 2020;513:241\u201351.","journal-title":"Inf Sci"},{"issue":"10","key":"1717_CR32","doi-asserted-by":"publisher","first-page":"1745","DOI":"10.1093\/bioinformatics\/bty869","volume":"35","author":"X Wang","year":"2019","unstructured":"Wang X, Zhang Y, Ren X, Zhang Y, Zitnik M, Shang J, Langlotz C, Han J. Cross-type biomedical named entity recognition with deep multi-task learning. Bioinformatics. 2019;35(10):1745\u201352.","journal-title":"Bioinformatics"},{"key":"1717_CR33","doi-asserted-by":"publisher","first-page":"103422","DOI":"10.1016\/j.jbi.2020.103422","volume":"107","author":"X Li","year":"2020","unstructured":"Li X, Zhang H, Zhou X. Chinese clinical named entity recognition with variant neural structures based on BERT methods. J Biomed Inform. 2020;107:103422.","journal-title":"J Biomed Inform"},{"issue":"2","key":"1717_CR34","first-page":"131","volume":"19\u2013S","author":"Y Ren","year":"2019","unstructured":"Ren Y, Fei H, Liang X, Ji D, Cheng M. A hybrid neural network model for predicting kidney disease in hypertension patients based on electronic health records. BMC Med Inform Decis Mak. 2019;19\u2013S(2):131\u20138.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"1717_CR35","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1186\/s12911-020-1113-4","volume":"20\u2013S","author":"M. Cheng","year":"2020","unstructured":"Cheng M., Zhao X., Ding X., Gao J., Xiong S., Ren Y. Prediction of blood culture outcome using hybrid neural network model based on electronic health records. BMC Med Inform Decis Mak. 2020;20\u2013S(3):121.","journal-title":"BMC Med Inform Decis Mak"},{"key":"1717_CR36","unstructured":"Hu J, Shi X, Liu Z, Wang X, Chen Q, Tang B. Hitsz cner: a hybrid system for entity recognition from Chinese clinical text. In: Proceedings of CCKS 2017."},{"key":"1717_CR37","doi-asserted-by":"crossref","unstructured":"Zhang Q, Li Z, Feng D, Li D, Huang Z, Peng Y. Multitask learning for chinese named entity recognition. In: Advances in multimedia information processing\u2014PCM 2018\u20142019th Pacific-Rim conference on multimedia, Hefei, China. Lecture notes in computer science, vol. 11165; 2018. p. 653\u201362.","DOI":"10.1007\/978-3-030-00767-6_60"},{"key":"1717_CR38","doi-asserted-by":"crossref","unstructured":"Qiu J, Wang Q, Zhou Y, Ruan T, Gao J. Fast and accurate recognition of Chinese clinical named entities with residual dilated convolutions. In: IEEE international conference on bioinformatics and biomedicine, BIBM, Madrid, Spain; 2018. p. 935\u201342.","DOI":"10.1109\/BIBM.2018.8621360"},{"key":"1717_CR39","doi-asserted-by":"crossref","unstructured":"Luo L, Li N, Li S, Yang Z, Lin H. Dutir at the ccks-2018 task1: a neural network ensemble approach for Chinese clinical named entity recognition. In: In: CEUR workshop proceedings, vol. 2242; 2018. p. 7\u201312.","DOI":"10.1186\/s13321-018-0318-3"},{"key":"1717_CR40","unstructured":"Yang X, Huang W. A conditional random fields approach to clinical name entity recognition. In: CEUR workshop proceedings, vol. 2242; 2018. p. 1\u20136."},{"key":"1717_CR41","doi-asserted-by":"crossref","unstructured":"Aguilar G, Maharjan S, L\u00f3pez-Monroy AP, Solorio T. A multi-task approach for named entity recognition in social media data. In: Proceedings of the 3rd workshop on noisy user-generated text, NUT@EMNLP, Copenhagen, Denmark; 2017. p. 148\u201353.","DOI":"10.18653\/v1\/W17-4419"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01717-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-021-01717-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01717-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T18:03:37Z","timestamp":1640973817000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-021-01717-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1717"],"URL":"https:\/\/doi.org\/10.1186\/s12911-021-01717-1","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"29 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"372"}}