{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T06:47:49Z","timestamp":1772261269656,"version":"3.50.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,30]],"date-time":"2022-07-30T00:00:00Z","timestamp":1659139200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,30]],"date-time":"2022-07-30T00:00:00Z","timestamp":1659139200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Beijing Natural Science Foundation","award":["L192064"],"award-info":[{"award-number":["L192064"]}]},{"name":"Beijing Natural Science Foundation","award":["M21018"],"award-info":[{"award-number":["M21018"]}]},{"DOI":"10.13039\/501100013142","name":"Key Research and Development Project of Hainan Province","doi-asserted-by":"publisher","award":["ZDYF2021GXJS205"],"award-info":[{"award-number":["ZDYF2021GXJS205"]}],"id":[{"id":"10.13039\/501100013142","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Named entity recognition (NER) is a key and fundamental part of many medical and clinical tasks, including the establishment of a medical knowledge graph, decision-making support, and question answering systems. When extracting entities from electronic health records (EHRs), NER models mostly apply long short-term memory (LSTM) and have surprising performance in clinical NER. However, increasing the depth of the network is often required by these LSTM-based models to capture long-distance dependencies. Therefore, these LSTM-based models that have achieved high accuracy generally require long training times and extensive training data, which has obstructed the adoption of LSTM-based models in clinical scenarios with limited training time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>Inspired by Transformer, we combine Transformer with Soft Term Position Lattice to form soft lattice structure Transformer, which models long-distance dependencies similarly to LSTM. Our model consists of four components: the WordPiece module, the BERT module, the soft lattice structure Transformer module, and the CRF module.<\/jats:p><\/jats:sec><jats:sec><jats:title>Result<\/jats:title><jats:p>Our experiments demonstrated that this approach increased the F1 by 1\u20135% in the CCKS NER task compared to other models based on LSTM with CRF and consumed less training time. Additional evaluations showed that lattice structure transformer shows good performance for recognizing long medical terms, abbreviations, and numbers. The proposed model achieve 91.6% f-measure in recognizing long medical terms and 90.36% f-measure in abbreviations, and numbers.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>By using soft lattice structure Transformer, the method proposed in this paper captured Chinese words to lattice information, making our model suitable for Chinese clinical medical records. Transformers with Mutilayer soft lattice Chinese word construction can capture potential interactions between Chinese characters and words.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-022-01924-4","type":"journal-article","created":{"date-parts":[[2022,7,30]],"date-time":"2022-07-30T08:06:51Z","timestamp":1659168411000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A multi-layer soft lattice based model for Chinese clinical named entity recognition"],"prefix":"10.1186","volume":"22","author":[{"given":"Shuli","family":"Guo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wentao","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lina","family":"Han","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaowei","family":"Song","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guowei","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,7,30]]},"reference":[{"key":"1924_CR1","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/j.procs.2021.03.010","volume":"183","author":"Q Zhang","year":"2021","unstructured":"Zhang Q, Sun Y, Zhang LL, Jiao Y, Tian Y. Named entity recognition method in health preserving field based on BERT. Procedia Comput Sci. 2021;183:212\u201320.","journal-title":"Procedia Comput Sci"},{"key":"1924_CR2","doi-asserted-by":"publisher","DOI":"10.1093\/database\/baz054","author":"YJ Zhang","year":"2019","unstructured":"Zhang YJ, Lin HF, Yang ZH, Wang J, Sun YY. Chemical-protein interaction extraction via contextualized word representations and multihead attention. Database. 2019. https:\/\/doi.org\/10.1093\/database\/baz054.","journal-title":"Database"},{"key":"1924_CR3","doi-asserted-by":"publisher","first-page":"1739","DOI":"10.1093\/bioinformatics\/btaa907","volume":"37","author":"M Asada","year":"2021","unstructured":"Asada M, Miwa M, Sasaki Y. Using drug descriptions and molecular structures for drug\u2013drug interaction extraction from literature. Bioinformatics. 2021;37:1739\u201346.","journal-title":"Bioinformatics"},{"key":"1924_CR4","doi-asserted-by":"publisher","first-page":"103384","DOI":"10.1016\/j.jbi.2020.103384","volume":"103","author":"L Luo","year":"2020","unstructured":"Luo L, Yang Z, Cao M, Wang Y, Zhang HL. A neural network-based joint learning approach for biomedical entity and relation extraction from biomedical literature. J Biomed Inf. 2020;103:103384.","journal-title":"J Biomed Inf"},{"key":"1924_CR5","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1038\/s42256-020-0189-y","volume":"2","author":"L Hong","year":"2020","unstructured":"Hong L, Lin J, Li S, Wan F, Yang H, Jiang T, Zhao D, Zeng J. A novel machine learning framework for automated biomedical relation extraction from large-scale literature repositories. Nat Mach Intell. 2020;2:347\u201355.","journal-title":"Nat Mach Intell"},{"key":"1924_CR6","first-page":"100","volume":"129","author":"A Casillas","year":"2019","unstructured":"Casillas A, Ezeiza N, Goenaga I, P\u00e9rez A, Sotor X. Measuring the effect of different types of unsupervised word representations on Medical Named Entity Recognition. J Biomed Inf. 2019;129:100\u20136.","journal-title":"J Biomed Inf"},{"key":"1924_CR7","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1093\/jamia\/ocz101","volume":"27","author":"F Christopoulou","year":"2020","unstructured":"Christopoulou F, Tran TT, Sahu SK, Miwa M, Ananiadou S. Adverse drug events and medication relation extraction in electronic health records with ensemble deep learning methods. J Am Med Inform Assoc. 2020;27:39\u201346.","journal-title":"J Am Med Inform Assoc"},{"key":"1924_CR8","doi-asserted-by":"publisher","first-page":"1088","DOI":"10.1016\/j.jbi.2013.08.004","volume":"46","author":"SD Zhang","year":"2013","unstructured":"Zhang SD, Elhadad N. Unsupervised biomedical named entity recognition: experiments with clinical and biological texts. J Biomed Inf. 2013;46:1088\u201398.","journal-title":"J Biomed Inf"},{"key":"1924_CR9","doi-asserted-by":"crossref","unstructured":"Settles B. Biomedical named entity recognition using conditional random fields and rich feature sets. Presented at Proceedings of the international joint workshop on natural language processing in biomedicine and its applications (NLPBA\/BioNLP), 2004. p. 107\u2013110.","DOI":"10.3115\/1567594.1567618"},{"key":"1924_CR10","doi-asserted-by":"crossref","unstructured":"Petasis G, Vichot F, Wolinski F, Paliouras G, Karkaletsis V, Spyropoulos C. Using machine learning to maintain rule-based named-entity recognition and classification systems. Presented at proceedings of the 39th annual meeting of the association for computational linguistics, 2001. p. 426\u2013433.","DOI":"10.3115\/1073012.1073067"},{"key":"1924_CR11","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/8829219","author":"LJ Gong","year":"2020","unstructured":"Gong LJ, Zhang ZH, Chen SQ. Clinical named entity recognition from Chinese electronic medical records based on deep learning pretraining. J Healthc Eng. 2020. https:\/\/doi.org\/10.1155\/2020\/8829219.","journal-title":"J Healthc Eng"},{"key":"1924_CR12","first-page":"761","volume":"761","author":"Y Ling","year":"2019","unstructured":"Ling Y, Hasan SA, Farri O, Chen Z, Ommering R, Yee C, Dimitrova N. A domain knowledge-enhanced LSTM-CRF model for disease named entity recognition. AMIA Summits Transl Sci Proc. 2019;761:761\u201370.","journal-title":"AMIA Summits Transl Sci Proc"},{"key":"1924_CR13","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141. Attention is all you need. Presented at Advances in neural information processing systems, 2017. p. 5998\u20136008."},{"key":"1924_CR14","doi-asserted-by":"crossref","unstructured":"Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L. Deep contextualized word representations. 2018. arXiv preprint arXiv:1802.05365.","DOI":"10.18653\/v1\/N18-1202"},{"key":"1924_CR15","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. 2018. arXiv preprint arXiv:1810.04805."},{"key":"1924_CR16","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","volume":"36","author":"J Lee","year":"2020","unstructured":"Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, Kang J. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics. 2020;36:1234\u201340.","journal-title":"Bioinformatics"},{"key":"1924_CR17","doi-asserted-by":"publisher","first-page":"100057","DOI":"10.1016\/j.yjbinx.2019.100057","volume":"100","author":"FK Khattak","year":"2019","unstructured":"Khattak FK, Jeblee S, Pou-Prom C, Abdalla M, Meaney C, Rudzicz F. A survey of word embeddings for clinical text. J Biomed Inform. 2019;100:100057.","journal-title":"J Biomed Inform"},{"key":"1924_CR18","doi-asserted-by":"publisher","first-page":"15","DOI":"10.5121\/ijnlc.2012.1402","volume":"1","author":"S Morwal","year":"2012","unstructured":"Morwal S, Jahan N, Chopra D. Named entity recognition using hidden Markov model (HMM). IJNLC. 2012;1:15\u201323.","journal-title":"IJNLC"},{"key":"1924_CR19","first-page":"591","volume":"17","author":"A McCallum","year":"2000","unstructured":"McCallum A, Freitag D, Pereira F. Maximum entropy Markov models for information extraction and segmentation. ICML. 2000;17:591\u20138.","journal-title":"ICML"},{"key":"1924_CR20","first-page":"1","volume":"2021","author":"QL Qin","year":"2021","unstructured":"Qin QL, Zhao S, Liu CM. A BERT-BiGRU-CRF model for entity recognition of Chinese electronic medical records. Complexity. 2021;2021:1\u201311.","journal-title":"Complexity"},{"key":"1924_CR21","doi-asserted-by":"publisher","first-page":"1745","DOI":"10.1093\/bioinformatics\/bty869","volume":"35","author":"X Wang","year":"2019","unstructured":"Wang X, Zhang Y, Ren X, Zhang YH, Zitnik M, Shang JB, Langlotz J, Han W. Cross-type biomedical named entity recognition with deep multi-task learning. Bioinformatics. 2019;35:1745\u201352.","journal-title":"Bioinformatics"},{"key":"1924_CR22","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1186\/s12859-019-2609-8","volume":"20","author":"W Yoon","year":"2019","unstructured":"Yoon W, So CH, Lee J, Kang J. Collabonet: collaboration of deep neural networks for biomedical named entity recognition. BMC Bioinform. 2019;20:55\u201365.","journal-title":"BMC Bioinform"},{"key":"1924_CR23","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1007\/s40264-018-0765-9","volume":"42","author":"S Wunnava","year":"2019","unstructured":"Wunnava S, Qin X, Kakar T, Sen C, Rundensteiner EA, Kong XN. Adverse drug event detection from electronic health records using hierarchical recurrent neural networks with dual-level embedding. Drug Saf. 2019;42:113\u201322.","journal-title":"Drug Saf"},{"key":"1924_CR24","doi-asserted-by":"crossref","unstructured":"Zhang Y, Yang J. Chinese NER using lattice LSTM. 2018. arXiv preprint arXiv:1805.02023.","DOI":"10.18653\/v1\/P18-1144"},{"key":"1924_CR25","doi-asserted-by":"publisher","first-page":"103422","DOI":"10.1016\/j.jbi.2020.103422","volume":"107","author":"XY Li","year":"2020","unstructured":"Li XY, Zhang H, Zhou XH. Chinese clinical named entity recognition with variant neural structures based on BERT methods. J Biomed Inf. 2020;107:103422.","journal-title":"J Biomed Inf"},{"key":"1924_CR26","doi-asserted-by":"publisher","first-page":"103985","DOI":"10.1016\/j.ijmedinf.2019.103985","volume":"132","author":"XH Zhang","year":"2019","unstructured":"Zhang XH, Zhang YY, Zhang Q, Ren YK, Qiu TL, Ma JH, Sun Q. Extracting comprehensive clinical information for breast cancer using deep learning methods. Int J Med Inf. 2019;132:103985.","journal-title":"Int J Med Inf"},{"key":"1924_CR27","doi-asserted-by":"publisher","first-page":"14830","DOI":"10.2196\/14830","volume":"7","author":"F Li","year":"2019","unstructured":"Li F, Jin YH, Liu WS, Rawat BPS, Cai PS, Yu H. Fine-tuning bidirectional encoder representations from transformers (BERT)-based models on large-scale electronic health record notes: an empirical study. JMIR Med Inform. 2019;7:14830.","journal-title":"JMIR Med Inform"},{"key":"1924_CR28","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1109\/TNB.2019.2908678","volume":"18","author":"J Qiu","year":"2019","unstructured":"Qiu J, Zhou YM, Wang Q, Ruan T, Gao J. Chinese clinical named entity recognition using residual dilated convolutional neural network with conditional random field.\". IEEE Trans Nanobiosci. 2019;18:306\u201315.","journal-title":"IEEE Trans Nanobiosci"},{"key":"1924_CR29","unstructured":"Yu F, Koltun V. Multi-scale context aggregation by dilated convolutions. 2015. arXiv preprint arXiv:1511.07122."},{"key":"1924_CR30","unstructured":"Zhang N, Jia Q, Yin K. Conceptualized representation learning for Chinese biomedical text mining. 2020. arXiv preprint arXiv:2008.10813."},{"key":"1924_CR31","doi-asserted-by":"crossref","unstructured":"Vig J. A multiscale visualization of attention in the transformer model. 2019. arXiv preprint arXiv:1906.05714.","DOI":"10.18653\/v1\/P19-3007"},{"key":"1924_CR32","doi-asserted-by":"crossref","unstructured":"Li X, Yan H, Qiu X, Huang X. FLAT: Chinese NER using flat-lattice transformer. 2020. arXiv preprint arXiv:2004.11795.","DOI":"10.18653\/v1\/2020.acl-main.611"},{"key":"1924_CR33","doi-asserted-by":"crossref","unstructured":"Mengge X, Bowen Y, Tingwen L, Yue Z, Erli M, Bin W. Porous lattice-based transformer encoder for chinese ner. arXiv preprint arXiv:1911.02733. 2019 Nov 7.","DOI":"10.18653\/v1\/2020.coling-main.340"},{"key":"1924_CR34","doi-asserted-by":"crossref","unstructured":"Guan T, Zan H, Zhou X, Xu H, Zhang K. CMeIE: construction and evaluation of Chinese medical information extraction dataset. In: Natural language processing and Chinese computing, 9th CCF international conference, NLPCC 2020, Zhengzhou, China, Oct 14\u201318, 2020, Proceedings, Part I.","DOI":"10.1007\/978-3-030-60450-9_22"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01924-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01924-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01924-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,13]],"date-time":"2023-02-13T01:42:49Z","timestamp":1676252569000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01924-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,30]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1924"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01924-4","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,30]]},"assertion":[{"value":"23 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"201"}}