{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:44:46Z","timestamp":1760240686376,"version":"build-2065373602"},"reference-count":27,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,8,18]],"date-time":"2019-08-18T00:00:00Z","timestamp":1566086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61802425"],"award-info":[{"award-number":["61802425"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge. In order to solve this problem, we propose a method employing a bidirectional long short-term memory (BiLSTM) neural network with a self-attention mechanism to identify the military entities automatically. We obtain distributed vector representations of the military corpus by unsupervised learning and the BiLSTM model combined with the self-attention mechanism is adopted to capture contextual information fully carried by the character vector sequence. The experimental results show that the self-attention mechanism can improve effectively the performance of MNER task. The F-score of the military documents and network military texts identification was 90.15% and 89.34%, respectively, which was better than other models.<\/jats:p>","DOI":"10.3390\/fi11080180","type":"journal-article","created":{"date-parts":[[2019,8,19]],"date-time":"2019-08-19T06:10:14Z","timestamp":1566195014000},"page":"180","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military"],"prefix":"10.3390","volume":"11","author":[{"given":"Fei","family":"Liao","sequence":"first","affiliation":[{"name":"College of Electronic Engineering, Naval University of Engineering, Wuhan 430033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liangli","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Electronic Engineering, Naval University of Engineering, Wuhan 430033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingjing","family":"Pei","sequence":"additional","affiliation":[{"name":"Force 91001, Beijing 100841, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Linshan","family":"Tan","sequence":"additional","affiliation":[{"name":"Force 91001, Beijing 100841, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Peng, N., and Dredze, M. (2015, January 17\u201321). Named entity recognition for chinese social media with jointly trained embeddings. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1064"},{"key":"ref_2","first-page":"873","article-title":"Approach to recognizing Uyhgur names based on conditional random fields","volume":"53","author":"Rozi","year":"2013","journal-title":"J. Tsinghua Univ."},{"key":"ref_3","unstructured":"Gayen, V., and Sarkar, K. (2014). An HMM based named entity recognition system for Indian languages: JU system at ICON 2013. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Curran, J., and Clark, S. (2003, January 21\u201323). Language independent NER using a maximum entropy tagger. Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003, Edmonton, AB, Canada.","DOI":"10.3115\/1119176.1119200"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Grishman, R., and Sundheim, B. (1996, January 5\u20139). Message Understanding Conference -6: A Brief History. Proceedings of the 16th International Conference on Computational Linguistics, Copenhagen, Denmark.","DOI":"10.3115\/992628.992709"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kravalov\u00e1, J., and Zabokrtsky, Z. (2009, January 7). Czech Named Entity Corpus and SVM-Based Recognizer. Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration, Singapore.","DOI":"10.3115\/1699705.1699748"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.procs.2015.09.153","article-title":"Extracting meaningful entities from human-generated tactical reports","volume":"61","author":"Guo","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_8","first-page":"101","article-title":"A Military Named Entity Recognition Method Based on CRFs with Small Granularity Strategy","volume":"31","author":"Shan","year":"2017","journal-title":"J. Armored Force Eng. Inst."},{"key":"ref_9","first-page":"13","article-title":"Research on Military Named Entity Recognition Based on CRF and Rules","volume":"33","author":"Jiang","year":"2011","journal-title":"Command Simul."},{"key":"ref_10","first-page":"15","article-title":"Named Entity Recognition for Military Texts","volume":"42","author":"Feng","year":"2015","journal-title":"Comput. Sci."},{"key":"ref_11","first-page":"239","article-title":"Weapon Name Recognition Based on Deep Neural Network","volume":"27","author":"You","year":"2018","journal-title":"J. Comput. Syst."},{"key":"ref_12","unstructured":"Zhu, J., Zhang, W., and Liu, W. (2018, January 2\u20134). Identification and Linkage of Military Named Entities Based on Bidirectional LSTM and CRF. Chinese Academy of Command and Control. Proceedings of the 6th China Command and Control Conference, Beijing, China."},{"key":"ref_13","first-page":"121","article-title":"Named Entity Recognition of Combat Documents Based on Deep Learning","volume":"3","author":"Zhang","year":"2019","journal-title":"Command Control Simul."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Peters, M.E., Ammar, W., and Bhagavatula, C. (2017). Semi-supervised sequence tagging with bidirectional language models. arXiv.","DOI":"10.18653\/v1\/P17-1161"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ma, X., and Hovy, E. (2016). End-to-end sequence labeling via bi-directional lstm-cnns-crf. arXiv.","DOI":"10.18653\/v1\/P16-1101"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1162\/tacl_a_00104","article-title":"Named entity recognition with bidirectional LSTM-CNNs","volume":"4","author":"Chiu","year":"2016","journal-title":"TACL"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., and Dyer, C. (2016). Neural architectures for named entity recognition. arXiv.","DOI":"10.18653\/v1\/N16-1030"},{"key":"ref_18","unstructured":"Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF models for sequence tagging. arXiv."},{"key":"ref_19","unstructured":"He, J., and Wang, H. (2008, January 11\u201312). Chinese named entity recognition and word segmentation based on character. Proceedings of the Sixth SIGHAN Workshop on Chinese Language Processing, Hyderabad, India."},{"key":"ref_20","unstructured":"Li, H., Hagiwara, M., Li, Q., and Ji, H. (2014, January 26\u201331). Comparison of the Impact of Word Segmentation on Name Tagging for Chinese and Japanese. Proceedings of the Ninth International Conference on Language Resources and Evaluation, Reykjavik, Iceland."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, Z., Zhu, C., and Zhao, T. (2010, January 19\u201320). Chinese named entity recognition with a sequence labeling approach: based on characters, or based on words?. Proceedings of the International Conference on Intelligent Computing, Heidelberg, Germany.","DOI":"10.1007\/978-3-642-14932-0_78"},{"key":"ref_22","unstructured":"Mikolov, T., Corrado, G., and Chen, K. (2013, January 2\u20134). Efficient estimation of word representations in vector space. Proceedings of the International Conference on Learning Representations, Scottsdale, AZ, USA."},{"key":"ref_23","first-page":"473","article-title":"LSTM can solve hard long time lag problems","volume":"4","author":"Hochreiter","year":"1997","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhou, P., Shi, W., and Tian, J. (2016, January 7\u201312). Attention-based bidirectional long short-term memory networks for relation classification. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.","DOI":"10.18653\/v1\/P16-2034"},{"key":"ref_25","first-page":"5998","article-title":"Attention is all you need","volume":"2","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Tan, Z., Wang, M., and Xie, J. (2018, January 2\u20137). Deep semantic role labeling with self-attention. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11928"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1109\/PROC.1973.9030","article-title":"The viterbi algorithm","volume":"61","author":"Forney","year":"1973","journal-title":"Proc. IEEE"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/8\/180\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:12:00Z","timestamp":1760188320000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/8\/180"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,18]]},"references-count":27,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["fi11080180"],"URL":"https:\/\/doi.org\/10.3390\/fi11080180","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2019,8,18]]}}}