{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T15:58:07Z","timestamp":1774454287972,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T00:00:00Z","timestamp":1737936000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Identifying key concepts in automobile fault texts is crucial for understanding fault causes and enabling diagnosis. However, effective mining tools are lacking, leaving much latent information unexplored. To solve the problem, this paper proposes Chinese named entity recognition for automobile fault texts based on external context retrieval and adversarial training. First, we retrieve external contexts by using a search engine. Then, the input sentence and its external contexts are respectively fed into Lexicon Enhanced BERT to improve the text embedding representation. Furthermore, the input sentence and its external contexts embedding representation are fused through the attention mechanism. Then, adversarial samples are generated by adding perturbations to the fusion vector representation. Finally, the fusion vector representation and adversarial samples are input into the BiLSTM-CRF layer as training data for entity labeling. Our model is evaluated on the automotive fault datasets, Weibo and Resume datasets, and achieves state-of-the-art results.<\/jats:p>","DOI":"10.3390\/e27020133","type":"journal-article","created":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T04:59:10Z","timestamp":1737953950000},"page":"133","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Chinese Named Entity Recognition for Automobile Fault Texts Based on External Context Retrieving and Adversarial Training"],"prefix":"10.3390","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1446-639X","authenticated-orcid":false,"given":"Shuhai","family":"Wang","sequence":"first","affiliation":[{"name":"School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611756, China"},{"name":"Manufacturing Industry Chain Collaboration and Information Support Technology Key Laboratory of Sichuan Province, Southwest Jiaotong University, Chengdu 610031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3448-6471","authenticated-orcid":false,"given":"Linfu","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611756, China"},{"name":"Manufacturing Industry Chain Collaboration and Information Support Technology Key Laboratory of Sichuan Province, Southwest Jiaotong University, Chengdu 610031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1145\/3522593","article-title":"Nested named entity recognition: A survey","volume":"16","author":"Wang","year":"2022","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Cheng, M., Li, H., Yang, Z., Fan, W., and Gan, Y. (2022, January 19\u201321). Named entity recognition for medical dialogue based on BERT and adversarial training. Proceedings of the 2022 5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), Chengdu, China.","DOI":"10.1109\/PRAI55851.2022.9904246"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"21201","DOI":"10.1109\/TITS.2022.3182371","article-title":"Adversarial training lattice LSTM for named entity recognition of rail fault texts","volume":"23","author":"Su","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/TKDE.2020.2981314","article-title":"A survey on deep learning for named entity recognition","volume":"34","author":"Li","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1450","DOI":"10.1007\/s11227-017-2229-x","article-title":"WCP-RNN: A novel RNN-based approach for Bio-NER in Chinese EMRs","volume":"76","author":"Li","year":"2020","journal-title":"J. Supercomput."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Xu, C., Wang, F., Han, J., and Li, C. (2019, January 3\u20137). Exploiting multiple embeddings for Chinese named entity recognition. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.","DOI":"10.1145\/3357384.3358117"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, W., Xu, T., Xu, Q., Song, J., and Zu, Y. (2019, January 2\u20137). An encoding strategy based word-character LSTM for Chinese NER. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long & Short Papers), Minneapolis, MN, USA.","DOI":"10.18653\/v1\/N19-1247"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cao, P., Chen, Y., Liu, K., Zhao, J., and Liu, S. (November, January 31). Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1017"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1162\/tacl_a_00104","article-title":"Named entity recognition with bidirectional LSTM-CNNs","volume":"4","author":"Chiu","year":"2016","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, M., and Lu, L. (2023). A local information perception enhancement\u2013based method for Chinese NER. Appl. Sci., 13.","DOI":"10.3390\/app13179948"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Peng, N., and Dredze, M. (2015, January 17\u201321). Named entity recognition for Chinese social media with jointly trained embeddings. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1064"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Yang, J. (2018, January 15\u201320). Chinese NER using lattice LSTM. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1144"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, X., Yan, H., Qiu, X., and Huang, X. (2020). Flat: Chinese NER using flat-lattice transformer. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.611"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, Y., Yan, H., Yang, Y., and Wang, X. (July, January 30). A method for cultural relics named entity recognition based on enhanced lexical features. Proceedings of the 2024 International Joint Conference on Neural Networks (IJCNN), Yokohama, Japan.","DOI":"10.1109\/IJCNN60899.2024.10650517"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, S., Liu, F., Huang, B., Li, J., and Feng, P. (2023, January 22\u201324). Chinese named entity recognition based on multi-metadata embedding and global pointer. Proceedings of the 2023 3rd International Conference on Electronic Information Engineering and Computer Science (EIECS), Changchun, China.","DOI":"10.1109\/EIECS59936.2023.10435487"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"103314","DOI":"10.1016\/j.ipm.2023.103314","article-title":"VisPhone: Chinese named entity recognition model enhanced by visual and phonetic features","volume":"60","author":"Zhang","year":"2023","journal-title":"Inf. Process. Manag."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, X., Jiang, Y., Bach, N., Wang, T., Huang, Z., Huang, F., and Tu, K. (2021). Improving named entity recognition by external context retrieving and cooperative learning. arXiv.","DOI":"10.18653\/v1\/2021.acl-long.142"},{"key":"ref_18","unstructured":"Kenton, J., Devlin, J., Chang, M.-W., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of NAACL-HLT 2019, Minneapolis, MN, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hu, S., Zhang, H., and Hu, X. (2022, January 26\u201328). Chinese Named Entity Recognition based on BERT-CRF Model. Proceedings of the 2022 IEEE\/ACIS 22nd International Conference on Computer and Information Science (ICIS), Zhuhai, China.","DOI":"10.1109\/ICIS54925.2022.9882514"},{"key":"ref_20","unstructured":"Xue, M., Yu, B., Liu, T., Zhang, Y., Meng, E., and Wang, B. (2020, January 8\u201313). Porous lattice transformer encoder for Chinese NER. Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, Spain."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ma, R., Peng, M., Zhang, Q., Wei, Z., and Huang, X. (2020, January 5\u201310). Simplify the usage of lexicon in Chinese NER. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.528"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gui, T., Zou, Y., Zhang, Q., Peng, M., Fu, J., Wei, Z., and Huang, X. (2019, January 3\u20137). A lexicon-based graph neural network for Chinese NER. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing & 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1096"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, W., Fu, X., Zhang, Y., and Xiao, W. (2021, January 1\u20136). Lexicon enhanced Chinese sequence labeling using BERT adapter. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics & 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Online.","DOI":"10.18653\/v1\/2021.acl-long.454"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liang, J., Li, D., Lin, Y., Wu, S., and Huang, Z. (2023). Named Entity Recognition of Chinese Crop Diseases and Pests Based on RoBERTa-wwm with Adversarial Training. Agronomy, 13.","DOI":"10.3390\/agronomy13030941"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ma, H., Zhang, Y., and Wang, J. (2022, January 27\u201328). Pretrained Models with Adversarial Training for Named Entity Recognition in Scientific Text. Proceedings of the 2022 International Conference on Asian Language Processing (IALP), Singapore.","DOI":"10.1109\/IALP57159.2022.9961309"},{"key":"ref_26","unstructured":"Mao, Q., Li, J., and Meng, K. (2022). Improving Chinese named entity recognition by search engine augmentation. arXiv."},{"key":"ref_27","unstructured":"Mihalcea, R., and Tarau, P. (2004, January 25\u201326). TextRank: Bringing order into texts. Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing (EMNLP), Barcelona, Spain."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Robertson, S.E., and Walker, S. (1994, January 3\u20136). Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201994), Dublin, Ireland.","DOI":"10.1007\/978-1-4471-2099-5_24"},{"key":"ref_29","first-page":"37","article-title":"Chinese text classification based on fastText","volume":"5","author":"Dai","year":"2018","journal-title":"Comput. Mod."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Diao, S., Bai, J., Song, Y., Zhang, T., and Wang, Y. (2019). Zen: Pre-training Chinese text encoder enhanced by n-gram representations. arXiv.","DOI":"10.18653\/v1\/2020.findings-emnlp.425"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wen, P., Feng, L., and Zhang, T. (2022). A hybrid Chinese word segmentation model for quality management-related texts based on transfer learning. PLoS ONE, 17.","DOI":"10.1371\/journal.pone.0270154"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1109\/TASLP.2022.3153261","article-title":"Improving Chinese named entity recognition by large-scale syntactic dependency graph","volume":"30","author":"Zhu","year":"2022","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"12457","DOI":"10.1007\/s10489-022-03274-0","article-title":"A comparative study of Chinese named entity recognition with different segment representations","volume":"52","author":"Pan","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neucom.2022.12.013","article-title":"ASAT: Adaptively scaled adversarial training in time series","volume":"522","author":"Zhang","year":"2023","journal-title":"Neurocomputing"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"105842","DOI":"10.1016\/j.knosys.2020.105842","article-title":"ASTRAL: Adversarial trained LSTM-CNN for named entity recognition","volume":"197","author":"Wang","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_36","unstructured":"Southwest Jiaotong University (2024, September 28). ASP\/SaaS-Based Manufacturing Industry Value Chain Collaboration Platform. Data Provided by Manufacturing Industry Chain Collaboration and Information Support Technology Key Laboratory of Sichuan Province., Available online: http:\/\/www.autosaas.cn\/."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"He, H., and Sun, X. (2017, January 3\u20137). F-score driven max margin neural network for named entity recognition in Chinese social media. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, Valencia, Spain.","DOI":"10.18653\/v1\/E17-2113"},{"key":"ref_38","unstructured":"Brown, D. (2024, October 28). Rank-BM25: A Collection of BM25 Algorithms in Python. Available online: https:\/\/zenodo.org\/records\/4520057."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3425","DOI":"10.1007\/s11063-022-10768-y","article-title":"TFM: A triple fusion module for integrating lexicon information in Chinese named entity recognition","volume":"54","author":"Liu","year":"2022","journal-title":"Neural Process. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.procs.2021.03.010","article-title":"Named entity recognition method in health preserving field based on BERT","volume":"183","author":"Zhang","year":"2021","journal-title":"Procedia Comput. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Pan, S., Li, Z., and Dai, J. (2019, January 17\u201319). An improved TextRank keywords extraction algorithm. Proceedings of the ACM Turing Celebration Conference\u2013China, Chengdu China.","DOI":"10.1145\/3321408.3326659"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Fan, H., and Qin, Y. (2018, January 26\u201327). Research on text classification based on improved TF-IDF algorithm. Proceedings of the 2018 International Conference on Network, Communication, Computer Engineering (NCCE 2018), Chongqing, China.","DOI":"10.2991\/ncce-18.2018.79"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yao, L., Pengzhou, Z., and Chi, Z. (2019, January 17\u201319). Research on news keyword extraction technology based on TF-IDF and TextRank. Proceedings of the 2019 IEEE\/ACIS 18th International Conference on Computer and Information Science (ICIS), Beijing, China.","DOI":"10.1109\/ICIS46139.2019.8940293"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.eswa.2016.10.065","article-title":"Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN","volume":"72","author":"Chen","year":"2017","journal-title":"Expert Syst. Appl."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/2\/133\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:36:52Z","timestamp":1759919812000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/2\/133"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,27]]},"references-count":44,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["e27020133"],"URL":"https:\/\/doi.org\/10.3390\/e27020133","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,27]]}}}