{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:18:47Z","timestamp":1760239127741,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,10,13]],"date-time":"2020-10-13T00:00:00Z","timestamp":1602547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>To improve the performance of deep learning methods in case of a lack of labeled data for entity annotation in entity recognition tasks, this study proposes transfer learning schemes that combine the character to be the word to convert low-resource data symmetry into high-resource data. We combine character embedding, word embedding, and the embedding of the label features using high- and low-resource data based on the BiLSTM-CRF model, and perform the feature-transfer and parameter-sharing tasks in two domains of the BiLSTM network to annotate with zero resources. Before transfer learning, we must first calculate the label similarity between two different domains and select the label features with large similarity for feature transfer mapping. All training parameters of the source domain in the model are shared during the BiLSTM network processing and CRF layer. In addition, we also use the method of combining characters and words to reduce the problem of word segmentation across domains and reduce the error rate in label mapping. The results of experiments show that in terms of the overall F1 score, the proposed model without supervision was superior by 9.76 percentage points to the general parametric shared transfer learning method, and by 9.08 and 12.38 percentage points, respectively, to two recent high\u2013low resource learning methods. The proposed scheme improves performance in terms of transfer learning between the high- and low-resource data and can identify the predicted data in the target domain.<\/jats:p>","DOI":"10.3390\/sym12101673","type":"journal-article","created":{"date-parts":[[2020,10,17]],"date-time":"2020-10-17T07:23:22Z","timestamp":1602919402000},"page":"1673","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["POISE: Efficient Cross-Domain Chinese Named Entity Recognization via Transfer Learning"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7731-8688","authenticated-orcid":false,"given":"Jiabao","family":"Sheng","sequence":"first","affiliation":[{"name":"College of Software, Xinjiang University, Urumqi 832001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1681-1089","authenticated-orcid":false,"given":"Aishan","family":"Wumaier","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 832001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0519-7434","authenticated-orcid":false,"given":"Zhe","family":"Li","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 832001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., and He, Q. (2020). A comprehensive survey on transfer learning. Proc. IEEE.","DOI":"10.1109\/JPROC.2020.3004555"},{"key":"ref_2","unstructured":"Lin, Y.H., Chen, C.Y., Lee, J., Li, Z., Zhang, Y., Xia, M., Rijhwani, S., He, J., Zhang, Z., and Ma, X. (August, January 28). Choosing Transfer Languages for Cross-Lingual Learning. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Peng, Y., Yan, S., and Lu, Z. (2019, January 1). Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets. Proceedings of the 18th BioNLP Workshop and Shared Task, Florence, Italy.","DOI":"10.18653\/v1\/W19-5006"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4341","DOI":"10.1007\/s00521-018-3351-2","article-title":"Tourism scene classification based on multi-stage transfer learning model","volume":"31","author":"Qi","year":"2019","journal-title":"Neural Comput. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chen, Q., Zheng, Z., Hu, C., Wang, D., and Liu, F. (2019, January 7\u201310). Data-driven Task Allocation for Multi-task Transfer Learning on the Edge. Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), Dallas, TX, USA.","DOI":"10.1109\/ICDCS.2019.00107"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5339","DOI":"10.1109\/ACCESS.2019.2962581","article-title":"Deep Multi-Task Transfer Network for Cross Domain Person Re-Identification","volume":"8","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Pfeiffer, J., Vuli\u0107, I., Gurevych, I., and Ruder, S. (2020). MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer. arXiv.","DOI":"10.18653\/v1\/2020.emnlp-main.617"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yin, X., Yu, X., Sohn, K., Liu, X., and Chandraker, M. (2019, January 16\u201320). Feature transfer learning for face recognition with under- represented data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00585"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.neunet.2020.01.003","article-title":"Deep feature transfer learning for trusted and automated malware signature generation in private cloud environments","volume":"124","author":"Nahmias","year":"2020","journal-title":"Neural Netw."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, T., Huan, J., and Zhu, M. (2019, January 7\u201311). Instance-based deep transfer learning. Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00045"},{"key":"ref_11","unstructured":"Arnold, A.O., and Cohen, W.W. (2019). Instance-based Transfer Learning for Multilingual Deep Retrieval. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ma, J., Li, Z.Z.J.C.A., and Hong, L. (2019). SNR: Sub-Network Routing for Flexible Parameter Sharing in Multi-Task Learning, Association for the Advancement of Artificial Intelligence.","DOI":"10.1609\/aaai.v33i01.3301216"},{"key":"ref_13","unstructured":"Savarese, P., and Maire, M. (May, January 30). Learning Implicitly Recurrent CNNs Through Parameter Sharing. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jia, C., Liang, X., and Zhang, Y. (2019). Cross-Domain NER using Cross-Domain Language Modeling. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics.","DOI":"10.18653\/v1\/P19-1236"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Taslimipoor, S., and Rohanian, O. (2019). Cross-lingual transfer learning and multitask learning for capturing multiword expressions. Proceedings of the Joint Workshop on Multiword Expressions and WordNet (MWE-WN 2019), Association for Computational Linguistics.","DOI":"10.18653\/v1\/W19-5119"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0278-0","article-title":"Toward multi-label sentiment analysis: A transfer learning based approach","volume":"7","author":"Tao","year":"2020","journal-title":"J. Big Data"},{"key":"ref_17","unstructured":"Li, J., Sun, A., Han, J., and Li, C. (2020). A Survey on Deep Learning for Named Entity Recognition. IEEE Trans. Knowl. Data Eng."},{"key":"ref_18","unstructured":"Kuru, O., Can, O.A., and Yuret, D. (2016). Charner: Character-level named entity recognition. Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, The COLING 2016 Organizing Committee."},{"key":"ref_19","unstructured":"Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF models for sequence tagging. arXiv."},{"key":"ref_20","unstructured":"Lafferty, J., McCallum, A., and Pereira, F.C. (2020, September 08). Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. Available online: http:\/\/portal.acm.org\/citation.cfm?id=655813."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ma, X., and Hovy, E. (2016). End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics.","DOI":"10.18653\/v1\/P16-1101"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, L., Shang, J., Ren, X., Xu, F.F., Gui, H., Peng, J., and Han, J. (2018). Empower Sequence Labeling with Task-Aware Neural Language Model. arXiv.","DOI":"10.1609\/aaai.v32i1.12006"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"136694","DOI":"10.1109\/ACCESS.2019.2942433","article-title":"LSTM-CRF neural network with gated self attention for Chinese NER","volume":"7","author":"Jin","year":"2019","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Yang, J. (2018). Chinese NER Using Lattice LSTM. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics.","DOI":"10.18653\/v1\/P18-1144"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"101077","DOI":"10.1016\/j.csl.2020.101077","article-title":"Transfer Learning from Adult to Children for Speech Recognition: Evaluation, Analysis and Recommendations","volume":"63","author":"Shivakumar","year":"2020","journal-title":"Comput. Speech Lang."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Banerjee, S., Akkaya, C., Perez-Sorrosal, F., and Tsioutsiouliklis, K. (2019). Hierarchical transfer learning for multi-label text classification. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics.","DOI":"10.18653\/v1\/P19-1633"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"154157","DOI":"10.1109\/ACCESS.2019.2936002","article-title":"Hierarchical transfer learning architecture for low-resource neural machine translation","volume":"7","author":"Luo","year":"2019","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bhatia, P., Arumae, K., and Celikkaya, B. (2019). Dynamic Transfer Learning for Named Entity Recognition, Springer.","DOI":"10.1007\/978-3-030-24409-5_7"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"6260","DOI":"10.1609\/aaai.v33i01.33016260","article-title":"Transfer learning for sequence labeling using source model and target data","volume":"Volume 33","author":"Chen","year":"2019","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"37736","DOI":"10.1109\/ACCESS.2020.2973319","article-title":"Transfer Learning for Arabic Named Entity Recognition With Deep Neural Networks","volume":"8","author":"Jararweh","year":"2020","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Francis, S., Van Landeghem, J., and Moens, M.F. (2019). Transfer Learning for Named Entity Recognition in Financial and Biomedical Documents. Information, 10.","DOI":"10.3390\/info10080248"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Peng, D., Wang, Y., Liu, C., and Chen, Z. (2019). TL-NER: A transfer learning model for Chinese named entity recognition. Inf. Syst. Front., 1\u201314.","DOI":"10.1007\/s10796-019-09932-y"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cao, P., Chen, Y., Liu, K., Zhao, J., and Liu, S. (November, January 31). Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1017"},{"key":"ref_34","unstructured":"Yang, Z., Salakhutdinov, R., and Cohen, W.W. (2017). Transfer learning for sequence tagging with hierarchical recurrent networks. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lin, B.Y., and Lu, W. (2018). Neural adaptation layers for cross-domain named entity recognition. arXiv.","DOI":"10.18653\/v1\/D18-1226"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, H., and Sun, X. (2017). A unified model for cross-domain and semi-supervised named entity recognition in chinese social media. Thirty-First AAAI Conference on Artificial Intelligence, Association for the Advancement of Artificial Intelligence.","DOI":"10.1609\/aaai.v31i1.10977"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/10\/1673\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:20:45Z","timestamp":1760178045000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/10\/1673"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,13]]},"references-count":36,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["sym12101673"],"URL":"https:\/\/doi.org\/10.3390\/sym12101673","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,10,13]]}}}