{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T09:37:25Z","timestamp":1758274645199,"version":"3.41.0"},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,11,3]],"date-time":"2021-11-03T00:00:00Z","timestamp":1635897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2020AAA0108004"],"award-info":[{"award-number":["2020AAA0108004"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U1936109 and 61672127"],"award-info":[{"award-number":["U1936109 and 61672127"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2022,3,31]]},"abstract":"<jats:p>Word segmentation is an essential and challenging task in natural language processing, especially for the Chinese language due to its high linguistic complexity. Existing methods for Chinese word segmentation, including statistical machine learning methods and neural network methods, usually have good performance in specific knowledge domains. Given the increasing importance of interdisciplinary and cross-domain studies, one of the challenges in cross-domain word segmentation is to handle the out-of-vocabulary (OOV) words. Existing methods show unsatisfactory performance to meet the practical standard. To this end, we propose a document-level context-aware model that can automatically perceive and identify OOV words from different domains. Our method jointly implements a word-based and a character-based model and then processes the results with a newly proposed reconstruction model. We evaluate the new method by designing and conducting comprehensive experiments on two real-world datasets (e.g., news from different domains). The results demonstrate the superiority of our method over the state-of-the-art models in handling texts from different domains. Importantly, when doing the word segmentation under the cross-domain scenario, our proposed method can improve the performance of OOV words recognition.<\/jats:p>","DOI":"10.1145\/3481298","type":"journal-article","created":{"date-parts":[[2021,11,3]],"date-time":"2021-11-03T15:03:32Z","timestamp":1635951812000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model"],"prefix":"10.1145","volume":"21","author":[{"given":"Kaiyu","family":"Huang","sequence":"first","affiliation":[{"name":"Dalian University of Technology, Dalian City, Liaoning Province, P. R. C."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keli","family":"Xiao","sequence":"additional","affiliation":[{"name":"Stony Brook University, Stony Brook, NY"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fengran","family":"Mo","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian City, Liaoning Province, P. R. C."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Jin","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian City, Liaoning Province, P. R. C."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuang","family":"Liu","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian City, Liaoning Province, P. R. C."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Degen","family":"Huang","sequence":"additional","affiliation":[{"name":"Dalian University of Technology, Dalian City, Liaoning Province, P. R. C."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,11,3]]},"reference":[{"key":"e_1_3_1_2_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-2096"},{"key":"e_1_3_1_3_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1168"},{"key":"e_1_3_1_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1141"},{"key":"e_1_3_1_5_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1110"},{"key":"e_1_3_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078186"},{"key":"e_1_3_1_7_1","first-page":"123","volume-title":"Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing","author":"Emerson Thomas","year":"2005","unstructured":"Thomas Emerson. 2005. The Second International Chinese Word Segmentation Bakeoff. In Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing. 123\u2013133."},{"issue":"3","key":"e_1_3_1_8_1","first-page":"8","article-title":"Chinese word segmentation: A decade review","volume":"21","author":"Huang Chang-Ning","year":"2007","unstructured":"Chang-Ning Huang and Hai Zhao. 2007. Chinese word segmentation: A decade review. Journal of Chinese Information Processing 21, 3 (2007), 8\u201319.","journal-title":"Journal of Chinese Information Processing"},{"issue":"3","key":"e_1_3_1_9_1","first-page":"49","article-title":"Context information and fragments based cross-domain word segmentation","volume":"9","author":"Huang Degen","year":"2012","unstructured":"Degen Huang and Deqin Tong. 2012. Context information and fragments based cross-domain word segmentation. China Communications 9, 3 (2012), 49\u201357.","journal-title":"China Communications"},{"key":"e_1_3_1_10_1","article-title":"Bidirectional LSTM-CRF models for sequence tagging","author":"Huang Zhiheng","year":"2015","unstructured":"Zhiheng Huang, Wei Xu, and Kai Yu. 2015. Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991 (2015). http:\/\/arxiv.org\/abs\/1508.01991.","journal-title":"arXiv preprint arXiv:1508.01991"},{"key":"e_1_3_1_11_1","first-page":"230","volume-title":"Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing","author":"Kudo Taku","year":"2004","unstructured":"Taku Kudo, Kaoru Yamamoto, and Yuji Matsumoto. 2004. Applying conditional random fields to Japanese morphological analysis. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. 230\u2013237."},{"key":"e_1_3_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3060832.3061024"},{"key":"e_1_3_1_13_1","first-page":"745","volume-title":"Proceedings of COLING 2012: Posters","author":"Liu Yang","year":"2012","unstructured":"Yang Liu and Yue Zhang. 2012. Unsupervised domain adaptation for joint segmentation and POS-tagging. In Proceedings of COLING 2012: Posters. 745\u2013754."},{"key":"e_1_3_1_14_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1093"},{"key":"e_1_3_1_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1529"},{"key":"e_1_3_1_16_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220355.1220422"},{"key":"e_1_3_1_17_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1028"},{"key":"e_1_3_1_18_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220355.1220436"},{"key":"e_1_3_1_19_1","first-page":"168","volume-title":"Proceedings of the 4rth SIGHAN Workshop on Chinese Language Processing","author":"Tseng Huihsin","year":"2005","unstructured":"Huihsin Tseng, Pichuan Chang, Galen Andrew, Daniel Jurafsky, and Christopher Manning. 2005. A conditional random field word segmenter for Sighan Bakeoff 2005. In Proceedings of the 4rth SIGHAN Workshop on Chinese Language Processing. 168\u2013171. https:\/\/www.aclweb.org\/anthology\/I05-3027."},{"issue":"1","key":"e_1_3_1_20_1","first-page":"29","article-title":"Chinese word segmentation as character tagging","volume":"8","author":"Xue Nianwen","year":"2003","unstructured":"Nianwen Xue. 2003. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing 8, 1 (2003), 29\u201348.","journal-title":"Computational Linguistics and Chinese Language Processing"},{"key":"e_1_3_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1078"},{"key":"e_1_3_1_22_1","first-page":"2720","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long and Short Papers)","author":"Yang Jie","year":"2019","unstructured":"Jie Yang, Yue Zhang, and Shuailong Liang. 2019. Subword encoding in lattice LSTM for Chinese word segmentation. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long and Short Papers). 2720\u20132725."},{"key":"e_1_3_1_23_1","first-page":"311","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing","author":"Zhang Longkai","year":"2013","unstructured":"Longkai Zhang, Houfeng Wang, Xu Sun, and Mairgup Mansur. 2013. Exploring representations from unlabeled data with co-training for Chinese word segmentation. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 311\u2013321. https:\/\/aclweb.org\/anthology\/D13-1031.pdf."},{"key":"e_1_3_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1040"},{"key":"e_1_3_1_25_1","volume-title":"Proceedings of the 32nd AAAI Conference on Artificial Intelligence","author":"Zhang Qi","year":"2018","unstructured":"Qi Zhang, Xiaoyu Liu, and Jinlan Fu. 2018. Neural networks incorporating dictionaries for Chinese word segmentation. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_1_26_1","article-title":"Chinese word segmentation: Another decade review (2007-2017)","author":"Zhao Hai","year":"2019","unstructured":"Hai Zhao, Deng Cai, Changning Huang, and Chunyu Kit. 2019. Chinese word segmentation: Another decade review (2007-2017). arXiv preprint arXiv:1901.06079 (2019).","journal-title":"arXiv preprint arXiv:1901.06079"},{"key":"e_1_3_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1781134.1781135"},{"key":"e_1_3_1_28_1","first-page":"106","volume-title":"Proceedings of the 6th SIGHAN Workshop on Chinese Language Processing","author":"Zhao Hai","year":"2008","unstructured":"Hai Zhao and Chunyu Kit. 2008. Unsupervised segmentation helps supervised learning of character tagging for word segmentation and named entity recognition. In Proceedings of the 6th SIGHAN Workshop on Chinese Language Processing. 106\u2013111."},{"key":"e_1_3_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/3304222.3304410"},{"key":"e_1_3_1_30_1","first-page":"647","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201913)","author":"Zheng Xiaoqing","year":"2013","unstructured":"Xiaoqing Zheng, Hanyang Chen, and Tianyu Xu. 2013. Deep learning for Chinese word segmentation and POS tagging. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201913). 647\u2013657."},{"key":"e_1_3_1_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1079"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3481298","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3481298","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:32Z","timestamp":1750191452000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3481298"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,3]]},"references-count":30,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3,31]]}},"alternative-id":["10.1145\/3481298"],"URL":"https:\/\/doi.org\/10.1145\/3481298","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2021,11,3]]},"assertion":[{"value":"2019-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}