{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:16:48Z","timestamp":1750306608631,"version":"3.41.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2015,6,12]],"date-time":"2015-06-12T00:00:00Z","timestamp":1434067200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"International Science & Technology Cooperation Program of China","award":["2014DFA11350"],"award-info":[{"award-number":["2014DFA11350"]}]},{"name":"Hi-Tech Research and Development Program (\u201c863\u201d Program) of China","award":["2012AA011102"],"award-info":[{"award-number":["2012AA011102"]}]},{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61333018"],"award-info":[{"award-number":["61333018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2015,6,12]]},"abstract":"<jats:p>This article proposes a unified, character-based, generative model to incorporate additional resources for solving the out-of-vocabulary (OOV) problem of Chinese word segmentation, within which different types of additional information can be utilized independently in corresponding submodels. This article mainly addresses the following three types of OOV: unseen dictionary words, named entities, and suffix-derived words, none of which are handled well by current approaches. The results show that our approach can effectively improve the performance of the first two types with positive interaction in F-score. Additionally, we also analyze reason that suffix information is not helpful. After integrating the proposed generative model with the corresponding discriminative approach, our evaluation on various corpora---including SIGHAN-2005, CIPS-SIGHAN-2010, and the Chinese Treebank (CTB)---shows that our integrated approach achieves the best performance reported in the literature on all testing sets when additional information and resources are allowed.<\/jats:p>","DOI":"10.1145\/2699940","type":"journal-article","created":{"date-parts":[[2015,6,18]],"date-time":"2015-06-18T18:14:05Z","timestamp":1434651245000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["A Unified Model for Solving the OOV Problem of Chinese Word Segmentation"],"prefix":"10.1145","volume":"14","author":[{"given":"Xiaoqing","family":"Li","sequence":"first","affiliation":[{"name":"Chinese Academy of Sciences"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chengqing","family":"Zong","sequence":"additional","affiliation":[{"name":"Chinese Academy of Sciences"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keh-yih","family":"Su","sequence":"additional","affiliation":[{"name":"Academia Sinica"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,6,12]]},"reference":[{"volume-title":"Corpus Linguistics: An International Handbook","author":"Baroni M.","key":"e_1_2_1_1_1"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073483.1073485"},{"volume-title":"Technical Report TR-10-98. Harvard University Center for Research in Computing Technology.","year":"1998","author":"Chen S. F.","key":"e_1_2_1_3_1"},{"volume-title":"Proceedings of the 1st CIPS-SIGHAN Joint Conference on Chinese Language Processing. 1--7.","author":"Dong Z.","key":"e_1_2_1_4_1"},{"volume-title":"Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing. 123--133","year":"2005","author":"Emerson T.","key":"e_1_2_1_5_1"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1162\/089120104773633394"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1162\/089120105775299177"},{"volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics. 1045--1053","author":"Hatori J.","key":"e_1_2_1_8_1"},{"key":"e_1_2_1_9_1","first-page":"8","article-title":"Chinese word segmentation: A decade review","volume":"21","author":"Huang C.","year":"2007","journal-title":"J. Chinese Inf.Process."},{"volume-title":"Proceedings of the NAACL. 697--700","author":"Jiampojamarn S.","key":"e_1_2_1_10_1"},{"volume-title":"Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. 522--530","author":"Jiang W.","key":"e_1_2_1_11_1"},{"volume-title":"Proceedings of the ACL. 897--904","author":"Jiang W.","key":"e_1_2_1_12_1"},{"volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics. (Vol. 1, Long Papers). 761--769","author":"Jiang W.","key":"e_1_2_1_13_1"},{"volume-title":"Proceedings of the 6th SIGHAN Workshop on Chinese Language Processing. 69","author":"Jin G.","key":"e_1_2_1_14_1"},{"volume-title":"Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. 513--521","author":"Kruengkrai C.","key":"e_1_2_1_15_1"},{"volume-title":"Proceedings of COLING. 1653--1670","author":"Li X.","key":"e_1_2_1_16_1"},{"volume-title":"Proceedings of the 27th Pacific Asia Conference on Language, Information and Computation.","author":"Li X.","key":"e_1_2_1_17_1"},{"key":"e_1_2_1_18_1","unstructured":"Li Z. 2011. Parsing the internal structure of words: A new paradigm for Chinese word segmentation.In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics.1405--1414.   Li Z. 2011. Parsing the internal structure of words: A new paradigm for Chinese word segmentation.In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics .1405--1414."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2009.35.4.35403"},{"volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. 1445--1454","author":"Li Z.","key":"e_1_2_1_20_1"},{"volume-title":"Proceedings of the EMNLP. 277--284","author":"Ng H. T.","key":"e_1_2_1_21_1"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Nadeau D. and Sekine S. 2007. A survey of named entity recognition and classification.Lingvisticae Investigationes 30 1 3--26.  Nadeau D. and Sekine S. 2007. A survey of named entity recognition and classification. Lingvisticae Investigationes 30 1 3--26.","DOI":"10.1075\/li.30.1.03nad"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3115\/1075096.1075117"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220355.1220436"},{"volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. 501--511","author":"Qian X.","key":"e_1_2_1_25_1"},{"volume-title":"Proceedings of the International Conference on Spoken Language Processing. 311--318","year":"2002","author":"Stolcke A.","key":"e_1_2_1_26_1"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3115\/1072228.1072240"},{"volume-title":"Proceedings of the 23rd International Conference on Computational Linguistics (COLING\u201910)","year":"2010","author":"Sun W.","key":"e_1_2_1_28_1"},{"volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics. 1385--1394","year":"2011","author":"Sun W.","key":"e_1_2_1_29_1"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. 970--979","author":"Sun W.","key":"e_1_2_1_30_1"},{"volume-title":"Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing. 168--171","author":"Tseng H.","key":"e_1_2_1_31_1"},{"volume-title":"Proceedings of the 23rd Pacific Asia Conference on Language, Information and Computation (PACLIC\u201923)","author":"Wang K.","key":"e_1_2_1_32_1"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2184436.2184440"},{"volume-title":"Proceedings of the 5th International Joint Conference on Natural Language Processing. 309--317","author":"Wang Y.","key":"e_1_2_1_34_1"},{"volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Vol. 2, Short Papers). 623--627","author":"Wang Z.","key":"e_1_2_1_35_1"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2008.09.018"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1017\/S135132490400364X"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119250.1119278"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119250.1119280"},{"volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics. 125--134","author":"Zhang M.","key":"e_1_2_1_40_1"},{"volume-title":"Proceedings of the 14th Conference of the European Chapter of the ACL. 588--597","author":"Zhang M.","key":"e_1_2_1_41_1"},{"volume-title":"Proceedings of the COLING\/ACL. 961--968","author":"Zhang R.","key":"e_1_2_1_42_1"},{"volume-title":"Proceedings of the 4th International Conference on Language Resource and Evaluation (LREC). 2051--2054","author":"Zhang Y.","key":"e_1_2_1_43_1"},{"volume-title":"Proceedings of the ACL. 840--847","author":"Zhang Y.","key":"e_1_2_1_44_1"},{"volume-title":"Proceedings of the ACL\/HLT. 888--896","author":"Zhang Y.","key":"e_1_2_1_45_1"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00037"},{"volume-title":"Proceedings of the 5th SIGHAN Workshop on Chinese Language Processing.162--165","author":"Zhao H.","key":"e_1_2_1_47_1"},{"volume-title":"Proceedings of the PACLIC-20","author":"Zhao H.","key":"e_1_2_1_48_1"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1781134.1781135"},{"volume-title":"Proceedings of the 6th SIGHAN Workshop on Chinese Language Processing. 106--111","author":"Zhao H.","key":"e_1_2_1_50_1"},{"volume-title":"Proceedings of the 7th Conference on International Language Resources and Evaluation (LREC\u201910)","author":"Zhao H.","key":"e_1_2_1_51_1"},{"volume-title":"The CIPS-SIGHAN CLP 2010 Chinese word segmentation bakeoff. In Proceedings of the CIPS-SIGHAN Joint Conference on Chinese Language Processing (CLP\u201910)","author":"Zhao H.","key":"e_1_2_1_52_1"},{"key":"e_1_2_1_53_1","unstructured":"Zipf G. 1949. Human Behavior and the Principle of Least Effort. Addison-Wesley.  Zipf G. 1949. Human Behavior and the Principle of Least Effort. Addison-Wesley."}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2699940","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2699940","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:16:59Z","timestamp":1750227419000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2699940"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,6,12]]},"references-count":53,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,6,12]]}},"alternative-id":["10.1145\/2699940"],"URL":"https:\/\/doi.org\/10.1145\/2699940","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2015,6,12]]},"assertion":[{"value":"2014-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-06-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}