{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:25:12Z","timestamp":1750307112465,"version":"3.41.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2012,9,1]],"date-time":"2012-09-01T00:00:00Z","timestamp":1346457600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Transactions on Asian Language Information Processing"],"published-print":{"date-parts":[[2012,9]]},"abstract":"<jats:p>We propose an adaptive Bayesian hidden Markov model for fully unsupervised part-of-speech (POS) induction. The proposed model with its inference algorithm has two extensions to the first-order Bayesian HMM with Dirichlet priors. First our algorithm infers the optimal number of hidden states from the training corpus rather than fixes the dimensionality of state space beforehand. The second extension studies the Chinese unknown word processing module which measures similarities from both morphological properties and context distribution. Experimental results showed that both of these two extensions can help to find the optimal categories for Chinese in terms of both unsupervised clustering metrics and grammar induction accuracies on the Chinese Treebank.<\/jats:p>","DOI":"10.1145\/2334801.2334803","type":"journal-article","created":{"date-parts":[[2012,9,11]],"date-time":"2012-09-11T22:21:06Z","timestamp":1347402066000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Adaptive Bayesian HMM for Fully Unsupervised Chinese Part-of-Speech Induction"],"prefix":"10.1145","volume":"11","author":[{"given":"Lidan","family":"Zhang","sequence":"first","affiliation":[{"name":"The University of Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kwop-Ping","family":"Chan","sequence":"additional","affiliation":[{"name":"The University of Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,9]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_1_1_1","DOI":"10.1214\/aoms\/1177697196"},{"doi-asserted-by":"crossref","unstructured":"Beal M. Ghahramani Z. and Rasmussen C. 2002. The infinite hidden Markov model. In Advances in Neural Information Processing Systems 14 T. Dietterich S. Becker and Z. Ghahramani Eds. MIT Press 577--584. Beal M. Ghahramani Z. and Rasmussen C. 2002. The infinite hidden Markov model. In Advances in Neural Information Processing Systems 14 T. Dietterich S. Becker and Z. Ghahramani Eds. MIT Press 577--584.","key":"e_1_2_1_2_1","DOI":"10.7551\/mitpress\/1120.003.0079"},{"unstructured":"Beal M. J. 2003. Variational algorithms for approximate Bayesian inference. Ph.D. thesis Gatsby Computational Neuroscience Unit University College London. Beal M. J. 2003. Variational algorithms for approximate Bayesian inference. Ph.D. thesis Gatsby Computational Neuroscience Unit University College London.","key":"e_1_2_1_3_1"},{"volume-title":"Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL\u201910)","author":"Berg-Kirkpatrick T.","key":"e_1_2_1_4_1"},{"volume-title":"Mathematical Foundations of Speech and Language Processing","author":"Besag J.","key":"e_1_2_1_5_1"},{"volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems II (ANIPS\u201998)","year":"1999","author":"Brand M.","key":"e_1_2_1_6_1"},{"volume-title":"Proceedings of the Workshop on Very Large Corpora: Academic and Industrial Perspectives (WVLC\u201993)","author":"Chang C.-H.","key":"e_1_2_1_7_1"},{"volume-title":"Proceedings of the 11th National Conference on Artificial Intelligence (AAAI\u201993)","author":"Charniak E.","key":"e_1_2_1_8_1"},{"volume-title":"Proceedings of the International Conference on Computer Linguistics (COLING\u201910)","author":"Cheng A.","key":"e_1_2_1_9_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.3115\/1067807.1067817"},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.5555\/211190.211194"},{"unstructured":"Duda R. O. Hart P. E. and Stork D. G. 2000. Pattern Classification 2nd Ed. Wiley-Interscience. Duda R. O. Hart P. E. and Stork D. G. 2000. Pattern Classification 2nd Ed. Wiley-Interscience.","key":"e_1_2_1_12_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_13_1","DOI":"10.3115\/974358.974371"},{"volume-title":"Proceedings of the 12th Conference of the European Chapter of the ACL (EACL\u201909)","author":"Forst M.","key":"e_1_2_1_14_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_15_1","DOI":"10.1145\/1390156.1390196"},{"volume-title":"Proceedings of the 6th SIGHAN Workshop on Chinese Language Processing (SIGHAN\u201908)","author":"Fu G.","key":"e_1_2_1_16_1"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201908)","author":"Gao J.","key":"e_1_2_1_17_1"},{"volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL\u201907)","author":"Goldwater S.","key":"e_1_2_1_18_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_19_1","DOI":"10.1006\/csla.2001.0174"},{"unstructured":"Graca J. Ganchev K. Taskar B. and Pereira F. 2009. Posterior vs. parameter sparsity in latent variable models. In Advances in Neural Information Processing Systems 22 Y. Bengio D. Schuurmans J. Lafferty C. K. I. Williams and A. Culotta Eds. 664--672. Graca J. Ganchev K. Taskar B. and Pereira F. 2009. Posterior vs. parameter sparsity in latent variable models. In Advances in Neural Information Processing Systems 22 Y. Bengio D. Schuurmans J. Lafferty C. K. I. Williams and A. Culotta Eds. 664--672.","key":"e_1_2_1_20_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.3115\/1220835.1220876"},{"volume-title":"Proceedings of the 13th Conference on Computational Natural Language Learning: Shared Task (CoNLL\u201909)","author":"Haji\u010d J.","key":"e_1_2_1_22_1"},{"volume-title":"Proceedings of the 12th Conference of the European Chapter of the ACL (EACL\u201909)","author":"Hasan K. S.","key":"e_1_2_1_23_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_24_1","DOI":"10.5555\/1620754.1620769"},{"volume-title":"Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing (ACL\u201909)","author":"Huang L.","key":"e_1_2_1_25_1"},{"volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907)","author":"Huang Z.","key":"e_1_2_1_26_1"},{"volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907)","year":"2007","author":"Johnson M.","key":"e_1_2_1_27_1"},{"volume-title":"Proceedings of the North American Conference on Computational Linguistics (NAACL\u201907)","author":"Johnson M.","key":"e_1_2_1_28_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_29_1","DOI":"10.3115\/1218955.1219016"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201910)","author":"Lee Y. K.","key":"e_1_2_1_30_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_31_1","DOI":"10.1016\/j.jmva.2006.11.013"},{"doi-asserted-by":"publisher","key":"e_1_2_1_32_1","DOI":"10.5555\/972525.972526"},{"key":"e_1_2_1_33_1","first-page":"2","article-title":"A brief history of generative models for power law and lognormal distributions","volume":"1","author":"Mitzenmacher M.","year":"2003","journal-title":"Internet Math."},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201904)","author":"Ng H. T.","key":"e_1_2_1_34_1"},{"doi-asserted-by":"crossref","unstructured":"Packard J. L. 2000. The Morphology of Chinese: A Linguistic and Cognitive Approach. Cambridge University Press. Packard J. L. 2000. The Morphology of Chinese: A Linguistic and Cognitive Approach . Cambridge University Press.","key":"e_1_2_1_35_1","DOI":"10.1017\/CBO9780511486821"},{"doi-asserted-by":"publisher","key":"e_1_2_1_36_1","DOI":"10.3115\/1220175.1220230"},{"volume-title":"Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201908)","author":"Petrov S.","key":"e_1_2_1_37_1"},{"volume-title":"Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP (IJCNLP\u201909)","author":"Ravi S.","key":"e_1_2_1_38_1"},{"volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907)","author":"Rosenberg A.","key":"e_1_2_1_39_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_40_1","DOI":"10.1214\/aos\/1176344136"},{"volume-title":"Proceedings of the 11th International Conference on Artificial Intelligence and Statistics (AISTATS\u201907)","author":"Siddiqi S.","key":"e_1_2_1_41_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_42_1","DOI":"10.1162\/153244303321897735"},{"doi-asserted-by":"publisher","key":"e_1_2_1_43_1","DOI":"10.1198\/016214506000000302"},{"doi-asserted-by":"publisher","key":"e_1_2_1_44_1","DOI":"10.3115\/1034678.1034712"},{"volume-title":"Proceedings of the 4th Workshop on Chinese Language Processing (SIGHAN\u201905)","author":"Tseng H.","key":"e_1_2_1_45_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_46_1","DOI":"10.1145\/1390156.1390293"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201909)","author":"Van Gael J.","key":"e_1_2_1_47_1"},{"key":"e_1_2_1_48_1","first-page":"4","article-title":"Hidden Markov models and the Baum-Welch algorithm","volume":"53","author":"Welch L. R.","year":"2003","journal-title":"IEEE Infor. Theory Soc. Newsl."},{"unstructured":"Xia F. 2000. The part-of-speech tagging guidelines for the Penn Chinese treebank (3.0). Tech. rep. The University of Pennsylvania. Xia F. 2000. The part-of-speech tagging guidelines for the Penn Chinese treebank (3.0). Tech. rep. The University of Pennsylvania.","key":"e_1_2_1_49_1"},{"volume-title":"Proceedings of the 5th Workshop on Chinese Language Processing (SIGHAN\u201906)","author":"Xia F.","key":"e_1_2_1_50_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_51_1","DOI":"10.1017\/S1351324908004865"},{"doi-asserted-by":"publisher","key":"e_1_2_1_52_1","DOI":"10.1017\/S135132490400364X"}],"container-title":["ACM Transactions on Asian Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2334801.2334803","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2334801.2334803","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:48:10Z","timestamp":1750240090000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2334801.2334803"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,9]]},"references-count":52,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,9]]}},"alternative-id":["10.1145\/2334801.2334803"],"URL":"https:\/\/doi.org\/10.1145\/2334801.2334803","relation":{},"ISSN":["1530-0226","1558-3430"],"issn-type":[{"type":"print","value":"1530-0226"},{"type":"electronic","value":"1558-3430"}],"subject":[],"published":{"date-parts":[[2012,9]]},"assertion":[{"value":"2011-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}