{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:26:07Z","timestamp":1750220767291,"version":"3.41.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,1,31]],"date-time":"2021-01-31T00:00:00Z","timestamp":1612051200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"The Scientific and Technological Research Council of Turkey","award":["115E464"],"award-info":[{"award-number":["115E464"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2021,1,31]]},"abstract":"<jats:p>Part of speech (PoS) tagging is one of the fundamental syntactic tasks in Natural Language Processing, as it assigns a syntactic category to each word within a given sentence or context (such as noun, verb, adjective, etc.). Those syntactic categories could be used to further analyze the sentence-level syntax (e.g., dependency parsing) and thereby extract the meaning of the sentence (e.g., semantic parsing). Various methods have been proposed for learning PoS tags in an unsupervised setting without using any annotated corpora. One of the widely used methods for the tagging problem is log-linear models. Initialization of the parameters in a log-linear model is very crucial for the inference. Different initialization techniques have been used so far. In this work, we present a log-linear model for PoS tagging that uses another fully unsupervised Bayesian model to initialize the parameters of the model in a cascaded framework. Therefore, we transfer some knowledge between two different unsupervised models to leverage the PoS tagging results, where a log-linear model benefits from a Bayesian model\u2019s expertise. We present results for Turkish as a morphologically rich language and for English as a comparably morphologically poor language in a fully unsupervised framework. The results show that our framework outperforms other unsupervised models proposed for PoS tagging.<\/jats:p>","DOI":"10.1145\/3447759","type":"journal-article","created":{"date-parts":[[2021,3,31]],"date-time":"2021-03-31T16:11:04Z","timestamp":1617207064000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["A Cascaded Unsupervised Model for PoS Tagging"],"prefix":"10.1145","volume":"20","author":[{"given":"Necva","family":"B\u00f6l\u00fcc\u00fc","sequence":"first","affiliation":[{"name":"Hacettepe University, Ankara, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1700-0395","authenticated-orcid":false,"given":"Burcu","family":"Can","sequence":"additional","affiliation":[{"name":"Research Institute in Information and Language Processing, University of Wolverhampton, Wolverhampton, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,31]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1231"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273501"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning, Sanjoy Dasgupta and David McAllester (Eds.)","volume":"28","author":"Arora Sanjeev","year":"2013"},{"volume-title":"Proceedings of the 20th International Conference on Computational Linguistics. Association for Computational Linguistics, 556","author":"Banko Michele","key":"e_1_2_1_4_1"},{"volume-title":"Human Language Technologies: Proceedings of the 2010 Annual Conference of the North American","author":"Berg-Kirkpatrick Taylor","key":"e_1_2_1_5_1"},{"volume-title":"Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop","author":"Biemann Chris","key":"e_1_2_1_6_1"},{"volume-title":"Proceedings of the International Conference on Computational Linguistics and Intelligent Text Processing. Springer, 110--122","year":"2017","author":"B\u00f6l\u00fcc\u00fc Necva","key":"e_1_2_1_7_1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.310"},{"volume-title":"Proceedings of the 6th Applied Natural Language Processing Conference. Association for Computational Linguistics, 224--231","year":"2000","author":"Brants Thorsten","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.3115\/974499.974526"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/176313.176316"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0060-1"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1137\/0916069"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201993)","volume":"11","author":"Charniak Eugene","year":"1993"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1082"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3115\/1067807.1067817"},{"volume-title":"Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12 (Aug","year":"2011","author":"Collobert Ronan","key":"e_1_2_1_17_1"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3115\/974499.974523"},{"volume-title":"Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 318--329","author":"Cutting Douglass R.","key":"e_1_2_1_19_1"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the European Association for Signal Processing (EUSIPCO\u201994)","volume":"1","author":"Lathauwer L. De","year":"1994"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.3115\/974358.974371"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118723203"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613761"},{"volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics. 744--751","year":"2007","author":"Goldwater Sharon","key":"e_1_2_1_24_1"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016465"},{"volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 444--454","author":"Matthew","key":"e_1_2_1_26_1"},{"volume-title":"Proceedings of the Main Conference on Human Language Technology Conference of the North American","author":"Haghighi Aria","key":"e_1_2_1_27_1"},{"volume-title":"Advances in Neural Information Processing Systems 21","author":"Heitz Geremy","key":"e_1_2_1_28_1"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1073"},{"volume-title":"Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907)","year":"2007","author":"Johnson Mark","key":"e_1_2_1_30_1"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1025"},{"volume-title":"Proceedings of the 18th International Conference on Machine Learning (ICML\u201901)","author":"Lafferty John D.","key":"e_1_2_1_32_1"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01589116"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/972470.972475"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmva.2006.11.013"},{"volume-title":"Algorithms for maximum-likelihood logistic regression. Retrieved on","year":"2021","author":"Minka Thomas","key":"e_1_2_1_36_1"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1151"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00130"},{"volume-title":"Dilek Zeynep Hakkani-T\u00fcr, and G\u00f6khan T\u00fcr","year":"2003","author":"Oflazer Kemal","key":"e_1_2_1_39_1"},{"volume-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201901)","author":"Perez-Ortiz J. A.","key":"e_1_2_1_40_1"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-2067"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing.","year":"1996","author":"Ratnaparkhi Adwait","key":"e_1_2_1_42_1"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3115\/1687878.1687950"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/1896300.1896306"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.3115\/981574.981608"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073445.1073473"},{"volume-title":"Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics, 354--362","author":"Noah","key":"e_1_2_1_48_1"},{"volume-title":"Smith and Jason Eisner","year":"2006","author":"Noah","key":"e_1_2_1_49_1"},{"volume-title":"Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 751--759","year":"2010","author":"Spitkovsky Valentin I.","key":"e_1_2_1_50_1"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00096"},{"volume-title":"Cluster ensembles\u2014A knowledge reuse framework for combining multiple partitions. J. Mach. Learn. Res. 3 (Dec","year":"2002","author":"Strehl Alexander","key":"e_1_2_1_52_1"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.3115\/1067807.1067853"},{"key":"e_1_2_1_54_1","unstructured":"Peilu Wang Yao Qian Frank K. Soong Lei He and Hai Zhao. 2015. Part-of-speech tagging with bidirectional long short-term memory recurrent neural network. pre-print abs\/1510.06168.  Peilu Wang Yao Qian Frank K. Soong Lei He and Hai Zhao. 2015. Part-of-speech tagging with bidirectional long short-term memory recurrent neural network. pre-print abs\/1510.06168."},{"volume-title":"Proceedings of The Thirty-Third AAAI Conference on Artificial Intelligence. 7354--7361","year":"2018","author":"Yan Ming","key":"e_1_2_1_55_1"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/279232.279236"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447759","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447759","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:10Z","timestamp":1750200070000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447759"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,31]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1,31]]}},"alternative-id":["10.1145\/3447759"],"URL":"https:\/\/doi.org\/10.1145\/3447759","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2021,1,31]]},"assertion":[{"value":"2019-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}