{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T06:49:36Z","timestamp":1781938176717,"version":"3.54.5"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,1,25]],"date-time":"2019-01-25T00:00:00Z","timestamp":1548374400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004410","name":"Scientific and Technological Research Council of Turkey","doi-asserted-by":"crossref","award":["EEEAG-115E464"],"award-info":[{"award-number":["EEEAG-115E464"]}],"id":[{"id":"10.13039\/501100004410","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2019,9,30]]},"abstract":"<jats:p>The number of possible word forms is theoretically infinite in agglutinative languages. This brings up the out-of-vocabulary (OOV) issue for part-of-speech (PoS) tagging in agglutinative languages. Since inflectional morphology does not change the PoS tag of a word, we propose to learn stems along with PoS tags simultaneously. Therefore, we aim to overcome the sparsity problem by reducing word forms into their stems. We adopt a Bayesian model that is fully unsupervised. We build a Hidden Markov Model for PoS tagging where the stems are emitted through hidden states. Several versions of the model are introduced in order to observe the effects of different dependencies throughout the corpus, such as the dependency between stems and PoS tags or between PoS tags and affixes. Additionally, we use neural word embeddings to estimate the semantic similarity between the word form and stem. We use the semantic similarity as prior information to discover the actual stem of a word since inflection does not change the meaning of a word. We compare our models with other unsupervised stemming and PoS tagging models on Turkish, Hungarian, Finnish, Basque, and English. The results show that a joint model for PoS tagging and stemming improves on an independent PoS tagger and stemmer in agglutinative languages.<\/jats:p>","DOI":"10.1145\/3292398","type":"journal-article","created":{"date-parts":[[2019,1,28]],"date-time":"2019-01-28T14:01:39Z","timestamp":1548684099000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Unsupervised Joint PoS Tagging and Stemming for Agglutinative Languages"],"prefix":"10.1145","volume":"18","author":[{"given":"Necva","family":"B\u00f6l\u00fcc\u00fc","sequence":"first","affiliation":[{"name":"Hacettepe University, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Burcu","family":"Can","sequence":"additional","affiliation":[{"name":"Hacettepe University, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,1,25]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1885450.1885501"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 2nd Workshop on Treebanks and Linguistic Theories. 201--204","author":"Aduriz Itziar"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning. ACM, 280--288","author":"Arora Sanjeev","year":"2013"},{"key":"e_1_2_1_4_1","volume-title":"International Conference on Asian Digital Libraries. Springer, 117--128","author":"Bacchin Michela","year":"2002"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2004.04.006"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220355.1220435"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177697196"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop","author":"Biemann Chris"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/176313.176316"},{"key":"e_1_2_1_10_1","volume-title":"HPS: High precision stemmer. Information Processing 8 Management 51, 1","author":"Brychc\u00edn Tom\u00e1\u0161","year":"2015"},{"key":"e_1_2_1_11_1","first-page":"13","volume-title":"Proceedings of the 6th International Joint Conference on Natural Language Processing. Asian Federation of Natural Language Processing, 1087--1091","author":"Can Burcu","year":"2013"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 575--584","author":"Christodoulopoulos Christos","year":"2010"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.3115\/974499.974523"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/945546.945548"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613761"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1984.4767596"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1162\/089120101750300490"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324905004055"},{"key":"e_1_2_1_19_1","volume-title":"Annual Meeting\u2014Association for Computational Linguistics","volume":"45","author":"Goldwater Sharon","year":"2007"},{"key":"e_1_2_1_20_1","article-title":"A hybrid method for stemming Arabic text","author":"Goweder A.","year":"2008","journal-title":"Journal of Computer Science. Retrieved"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers. Association for Computational Linguistics, 1177--1185","author":"Gr\u00f6nroos Stig-Arne","year":"2014"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220835.1220876"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL'07)","author":"Johnson Mark","year":"2007"},{"key":"e_1_2_1_24_1","volume-title":"International Computing and Combinatorics Conference. Springer, 1--17","author":"Kleinberg Jon M."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/160688.160718"},{"key":"e_1_2_1_26_1","first-page":"1","article-title":"Development of a stemming algorithm","volume":"11","author":"Lovins Julie B.","year":"1968","journal-title":"Mechanical Translation and Computational Linguistics"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281485.1281489"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/972470.972475"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:INRT.0000009441.78971.be"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmva.2006.11.013"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/956863.956889"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/972525.972526"},{"key":"e_1_2_1_34_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S. Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111--3119.   Tomas Mikolov Ilya Sutskever Kai Chen Greg S. Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111--3119."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Nivre Joakim","year":"2016"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Kemal Oflazer Bilge Say Dilek Zeynep Hakkani-T\u00fcr and G\u00f6khan T\u00fcr. 2003. Building a Turkish treebank. Treebanks (2003) 261--277.  Kemal Oflazer Bilge Say Dilek Zeynep Hakkani-T\u00fcr and G\u00f6khan T\u00fcr. 2003. Building a Turkish treebank. Treebanks (2003) 261--277.","DOI":"10.1007\/978-94-010-0201-1_15"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2037661.2037664"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277851"},{"key":"e_1_2_1_39_1","unstructured":"Slav Petrov Dipanjan Das and Ryan McDonald. 2011. A universal part-of-speech tagset. arXiv preprint arXiv:1104.2086 (2011).  Slav Petrov Dipanjan Das and Ryan McDonald. 2011. A universal part-of-speech tagset. arXiv preprint arXiv:1104.2086 (2011)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb046814"},{"key":"e_1_2_1_41_1","unstructured":"Xipeng Qiu F. Eng Ji Jiayi Zhao and Xuanjing Huang. 2012. Joint segmentation and tagging with coupled sequences labeling. (2012).  Xipeng Qiu F. Eng Ji Jiayi Zhao and Xuanjing Huang. 2012. Joint segmentation and tagging with coupled sequences labeling. (2012)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-85287-2_40"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3115\/981574.981608"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 4th Annual Inter Research Institute Student Seminar in Computer Science, IIT","author":"Shrivastava Manish","year":"2005"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/2382029.2382086"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-2044"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00096"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244303321897735"},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing","volume":"2","author":"Gael Jurgen Van","year":"2009"},{"key":"e_1_2_1_50_1","volume-title":"LREC","volume":"10","author":"Vincze Veronika","year":"2010"},{"key":"e_1_2_1_51_1","volume-title":"Shall We Play the Festschrift Game?","author":"Voutilainen Atro"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1080\/03610910601096262"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/267954.267957"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3292398","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3292398","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:39Z","timestamp":1750208919000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3292398"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,25]]},"references-count":52,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,9,30]]}},"alternative-id":["10.1145\/3292398"],"URL":"https:\/\/doi.org\/10.1145\/3292398","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,25]]},"assertion":[{"value":"2017-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}