{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T22:00:04Z","timestamp":1787695204486,"version":"build-2784847793"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T00:00:00Z","timestamp":1631491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"<jats:p>\n                    As a highly analytic language, Khmer has considerable ambiguities in tokenization and\n                    <jats:bold>part-of-speech (POS)<\/jats:bold>\n                    tagging processing. This topic is investigated in this study. Specifically, a 20,000-sentence Khmer corpus with manual tokenization and POS-tagging annotation is released after a series of work over the last 4 years. This is the largest morphologically annotated Khmer dataset as of 2020, when this article was prepared. Based on the annotated data, experiments were conducted to establish a comprehensive benchmark on the automatic processing of tokenization and POS-tagging for Khmer. Specifically, a support vector machine, a\n                    <jats:bold>conditional random field (CRF)<\/jats:bold>\n                    , a\n                    <jats:bold>long short-term memory (LSTM)<\/jats:bold>\n                    -based recurrent neural network, and an integrated LSTM-CRF model have been investigated and discussed. As a primary conclusion, processing at morpheme-level is satisfactory for the provided data. However, it is intrinsically difficult to identify further grammatical constituents of compounds or phrases because of the complex analytic features of the language. Syntactic annotation and automatic parsing for Khmer will be scheduled in the near future.\n                  <\/jats:p>","DOI":"10.1145\/3464378","type":"journal-article","created":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T19:39:41Z","timestamp":1631561981000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Towards Tokenization and Part-of-Speech Tagging for Khmer: Data and Discussion"],"prefix":"10.1145","volume":"20","author":[{"given":"Hour","family":"Kaing","sequence":"first","affiliation":[{"name":"ASTREC, National Institute of Information and Communications Technology, Japan and Nara Institute of Science and Technology, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenchen","family":"Ding","sequence":"additional","affiliation":[{"name":"ASTREC, National Institute of Information and Communications Technology, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Masao","family":"Utiyama","sequence":"additional","affiliation":[{"name":"ASTREC, National Institute of Information and Communications Technology, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eiichiro","family":"Sumita","sequence":"additional","affiliation":[{"name":"ASTREC, National Institute of Information and Communications Technology, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sethserey","family":"Sam","sequence":"additional","affiliation":[{"name":"National Institute of Posts, Telecoms &amp; ICT, Cambodia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sopheap","family":"Seng","sequence":"additional","affiliation":[{"name":"National Institute of Posts, Telecoms &amp; ICT, Cambodia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katsuhito","family":"Sudoh","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Satoshi","family":"Nakamura","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,9,13]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of LREC. 2980\u20132983","author":"Mon Aye Myat","year":"2020","unstructured":"Aye Myat Mon , Chenchen Ding , Hour Kaing , Khin Mar Soe , Masao Utiyama , and Eiichiro Sumita . 2020 . A Myanmar (Burmese)-English named entity transliteration dictionary . In Proceedings of LREC. 2980\u20132983 . Aye Myat Mon, Chenchen Ding, Hour Kaing, Khin Mar Soe, Masao Utiyama, and Eiichiro Sumita. 2020. A Myanmar (Burmese)-English named entity transliteration dictionary. In Proceedings of LREC. 2980\u20132983."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/APSIPA.2014.7041822"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of Khmer NLP. 62\u201369","author":"Chea Vichet","year":"2015","unstructured":"Vichet Chea , Ye Kyaw Thu , Chenchen Ding , Masao Utiyama , Andrew Finch , and Eiichiro Sumita . 2015 . Khmer word segmentation using conditional random fields . In Proceedings of Khmer NLP. 62\u201369 . Vichet Chea, Ye Kyaw Thu, Chenchen Ding, Masao Utiyama, Andrew Finch, and Eiichiro Sumita. 2015. Khmer word segmentation using conditional random fields. In Proceedings of Khmer NLP. 62\u201369."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1141"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078186"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of PACLING. 179\u2013190","author":"Ding Chenchen","year":"2017","unstructured":"Chenchen Ding , Vichet Chea , Masao Utiyama , Eiichiro Sumita , Sethserey Sam , and Sopheap Seng . 2017 . Statistical khmer name romanization . In Proceedings of PACLING. 179\u2013190 . Chenchen Ding, Vichet Chea, Masao Utiyama, Eiichiro Sumita, Sethserey Sam, and Sopheap Seng. 2017. Statistical khmer name romanization. In Proceedings of PACLING. 179\u2013190."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3325885"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373268"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3276773"},{"key":"#cr-split#-e_1_2_1_10_1.1","unstructured":"Chenchen Ding Masao Utiyama and Eiichiro Sumita. 2020. Tokenized and POS-tagged Khmer data of the Asian language treebank project. https:\/\/doi.org\/10.5281\/zenodo.3937914 10.5281\/zenodo.3937914"},{"key":"#cr-split#-e_1_2_1_10_1.2","unstructured":"Chenchen Ding Masao Utiyama and Eiichiro Sumita. 2020. Tokenized and POS-tagged Khmer data of the Asian language treebank project. https:\/\/doi.org\/10.5281\/zenodo.3937914"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2846095"},{"key":"e_1_2_1_12_1","volume-title":"Contemporary Cambodian: Grammatical Sketch.","author":"Ehrman Madeline Elizabeth","year":"1972","unstructured":"Madeline Elizabeth Ehrman and Kem Sos . 1972 . Contemporary Cambodian: Grammatical Sketch. Madeline Elizabeth Ehrman and Kem Sos. 1972. Contemporary Cambodian: Grammatical Sketch."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_14_1","volume-title":"Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991","author":"Huang Zhiheng","year":"2015","unstructured":"Zhiheng Huang , Wei Xu , and Kai Yu. 2015. Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991 ( 2015 ). Zhiheng Huang, Wei Xu, and Kai Yu. 2015. Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991 (2015)."},{"key":"e_1_2_1_15_1","volume-title":"Vann Navy, Chin Chanthirith, and Chhoeun Tola.","author":"Huor Chea Sok","year":"2004","unstructured":"Chea Sok Huor , Top Rithy , Ros Pich Hemy , Vann Navy, Chin Chanthirith, and Chhoeun Tola. 2004 . Word bigram vs orthographic syllable bigram in Khmer word segmentation. PAN Localization Working Papers ( 2004). Chea Sok Huor, Top Rithy, Ros Pich Hemy, Vann Navy, Chin Chanthirith, and Chhoeun Tola. 2004. Word bigram vs orthographic syllable bigram in Khmer word segmentation. PAN Localization Working Papers (2004)."},{"key":"e_1_2_1_16_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba . 2015 . Adam : A method for stochastic optimization. In Proceedings of ICLR. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of ICLR."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1687878.1687951"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of EMNLP. 230\u2013237","author":"Kudo Taku","year":"2004","unstructured":"Taku Kudo , Kaoru Yamamoto , and Yuji Matsumoto . 2004 . Applying conditional random fields to Japanese morphological analysis . In Proceedings of EMNLP. 230\u2013237 . Taku Kudo, Kaoru Yamamoto, and Yuji Matsumoto. 2004. Applying conditional random fields to Japanese morphological analysis. In Proceedings of EMNLP. 230\u2013237."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/645530.655813"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1030"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1101"},{"key":"e_1_2_1_22_1","unstructured":"Graham Neubig Chris Dyer Yoav Goldberg Austin Matthews Waleed Ammar Antonios Anastasopoulos Miguel Ballesteros David Chiang Daniel Clothiaux Trevor Cohn Kevin Duh Manaal Faruqui Cynthia Gan Dan Garrette Yangfeng Ji Lingpeng Kong Adhiguna Kuncoro Gaurav Kumar Chaitanya Malaviya Paul Michel Yusuke Oda Matthew Richardson Naomi Saphra Swabha Swayamdipta and Pengcheng Yin. 2017. DyNet: The dynamic neural network toolkit. arXiv preprint arXiv:1701.03980 (2017).  Graham Neubig Chris Dyer Yoav Goldberg Austin Matthews Waleed Ammar Antonios Anastasopoulos Miguel Ballesteros David Chiang Daniel Clothiaux Trevor Cohn Kevin Duh Manaal Faruqui Cynthia Gan Dan Garrette Yangfeng Ji Lingpeng Kong Adhiguna Kuncoro Gaurav Kumar Chaitanya Malaviya Paul Michel Yusuke Oda Matthew Richardson Naomi Saphra Swabha Swayamdipta and Pengcheng Yin. 2017. DyNet: The dynamic neural network toolkit. arXiv preprint arXiv:1701.03980 (2017)."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of LREC.","author":"Neubig Graham","year":"2010","unstructured":"Graham Neubig and Shinsuke Mori . 2010 . Word-based partial annotation for efficient corpus construction . In Proceedings of LREC. Graham Neubig and Shinsuke Mori. 2010. Word-based partial annotation for efficient corpus construction. In Proceedings of LREC."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/2002736.2002841"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/IRI.2007.4296623"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of ICAI. 581\u2013587","author":"Nou Chenda","year":"2007","unstructured":"Chenda Nou and Wataru Kameyama . 2007 . Transformation-based Khmer part-of-speech tagger . In Proceedings of ICAI. 581\u2013587 . Chenda Nou and Wataru Kameyama. 2007. Transformation-based Khmer part-of-speech tagger. In Proceedings of ICAI. 581\u2013587."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1161"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSDA.2016.7918974"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of LREC. 2658\u20132661","author":"Seng Sopheap","year":"2008","unstructured":"Sopheap Seng , Sethserey Sam , Laurent Besacier , Brigitte Bigi , and Eric Castelli . 2008 . First broadcast news transcription system for Khmer language . In Proceedings of LREC. 2658\u20132661 . Sopheap Seng, Sethserey Sam, Laurent Besacier, Brigitte Bigi, and Eric Castelli. 2008. First broadcast news transcription system for Khmer language. In Proceedings of LREC. 2658\u20132661."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2998828.2998855"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of COLING. 3879\u20133889","author":"Yang Jie","year":"2018","unstructured":"Jie Yang , Shuailong Liang , and Yue Zhang . 2018 . Design challenges and misconceptions in neural sequence labeling . In Proceedings of COLING. 3879\u20133889 . Jie Yang, Shuailong Liang, and Yue Zhang. 2018. Design challenges and misconceptions in neural sequence labeling. In Proceedings of COLING. 3879\u20133889."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-4013"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1781134.1781135"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3464378","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3464378","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:17:10Z","timestamp":1750177030000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3464378"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,13]]},"references-count":34,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3464378"],"URL":"https:\/\/doi.org\/10.1145\/3464378","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,13]]},"assertion":[{"value":"2020-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}