{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T06:22:02Z","timestamp":1769926922472,"version":"3.49.0"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,1,20]],"date-time":"2017-01-20T00:00:00Z","timestamp":1484870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ADAPT Centre at DCU","award":["1713\/RC\/2106"],"award-info":[{"award-number":["1713\/RC\/2106"]}]},{"DOI":"10.13039\/501100001602","name":"Science Foundation Ireland","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001602","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Indian Statistical Institute, Kolkata, India"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2017,9,30]]},"abstract":"<jats:p>In this article, we propose a word embedding--based named entity recognition (NER) approach. NER is commonly approached as a sequence labeling task with the application of methods such as conditional random field (CRF). However, for low-resource languages without the presence of sufficiently large training data, methods such as CRF do not perform well. In our work, we make use of the proximity of the vector embeddings of words to approach the NER problem. The hypothesis is that word vectors belonging to the same name category, such as a person\u2019s name, occur in close vicinity in the abstract vector space of the embedded words. Assuming that this clustering hypothesis is true, we apply a standard classification approach on the vectors of words to learn a decision boundary between the NER classes. Our NER experiments are conducted on a morphologically rich and low-resource language, namely Bengali. Our approach significantly outperforms standard baseline CRF approaches that use cluster labels of word embeddings and gazetteers constructed from Wikipedia. Further, we propose an unsupervised approach (that uses an automatically created named entity (NE) gazetteer from Wikipedia in the absence of training data). For a low-resource language, the word vectors obtained from Wikipedia are not sufficient to train a classifier. As a result, we propose to make use of the distance measure between the vector embeddings of words to expand the set of Wikipedia training examples with additional NEs extracted from a monolingual corpus that yield significant improvement in the unsupervised NER performance. In fact, our expansion method performs better than the traditional CRF-based (supervised) approach (i.e., F-score of 65.4% vs. 64.2%). Finally, we compare our proposed approach to the official submission for the IJCNLP-2008 Bengali NER shared task and achieve an overall improvement of F-score 11.26% with respect to the best official system.<\/jats:p>","DOI":"10.1145\/3015467","type":"journal-article","created":{"date-parts":[[2017,1,20]],"date-time":"2017-01-20T14:05:40Z","timestamp":1484921140000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["Named Entity Recognition with Word Embeddings and Wikipedia Categories for a Low-Resource Language"],"prefix":"10.1145","volume":"16","author":[{"given":"Arjun","family":"Das","sequence":"first","affiliation":[{"name":"University of Calcutta, Kolkata, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Debasis","family":"Ganguly","sequence":"additional","affiliation":[{"name":"Dublin City University, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Utpal","family":"Garain","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute, Kolkata, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,1,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007558221122"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390177"},{"key":"e_1_2_1_5_1","unstructured":"Ronan Collobert Jason Weston L\u00e9on Bottou Michael Karlen Koray Kavukcuoglu and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research 2493--2537. http:\/\/dl.acm.org\/citation.cfm?id&equals;1953048.2078186.  Ronan Collobert Jason Weston L\u00e9on Bottou Michael Karlen Koray Kavukcuoglu and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research 2493--2537. http:\/\/dl.acm.org\/citation.cfm?id&equals;1953048.2078186."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3115\/980845.980892"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2014.24"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5006","author":"Ekbal Asif","year":"2008","unstructured":"Asif Ekbal , Rejwanul Haque , Amitava Das , Venkateswarlu Poka , and Sivaji Bandyopadhyay . 2008 . Language independent named entity recognition in Indian languages . In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5006 . Asif Ekbal, Rejwanul Haque, Amitava Das, Venkateswarlu Poka, and Sivaji Bandyopadhyay. 2008. Language independent named entity recognition in Indian languages. In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5006."},{"key":"e_1_2_1_9_1","first-page":"09","volume-title":"Proceedings of the 23rd Pacific Asia Conference on Language, Information, and Computation (PACLIC 23)","author":"Ekbal Asif","year":"2009","unstructured":"Asif Ekbal , Mohammed Hasanuzzaman , and Sivaji Bandyopadhyay . 2009 . Voted approach for part of speech tagging in Bengali . In Proceedings of the 23rd Pacific Asia Conference on Language, Information, and Computation (PACLIC 23) . 120--129. http:\/\/www.aclweb.org\/anthology\/Y 09 - 1014 . Asif Ekbal, Mohammed Hasanuzzaman, and Sivaji Bandyopadhyay. 2009. Voted approach for part of speech tagging in Bengali. In Proceedings of the 23rd Pacific Asia Conference on Language, Information, and Computation (PACLIC 23). 120--129. http:\/\/www.aclweb.org\/anthology\/Y09-1014."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1967293.1967296"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10032-011-0155-7"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP\u201903)","author":"Evans Richard J.","year":"2003","unstructured":"Richard J. Evans . 2003 . A framework for named entity recognition in the open domain . In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP\u201903) . Richard J. Evans. 2003. A framework for named entity recognition in the open domain. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP\u201903)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2697065"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5005","author":"Gali Karthik","year":"2008","unstructured":"Karthik Gali , Harshit Surana , Ashwini Vaidya , Praneeth Shishtla , and Dipti Misra Sharma . 2008 . Aggregating machine learning and rule based heuristics for named entity recognition . In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5005 . Karthik Gali, Harshit Surana, Ashwini Vaidya, Praneeth Shishtla, and Dipti Misra Sharma. 2008. Aggregating machine learning and rule based heuristics for named entity recognition. In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5005."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 5th Forum on Information Retrieval Evaluation (FIRE\u201913)","author":"Ganguly Debasis","unstructured":"Debasis Ganguly , Johannes Leveling , and Gareth J. F. Jones . 2013. DCU@Morpheme extraction task of FIRE-2012: Rule-based stemmers for Bengali and Hindi . In Proceedings of the 5th Forum on Information Retrieval Evaluation (FIRE\u201913) . 12. Debasis Ganguly, Johannes Leveling, and Gareth J. F. Jones. 2013. DCU@Morpheme extraction task of FIRE-2012: Rule-based stemmers for Bengali and Hindi. In Proceedings of the 5th Forum on Information Retrieval Evaluation (FIRE\u201913). 12."},{"key":"e_1_2_1_16_1","unstructured":"Yoav Goldberg and Omer Levy. 2014. Word2vec explained: Deriving Mikolov et&nbsp;al.\u2019s negative-sampling word-embedding method. arXiv:1402.3722. http:\/\/arxiv.org\/abs\/1402.3722.  Yoav Goldberg and Omer Levy. 2014. Word2vec explained: Deriving Mikolov et&nbsp;al.\u2019s negative-sampling word-embedding method. arXiv:1402.3722. http:\/\/arxiv.org\/abs\/1402.3722."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1012"},{"key":"e_1_2_1_18_1","first-page":"07","volume-title":"Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907)","author":"Kazama Jun\u2019ichi","year":"2007","unstructured":"Jun\u2019ichi Kazama and Kentaro Torisawa . 2007 . Exploiting Wikipedia as external knowledge for named entity recognition . In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907) . http:\/\/aclweb.org\/anthology\/D 07 - 1073 . Jun\u2019ichi Kazama and Kentaro Torisawa. 2007. Exploiting Wikipedia as external knowledge for named entity recognition. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL\u201907). http:\/\/aclweb.org\/anthology\/D07-1073."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5012","author":"Praveen Kumar P.","unstructured":"P. Praveen Kumar and V. Ravi Kiran . 2008. Hybrid named entity recognition system for South and South East Asian languages . In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5012 . P. Praveen Kumar and V. Ravi Kiran. 2008. Hybrid named entity recognition system for South and South East Asian languages. In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5012."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3115\/1119176.1119206"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.3115\/977035.977037"},{"key":"e_1_2_1_22_1","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013a. Efficient estimation of word representations in vector space. arXiv:1301.3781. http:\/\/arxiv.org\/abs\/1301.3781.  Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013a. Efficient estimation of word representations in vector space. arXiv:1301.3781. http:\/\/arxiv.org\/abs\/1301.3781."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the Neural Information Processing Systems Conference (NIPS\u201913)","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov , Ilya Sutskever , Kai Chen , Gregory S. Corrado , and Jeffrey Dean . 2013 b. Distributed representations of words and phrases and their compositionality . In Proceedings of the Neural Information Processing Systems Conference (NIPS\u201913) . 3111--3119. Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. 2013b. Distributed representations of words and phrases and their compositionality. In Proceedings of the Neural Information Processing Systems Conference (NIPS\u201913). 3111--3119."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the Neural Information Processing Systems Conference (NIPS\u201908)","author":"Mnih Andriy","unstructured":"Andriy Mnih and Geoffrey E. Hinton . 2008. A scalable hierarchical distributed language model . In Proceedings of the Neural Information Processing Systems Conference (NIPS\u201908) . 1081--1088. http:\/\/papers.nips.cc\/paper\/3583-a-scalable-hierarchical-distributed-language-model. Andriy Mnih and Geoffrey E. Hinton. 2008. A scalable hierarchical distributed language model. In Proceedings of the Neural Information Processing Systems Conference (NIPS\u201908). 1081--1088. http:\/\/papers.nips.cc\/paper\/3583-a-scalable-hierarchical-distributed-language-model."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-1609"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/1596374.1596399"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics and the Human Language Technology Conference (ACL-08: HLT). 1--9. http:\/\/aclweb.org\/anthology\/P08-1001","author":"Alexander Richman E.","year":"2008","unstructured":"E. Alexander Richman and Patrick Schone . 2008 . Mining Wiki resources for multilingual named entity recognition . In Proceedings of the Annual Meeting of the Association for Computational Linguistics and the Human Language Technology Conference (ACL-08: HLT). 1--9. http:\/\/aclweb.org\/anthology\/P08-1001 . E. Alexander Richman and Patrick Schone. 2008. Mining Wiki resources for multilingual named entity recognition. In Proceedings of the Annual Meeting of the Association for Computational Linguistics and the Human Language Technology Conference (ACL-08: HLT). 1--9. http:\/\/aclweb.org\/anthology\/P08-1001."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5004","author":"Saha Sujan K.","year":"2008","unstructured":"Sujan K. Saha , Sanjay Chatterji , Sandipan Dandapat , Sudeshna Sarkar , and Pabitra Mitra . 2008 . A hybrid named entity recognition system for South and South East Asian languages . In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5004 . Sujan K. Saha, Sanjay Chatterji, Sandipan Dandapat, Sudeshna Sarkar, and Pabitra Mitra. 2008. A hybrid named entity recognition system for South and South East Asian languages. In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5004."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073445.1073473"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 24th International Conference on Computational Linguistics (COLING\u201912)","author":"Sikdar Utpal Kumar","year":"2012","unstructured":"Utpal Kumar Sikdar , Asif Ekbal , and Sriparna Saha . 2012 . Differential evolution based feature selection and classifier ensemble for named entity recognition . In Proceedings of the 24th International Conference on Computational Linguistics (COLING\u201912) . 2475--2490. http:\/\/dblp.uni-trier.de\/db\/conf\/coling\/coling2012.html#SikdarES12. Utpal Kumar Sikdar, Asif Ekbal, and Sriparna Saha. 2012. Differential evolution based feature selection and classifier ensemble for named entity recognition. In Proceedings of the 24th International Conference on Computational Linguistics (COLING\u201912). 2475--2490. http:\/\/dblp.uni-trier.de\/db\/conf\/coling\/coling2012.html#SikdarES12."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5003","author":"Singh Anil K.","year":"2008","unstructured":"Anil K. Singh . 2008 . Named entity recognition for South and South East Asian languages: Taking stock . In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5003 . Anil K. Singh. 2008. Named entity recognition for South and South East Asian languages: Taking stock. In Proceedings of the IJCNLP-08 Workshop on Named Entity Recognition for South and South East Asian Languages. http:\/\/aclweb.org\/anthology\/I08-5003."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the NIPS Workshop on Grammar Induction, Representation of Language, and Language Learning. http:\/\/citeseerx.ist.psu.edu\/citeseerx\/viewdoc\/summary?doi&equals;10","author":"Turian Joseph","year":"2009","unstructured":"Joseph Turian , Yoshua Bengi , Lev Ratinov , and Dan Roth . 2009 . A preliminary evaluation of word representations for named-entity recognition . In Proceedings of the NIPS Workshop on Grammar Induction, Representation of Language, and Language Learning. http:\/\/citeseerx.ist.psu.edu\/citeseerx\/viewdoc\/summary?doi&equals;10 .1.1.174.1362. Joseph Turian, Yoshua Bengi, Lev Ratinov, and Dan Roth. 2009. A preliminary evaluation of word representations for named-entity recognition. In Proceedings of the NIPS Workshop on Grammar Induction, Representation of Language, and Language Learning. http:\/\/citeseerx.ist.psu.edu\/citeseerx\/viewdoc\/summary?doi&equals;10.1.1.174.1362."},{"key":"e_1_2_1_34_1","first-page":"2579","article-title":"Visualizing high-dimensional data using t-SNE","volume":"9","author":"van der Maaten L. J. P.","year":"2008","unstructured":"L. J. P. van der Maaten and G. E. Hinton . 2008 . Visualizing high-dimensional data using t-SNE . Journal of Machine Learning Research 9 , 2579 -- 2605 . L. J. P. van der Maaten and G. E. Hinton. 2008. Visualizing high-dimensional data using t-SNE. Journal of Machine Learning Research 9, 2579--2605.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/1699765.1699766"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073163"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3015467","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3015467","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:24:14Z","timestamp":1750220654000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3015467"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1,20]]},"references-count":34,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,30]]}},"alternative-id":["10.1145\/3015467"],"URL":"https:\/\/doi.org\/10.1145\/3015467","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,1,20]]},"assertion":[{"value":"2015-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-01-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}