{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T07:14:36Z","timestamp":1778742876682,"version":"3.51.4"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"12","license":[{"start":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T00:00:00Z","timestamp":1702944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2023,12,31]]},"abstract":"<jats:p>\n            Language identification and content detection are essential for ensuring effective digital communication, and content moderation. While extensive research has primarily focused on well-known and widely spoken languages, challenges persist when dealing with indigenous and resource-limited languages, especially between closely similar languages such as Ethiopian languages. This article aims to simultaneously identify the language of a given text and detect its content, and to achieve this, we propose a novel attention-based recurrent neural network framework. The proposed method has an attention-embedded Bidirectional-LSTM architecture with two classifiers that identify the language of a given text and content within the text. The two classifiers share a common feature space before they branched at their task-specific layers where both layers are assisted by attention mechanism. We use five different topics in Six Ethiopian Languages the dataset consists of nearly 22,624 sentences. We compared our result with the classical NLP techniques, the proposed method shortened the data prepossessing steps. We evaluated the model performance using the accuracy metric, achieving results of 98.88% for language identification and 96.5% for text content detection. The dataset, source code, and pretrained model are available at\n            <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"url\" xlink:href=\"https:\/\/github.com\/bdu-birhanu\/LID_TCD\">https:\/\/github.com\/bdu-birhanu\/LID_TCD<\/jats:ext-link>\n            .\n          <\/jats:p>","DOI":"10.1145\/3630607","type":"journal-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T22:17:54Z","timestamp":1698963474000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Factorized Recurrent Neural Network with Attention for Language Identification and Content Detection"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-6709-7773","authenticated-orcid":false,"given":"Birhanu Hailu","family":"Belay","sequence":"first","affiliation":[{"name":"Faculty of Computing, Bahir Dar Institute of Technology, Bahir Dar University, Ethiopia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6101-6204","authenticated-orcid":false,"given":"Gebeyehu Belay","family":"Gebremeskel","sequence":"additional","affiliation":[{"name":"Faculty of Computing, Bahir Dar Institute of Technology, Bahir Dar University, Ethiopia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-1904-6941","authenticated-orcid":false,"given":"Belete Biazen","family":"Bezabih","sequence":"additional","affiliation":[{"name":"Faculty of Computing, Bahir Dar Institute of Technology, Bahir Dar University, Ethiopia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9974-5015","authenticated-orcid":false,"given":"Seffi","family":"Gebeyehu","sequence":"additional","affiliation":[{"name":"Faculty of Computing, Bahir Dar Institute of Technology, Bahir Dar University, Ethiopia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,12,19]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Solomon Teferra Abate Michael Melese Martha Yifiru Tachbelie Million Meshesha Solomon Atinafu Wondwossen Mulugeta Yaregal Assabie Hafte Abera Binyam Ephrem Seyoum Tewodros Abebe et\u00a0al. 2018. Parallel corpora for bi-directional statistical machine translation for seven Ethiopian language pairs. In Proceedings of the 1st Workshop on Linguistic Resources for Natural Language Processing . 83\u201390."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/0885-064X(90)90006-Y"},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","unstructured":"Ahmed Sulaiman M. Alharbi and Elise de Doncker. 2019. Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral information. Elsevier Cognitive Systems Research 54 (2019) 50\u201361.","DOI":"10.1016\/j.cogsys.2018.10.001"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00636"},{"key":"e_1_3_2_6_2","first-page":"41","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Argyriou Andreas","year":"2007","unstructured":"Andreas Argyriou, Theodoros Evgeniou, and Massimiliano Pontil. 2007. Multi-task feature learning. In Proceedings of the Advances in Neural Information Processing Systems. 41\u201348."},{"key":"e_1_3_2_7_2","unstructured":"Dzmitry Bahdanau Kyunghyun Cho and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv:1409.0473 [cs.CL]. Retrieved from https:\/\/arxiv.org\/abs\/1409.0473"},{"key":"e_1_3_2_8_2","first-page":"2906","volume-title":"Proceedings of the 2019 IEEE International Conference on Image Processing.","author":"Belay Birhanu","year":"2019","unstructured":"Birhanu Belay, Tewodros Habtegebrial, Marcus Liwicki, Gebeyehu Belay, and Didier Stricker. 2019. Factored convolutional neural network for amharic character image recognition. In Proceedings of the 2019 IEEE International Conference on Image Processing.IEEE, 2906\u20132910."},{"key":"e_1_3_2_9_2","first-page":"1268","volume-title":"Proceedings of the 2019 International Conference on Document Analysis and Recognition.","author":"Belay Birhanu Hailu","year":"2019","unstructured":"Birhanu Hailu Belay, Tewodros Habtegebirial, Marcus Liwicki, Gebeyehu Belay, and Didier Stricker. 2019. Amharic text image recognition: Database, algorithm, and analysis. In Proceedings of the 2019 International Conference on Document Analysis and Recognition.IEEE, 1268\u20131273."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.5555\/2390374.2390382"},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","unstructured":"Ibrahim Bounhas Nadia Soudani and Yahya Slimani. 2020. Building a morpho-semantic knowledge graph for arabic information retrieval. Elsevier Information Processing and Management 57 6 (2020) 102124.","DOI":"10.1016\/j.ipm.2019.102124"},{"key":"e_1_3_2_12_2","unstructured":"William B. Cavnar John M. Trenkle et\u00a0al. 1994. N-gram-based text categorization. In Proceedings of the SDAIR-94 3rd Annual Symposium on Document Analysis and Information Retrieval . Citeseer Las Vegas 161\u2013175."},{"key":"e_1_3_2_13_2","doi-asserted-by":"crossref","first-page":"73","DOI":"10.3115\/v1\/W14-3908","volume-title":"Proceedings of the 1st Workshop on Computational Approaches to Code Switching","author":"Chittaranjan Gokul","year":"2014","unstructured":"Gokul Chittaranjan, Yogarshi Vyas, Kalika Bali, and Monojit Choudhury. 2014. Word-level language identification using crf: Code-switching shared task report of msr india system. In Proceedings of the 1st Workshop on Computational Approaches to Code Switching. 73\u201379."},{"key":"e_1_3_2_14_2","unstructured":"Fran\u00e7ois Chollet and others 2018. Keras: The Python deep learning library. Astrophysics Source Code Library (2018) ascl\u20131806."},{"key":"e_1_3_2_15_2","first-page":"577","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Chorowski Jan K.","year":"2015","unstructured":"Jan K. Chorowski, Dzmitry Bahdanau, Dmitriy Serdyuk, Kyunghyun Cho, and Yoshua Bengio. 2015. Attention-based models for speech recognition. In Proceedings of the Advances in Neural Information Processing Systems. 577\u2013585."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390177"},{"key":"e_1_3_2_17_2","unstructured":"Douglas R. Davidson and Ali Ozer. 2013. Automatic language identification for dynamic text processing. Date of Patent: Jun. 11 2013 US Patent 8 464 150."},{"issue":"2","key":"e_1_3_2_18_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3345627","article-title":"Sentifars: A persian polarity lexicon for sentiment analysis","volume":"19","author":"Dehkharghani Rahim","year":"2019","unstructured":"Rahim Dehkharghani. 2019. Sentifars: A persian polarity lexicon for sentiment analysis. ACM Transactions on Asian and Low-Resource Language Information Processing 19, 2 (2019), 1\u201312.","journal-title":"ACM Transactions on Asian and Low-Resource Language Information Processing"},{"key":"e_1_3_2_19_2","first-page":"8599","volume-title":"Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Deng Li","year":"2013","unstructured":"Li Deng, Geoffrey Hinton, and Brian Kingsbury. 2013. New types of deep neural network learning for speech recognition and related applications: An overview. In Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 8599\u20138603."},{"key":"e_1_3_2_20_2","first-page":"41","volume-title":"Proceedings of the 8th Workshop on Natural Language Processing for Computer Assisted Language Learning","author":"Dittrich Sabrina","year":"2019","unstructured":"Sabrina Dittrich, Zarah Weiss, Hannes Schr\u00f6ter, and Detmar Meurers. 2019. Integrating large-scale web data and curated corpus data in a search engine supporting german literacy education. In Proceedings of the 8th Workshop on Natural Language Processing for Computer Assisted Language Learning. Link\u00f6ping University Electronic Press, 41\u201356."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-2139"},{"key":"e_1_3_2_22_2","article-title":"Ethnologue: Languages of the world. 23rd edn. dallas: SIL International","author":"Eberhard David M.","year":"2020","unstructured":"David M. Eberhard, Gary F. Simons, and Charles D. Fennig. 2020. Ethnologue: Languages of the world. 23rd edn. dallas: SIL International. Retrieved from https:\/\/www.ethnologue.com","journal-title":"R"},{"issue":"23","key":"e_1_3_2_23_2","first-page":"3412","article-title":"Classifying arabic text using deep learning","volume":"97","author":"GALAL MOHAMED","year":"2019","unstructured":"MOHAMED GALAL, MAGDA M. MADBOULY, and ADEL EL-ZOGHBY. 2019. Classifying arabic text using deep learning. Journal of Theoretical and Applied Information Technology 97, 23 (2019), 3412\u20133422.","journal-title":"Journal of Theoretical and Applied Information Technology"},{"key":"e_1_3_2_24_2","first-page":"1","volume-title":"Proceedings of the 2019 International Conference on Advances in Computing, Communication and Control.","author":"Gashaw Ibrahim","year":"2019","unstructured":"Ibrahim Gashaw and HL Shashirekha. 2019. Enhanced amharic-arabic cross-language information retrieval system using part of speech tagging. In Proceedings of the 2019 International Conference on Advances in Computing, Communication and Control.IEEE, 1\u20137."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.169"},{"key":"e_1_3_2_26_2","unstructured":"Gregory Grefenstette. 2001. Text summarization using part-of-speech. Date of Patent Sep. 11 2001 US Patent 6 289 304."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-017-9566-2"},{"key":"e_1_3_2_28_2","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980 [cs. LG]. Retrieved from https:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_3_2_29_2","first-page":"926","volume-title":"Proceedings of the IEEE International Symposium on Communications and Information Technology","author":"Kruengkrai Canasai","year":"2005","unstructured":"Canasai Kruengkrai, Prapass Srichaivattana, Virach Sornlertlamvanich, and Hitoshi Isahara. 2005. Language identification based on string kernels. In Proceedings of the IEEE International Symposium on Communications and Information Technology. IEEE, 926\u2013929."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2480362.2480535"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.11236"},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Minh-Thang Luong Hieu Pham and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. arXiv:1508.04025 [cs.CL]. Retrieved from https:\/\/arxiv.org\/abs\/1508.04025","DOI":"10.18653\/v1\/D15-1166"},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","unstructured":"Nora Madi and Hend S. Al-Khalifa. 2018. A proposed Arabic grammatical error detection tool based on deep learning. Elsevier Procedia Computer Science 142 (2018) 352\u2013355.","DOI":"10.1016\/j.procs.2018.10.482"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.5555\/1040196.1040208"},{"issue":"5","key":"e_1_3_2_35_2","doi-asserted-by":"crossref","first-page":"2744","DOI":"10.1007\/s00034-019-01286-9","article-title":"A new time\u2013frequency attention tensor network for language identification","volume":"39","author":"Miao Xiaoxiao","year":"2020","unstructured":"Xiaoxiao Miao, Ian McLoughlin, and Yonghong Yan. 2020. A new time\u2013frequency attention tensor network for language identification. Circuits, Systems, and Signal Processing 39, 5 (2020), 2744\u20132758.","journal-title":"Circuits, Systems, and Signal Processing"},{"issue":"01","key":"e_1_3_2_36_2","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1080\/09296170500500694","article-title":"Language identification from small text samples","volume":"13","author":"Murthy Kavi Narayana","year":"2006","unstructured":"Kavi Narayana Murthy and G. Bharadwaja Kumar. 2006. Language identification from small text samples. Journal of Quantitative Linguistics 13, 01 (2006), 57\u201380.","journal-title":"Journal of Quantitative Linguistics"},{"key":"e_1_3_2_37_2","unstructured":"Seppo Mustonen. 1965. Multiple discriminant analysis in linguistic problems. Statistical Methods in Linguistics 4 (1965) 37\u201344."},{"key":"e_1_3_2_38_2","unstructured":"Bharath Ramsundar Steven Kearnes Patrick Riley Dale Webster David Konerding and Vijay Pande. 2015. Massively multitask networks for drug discovery. arXiv:1502.02072 [stat.ML] Retrieved from https:\/\/arxiv.org\/abs\/1502.02072"},{"key":"e_1_3_2_39_2","first-page":"11","volume-title":"Proceedings of the Language Identification Using Excitation Source Features","author":"Rao K. Sreenivasa","year":"2015","unstructured":"K. Sreenivasa Rao and Dipanjan Nandi. 2015. Language identification\u2014a brief review. In Proceedings of the Language Identification Using Excitation Source Features. Springer, 11\u201330."},{"key":"e_1_3_2_40_2","volume-title":"AUTOMATIC IDENTIFICATION OF MAJOR ETHIOPIAN LANGUAGES (Master\u2019s thesis)","author":"Tadesse Biruk","year":"2018","unstructured":"Biruk Tadesse. 2018. AUTOMATIC IDENTIFICATION OF MAJOR ETHIOPIAN LANGUAGES (Master\u2019s thesis). Master\u2019s thesis. school of Computing, Bahir Dar Institute of Technology, Bahir Dar, Ethiopia."},{"key":"e_1_3_2_41_2","first-page":"27","volume-title":"Proceedings of the 20th Machine Learning Conference of Belgium and the Netherlands","author":"Tromp Erik","year":"2011","unstructured":"Erik Tromp and Mykola Pechenizkiy. 2011. Graph-based n-gram language identification on short texts. In Proceedings of the 20th Machine Learning Conference of Belgium and the Netherlands. 27\u201334."},{"key":"e_1_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Mohd Usama Belal Ahmad Enmin Song M. Shamim Hossain Mubarak Alrashoud and Ghulam Muhammad. 2020. Attention-based sentiment analysis using convolutional and recurrent neural networks. Elsevier Future Generation Computer Systems 113 (2020) 571\u2013578.","DOI":"10.1016\/j.future.2020.07.022"},{"key":"e_1_3_2_43_2","first-page":"498","volume-title":"Proceedings of the ICAART 1, (2011),","author":"Winkelmolen Fela","year":"2011","unstructured":"Fela Winkelmolen and Viviana Mascardi. 2011. Statistical language identification of short texts.. In Proceedings of the ICAART 1, (2011),498\u2013503."},{"key":"e_1_3_2_44_2","volume-title":"Modeling Text Language Identification for Ethiopian Cushitic Languages (Master\u2019s Thesis)","author":"Wodajo Legesse","year":"2014","unstructured":"Legesse Wodajo. 2014. Modeling Text Language Identification for Ethiopian Cushitic Languages (Master\u2019s Thesis). Master\u2019s thesis. HiLCoE School of computer Science, Addis Ababa, Ethiopia."},{"issue":"3","key":"e_1_3_2_45_2","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1007\/s00607-019-00766-9","article-title":"Chinese text classification based on attention mechanism and feature-enhanced fusion neural network","volume":"102","author":"Xie Jinbao","year":"2020","unstructured":"Jinbao Xie, Yongjin Hou, Yujing Wang, Qingyan Wang, Baiwei Li, Shiwei Lv, and Yury I Vorotnitsky. 2020. Chinese text classification based on attention mechanism and feature-enhanced fusion neural network. Computing 102, 3 (2020), 683\u2013700.","journal-title":"Computing"},{"key":"e_1_3_2_46_2","unstructured":"Yu Zhang and Qiang Yang. 2017. A survey on multi-task learning. arXiv:1707.08114 [cs. LG]. Retrieved from https:\/\/arxiv.org\/abs\/1707.08114"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/1946943.1947054"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3630607","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3630607","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:32Z","timestamp":1750178192000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3630607"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,19]]},"references-count":46,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2023,12,31]]}},"alternative-id":["10.1145\/3630607"],"URL":"https:\/\/doi.org\/10.1145\/3630607","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,19]]},"assertion":[{"value":"2022-01-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-22","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}