{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T16:35:46Z","timestamp":1781109346820,"version":"3.54.1"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,10,31]],"date-time":"2021-10-31T00:00:00Z","timestamp":1635638400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Information and Communication Technology Division"},{"name":"Ministry of Posts, Telecommunications and Information Technology of the Government of the People\u2019s Republic of Bangladesh"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2022,3,31]]},"abstract":"<jats:p>\n            Sentiment Analysis (SA) is a Natural Language Processing (NLP) and an Information Extraction (IE) task that primarily aims to obtain the writer\u2019s feelings expressed in positive or negative by analyzing a large number of documents. SA is also widely studied in the fields of data mining, web mining, text mining, and information retrieval. The fundamental task in sentiment analysis is to classify the polarity of a given content as\n            <jats:italic>Positive, Negative,<\/jats:italic>\n            or\n            <jats:italic>Neutral<\/jats:italic>\n            . Although extensive research has been conducted in this area of computational linguistics, most of the research work has been carried out in the context of English language. However, Bengali sentiment expression has varying degree of sentiment labels, which can be plausibly distinct from English language. Therefore, sentiment assessment of Bengali language is undeniably important to be developed and executed properly. In sentiment analysis, the prediction potential of an automatic modeling is completely dependent on the quality of dataset annotation. Bengali sentiment annotation is a challenging task due to diversified structures (syntax) of the language and its different degrees of innate sentiments (i.e., weakly and strongly positive\/negative sentiments). Thus, in this article, we propose a novel and precise guideline for the researchers, linguistic experts, and referees to annotate Bengali sentences immaculately with a view to building effective datasets for automatic sentiment prediction efficiently.\n          <\/jats:p>","DOI":"10.1145\/3474363","type":"journal-article","created":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T00:44:30Z","timestamp":1635727470000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["A Comprehensive Guideline for Bengali Sentiment Annotation"],"prefix":"10.1145","volume":"21","author":[{"given":"Md. Saddam Hossain","family":"Mukta","sequence":"first","affiliation":[{"name":"Giga Tech Limited and United International University, Dhaka, Bangladesh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Md. Adnanul","family":"Islam","sequence":"additional","affiliation":[{"name":"Giga Tech Limited and Military Institute of Science and Technology, Dhaka, Bangladesh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Faisal Ahamed","family":"Khan","sequence":"additional","affiliation":[{"name":"Giga Tech Limited, Dhaka, Bangladesh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Afjal","family":"Hossain","sequence":"additional","affiliation":[{"name":"Giga Tech Limited, Dhaka, Bangladesh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuvanon","family":"Razik","sequence":"additional","affiliation":[{"name":"Giga Tech Limited, Dhaka, Bangladesh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shazzad","family":"Hossain","sequence":"additional","affiliation":[{"name":"Giga Tech Limited and United International University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jalal","family":"Mahmud","sequence":"additional","affiliation":[{"name":"IBM Almaden Research Center, San Jose, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,10,31]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Firoj Alam Hassan Sajjad Muhammad Imran and Ferda Ofli. 2020. Standardizing and benchmarking crisis-related social media datasets for humanitarian information processing. arXiv abs\/2004.06774 (2020) 1\u201317."},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","unstructured":"Firoj Alam Shaden Shaar Alex Nikolov Hamdy Mubarak Giovanni Da San Martino Ahmed Abdelali Fahim Dalvi Nadir Durrani Hassan Sajjad Kareem Darwish and Preslav Nakov. 2020. Fighting the COVID-19 infodemic: Modeling the perspective of journalists fact-checkers social media platforms policymakers and the society. arXiv abs\/2005.00033 (2020) 1\u201339.","DOI":"10.18653\/v1\/2021.findings-emnlp.56"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.5555\/1776334.1776363"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","unstructured":"Md. Saidul Hoque Anik Md. Adnanul Islam and A. B. M. Alim AlIslam. 2018. An approach towards multilingual translation bysemantic-based verb identification and root word analysis. In Proceedings of the 2018 5th International Conference on Networking Systems and Security. IEEE 1\u20139. DOI: https:\/\/doi.org\/10.1109\/NSysS.2018.8631383","DOI":"10.1109\/NSysS.2018.8631383"},{"key":"e_1_3_2_6_2","first-page":"452","volume-title":"Proceedings of the 2016 3rd International Conference on Computing for Sustainable Global Development","author":"Bakshi Rushlene Kaur","year":"2016","unstructured":"Rushlene Kaur Bakshi, Navneet Kaur, Ravneet Kaur, and Gurpreet Kaur. 2016. Opinion mining and sentiment analysis. In Proceedings of the 2016 3rd International Conference on Computing for Sustainable Global Development. IEEE, 452\u2013455."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASERT.2019.8934481"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5202"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.5555\/2832747.2832832"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIEV.2014.6850712"},{"key":"e_1_3_2_11_2","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and KristinaToutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. InProceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 4171\u20134186. DOI: https:\/\/doi.org\/10.18653\/v1\/N19-1423"},{"key":"e_1_3_2_12_2","first-page":"76","volume-title":"Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities","author":"Castilho Richard Eckart de","year":"2016","unstructured":"Richard Eckart de Castilho, \u00c9va M\u00fajdricza-Maydt, Seid MuhieYimam, Silvana Hartmann, Iryna Gurevych, Anette Frank, and Chris Biemann. 2016. A web-based tool for the integrated annotation of semantic and syntactic structures. In Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities. The COLING 2016 Organizing Committee, 76\u201384."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3362966.3362977"},{"key":"e_1_3_2_14_2","volume-title":"Proceedings of the 5th International Conference on Language Resources and Evaluation","author":"Esuli Andrea","year":"2006","unstructured":"Andrea Esuli and Fabrizio Sebastiani. 2006. SENTIWORDNET: A publicly available lexical resource for opinion mining. In Proceedings of the 5th International Conference on Language Resources and Evaluation. European Language Resources Association."},{"issue":"3","key":"e_1_3_2_15_2","first-page":"334","article-title":"Adapting rule based machine translation from english to bangla","volume":"2","author":"Francisca Judith","year":"2011","unstructured":"Judith Francisca, Md Mamun Mia, and S. M. Monzurur Rahman. 2011. Adapting rule based machine translation from english to bangla. Indian Journal of Computer Science and Engineering 2, 3 (2011), 334\u2013342.","journal-title":"Indian Journal of Computer Science and Engineering"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.14198\/raei.1998.11.11"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSSIT48917.2020.9214196"},{"key":"e_1_3_2_18_2","unstructured":"Dan Hendrycks and Kevin Gimpel. 2016. Bridging nonlinearities and stochastic regularizers with gaussian error linear units. arXiv abs\/1606.08415 (2016) 1\u20137."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/1014052.1014073"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/1014052.1014073"},{"key":"e_1_3_2_21_2","unstructured":"Md. Adnanul Islam and A. B. M. Alim Al Islam. 2016. Polygot: Going beyond database driven and syntax-based translation. Association for Computing Machinery New York NY Article 28 4 pages."},{"key":"e_1_3_2_22_2","first-page":"1","article-title":"Towards achieving a delicate blending between rule-based translator and neural machine translator","author":"Islam Md. Adnanul","year":"2021","unstructured":"Md. Adnanul Islam, A. B. M. Alim Al Islam, and Md. Saidul Hoque Anik. 2021. Towards achieving a delicate blending between rule-based translator and neural machine translator. Neural Computing and Applications 33, 18 (2021), 1\u201327.","journal-title":"Neural Computing and Applications"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.4304\/jetwi.5.4.367-371"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338244"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1095"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.2200\/S00416ED1V01Y201204HLT016"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-3223-4_13"},{"key":"e_1_3_2_28_2","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. arXiv abs\/1907.11692 (2019) 1\u201313."},{"key":"e_1_3_2_29_2","unstructured":"Ilya Loshchilov and Frank Hutter. 2017. Fixing weight decay regularization in adam. arXiv abs\/1711.05101 (2017) 1\u201314."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.5555\/2002472.2002491"},{"key":"e_1_3_2_31_2","first-page":"121","volume-title":"Proceedings of the 22nd Nordic Conference on Computational Linguistics Link\u00f6ping Electronic Conference","author":"M\u00e6hlum Petter","year":"2019","unstructured":"Petter M\u00e6hlum, Jeremy Claude Barnes, Lilja \u00d8vrelid,and Erik Velldal. 2019. Annotating evaluative sentences for sentiment analysis: A dataset for Norwegian. In Proceedings of the 22nd Nordic Conference on Computational Linguistics Link\u00f6ping Electronic Conference. Link\u00f6ping University Electronic Press, 121\u2013130."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5010"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2012.031"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-0429"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.2012.00460.x"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2014.09.003"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","unstructured":"Igor Mozetic Miha Grcar and Jasmina Smailovic. 2016. Multilingual twitter sentiment classification: The role of human annotators. PLOS ONE 11 5 (2016) 1\u201326.","DOI":"10.1371\/journal.pone.0155036"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13278-016-0383-4"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1075\/li.30.1.03nad"},{"key":"e_1_3_2_40_2","volume-title":"Proceedings of the 7th International Conference on Language Resources and Evaluation","author":"Pak Alexander","year":"2010","unstructured":"Alexander Pak and Patrick Paroubek. 2010. Twitter as a corpus for sentiment analysis and opinion mining. In Proceedings of the 7th International Conference on Language Resources and Evaluation. European Language Resources Association."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1493"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2088"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/SYNASC.2015.46"},{"key":"e_1_3_2_44_2","unstructured":"Sagor Sarker. 2020. BanglaBERT: Bengali mask language model for bengali language understading. Retrieved 26 April 2021 from https:\/\/github.com\/sagorbrur\/bangla-bert."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.3390\/su11030917"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1401"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/2140458.2140465"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/1461551.1461583"},{"key":"e_1_3_2_49_2","first-page":"172","volume-title":"Proceedings of the COLING 2014, 25th International Conference on Computational Linguistics","author":"Tang Duyu","year":"2014","unstructured":"Duyu Tang, Furu Wei, Bing Qin, Ming Zhou, and Ting Liu. 2014. Building large-scale twitter-specific sentiment lexicon: A representation learning approach. In Proceedings of the COLING 2014, 25th International Conference on Computational Linguistics. Dublin City University and Association for Computational Linguistics, 172\u2013182."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.5555\/1858681.1858740"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/CCOMS.2019.8821658"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-015-9297-4"},{"issue":"6","key":"e_1_3_2_53_2","first-page":"282","article-title":"Sentiment analysis and opinion mining: A survey","volume":"2","author":"Vinodhini G.","year":"2012","unstructured":"G. Vinodhini and R. M. Chandrasekaran. 2012. Sentiment analysis and opinion mining: A survey. International Journal of Advanced Research in Computer Science and Software Engineering 2, 6 (2012), 282\u2013292.","journal-title":"International Journal of Advanced Research in Computer Science and Software Engineering"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40319-4_18"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220619"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-016-0200-9"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474363","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474363","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:26Z","timestamp":1750188626000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474363"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,31]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3,31]]}},"alternative-id":["10.1145\/3474363"],"URL":"https:\/\/doi.org\/10.1145\/3474363","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,31]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}