{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,21]],"date-time":"2025-12-21T06:23:32Z","timestamp":1766298212087,"version":"3.41.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,11,29]],"date-time":"2021-11-29T00:00:00Z","timestamp":1638144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2022,1,31]]},"abstract":"<jats:p>This work presents a detailed comparison of the performance of deep learning models such as convolutional neural networks, long short-term memory, gated recurrent units, their hybrids, and a selection of shallow learning classifiers for sentiment analysis of Arabic reviews. Additionally, the comparison includes state-of-the-art models such as the transformer architecture and the araBERT pre-trained model. The datasets used in this study are multi-dialect Arabic hotel and book review datasets, which are some of the largest publicly available datasets for Arabic reviews. Results showed deep learning outperforming shallow learning for binary and multi-label classification, in contrast with the results of similar work reported in the literature. This discrepancy in outcome was caused by dataset size as we found it to be proportional to the performance of deep learning models. The performance of deep and shallow learning techniques was analyzed in terms of accuracy and F1 score. The best performing shallow learning technique was Random Forest followed by Decision Tree, and AdaBoost. The deep learning models performed similarly using a default embedding layer, while the transformer model performed best when augmented with araBERT.<\/jats:p>","DOI":"10.1145\/3466171","type":"journal-article","created":{"date-parts":[[2021,11,29]],"date-time":"2021-11-29T23:43:17Z","timestamp":1638229397000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Empirical Evaluation of Shallow and Deep Learning Classifiers for Arabic Sentiment Analysis"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1570-0897","authenticated-orcid":false,"given":"Ali Bou","family":"Nassif","sequence":"first","affiliation":[{"name":"Computer Engineering Department, University of Sharjah, Sharjah, UAE"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4263-2041","authenticated-orcid":false,"given":"Abdollah Masoud","family":"Darya","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, University of Sharjah, Sharjah, UAE"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashraf","family":"Elnagar","sequence":"additional","affiliation":[{"name":"Computer Science Department, University of Sharjah, Sharjah, UAE"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,11,29]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2018.07.006"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocs.2017.11.011"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCSE1.2018.8374211"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70096-0_51"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3086575"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-3202"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocs.2017.11.006"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-99740-7_12"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3009217"},{"issue":"3","key":"e_1_3_3_11_2","first-page":"20","article-title":"Sentiment analysis of Iraqi Arabic dialect on Facebook based on distributed representations of documents","volume":"18","author":"Alnawas Anwar","year":"2019","unstructured":"Anwar Alnawas and Nursal Arici. 2019. Sentiment analysis of Iraqi Arabic dialect on Facebook based on distributed representations of documents. ACM Transactions on Asian and Low-Resource Language Information Processing 18, 3 (2019), 20.","journal-title":"ACM Transactions on Asian and Low-Resource Language Information Processing"},{"issue":"3","key":"e_1_3_3_12_2","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","article-title":"An introduction to kernel and nearest-neighbor nonparametric regression","volume":"46","author":"Altman Naomi S.","year":"1992","unstructured":"Naomi S. Altman. 1992. An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician 46, 3 (1992), 175\u2013185.","journal-title":"The American Statistician"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2017.8258460"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-3203"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3295662"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3623"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S18-1036"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404854"},{"key":"e_1_3_3_19_2","first-page":"9","volume-title":"Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection","author":"Baly Fady","year":"2020","unstructured":"Fady Baly, Hazem Hajj, and Wissam Antoun. 2020. AraBERT: Transformer-based model for Arabic language understanding. In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection. 9\u201315."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1314"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2099"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3086576"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3360016"},{"key":"e_1_3_3_24_2","article-title":"Sentiment analysis in Arabic: A review of the literature","author":"Boudad Naaima","year":"2017","unstructured":"Naaima Boudad, Rdouan Faizi, Rachid Oulad Haj Thami, and Raddouane Chiheb. 2017. Sentiment analysis in Arabic: A review of the literature. Ain Shams Engineering Journal 9 (2017), 2479\u20132490. DOI:https:\/\/doi.org\/10.1016\/j.asej.2017.04.007","journal-title":"Ain Shams Engineering Journal"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_3_26_2","unstructured":"Kyunghyun Cho Bart Van Merri\u00ebnboer Dzmitry Bahdanau and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. In Proceedings of the Eighth Workshop on Syntax Semantics and Structure in Statistical Translation (SSST-8\u201914) ."},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143874"},{"key":"e_1_3_3_28_2","unstructured":"Jacob Devlin Ming-Wei Chang Kenton Lee and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT . 4171\u20134186."},{"key":"e_1_3_3_29_2","article-title":"Deep learning for aspect-based sentiment analysis: A comparative review","author":"Dohaiha Hai Ha","year":"2019","unstructured":"Hai Ha Dohaiha, P. W. C. Prasad, Angelika Maag, and Abeer Alsadoon. 2019. Deep learning for aspect-based sentiment analysis: A comparative review. Expert Systems with Applications 118 (2019), 272\u2013299.","journal-title":"Expert Systems with Applications"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dib.2019.104076"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-4608"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/AICCSA.2016.7945623"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102121"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/AICCSA.2016.7945800"},{"key":"e_1_3_3_35_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/978-3-319-67056-0_3","volume-title":"Intelligent Natural Language Processing: Trends and Applications","author":"Elnagar Ashraf","year":"2018","unstructured":"Ashraf Elnagar, Yasmin S. Khalifa, and Anas Einea. 2018. Hotel Arabic-reviews dataset construction for sentiment analysis applications. In Intelligent Natural Language Processing: Trends and Applications. K. Shaalan, A. Hassanien, F. Tolba (Eds.), Studies in Computational Intelligence, Vol. 740, Springer, 35\u201352."},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2018.10.474"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3059504"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"e_1_3_3_39_2","first-page":"148","volume-title":"Proceedings of the 13th International Conference on International Conference on Machine Learning","volume":"96","author":"Freund Yoav","year":"1996","unstructured":"Yoav Freund and Robert E. Schapire. 1996. Experiments with a new boosting algorithm. In Proceedings of the 13th International Conference on International Conference on Machine Learning. Vol. 96, Citeseer, 148\u2013156."},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/52.1-2.203"},{"key":"e_1_3_3_41_2","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation","author":"Grave Edouard","year":"2018","unstructured":"Edouard Grave, Piotr Bojanowski, Prakhar Gupta, Armand Joulin, and Tomas Mikolov. 2018. Learning word vectors for 157 languages. In Proceedings of the International Conference on Language Resources and Evaluation."},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2016.2582924"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209885"},{"issue":"65","key":"e_1_3_3_44_2","first-page":"11","article-title":"Bridging long time lags by weight guessing and \u201cLong Short-Term Memory\u201d","volume":"37","author":"Hochreiter Sepp","year":"1996","unstructured":"Sepp Hochreiter and Jurgen Schmidhuber. 1996. Bridging long time lags by weight guessing and \u201cLong Short-Term Memory\u201d. Spatiotemporal Models in Biological and Artificial Systems 37, 65\u201372 (1996), 11.","journal-title":"Spatiotemporal Models in Biological and Artificial Systems"},{"key":"e_1_3_3_45_2","first-page":"2342","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Jozefowicz Rafal","year":"2015","unstructured":"Rafal Jozefowicz, Wojciech Zaremba, and Ilya Sutskever. 2015. An empirical exploration of recurrent network architectures. In Proceedings of the International Conference on Machine Learning. 2342\u20132350."},{"key":"e_1_3_3_46_2","first-page":"1","article-title":"EnSWF: Effective features extraction and selection in conjunction with ensemble learning methods for document sentiment classification","author":"Khan Jawad","year":"2019","unstructured":"Jawad Khan, Aftab Alam, Jamil Hussain, and Young-Koo Lee. 2019. EnSWF: Effective features extraction and selection in conjunction with ensemble learning methods for document sentiment classification. Applied Intelligence 49, 8 (2019), 1\u201323.","journal-title":"Applied Intelligence"},{"key":"e_1_3_3_47_2","doi-asserted-by":"crossref","unstructured":"Yoon Kim. 2014. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP\u201914) . Association for Computational Linguistics 1746\u20131751.","DOI":"10.3115\/v1\/D14-1181"},{"key":"e_1_3_3_48_2","first-page":"21","volume-title":"Proceedings of the 1988 Connectionist Models Summer School","volume":"1","author":"LeCun Yann","year":"1988","unstructured":"Yann LeCun, D. Touresky, G. Hinton, and T. Sejnowski. 1988. A theoretical framework for back-propagation. In Proceedings of the 1988 Connectionist Models Summer School. Vol. 1, Morgan Kaufmann, 21\u201328."},{"key":"e_1_3_3_49_2","article-title":"How textual quality of online reviews affect classification performance: A case of deep learning sentiment analysis","author":"Li Lin","year":"2020","unstructured":"Lin Li, Tiong-Thye Goh, and Dawei Jin. 2020. How textual quality of online reviews affect classification performance: A case of deep learning sentiment analysis. Neural Computing and Applications 32, 9 (2020), 4387\u20134415.","journal-title":"Neural Computing and Applications"},{"issue":"3","key":"e_1_3_3_50_2","first-page":"18","article-title":"Classification and regression by randomForest","volume":"2","author":"Liaw Andy","year":"2002","unstructured":"Andy Liaw and Matthew Wiener. 2002. Classification and regression by randomForest. R news 2, 3 (2002), 18\u201322.","journal-title":"R news"},{"key":"e_1_3_3_51_2","first-page":"11","article-title":"A survey of deep neural network architectures and their applications","volume":"100","author":"Liu Weibo","year":"2017","unstructured":"Weibo Liu, Zidong Wang, Xiaohui Liu, Nianyin Zeng, Yurong Liu, and Fuad E. Alsaadi. 2017. A survey of deep neural network architectures and their applications. Neurocomputing 100, 234 (2017), 11\u201326.","journal-title":"Neurocomputing"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2018.10.489"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.03.004"},{"key":"e_1_3_3_54_2","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. In Proceedings of the International Conference on Learning Representations (ICLR\u201913) ."},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S18-1001"},{"key":"e_1_3_3_56_2","first-page":"106836","article-title":"Deep learning for Arabic subjective sentiment analysis: Challenges and research opportunities","author":"Nassif Ali Bou","year":"2020","unstructured":"Ali Bou Nassif, Ashraf Elnagar, Ismail Shahin, and Safaa Henno. 2020. Deep learning for Arabic subjective sentiment analysis: Challenges and research opportunities. Applied Soft Computing 98 (2020), 106836. DOI:https:\/\/doi.org\/10.1016\/j.asoc.2020.106836","journal-title":"Applied Soft Computing"},{"key":"e_1_3_3_57_2","article-title":"What Data Scientists Should Know about Deep Learning","author":"Ng Andrew","year":"2015","unstructured":"Andrew Ng. 2015. What Data Scientists Should Know about Deep Learning. Retrieved on 22 March, 2021 from https:\/\/www.slideshare.net\/ExtractConf.","journal-title":"https:\/\/www.slideshare.net\/ExtractConf"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_3_59_2","volume-title":"Perceptrons and the Theory of Brain Mechanisms: Cornell Aeronautical Laboratory","author":"Rosenblatt F.","year":"1960","unstructured":"F. Rosenblatt. 1960. Perceptrons and the Theory of Brain Mechanisms: Cornell Aeronautical Laboratory. Technical Report. Report No. VG-1196-G-8."},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/21.97458"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2014.09.003"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/CTS.2012.6261103"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-018-1334-8"},{"key":"e_1_3_3_64_2","first-page":"5998","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 5998\u20136008."}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3466171","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3466171","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:52Z","timestamp":1750195492000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3466171"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,29]]},"references-count":63,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1,31]]}},"alternative-id":["10.1145\/3466171"],"URL":"https:\/\/doi.org\/10.1145\/3466171","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2021,11,29]]},"assertion":[{"value":"2020-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}