{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T23:03:11Z","timestamp":1785538991704,"version":"3.56.0"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"11","license":[{"start":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T00:00:00Z","timestamp":1700265600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:p>\n            We propose a new approach for Arabic Word Sense Disambiguation (AWSD) by hybridization of single-layer Convolutional Neural Network (CNN) with contextual representation (BERT). WSD is the task of automatically detecting the correct meaning of a word used in a given context. WSD can be performed as a classification task, and the context is generally a short sentence. Kim [\n            <jats:xref ref-type=\"bibr\">26<\/jats:xref>\n            ] proved that combining a CNN with an RNN (recurrent neural network) provides a good result for text classification. Here, we use a concatenation of BERT models as a word embedding to get simultaneously the target and context representation. Our approach improves the performance of WSD in Arabic languages. The experimental results show that our model outperforms the state-of-the-art approaches and improves the accuracy of 96.42% on the Arabic WordNet dataset.\n          <\/jats:p>","DOI":"10.1145\/3623379","type":"journal-article","created":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T11:55:10Z","timestamp":1694087710000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Stacking of BERT and CNN Models for Arabic Word Sense Disambiguation"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0798-4834","authenticated-orcid":false,"given":"Rakia","family":"Saidi","sequence":"first","affiliation":[{"name":"LIMTIC Laboratory - UTM University, Tunisia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2007-2645","authenticated-orcid":false,"given":"Fethi","family":"Jarray","sequence":"additional","affiliation":[{"name":"Higher Institute of Computer Science of Medenine Gabes University; LIMTIC Laboratory - UTM University, Tunisia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,11,18]]},"reference":[{"issue":"1","key":"e_1_3_2_2_2","first-page":"5","article-title":"Arabic word sense disambiguation with conceptual density for information retrieval","volume":"6","author":"Abderrahim M. Alaeddine","year":"2018","unstructured":"M. Alaeddine Abderrahim and M. El Amine Abderrahim. 2018. Arabic word sense disambiguation with conceptual density for information retrieval. Models and Optimisation and Mathematical Analysis Journal 6, 1 (2018), 5\u20139.","journal-title":"Models and Optimisation and Mathematical Analysis Journal"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510451"},{"key":"e_1_3_2_4_2","article-title":"ARBERT & MARBERT: Deep bidirectional transformers for Arabic","author":"Abdul-Mageed Muhammad","year":"2020","unstructured":"Muhammad Abdul-Mageed, AbdelRahim Elmadany, and El Moatez Billah Nagoudi. 2020. ARBERT & MARBERT: Deep bidirectional transformers for Arabic. arXiv preprint arXiv:2101.01785 (2020).","journal-title":"arXiv preprint arXiv:2101.01785"},{"key":"e_1_3_2_5_2","first-page":"00071","volume-title":"MATEC Web of Conferences","volume":"135","author":"Abood Rehab Hasan","year":"2017","unstructured":"Rehab Hasan Abood and Sabrina Tiun. 2017. A comparative study of open-domain and specific-domain word sense disambiguation based on Quranic information retrieval. In MATEC Web of Conferences, Vol. 135. EDP Sciences, 00071."},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","unstructured":"Moustafa Al-Hajj and Mustafa Jarrar. 2021. ArabGlossBERT: Fine-tuning BERT on context-gloss pairs for WSD. (2021).","DOI":"10.26615\/978-954-452-072-4_005"},{"issue":"3","key":"e_1_3_2_7_2","doi-asserted-by":"crossref","first-page":"116","DOI":"10.14445\/22312803\/IJCTT-V30P121","article-title":"Extract the semantic meaning of prepositions at Arabic texts: An exploratory study","volume":"30","author":"Al-Maghasbeh Mohammad Khaled A.","year":"2015","unstructured":"Mohammad Khaled A. Al-Maghasbeh and M. P. Bin Hamzah. 2015. Extract the semantic meaning of prepositions at Arabic texts: An exploratory study. Int. J. Comput. Trends Technol. 30, 3 (2015), 116\u2013120.","journal-title":"Int. J. Comput. Trends Technol."},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","unstructured":"Israa Alghanmi Luis Espinosa-Anke and Steven Schockaert. 2020. Combining BERT with static word embeddings for categorizing social media. (2020).","DOI":"10.18653\/v1\/2020.wnut-1.5"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10772-016-9376-y"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2018.10.460"},{"key":"e_1_3_2_11_2","article-title":"AraBERT: Transformer-based model for Arabic language understanding","author":"Antoun Wissam","year":"2020","unstructured":"Wissam Antoun, Fady Baly, and Hazem Hajj. 2020. AraBERT: Transformer-based model for Arabic language understanding. arXiv preprint arXiv:2003.00104 (2020).","journal-title":"arXiv preprint arXiv:2003.00104"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJMSO.2015.073880"},{"issue":"4","key":"e_1_3_2_13_2","first-page":"381","article-title":"Word sense disambiguation approach for Arabic text","volume":"7","author":"Bouhriz Nadia","year":"2016","unstructured":"Nadia Bouhriz, Faouzia Benabbou, and E. H. Ben Lahmar. 2016. Word sense disambiguation approach for Arabic text. International Journal of Advanced Computer Science and Applications 7, 4 (2016), 381\u2013385.","journal-title":"International Journal of Advanced Computer Science and Applications"},{"issue":"6","key":"e_1_3_2_14_2","first-page":"473","article-title":"Organizing contextual knowledge for Arabic text disambiguation and terminology extraction","volume":"38","author":"Bounhas Ibrahim","year":"2011","unstructured":"Ibrahim Bounhas, Bilel Elayeb, Fabrice Evrard, and Yahya Slimani. 2011. Organizing contextual knowledge for Arabic text disambiguation and terminology extraction. KO Knowledge Organization 38, 6 (2011), 473\u2013490.","journal-title":"KO Knowledge Organization"},{"key":"e_1_3_2_15_2","volume-title":"Convolutional Neural Network for Sentence Classification","author":"Chen Yahui","year":"2015","unstructured":"Yahui Chen. 2015. Convolutional Neural Network for Sentence Classification. Master\u2019s thesis. University of Waterloo."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1007\/978-3-030-88113-9_50","volume-title":"Advances in Computational Collective Intelligence: 13th International Conference, ICCCI 2021","author":"Chouikhi Hasna","year":"2021","unstructured":"Hasna Chouikhi, Hamza Chniter, and Fethi Jarray. 2021. Arabic sentiment analysis using BERT model. In Advances in Computational Collective Intelligence: 13th International Conference, ICCCI 2021. Springer, 621\u2013632."},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","unstructured":"Hasna Chouikhi Hamza Chniter and Fethi Jarray. 2021. Stacking BERT based models for Arabic sentiment analysis. (2021).","DOI":"10.5220\/0010648400003064"},{"key":"e_1_3_2_18_2","volume-title":"Computational Approaches to Semitic Languages","author":"Debili Fathi","year":"1998","unstructured":"Fathi Debili and Hadhemi Achour. 1998. Voyellation automatique de l\u2019arabe. In Computational Approaches to Semitic Languages."},{"key":"e_1_3_2_19_2","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).","journal-title":"arXiv preprint arXiv:1810.04805"},{"key":"e_1_3_2_20_2","volume-title":"Proceedings of the Tenth Conference of Language Engineering (SEOLEC\u20192010), Cairo, Egypt","author":"Eid M. Soha","year":"2010","unstructured":"M. Soha Eid, Almoataz B. Al-Said, Nayer M. Wanas, Mohsen A. Rashwan, and Nadia H. Hegazy. 2010. Comparative study of Rocchio classifier applied to supervised WSD using Arabic lexical samples. In Proceedings of the Tenth Conference of Language Engineering (SEOLEC\u20192010), Cairo, Egypt."},{"key":"e_1_3_2_21_2","article-title":"A comparative study for Arabic word sense disambiguation using document preprocessing and machine learning techniques.","author":"El-Gamml Mohamed M.","year":"2011","unstructured":"Mohamed M. El-Gamml, M. Waleed Fakhr, Mohsen A. Rashwan, and Almoataz B. Al-Said. 2011. A comparative study for Arabic word sense disambiguation using document preprocessing and machine learning techniques. ALTIC, Alexandria, Egypt (2011).","journal-title":"ALTIC, Alexandria, Egypt"},{"issue":"2","key":"e_1_3_2_22_2","article-title":"Using fuzzifiers to solve word sense ambiguation in Arabic language","volume":"79","author":"El-Gedawy Madeeh Nayer","year":"2013","unstructured":"Madeeh Nayer El-Gedawy. 2013. Using fuzzifiers to solve word sense ambiguation in Arabic language. International Journal of Computer Applications 79, 2 (2013).","journal-title":"International Journal of Computer Applications"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.3390\/app11062567"},{"key":"e_1_3_2_24_2","first-page":"16","volume-title":"Proceeding of the 6th International Conference on Informatics and Systems","author":"Elmougy Samir","year":"2008","unstructured":"Samir Elmougy, H. Taher, and H. Noaman. 2008. Na\u00efve Bayes classifier for Arabic word sense disambiguation. In Proceeding of the 6th International Conference on Informatics and Systems. Citeseer, 16\u201321."},{"issue":"1","key":"e_1_3_2_25_2","first-page":"215","article-title":"Word sense disambiguation for Arabic text categorization.","volume":"13","author":"Hadni Meryeme","year":"2016","unstructured":"Meryeme Hadni, Sa\u00efd El Alaoui Ouatik, and Abdelmonaime Lachkar. 2016. Word sense disambiguation for Arabic text categorization. Int. Arab J. Inf. Technol. 13, 1A (2016), 215\u2013222.","journal-title":"Int. Arab J. Inf. Technol."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-020-10183-2"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1181"},{"key":"e_1_3_2_28_2","first-page":"308","volume-title":"International Conference on Applications of Natural Language to Information Systems","author":"Laatar Rim","year":"2018","unstructured":"Rim Laatar, Chafik Aloulou, and Lamia Hadrich Belghuith. 2018. Word2vec for Arabic word sense disambiguation. In International Conference on Applications of Natural Language to Information Systems. Springer, 308\u2013311."},{"key":"e_1_3_2_29_2","article-title":"How language-neutral is multilingual BERT?","author":"Libovick\u1ef3 Jind\u0159ich","year":"2019","unstructured":"Jind\u0159ich Libovick\u1ef3, Rudolf Rosa, and Alexander Fraser. 2019. How language-neutral is multilingual BERT? arXiv preprint arXiv:1911.03310 (2019).","journal-title":"arXiv preprint arXiv:1911.03310"},{"key":"e_1_3_2_30_2","article-title":"Combining pre-trained word embeddings and linguistic features for sequential metaphor identification","author":"Mao Rui","year":"2021","unstructured":"Rui Mao, Chenghua Lin, and Frank Guerin. 2021. Combining pre-trained word embeddings and linguistic features for sequential metaphor identification. arXiv preprint arXiv:2104.03285 (2021).","journal-title":"arXiv preprint arXiv:2104.03285"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2014.06.021"},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1109\/SNPD.2012.38","volume-title":"2012 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing","author":"Menai Mohamed El Bachir","year":"2012","unstructured":"Mohamed El Bachir Menai and Wojdan Alsaeedan. 2012. Genetic algorithm for Arabic word sense disambiguation. In 2012 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing. IEEE, 195\u2013200."},{"key":"e_1_3_2_33_2","first-page":"1","volume-title":"Fourth International Conference on Information and Communication Technology and Accessibility (ICTA)","author":"Merhbene Laroussi","year":"2013","unstructured":"Laroussi Merhbene, Anis Zouaghi, and Mounir Zrigui. 2013. An experimental study for some supervised lexical disambiguation methods of Arabic language. In Fourth International Conference on Information and Communication Technology and Accessibility (ICTA). IEEE, 1\u20136."},{"key":"e_1_3_2_34_2","first-page":"1027","volume-title":"Proceedings of the Sixth International Joint Conference on Natural Language Processing","author":"Merhbene Laroussi","year":"2013","unstructured":"Laroussi Merhbene, Anis Zouaghi, and Mounir Zrigui. 2013. A semi-supervised method for Arabic word sense disambiguation using a weighted directed graph. In Proceedings of the Sixth International Joint Conference on Natural Language Processing. 1027\u20131031."},{"key":"e_1_3_2_35_2","first-page":"235","volume-title":"Proc. 7th Conference on Language Engineering of the Egyptian Society of Language Engineering-ESOLE","author":"Pinto David","year":"2007","unstructured":"David Pinto, Paolo Rosso, Yassine Benajiba, Anas Ahachad, and H\u00e9ctor Jim\u00e9nez-Salazar. 2007. Word sense induction in the Arabic language: A self-term expansion based approach. In Proc. 7th Conference on Language Engineering of the Egyptian Society of Language Engineering-ESOLE. Citeseer, 235\u2013245."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.semeval-1.271"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1007\/978-3-030-96308-8_63","volume-title":"International Conference on Intelligent Systems Design and Applications","author":"Saidi Rakia","year":"2022","unstructured":"Rakia Saidi and Fethi Jarray. 2022. Combining Bert representation and POS tagger for Arabic word sense disambiguation. In International Conference on Intelligent Systems Design and Applications. Springer, 676\u2013685."},{"key":"e_1_3_2_38_2","first-page":"655","volume-title":"OTM Confederated International Conferences \u201cOn the Move to Meaningful Internet Systems\u201d","author":"Soudani Nadia","year":"2014","unstructured":"Nadia Soudani, Ibrahim Bounhas, Bilel ElAyeb, and Yahya Slimani. 2014. Toward an Arabic ontology for Arabic word sense disambiguation based on normalized dictionaries. In OTM Confederated International Conferences \u201cOn the Move to Meaningful Internet Systems\u201d. Springer, 655\u2013658."},{"key":"e_1_3_2_39_2","article-title":"ConceptNet at SemEval-2017 task 2: Extending word embeddings with multilingual relational knowledge","author":"Speer Robyn","year":"2017","unstructured":"Robyn Speer and Joanna Lowry-Duda. 2017. ConceptNet at SemEval-2017 task 2: Extending word embeddings with multilingual relational knowledge. arXiv preprint arXiv:1704.03560 (2017).","journal-title":"arXiv preprint arXiv:1704.03560"},{"key":"e_1_3_2_40_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_41_2","first-page":"561","article-title":"Word sense disambiguation for Arabic language using the variants of the Lesk algorithm","volume":"11","author":"Zouaghi A.","year":"2011","unstructured":"A. Zouaghi, L. Merhbene, and M. Zrigui. 2011. Word sense disambiguation for Arabic language using the variants of the Lesk algorithm. WORLDCOMP 11 (2011), 561\u2013567.","journal-title":"WORLDCOMP"},{"issue":"02","key":"e_1_3_2_42_2","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1142\/S1793840612400090","article-title":"A hybrid approach for Arabic word sense disambiguation","volume":"24","author":"Zouaghi Anis","year":"2012","unstructured":"Anis Zouaghi, Laroussi Merhbene, and Mounir Zrigui. 2012. A hybrid approach for Arabic word sense disambiguation. International Journal of Computer Processing of Languages 24, 02 (2012), 133\u2013151.","journal-title":"International Journal of Computer Processing of Languages"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3623379","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3623379","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:26Z","timestamp":1750178186000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3623379"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,18]]},"references-count":41,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2023,11,30]]}},"alternative-id":["10.1145\/3623379"],"URL":"https:\/\/doi.org\/10.1145\/3623379","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,18]]},"assertion":[{"value":"2022-05-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}