{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T02:53:53Z","timestamp":1771296833503,"version":"3.50.1"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,11,28]],"date-time":"2019-11-28T00:00:00Z","timestamp":1574899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2020,3,31]]},"abstract":"<jats:p>\n            The evolution of information and communication technology has markedly influenced communication between correspondents. This evolution has facilitated the transmission of information and has engendered new forms of written communication (email, chat, SMS, comments, etc.). Most of these messages and comments are written in Latin script, also called\n            <jats:italic>Arabizi<\/jats:italic>\n            . Moreover, the language used in social media and SMS messaging is characterized by the use of informal and non-standard vocabulary, such as repeated letters for emphasis, typos, non-standard abbreviations, and nonlinguistic content like emoticons. Since the Tunisian dialect suffers from the unavailability of basic tools and linguistic resources compared to Modern Standard Arabic, we resort to the use of these written sources as a starting point to build large corpora automatically. In the context of natural language processing and to benefit from these networks\u2019 data, transliterating from Arabizi to Arabic script is a necessary step because most recently available tools for processing the Tunisian dialect expect Arabic script input. Indeed, the transliteration task can help construct and enrich parallel corpora and dictionaries for the Tunisian dialect and can be useful for developing various natural language processing applications such as sentiment analysis, opinion mining, topic detection, and machine translation. In this article, we focus on converting the Tunisian dialect text that is written in Latin script to Arabic script following the Conventional Orthography for Dialectal Arabic. Then, we propose two models to transliterate Arabizi into Arabic script for the Tunisian dialect, namely a rule-based model and a discriminative model as a sequence classification task based on conditional random fields). In the first model, we use a set of transliteration rules to convert the Tunisian dialect Arabizi texts to Arabic script. In the second model, transliteration is performed both at word and character levels. In the end, our models got a character error rate of 10.47%.\n          <\/jats:p>","DOI":"10.1145\/3364319","type":"journal-article","created":{"date-parts":[[2019,12,2]],"date-time":"2019-12-02T14:53:58Z","timestamp":1575298438000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Transliteration of Arabizi into Arabic Script for Tunisian Dialect"],"prefix":"10.1145","volume":"19","author":[{"given":"Abir","family":"Masmoudi","sequence":"first","affiliation":[{"name":"University of Sfax"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mariem Ellouze","family":"Khmekhem","sequence":"additional","affiliation":[{"name":"University of Sfax"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mourad","family":"Khrouf","sequence":"additional","affiliation":[{"name":"University of Sfax"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lamia Hadrich","family":"Belguith","sequence":"additional","affiliation":[{"name":"University of Sfax"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,11,28]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 18th Conference on Computational Natural Language Learning. 30--38","author":"Al-Badrashiny M."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the ACL-02 Workshop on Computational Approaches to Semitic Languages. 1--13","author":"Al-Onaizan Y."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics. 8--14","author":"Ammar W."},{"key":"e_1_2_1_4_1","unstructured":"T. Baccouche. 2003. L\u2019arabe d\u2019une koin dialectale une langue de culture Memoires de la soci\u00e9t\u00e9 linguistique de Paris TomeXI (les langues de Communication). 87--93.  T. Baccouche. 2003. L\u2019arabe d\u2019une koin dialectale une langue de culture Memoires de la soci\u00e9t\u00e9 linguistique de Paris TomeXI (les langues de Communication). 87--93."},{"key":"e_1_2_1_5_1","unstructured":"D. Bahdanau K. Cho and Y. Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv:1409.0473.  D. Bahdanau K. Cho and Y. Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv:1409.0473."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of Neural Information Processing Systems (NIPS\u201914)","author":"Bies A."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/1621804.1621813"},{"key":"e_1_2_1_8_1","volume-title":"Retrieved","author":"Casacuberta F.","year":"2019"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 2nd Workshop on Advances in Text Input Methods (WTIM 2). 89--96","author":"Chalabi A."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3629"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 4th Workshop on Statistical Machine Translation. 233--241","author":"Deselaers T."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1384--1393","author":"El-Kahky A."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 243--252","author":"El-Kahky A."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 1st Workshop on Computational Approaches to Code Switching. 1--12","author":"Eskander R."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 2nd Workshop on Cross Lingual Information Access. 42--47","author":"Surya G."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 1st Workshop on Social Media and User Generated Content Machine Translation.","author":"Guellil I."},{"key":"e_1_2_1_17_1","volume-title":"Dialect Contact in Tunisian Arabic: Sociolinguistic and Structural Aspects","author":"Gibson M. L."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2015.2464687"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 1st International Conference on Statistical Language and Speech Processing (SLSP\u201913)","author":"Graja M."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Habash N."},{"key":"e_1_2_1_21_1","volume-title":"Conventional orthography for dialectal Arabic. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC\u201912)","author":"Habash N."},{"key":"e_1_2_1_22_1","unstructured":"N. Habash A. Soudi and T. Buckwalter. 2007. On Arabic transliteration. In Arabic Computational Morphology: Knowledge-Based and Empirical Methods A. Soudi A. van den Bosch and G. Neumann (Eds.). Springer 3--14.  N. Habash A. Soudi and T. Buckwalter. 2007. On Arabic transliteration. In Arabic Computational Morphology: Knowledge-Based and Empirical Methods A. Soudi A. van den Bosch and G. Neumann (Eds.). Springer 3--14."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 3rd International Conference on Arabic Computational Linguistics. 5--6.","author":"Ameur M. Hadj"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.21248\/jlcl.32.2017.213","article-title":"A survey and comparative study of Arabic diacritization tools","volume":"32","author":"Hamed O.","year":"2017","journal-title":"Journal of Language Technology and Computational Linguistics"},{"key":"e_1_2_1_25_1","volume-title":"Modern Arabic: Structures, Functions, and Varieties. Georgetown Classics","author":"Holes C.","year":"2004"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 12th Annual Conference of the International Speech Communication Association(INTERSPEECH\u201911)","author":"Illina I."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 2nd International Conference on Language Resources and Evaluation (LREC\u201900)","author":"Kang B."},{"key":"e_1_2_1_28_1","first-page":"2","article-title":"Tunisian Arabic chat alphabet transliteration using probabilistic finite state transducers","volume":"16","author":"Karmani N.","year":"2019","journal-title":"International Arab Journal of Information Technology"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the 18th International Conference on Machine Learning. 282--289","author":"Lafferty J."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 6th International Language Resources and Evaluation (LREC\u201908)","author":"Maleki J."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 4th International Workshop on Spoken Language Technologies for Under-Resourced Languages.","author":"Masmoudi A."},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 19th Edition of the Language Resources and Evaluation Conference.","author":"Masmoudi A."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 16th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing\u201915)","author":"Masmoudi A."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 17th Annual Conference of the International Speech Communication Association (INTERSPEECH\u201916)","author":"Masmoudi A."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-017-9402-y"},{"key":"e_1_2_1_36_1","article-title":"Automatic diacritics restoration for Tunisian dialect","volume":"18","author":"Masmoudi A.","year":"2018","journal-title":"ACM Transactions on Asian and Low-Resource Language Information Processing"},{"key":"e_1_2_1_37_1","first-page":"53","article-title":"Pluringuisme et diglossie en Tunisie","volume":"1","author":"Mejri S.","year":"2009","journal-title":"Synergy Tunisie"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5121\/ijnlc.2013.2404"},{"key":"e_1_2_1_39_1","unstructured":"M. Rosca and T. Breuel. 2016. Sequence-to-sequence neural network models for transliteration. arXiv:1610.09565.  M. Rosca and T. Breuel. 2016. Sequence-to-sequence neural network models for transliteration. arXiv:1610.09565."},{"key":"e_1_2_1_40_1","volume-title":"Francais-Arabe. In Proceedings of the Joint JEP-TALN-RECITAL Conference. 127--140","author":"Saadane H."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 2nd Workshop on Arabic Natural Language Processing.","author":"Saadane H."},{"key":"e_1_2_1_42_1","unstructured":"I. Sfar. 2005. Morphologie des noms de professions: Incorporation et paraphrase La terminologie entre traduction et bilinguisme 15--16.  I. Sfar. 2005. Morphologie des noms de professions: Incorporation et paraphrase La terminologie entre traduction et bilinguisme 15--16."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the EACL 2009 Workshop on Computational Approaches to Semitic Languages.","author":"Shaalan K."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 9th International Conference on Human-Computer Interaction (HCI\u201901)","author":"Souissi E."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the International Conference on Speech and Language Processing.","author":"Stolcke A.","year":"2002"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2010.2098440"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 15th International Conference on Current Trends in Web Engineering (ICWE\u201915 Workshops). 3--14","author":"Younes J."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 17th International Conference on Intelligent Text Processing and Computational Linguistics (CICLing\u201916)","author":"Younes J."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the 4th International Conference on Arabic Computational Linguistics (ACLing\u201918)","author":"Younes J."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC\u201914)","author":"Zribi I."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2017.01.004"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3364319","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3364319","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:27Z","timestamp":1750203867000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3364319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,28]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,3,31]]}},"alternative-id":["10.1145\/3364319"],"URL":"https:\/\/doi.org\/10.1145\/3364319","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"value":"2375-4699","type":"print"},{"value":"2375-4702","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,28]]},"assertion":[{"value":"2019-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}