{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T13:05:02Z","timestamp":1769346302152,"version":"3.49.0"},"reference-count":98,"publisher":"Cambridge University Press (CUP)","issue":"6","license":[{"start":{"date-parts":[[2017,6,2]],"date-time":"2017-06-02T00:00:00Z","timestamp":1496361600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2017,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Text normalization is an indispensable stage in processing noncanonical language from natural sources, such as speech, social media or short text messages. Research in this field is very recent and mostly on English. As is known from different areas of natural language processing, morphologically rich languages (MRLs) pose many different challenges when compared to English. Turkish is a strong representative of MRLs and has particular normalization problems that may not be easily solved by a single-stage pure statistical model. This article introduces the first work on the social media text normalization of an MRL and presents the first complete social media text normalization system for Turkish. The article conducts an in-depth analysis of the error types encountered in Web 2.0 Turkish texts, categorizes them into seven groups and provides solutions for each of them by dividing the candidate generation task into separate modules working in a cascaded architecture. For the first time in the literature, two manually normalized Web 2.0 datasets are introduced for Turkish normalization studies. The exact match scores of the overall system on the provided datasets are 70.40 per cent and 67.37 per cent (77.07 per cent with a case insensitive evaluation).<\/jats:p>","DOI":"10.1017\/s1351324917000134","type":"journal-article","created":{"date-parts":[[2017,6,2]],"date-time":"2017-06-02T07:49:33Z","timestamp":1496389773000},"page":"835-875","source":"Crossref","is-referenced-by-count":20,"title":["Social media text normalization for Turkish"],"prefix":"10.1017","volume":"23","author":[{"given":"G\u00dcL\u015eEN","family":"ERY\u0130\u01e6\u0130T","sequence":"first","affiliation":[]},{"given":"D\u0130LARA","family":"TORUNO\u01e6LU-SELAMET","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2017,6,2]]},"reference":[{"key":"S1351324917000134_ref048","unstructured":"Leeman-Munk S. P. 2016. Morphosyntactic Neural Analysis for Generalized Lexical Normalization. Ph.D. thesis, North Carolina State University."},{"key":"S1351324917000134_ref066","first-page":"13","volume-title":"Proceedings the Workshop on Creation and Use of Basic Lexical Resources for Less-Resourced Languages at LREC","author":"Pirinen","year":"2010"},{"key":"S1351324917000134_ref084","first-page":"62","volume-title":"Proceedings of the 5th Workshop on Language Analysis for Social Media at EACL","author":"Toruno\u01e7lu","year":"2014"},{"key":"S1351324917000134_ref095","first-page":"37","volume-title":"Proceedings of the 21st International Conference on Computer and Information Sciences","author":"Y\u00fcret","year":"2006"},{"key":"S1351324917000134_ref047","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4323"},{"key":"S1351324917000134_ref014","first-page":"2196","volume-title":"Proceedings of COLING","author":"Blevins","year":"2016"},{"key":"S1351324917000134_ref058","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4317"},{"key":"S1351324917000134_ref037","first-page":"348","volume-title":"Proceedings of the 28th Pacific Asia Conference on Language, Information, and Computation","author":"Jhamtani","year":"2014"},{"key":"S1351324917000134_ref074","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2009.2023314"},{"key":"S1351324917000134_ref017","volume-title":"Txtng: The gr8 db8","author":"Crystal","year":"2008"},{"key":"S1351324917000134_ref070","first-page":"1","volume-title":"Proceedings of the 10th Symposium on Natural Language Processing (SNLP-2013)","author":"\u015eahin","year":"2013"},{"key":"S1351324917000134_ref056","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324914000011"},{"key":"S1351324917000134_ref042","doi-asserted-by":"crossref","unstructured":"Kobus C. , Yvon F. , and Damnati G. 2008. Normalizing sms: are two metaphors better than one? Proceedings of COLING, Manchester, UK, pp. 441\u20138.","DOI":"10.3115\/1599081.1599137"},{"key":"S1351324917000134_ref022","first-page":"71","volume-title":"Proceedings of the 5th Conference on Quantitative Investigations in Theoretical Linguistics","author":"Egidio","year":"2013"},{"key":"S1351324917000134_ref079","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-2406"},{"key":"S1351324917000134_ref092","first-page":"52","volume-title":"Proceedings of ACL-HLT","author":"Wang","year":"2011"},{"key":"S1351324917000134_ref054","unstructured":"McCallum A. K. 2002. Mallet: A Machine Learning for Language Toolkit. http:\/\/mallet.cs.umass.edu."},{"key":"S1351324917000134_ref053","first-page":"3143","volume-title":"Proceedings of LREC","author":"Max","year":"2010"},{"key":"S1351324917000134_ref028","first-page":"131","volume-title":"Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse at ACL","author":"Eryigit","year":"2013"},{"key":"S1351324917000134_ref065","first-page":"974","volume-title":"Proceedings of the International Joint Conference on Natural Language Processing","author":"Pennell","year":"2011"},{"key":"S1351324917000134_ref086","first-page":"1","volume-title":"Proceedings of the 1st Workshop on Statistical Parsing of Morphologically Rich Languages at NAACL-HLT","author":"Tsarfaty","year":"2010"},{"key":"S1351324917000134_ref021","doi-asserted-by":"publisher","DOI":"10.1515\/pralin-2016-0004"},{"key":"S1351324917000134_ref038","first-page":"4693","volume-title":"Acoustics, Speech and Signal Processing (ICASSP)","author":"Jia","year":"2008"},{"key":"S1351324917000134_ref094","first-page":"61","volume-title":"Proceedings of EMNLP","author":"Yang","year":"2013"},{"key":"S1351324917000134_ref068","first-page":"49","volume-title":"Proceedings of the Tweet Normalization Workshop (TWEET-NORM) at SEPLN","author":"Porta","year":"2013"},{"key":"S1351324917000134_ref071","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-010-9128-6"},{"key":"S1351324917000134_ref098","first-page":"577","volume-title":"Proceedings of COLING-ACL","author":"Zitouni","year":"2006"},{"key":"S1351324917000134_ref024","first-page":"359","volume-title":"Proceedings of NAACL-HLT","author":"Eisenstein","year":"2013"},{"key":"S1351324917000134_ref046","first-page":"282","volume-title":"Proceedings of the 18th International Conference on Machine Learning","author":"Lafferty","year":"2001"},{"key":"S1351324917000134_ref085","first-page":"7","volume-title":"Proceedings of the 1st International Conference on Turkic Computational Linguistics at CICLING","author":"Toruno\u011flu-Selamet","year":"2016"},{"key":"S1351324917000134_ref004","unstructured":"Ak\u0131n A. A. , and Ak\u0131n M. D. 2007. Zemberek, an open source nlp framework for Turkic languages."},{"key":"S1351324917000134_ref041","first-page":"634","volume-title":"Proceedings of the International Conference on Tools with Artificial Intelligence (ICTAI)","author":"Khan","year":"2012"},{"key":"S1351324917000134_ref035","first-page":"231","volume-title":"Proceedings of the 17th Nordic Conference of Computational Linguistics (NODALIDA)","author":"Ingason","year":"2009"},{"key":"S1351324917000134_ref010","first-page":"420","volume-title":"Proceedings of NAACL","author":"Baldwin","year":"2015"},{"key":"S1351324917000134_ref018","first-page":"65","article-title":"Code-mixing in social media text: the last language identification frontier","volume":"54","author":"Das","year":"2013","journal-title":"Traitement Automatique des Langues (TAL): Special Issue on Social Networks and NLP"},{"key":"S1351324917000134_ref089","first-page":"39","volume-title":"Proceedings of the Tweet Normalization Workshop (TWEET-NORM) at SEPLN","author":"Vilares","year":"2013"},{"key":"S1351324917000134_ref030","first-page":"1","volume-title":"Proceedings of Workshop on Computational Approaches to Semitic Languages at ACL","author":"Gal","year":"2002"},{"key":"S1351324917000134_ref008","first-page":"33","volume-title":"Proceedings of the COLING\/ACL","author":"Aw","year":"2006"},{"key":"S1351324917000134_ref001","first-page":"53","volume-title":"Proceedings of 5th Workshop on Language Analysis for Social Media","author":"Adal\u0131","year":"2014"},{"key":"S1351324917000134_ref002","first-page":"58","volume-title":"Proceedings of the Tweet Normalization Workshop (TWEET-NORM) at SEPLN","author":"Ageno","year":"2013"},{"key":"S1351324917000134_ref088","doi-asserted-by":"publisher","DOI":"10.1017\/S135132490200284X"},{"key":"S1351324917000134_ref069","first-page":"1837","volume-title":"Proceedings of EMNLP","author":"Qian","year":"2015"},{"key":"S1351324917000134_ref005","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-015-9315-6"},{"key":"S1351324917000134_ref020","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4315"},{"key":"S1351324917000134_ref057","unstructured":"Microsoft,. 2010. Microsoft Word, Version 10.0. Microsoft."},{"key":"S1351324917000134_ref036","first-page":"180","volume-title":"Word Normalization using Phonetic Signatures","author":"Jahjah","year":"2016"},{"key":"S1351324917000134_ref059","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-18458-6_5"},{"key":"S1351324917000134_ref015","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2011.10.577"},{"key":"S1351324917000134_ref050","first-page":"1675","volume-title":"Proceedings of EMNLP","author":"Limsopatham","year":"2015"},{"key":"S1351324917000134_ref027","first-page":"299","volume-title":"Proceedings of the International Conference on Artificial Intelligence and Applications","author":"Eryi\u011fit","year":"2004"},{"key":"S1351324917000134_ref044","volume-title":"A Study of Non-Standard English","author":"Labov","year":"1969"},{"key":"S1351324917000134_ref097","doi-asserted-by":"publisher","DOI":"10.1145\/2556195.2556228"},{"key":"S1351324917000134_ref043","doi-asserted-by":"publisher","DOI":"10.1145\/146370.146380"},{"key":"S1351324917000134_ref016","doi-asserted-by":"publisher","DOI":"10.3115\/1642011.1642021"},{"key":"S1351324917000134_ref052","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1162\/tacl_a_00163","article-title":"Automatic detection and language identification of multilingual documents","volume":"2","author":"Lui","year":"2014","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"S1351324917000134_ref029","first-page":"1","volume-title":"Proceedings of the 1st Workshop on Computational Approaches to Code Switching at ACL","author":"Eskander","year":"2014"},{"key":"S1351324917000134_ref087","unstructured":"T\u00fcr G. 2000. A Statistical Information Extraction System for Turkish. PhD Thesis, Department of Computer Engineering and the Institute of Engineering and Science of Bilkent University, Ankara."},{"key":"S1351324917000134_ref011","first-page":"770","volume-title":"Proceedings of ACL \u201910","author":"Beaufort","year":"2010"},{"key":"S1351324917000134_ref023","first-page":"11","volume-title":"Proceedings of the Workshop on Language Analysis in Social Media","author":"Eisenstein","year":"2013"},{"key":"S1351324917000134_ref090","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4314"},{"key":"S1351324917000134_ref055","volume-title":"The New Oxford American Dictionary","author":"McKean","year":"2005"},{"key":"S1351324917000134_ref060","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/1852611.1852627","volume-title":"Proceedings of the 2010 Symposium on Information and Communication Technology","author":"Nguyen","year":"2010"},{"key":"S1351324917000134_ref026","first-page":"1","volume-title":"Proceedings of the Demonstrations at EACL","author":"Eryi\u011fit","year":"2014"},{"key":"S1351324917000134_ref064","first-page":"19","volume-title":"Proceedings of the 5th International Conference on Knowledge Based Computer Systems","author":"Panchapagesan","year":"2004"},{"key":"S1351324917000134_ref072","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2014.04.009"},{"key":"S1351324917000134_ref003","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4308"},{"key":"S1351324917000134_ref093","first-page":"920","volume-title":"Proceedings of ACL-IJCNLP","author":"Xu","year":"2015"},{"key":"S1351324917000134_ref080","first-page":"18","volume-title":"Proceedings of ACL","author":"Smith","year":"2005"},{"key":"S1351324917000134_ref049","first-page":"86","volume-title":"Proceedings of the ACL Student Research Workshop","author":"Li","year":"2014"},{"key":"S1351324917000134_ref013","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4318"},{"key":"S1351324917000134_ref051","first-page":"1035","volume-title":"Proceedings of ACL","author":"Liu","year":"2012"},{"key":"S1351324917000134_ref062","first-page":"73","article-title":"Error-tolerant finite-state recognition with applications to morphological analysis and spelling correction","volume":"22","author":"Oflazer","year":"1996","journal-title":"Computational Linguistics"},{"key":"S1351324917000134_ref009","first-page":"126","volume-title":"Proceedings of ACL-IJCNLP 2015","author":"Baldwin","year":"2015"},{"key":"S1351324917000134_ref012","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4312"},{"key":"S1351324917000134_ref078","doi-asserted-by":"publisher","DOI":"10.3233\/SW-170253"},{"key":"S1351324917000134_ref073","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4305"},{"key":"S1351324917000134_ref075","volume-title":"Proceedings of the 11th International Conference of Turkish Linguistics","author":"Say","year":"2002"},{"key":"S1351324917000134_ref034","first-page":"1577","volume-title":"Proceedings of ACL","author":"Hassan","year":"2013"},{"key":"S1351324917000134_ref081","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3907"},{"key":"S1351324917000134_ref061","doi-asserted-by":"publisher","DOI":"10.1162\/089120103321337421"},{"key":"S1351324917000134_ref039","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4313"},{"key":"S1351324917000134_ref033","first-page":"5:1","article-title":"Lexical normalization for social media text","volume":"4","author":"Han","year":"2013","journal-title":"ACM Transactions on Intelligent Systems and Technology (TIST)"},{"key":"S1351324917000134_ref091","first-page":"471","volume-title":"Proceedings of NAACL-HLT","author":"Wang","year":"2013"},{"key":"S1351324917000134_ref083","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-4311"},{"key":"S1351324917000134_ref019","first-page":"179","volume-title":"Proceedings of Recent Advances in Natural Language Processing","author":"De Clercq","year":"2013"},{"key":"S1351324917000134_ref025","doi-asserted-by":"publisher","DOI":"10.3115\/1642059.1642078"},{"key":"S1351324917000134_ref031","first-page":"285","volume-title":"Proceedings of COLING","author":"Hakkani-T\u00fcr","year":"2000"},{"key":"S1351324917000134_ref045","doi-asserted-by":"publisher","DOI":"10.1075\/cll.42"},{"key":"S1351324917000134_ref063","first-page":"95","volume-title":"Proceedings of LAW Workshop at NAACL","author":"Pamay","year":"2015"},{"key":"S1351324917000134_ref082","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-1502"},{"key":"S1351324917000134_ref077","first-page":"2459","volume-title":"Proceedings of COLING 2012","author":"\u015eeker","year":"2012"},{"key":"S1351324917000134_ref096","first-page":"1159","volume-title":"Proceedings of ACL","author":"Zhang","year":"2013"},{"key":"S1351324917000134_ref032","first-page":"368","volume-title":"Proceedings of ACL-HLT","author":"Han","year":"2011"},{"key":"S1351324917000134_ref006","first-page":"1","volume-title":"Proceedings of the Tweet Normalization Workshop (TWEET-NORM) at SEPLN","author":"Alegria","year":"2013"},{"key":"S1351324917000134_ref040","first-page":"1","volume-title":"Proceedings of the 8th International Conference on Natural Language Processing (ICON)","author":"Kaufmann","year":"2010"},{"key":"S1351324917000134_ref007","first-page":"151","volume-title":"Proceedings of EMNLP-CONLL","author":"Alex","year":"2007"},{"key":"S1351324917000134_ref076","doi-asserted-by":"publisher","DOI":"10.1145\/2850422"},{"key":"S1351324917000134_ref067","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-54903-8_43"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324917000134","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,29]],"date-time":"2022-07-29T02:29:56Z","timestamp":1659061796000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324917000134\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,2]]},"references-count":98,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,11]]}},"alternative-id":["S1351324917000134"],"URL":"https:\/\/doi.org\/10.1017\/s1351324917000134","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,2]]}}}