{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,13]],"date-time":"2026-08-13T19:09:54Z","timestamp":1786648194970,"version":"3.56.0"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,8,24]],"date-time":"2022-08-24T00:00:00Z","timestamp":1661299200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,24]],"date-time":"2022-08-24T00:00:00Z","timestamp":1661299200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Efficient word representation techniques (word embeddings) with modern machine learning models have shown reasonable improvement on automatic text classification tasks. However, the effectiveness of such techniques has not been evaluated yet in terms of insufficient word vector representation for training. Convolutional Neural Network has achieved significant results in pattern recognition, image analysis, and text classification. This study investigates the application of the CNN model on text classification problems by experimentation and analysis. We trained our classification model with a prominent word embedding generation model, Fast Text on publically available datasets, six benchmark datasets including Ag News, Amazon Full and Polarity, Yahoo Question Answer, Yelp Full, and Polarity. Furthermore, the proposed model has been tested on the Twitter US airlines non-benchmark dataset as well. The analysis indicates that using Fast Text as word embedding is a very promising approach.<\/jats:p>","DOI":"10.1007\/s11042-022-13459-x","type":"journal-article","created":{"date-parts":[[2022,8,24]],"date-time":"2022-08-24T05:13:12Z","timestamp":1661317992000},"page":"5569-5585","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":151,"title":["Impact of convolutional neural network and FastText embedding on text classification"],"prefix":"10.1007","volume":"82","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6015-9326","authenticated-orcid":false,"given":"Muhammad","family":"Umer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zainab","family":"Imtiaz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad","family":"Ahmad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michele","family":"Nappi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlo","family":"Medaglia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gyu Sang","family":"Choi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arif","family":"Mehmood","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,24]]},"reference":[{"key":"13459_CR1","unstructured":"Aas K, Eikvil L (1999) Text categorisation: a survey"},{"key":"13459_CR2","doi-asserted-by":"publisher","first-page":"19","DOI":"10.5121\/ijdkp.2019.9302","volume":"09","author":"N Ali","year":"2019","unstructured":"Ali N, Hamid M, Youssif A (2019) Sentiment analysis for movies reviews dataset using deep learning models. Int J Data Mining Knowl Manag Process 09:19\u201327","journal-title":"Int J Data Mining Knowl Manag Process"},{"issue":"1","key":"13459_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jocs.2010.12.007","volume":"2","author":"J Bollen","year":"2011","unstructured":"Bollen J, Mao H, Zeng X (2011) Twitter mood predicts the stock market. J Comput Sci 2(1):1\u20138","journal-title":"J Comput Sci"},{"key":"13459_CR4","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/j.eswa.2016.10.065","volume":"72","author":"T Chen","year":"2017","unstructured":"Chen T, Xu R, He Y, Wang X (2017) Improving sentiment analysis via sentence type classification using bilstm-crf and cnn. Expert Syst Appl 72:221\u2013230","journal-title":"Expert Syst Appl"},{"key":"13459_CR5","doi-asserted-by":"crossref","unstructured":"Conneau A, Schwenk H, Barrault L, Lecun Y (2016) Very deep convolutional networks for text classification","DOI":"10.18653\/v1\/E17-1104"},{"key":"13459_CR6","unstructured":"Dai A M, Olah C, Le Q V (2015) Document embedding with paragraph vectors"},{"issue":"12","key":"13459_CR7","doi-asserted-by":"publisher","first-page":"e26752","DOI":"10.1371\/journal.pone.0026752","volume":"6","author":"PS Dodds","year":"2011","unstructured":"Dodds P S, Harris K D, Kloumann I M, Bliss C A, Danforth C M (2011) Temporal patterns of happiness and information in a global social network: hedonometrics and twitter. PLoS ONE 6(12):e26752","journal-title":"PLoS ONE"},{"key":"13459_CR8","unstructured":"dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: technical papers. Dublin City University and Association for Computational Linguistics, Dublin, pp 69\u201378"},{"key":"13459_CR9","doi-asserted-by":"publisher","first-page":"6359","DOI":"10.1609\/aaai.v33i01.33016359","volume":"33","author":"C Du","year":"2019","unstructured":"Du C, Chen Z, Feng F, Zhu L, Gan T, Nie L (2019) Explicit interaction model towards text classification. Proceedings of the AAAI Conference on Artificial Intelligence 33:6359\u20136366","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"13459_CR10","first-page":"1871","volume":"9","author":"R-E Fan","year":"2008","unstructured":"Fan R-E, Chang K-W, Hsieh C-J, Wang X-R, Lin C-J (2008) Liblinear: a library for large linear classification. J Mach Learn Res 9:1871\u20131874","journal-title":"J Mach Learn Res"},{"key":"13459_CR11","doi-asserted-by":"crossref","unstructured":"Friedman J H (2001) Greedy function approximation: a gradient boosting machine. Annals of Statistics, 1189\u20131232","DOI":"10.1214\/aos\/1013203451"},{"issue":"2","key":"13459_CR12","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/0165-1684(84)90013-6","volume":"6","author":"WA Gardner","year":"1984","unstructured":"Gardner W A (1984) Learning characteristics of stochastic-gradient-descent algorithms: a general study, analysis, and critique. Signal Process 6 (2):113\u2013133","journal-title":"Signal Process"},{"issue":"3","key":"13459_CR13","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1007\/s11222-016-9646-1","volume":"27","author":"B Gregorutti","year":"2017","unstructured":"Gregorutti B, Michel B, Saint-Pierre P (2017) Correlation and variable importance in random forests. Stat Comput 27(3):659\u2013678","journal-title":"Stat Comput"},{"key":"13459_CR14","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neur Comput 9:1735\u201380","journal-title":"Neur Comput"},{"key":"13459_CR15","doi-asserted-by":"publisher","first-page":"21932","DOI":"10.1109\/ACCESS.2020.2969041","volume":"8","author":"Z Imtiaz","year":"2020","unstructured":"Imtiaz Z, Umer M, Ahmad M, Ullah S, Choi G S, Mehmood A (2020) Duplicate questions pair detection using siamese malstm. IEEE Access 8:21932\u201321942","journal-title":"IEEE Access"},{"key":"13459_CR16","doi-asserted-by":"crossref","unstructured":"Iyyer M, Manjunatha V, Boyd-Graber J, Daum\u00e9 H III (July 2015) Deep unordered composition rivals syntactic methods for text classification. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (volume 1: long papers). Association for Computational Linguistics, Beijing, pp 1681\u20131691","DOI":"10.3115\/v1\/P15-1162"},{"key":"13459_CR17","doi-asserted-by":"crossref","unstructured":"Johnson R, Zhang T (2015) Effective use of word order for text categorization with convolutional neural networks. Proceedings of the 2015 conference of the North American chapter of the association for computational linguistics: human language technologies","DOI":"10.3115\/v1\/N15-1011"},{"key":"13459_CR18","doi-asserted-by":"crossref","unstructured":"Johnson R, Zhang T (2016) Convolutional neural networks for text categorization: shallow word-level vs. deep character-level","DOI":"10.18653\/v1\/P17-1052"},{"key":"13459_CR19","doi-asserted-by":"crossref","unstructured":"Joulin A, Grave E, Bojanowski P, Mikolov T (2017) Bag of tricks for efficient text classification. In: Proceedings of the 15th conference of the European chapter of the association for computational linguistics: volume 2, short papers","DOI":"10.18653\/v1\/E17-2068"},{"key":"13459_CR20","doi-asserted-by":"crossref","unstructured":"Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 1: long papers)","DOI":"10.3115\/v1\/P14-1062"},{"key":"13459_CR21","doi-asserted-by":"crossref","unstructured":"Kaya M, Fidan G, Toroslu I (2013) Transfer learning using twitter data for improving sentiment classification of turkish political news, 264, 139\u2013148","DOI":"10.1007\/978-3-319-01604-7_14"},{"key":"13459_CR22","doi-asserted-by":"crossref","unstructured":"Kim Y (October 2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, pp 1746\u20131751","DOI":"10.3115\/v1\/D14-1181"},{"issue":"4","key":"13459_CR23","doi-asserted-by":"publisher","first-page":"150","DOI":"10.3390\/info10040150","volume":"10","author":"J Meimandi","year":"2019","unstructured":"Kowsari, Meimandi J, Heidarysafa, Mendu, Barnes, Brown (2019) Text classification algorithms: a survey. Information 10(4):150","journal-title":"Information"},{"key":"13459_CR24","doi-asserted-by":"crossref","unstructured":"Lai S, Xu L, Liu K, Zhao J (2015) Recurrent convolutional neural networks for text classification. In: Proceedings of the Twenty-Ninth AAAI conference on artificial intelligence, AAAI\u201915. AAAI Press, pp 2267\u20132273","DOI":"10.1609\/aaai.v29i1.9513"},{"key":"13459_CR25","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1016\/j.procs.2019.11.159","volume":"161","author":"VLS Lee","year":"2019","unstructured":"Lee V L S, Gan K H, Tan T P, Abdullah R (2019) Semi-supervised learning for sentiment classification using small number of labeled data. Procedia Comput Sci 161:577\u2013584. The Fifth Information Systems International Conference, 23-24 July 2019, Surabaya, Indonesia","journal-title":"Procedia Comput Sci"},{"key":"13459_CR26","doi-asserted-by":"crossref","unstructured":"Lewis D D (1992) An evaluation of phrasal and clustered representations on a text categorization task. In: Proceedings of the 15th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR \u201992. Association for Computing Machinery, New York, pp 37\u201350","DOI":"10.1145\/133160.133172"},{"issue":"3","key":"13459_CR27","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1109\/MIS.2019.2904691","volume":"34","author":"N Majumder","year":"2019","unstructured":"Majumder N, Poria S, Peng H, Chhaya N, Cambria E, Gelbukh A, Cambria E (2019) Sentiment and sarcasm classification with multitask learning. IEEE Intell Syst 34(3):38\u201343","journal-title":"IEEE Intell Syst"},{"key":"13459_CR28","first-page":"05","volume":"752","author":"A Mccallum","year":"2001","unstructured":"Mccallum A, Nigam K (2001) A comparison of event models for naive bayes text classification. Work Learn Text Categ 752:05","journal-title":"Work Learn Text Categ"},{"key":"13459_CR29","unstructured":"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space"},{"key":"13459_CR30","unstructured":"Mitchell T M (2006) The discipline of machine learning, vol 9. Carnegie Mellon University, School of Computer Science, Machine Learning ..."},{"key":"13459_CR31","unstructured":"Nakagawa T, Inui K, Kurohashi S (2010) Dependency tree-based sentiment classification using CRFs with hidden variables. In: Human language technologies: the 2010 annual conference of the North American chapter of the association for computational linguistics. Association for Computational Linguistics, Los Angeles, pp 786\u2013794"},{"key":"13459_CR32","unstructured":"Post M, Bergsma S (2013) Explicit and implicit syntactic features for text classification. In: Proceedings of the 51st annual meeting of the association for computational linguistics (volume 2: short papers). Association for Computational Linguistics, Sofia, pp 866\u2013872"},{"key":"13459_CR33","unstructured":"Qiao C, Huang B, Niu G, Li D, Dong D, He W, Yu D, Wu H (2018) A new method of region embedding for text classification. In: ICLR"},{"key":"13459_CR34","doi-asserted-by":"crossref","unstructured":"Qureshi M, O\u2019 Riordan C, Pasi G (2013) Clustering with error-estimation for monitoring reputation of companies on twitter, 8281, 170\u2013180, 12","DOI":"10.1007\/978-3-642-45068-6_15"},{"issue":"11","key":"13459_CR35","doi-asserted-by":"publisher","first-page":"1078","DOI":"10.3390\/e21111078","volume":"21","author":"F Rustam","year":"2019","unstructured":"Rustam F, Ashraf I, Mehmood A, Ullah S, Choi G S (2019) Tweets classification on the base of sentiments for us airline companies. Entropy 21(11):1078","journal-title":"Entropy"},{"key":"13459_CR36","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.future.2020.07.050","volume":"114","author":"S Sadiq","year":"2021","unstructured":"Sadiq S, Mehmood A, Ullah S, Ahmad M, Choi G S, On B-W (2021) Aggression detection through deep neural model on twitter. Futur Gener Comput Syst 114:120\u2013129","journal-title":"Futur Gener Comput Syst"},{"issue":"1","key":"13459_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/505282.505283","volume":"34","author":"F Sebastiani","year":"2002","unstructured":"Sebastiani F (2002) Machine learning in automated text categorization. ACM Comput Surv 34(1):1\u201347","journal-title":"ACM Comput Surv"},{"key":"13459_CR38","doi-asserted-by":"crossref","unstructured":"Sharaff A, Gupta H (2019) Extra-tree classifier with metaheuristics approach for email classification. In: Advances in computer communication and computational sciences. Springer, pp 189\u2013197","DOI":"10.1007\/978-981-13-6861-5_17"},{"key":"13459_CR39","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s10462-010-9188-4","volume":"35","author":"J Silva","year":"2011","unstructured":"Silva J, Coheur L, Mendes A, Wichert A (2011) From symbolic to sub-symbolic information in question classification. Artif Intell Rev 35:137\u2013154, 02","journal-title":"Artif Intell Rev"},{"key":"13459_CR40","unstructured":"Socher R, Perelygin A, Wu J, Chuang J, Manning C D, Ng A, Potts C (2013) Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing. Association for Computational Linguistics, Seattle, pp 1631\u20131642"},{"key":"13459_CR41","doi-asserted-by":"crossref","unstructured":"Sundermeyer M, Schl\u00fcter R, Ney H (2012) Lstm neural networks for language modeling","DOI":"10.21437\/Interspeech.2012-65"},{"key":"13459_CR42","unstructured":"Sutskever I, Vinyals O, Le Q V (2014) Sequence to sequence learning with neural networks"},{"key":"13459_CR43","doi-asserted-by":"crossref","unstructured":"Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing. Association for Computational Linguistics, Lisbon, pp 1422\u20131432","DOI":"10.18653\/v1\/D15-1167"},{"key":"13459_CR44","doi-asserted-by":"publisher","first-page":"93782","DOI":"10.1109\/ACCESS.2020.2994810","volume":"8","author":"M Umer","year":"2020","unstructured":"Umer M, Sadiq S, Ahmad M, Ullah S, Choi G S, Mehmood A (2020) A novel stacked cnn for malarial parasite detection in thin blood smear images. IEEE Access 8:93782\u201393792","journal-title":"IEEE Access"},{"key":"13459_CR45","doi-asserted-by":"crossref","unstructured":"Wang J, Wang Z, Zhang D, Yan J (2017) Combining knowledge with deep convolutional neural networks for short text classification. In: Proceedings of the 26th international joint conference on artificial intelligence, IJCAI\u201917. AAAI Press, pp 2915\u20132921","DOI":"10.24963\/ijcai.2017\/406"},{"key":"13459_CR46","doi-asserted-by":"crossref","unstructured":"Wang P, Xu J, Xu B, Liu C, Zhang H, Wang F, Hao H (2015) Semantic clustering and convolutional neural network for short text categorization. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (volume 2: short papers). Association for Computational Linguistics, Beijing, pp 352\u2013 357","DOI":"10.3115\/v1\/P15-2058"},{"key":"13459_CR47","unstructured":"Wang S, Manning C (2012) Baselines and bigrams: simple, good sentiment and topic classification, 90\u201394, 07"},{"key":"13459_CR48","unstructured":"Wang S, Manning C (2012) Baselines and bigrams: simple, good sentiment and topic classification. In: Proceedings of the 50th annual meeting of the association for computational linguistics (volume 2: short papers). Association for Computational Linguistics, Jeju Island, pp 90\u201394"},{"issue":"4","key":"13459_CR49","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1109\/TAFFC.2017.2771234","volume":"8","author":"R Xia","year":"2017","unstructured":"Xia R, Jiang J, He H (2017) Distantly supervised lifelong learning for large-scale social media sentiment analysis. IEEE Trans Affect Comput 8(4):480\u2013491","journal-title":"IEEE Trans Affect Comput"},{"key":"13459_CR50","unstructured":"Xiao Y, Cho K (2016) Efficient character-level document classification by combining convolution and recurrent layers"},{"key":"13459_CR51","doi-asserted-by":"crossref","unstructured":"Yenigalla P, Kar S, Singh C, Nagar A, Mathur G (2018) Addressing unseen word problem in text classification, 339\u2013351. 01","DOI":"10.1007\/978-3-319-91947-8_36"},{"key":"13459_CR52","unstructured":"Yin W, Kann K, Yu M, Sch\u00fctze H (2017) Comparative study of cnn and rnn for natural language processing"},{"key":"13459_CR53","doi-asserted-by":"publisher","first-page":"6286","DOI":"10.1109\/ACCESS.2020.3047831","volume":"9","author":"A Yousaf","year":"2020","unstructured":"Yousaf A, Umer M, Sadiq S, Ullah S, Mirjalili S, Rupapara V, Nappi M (2020) Emotion recognition by textual tweets classification using voting classifier (lr-sgd). IEEE Access 9:6286\u20136295","journal-title":"IEEE Access"},{"key":"13459_CR54","unstructured":"Zhang X (2019) Textclassificationdatasets"},{"key":"13459_CR55","unstructured":"Zhang X, LeCun Y (2015) Text understanding from scratch"},{"key":"13459_CR56","unstructured":"Zhang X, Zhao J, LeCun Y (2015) Character-level convolutional networks for text classification"},{"key":"13459_CR57","unstructured":"Zhou C, Sun C, Liu Z, Lau F C M (2015) A c-lstm neural network for text classification"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-022-13459-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-022-13459-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-022-13459-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,25]],"date-time":"2023-01-25T08:31:38Z","timestamp":1674635498000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-022-13459-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,24]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["13459"],"URL":"https:\/\/doi.org\/10.1007\/s11042-022-13459-x","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,24]]},"assertion":[{"value":"1 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 May 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 August 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of Interests"}}]}}