{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T09:22:24Z","timestamp":1780392144102,"version":"3.54.1"},"reference-count":55,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T00:00:00Z","timestamp":1631577600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>With the extensive availability of social media platforms, Twitter has become a significant tool for the acquisition of peoples\u2019 views, opinions, attitudes, and emotions towards certain entities. Within this frame of reference, sentiment analysis of tweets has become one of the most fascinating research areas in the field of natural language processing. A variety of techniques have been devised for sentiment analysis, but there is still room for improvement where the accuracy and efficacy of the system are concerned. This study proposes a novel approach that exploits the advantages of the lexical dictionary, machine learning, and deep learning classifiers. We classified the tweets based on the sentiments extracted by TextBlob using a stacked ensemble of three long short-term memory (LSTM) as base classifiers and logistic regression (LR) as a meta classifier. The proposed model proved to be effective and time-saving since it does not require feature extraction, as LSTM extracts features without any human intervention. We also compared our proposed approach with conventional machine learning models such as logistic regression, AdaBoost, and random forest. We also included state-of-the-art deep learning models in comparison with the proposed model. Experiments were conducted on the sentiment140 dataset and were evaluated in terms of accuracy, precision, recall, and F1 Score. Empirical results showed that our proposed approach manifested state-of-the-art results by achieving an accuracy score of 99%.<\/jats:p>","DOI":"10.3390\/info12090374","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T21:47:21Z","timestamp":1631656041000},"page":"374","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":50,"title":["A Tweet Sentiment Classification Approach Using a Hybrid Stacked Ensemble Technique"],"prefix":"10.3390","volume":"12","author":[{"given":"Babacar","family":"Gaye","sequence":"first","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dezheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aziguli","family":"Wulamu","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"ref_1","unstructured":"(2021, September 06). Statista. Available online: https:\/\/www.statista.com\/statistics\/346167\/facebook-global-dau\/."},{"key":"ref_2","unstructured":"(2021, September 06). Statista. Available online: https:\/\/www.statista.com\/statistics\/272014\/global-social-networks-."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.sigpro.2015.10.032","article-title":"A picture tells a thousand words\u2014About you! User interest profiling from user generated visual content","volume":"124","author":"You","year":"2016","journal-title":"Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Persia, F., and D\u2019Auria, D. (2017, January 4\u20136). A survey of online social networks: Challenges and opportunities. Proceedings of the 2017 IEEE International Conference on Information Reuse and Integration (IRI), San Diego, CA, USA.","DOI":"10.1109\/IRI.2017.74"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"8892552","DOI":"10.1155\/2020\/8892552","article-title":"Tweets classification and sentiment analysis for personalized tweets recommendation","volume":"2020","author":"Khattak","year":"2020","journal-title":"Complexity"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"12203","DOI":"10.1007\/s11042-017-4880-x","article-title":"Predicting TV programme audience by using twitter based metrics","volume":"77","author":"Crisci","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_7","unstructured":"McConnell, J. (2015). Twitter and the 2016 US Presidential Campaign: A Rhetorical Analysis of Tweets and Media Coverage. [Master\u2019s Thesis, New York University]."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Coletta, L.F., da Silva, N.F., Hruschka, E.R., and Hruschka, E.R. (2014, January 18\u201322). Combining classification and clustering for tweet sentiment analysis. Proceedings of the 2014 Brazilian Conference on Intelligent Systems, Sao Paulo, Brazil.","DOI":"10.1109\/BRACIS.2014.46"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1109\/TCSS.2020.3037040","article-title":"Personality-Aware Product Recommendation System Based on User Interests Mining and Metapath Discovery","volume":"8","author":"Dhelim","year":"2020","journal-title":"IEEE Trans. Comput. Soc. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cambria, E., Das, D., Bandyopadhyay, S., and Feraco, A. (2017). Affective computing and sentiment analysis. A Practical Guide to Sentiment Analysis, Springer.","DOI":"10.1007\/978-3-319-55394-8"},{"key":"ref_11","first-page":"330","article-title":"A survey on sentiment analysis challenges","volume":"30","author":"Hussein","year":"2018","journal-title":"J. King Saud Univ.-Eng. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"107373","DOI":"10.1016\/j.asoc.2021.107373","article-title":"Deep learning and multilingual sentiment analysis on social media data: An overview","volume":"107","author":"Salas","year":"2021","journal-title":"Appl. Soft Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2181","DOI":"10.11591\/eei.v10i4.2790","article-title":"A multi domains short message sentiment classification using hybrid neural network architecture","volume":"10","author":"Munandar","year":"2021","journal-title":"Bull. Electr. Eng. Inform."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep learning in neural networks: An overview","volume":"61","author":"Schmidhuber","year":"2015","journal-title":"Neural Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.imavis.2017.01.011","article-title":"From pixels to sentiment: Fine-tuning CNNs for visual sentiment prediction","volume":"65","author":"Campos","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1515\/aoa-2015-0021","article-title":"Deep belief neural networks and bidirectional long-short term memory hybrid for speech recognition","volume":"40","author":"Marasek","year":"2015","journal-title":"Arch. Acoust."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"41283","DOI":"10.1109\/ACCESS.2021.3064830","article-title":"A ConvBiLSTM Deep Learning Model-Based Approach for Twitter Sentiment Classification","volume":"9","author":"Tam","year":"2021","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"24249","DOI":"10.1109\/ACCESS.2021.3055507","article-title":"Spider monkey crow optimization algorithm with deep learning for sentiment classification and information retrieval","volume":"9","author":"Chugh","year":"2021","journal-title":"IEEE Access"},{"key":"ref_19","first-page":"2009","article-title":"Twitter sentiment classification using distant supervision","volume":"1","author":"Go","year":"2009","journal-title":"CS224N Proj. Rep. Stanf."},{"key":"ref_20","first-page":"27","article-title":"Topic classification and sentiment analysis for Vietnamese education survey system","volume":"6","author":"Vo","year":"2016","journal-title":"Asian J. Comput. Sci. Inf. Technol."},{"key":"ref_21","first-page":"26","article-title":"Sentiment Analysis-An Objective View","volume":"2","author":"Sarkar","year":"2016","journal-title":"J. Res. Vol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1016\/j.procs.2018.05.109","article-title":"An ensemble classification system for twitter sentiment analysis","volume":"132","author":"Saleena","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.eswa.2016.06.005","article-title":"A multiobjective weighted voting ensemble classifier based on differential evolution algorithm for text sentiment classification","volume":"62","author":"Onan","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rustam, F., Ashraf, I., Mehmood, A., Ullah, S., and Choi, G.S. (2019). Tweets classification on the base of sentiments for US airline companies. Entropy, 21.","DOI":"10.3390\/e21111078"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1111\/coin.12415","article-title":"Sentiment analysis of tweets using a unified convolutional neural network-long short-term memory network model","volume":"37","author":"Umer","year":"2021","journal-title":"Comput. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Stojanovski, D., Strezoski, G., Madjarov, G., and Dimitrovski, I. (2015, January 22\u201324). Twitter sentiment analysis using deep convolutional neural network. Proceedings of the International Conference on Hybrid Artificial Intelligence Systems, Bilbao, Spain.","DOI":"10.1007\/978-3-319-19644-2_60"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"23253","DOI":"10.1109\/ACCESS.2017.2776930","article-title":"Deep convolution neural networks for twitter sentiment analysis","volume":"6","author":"Zhao","year":"2018","journal-title":"IEEE Access"},{"key":"ref_28","unstructured":"Dos Santos, C., and Gatti, M. (2014, January 23\u201329). Deep convolutional neural networks for sentiment analysis of short texts. Proceedings of the COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, Dublin, Ireland."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ishaq, A., Umer, M., Mushtaq, M.F., Medaglia, C., Siddiqui, H.U.R., Mehmood, A., and Choi, G.S. (2020). Extensive hotel reviews classification using long short term memory. J. Ambient. Intell. Humaniz. Comput., 1\u201311.","DOI":"10.1007\/s12652-020-02654-z"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"6861","DOI":"10.1109\/ACCESS.2019.2963426","article-title":"Comparative study of deep learning-based sentiment classification","volume":"8","author":"Seo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"58080","DOI":"10.1109\/ACCESS.2020.2982538","article-title":"A novel hybrid deep learning model for sentiment classification","volume":"8","author":"Salur","year":"2020","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Cliche, M. (2017). BB_twtr at SemEval-2017 task 4: Twitter sentiment analysis with CNNs and LSTMs. arXiv.","DOI":"10.18653\/v1\/S17-2094"},{"key":"ref_33","unstructured":"(2020, September 30). Sentiment 140. Available online: https:\/\/www.kaggle.com\/kazanova\/sentiment140."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kalra, V., and Aggarwal, R. (2017). Importance of Text Data Preprocessing & Implementation in RapidMiner, ICITKM.","DOI":"10.15439\/2017KM46"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7024","DOI":"10.1109\/JIOT.2020.3037109","article-title":"ComPath: User interest mining in heterogeneous signed social networks for Internet of people","volume":"8","author":"Dhelim","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_36","first-page":"525","article-title":"Text mining of Twitter data using a latent Dirichlet allocation topic model and sentiment analysis","volume":"12","author":"Yang","year":"2018","journal-title":"Int. J. Comput. Inf. Eng."},{"key":"ref_37","first-page":"269","article-title":"textblob Documentation","volume":"2","author":"Loria","year":"2018","journal-title":"Release 0.15"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"85721","DOI":"10.1109\/ACCESS.2021.3088838","article-title":"Determining the Efficiency of Drugs under Special Conditions from Users\u2019 Reviews on Healthcare Web Forums","volume":"9","author":"Saad","year":"2021","journal-title":"IEEE Access"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.compag.2016.08.015","article-title":"The effect of tuning, feature engineering, and feature selection in data mining applied to rainfed sugarcane yield modelling","volume":"128","author":"Bocca","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Heaton, J. (2016, January 30). An empirical analysis of feature engineering for predictive modeling. Proceedings of the SoutheastCon 2016, Norfolk, VA, USA.","DOI":"10.1109\/SECON.2016.7506650"},{"key":"ref_41","first-page":"2","article-title":"Lyric text mining in music mood classification","volume":"183","author":"Hu","year":"2009","journal-title":"Am. Music"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1093\/llc\/fqn015","article-title":"An evaluation of text classification methods for literary study","volume":"23","author":"Yu","year":"2008","journal-title":"Lit. Linguist. Comput."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1108\/00220410410560582","article-title":"Understanding inverse document frequency: On theoretical arguments for IDF","volume":"60","author":"Robertson","year":"2004","journal-title":"J. Doc."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2758","DOI":"10.1016\/j.eswa.2010.08.066","article-title":"A comparative study of TF* IDF, LSI and multi-words for text classification","volume":"38","author":"Zhang","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.dss.2014.07.003","article-title":"Tweet sentiment analysis with classifier ensembles","volume":"66","author":"Hruschka","year":"2014","journal-title":"Decis. Support Syst."},{"key":"ref_46","unstructured":"Kleinbaum, D.G., Klein, M., and Pryor, E.R. (2002). Logistic Regression: A Self-Learning Text, Springer."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhang, H., Cai, J., and Yang, B. (2014). A weighted voting classifier based on differential evolution. Abstract and Applied Analysis, Hindawi.","DOI":"10.1155\/2014\/376950"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"119708","DOI":"10.1016\/j.energy.2020.119708","article-title":"Well production forecasting based on ARIMA-LSTM model considering manual operations","volume":"220","author":"Fan","year":"2021","journal-title":"Energy"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Divina, F., Gilson, A., Gom\u00e9z-Vela, F., Garc\u00eda Torres, M., and Torres, J.F. (2018). Stacking ensemble learning for short-term electricity consumption forecasting. Energies, 11.","DOI":"10.3390\/en11040949"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"78621","DOI":"10.1109\/ACCESS.2021.3083638","article-title":"Impact of SMOTE on Imbalanced Text Features for Toxic Comments Classification using RVVC Model","volume":"9","author":"Rupapara","year":"2021","journal-title":"IEEE Access"},{"key":"ref_52","unstructured":"Han, J., Pei, J., and Kamber, M. (2011). Data Mining: Concepts and Techniques, Elsevier."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Iqbal, N., Chowdhury, A.M., and Ahsan, T. (2018, January 8\u20139). Enhancing the performance of sentiment analysis by using different feature combinations. Proceedings of the 2018 International Conference on Computer, Communication, Chemical, Material and Electronic Engineering (IC4ME2), Rajshahi, Bangladesh.","DOI":"10.1109\/IC4ME2.2018.8465673"},{"key":"ref_54","unstructured":"Korovkinas, K., and Gar\u0161va, G. (2018, January 18\u201320). Selection of intelligent algorithms for sentiment classification method creation. Proceedings of the International Conference on Information Technologies, Tomsk, Russia."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Dang, N.C., Moreno-Garc\u00eda, M.N., and De la Prieta, F. (2020). Sentiment analysis based on deep learning: A comparative study. Electronics, 9.","DOI":"10.3390\/electronics9030483"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/9\/374\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:02:18Z","timestamp":1760166138000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/9\/374"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,14]]},"references-count":55,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["info12090374"],"URL":"https:\/\/doi.org\/10.3390\/info12090374","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,14]]}}}