{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T14:49:22Z","timestamp":1773931762741,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T00:00:00Z","timestamp":1760313600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan","award":["AP22786059"],"award-info":[{"award-number":["AP22786059"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>Tourist reviews provide essential insights into travellers experiences and public perceptions of destinations. In Kazakhstan, however, sentiment analysis, particularly using ensemble learning, remains underexplored for evaluating such reviews. This study proposes a hybrid stacking ensemble for sentiment analysis of English-language tourist reviews about Kazakhstan, integrating four complementary approaches: VADER, TextBlob, Stanza, and Local Context Focus Mechanism with Bidirectional Encoder Representations from Transformers (LCF-BERT). Each model contributes distinct analytical capabilities, including lexicon-based polarity detection, rule-based subjectivity evaluation, generalised star-rating estimation, and contextual aspect-oriented sentiment classification. The evaluation utilised a cleaned dataset of 11,454 TripAdvisor reviews collected between February 2022 and June 2025. The ensemble aggregates model outputs through majority and weighted voting strategies to enhance robustness. Experimental results (accuracy 0.891, precision 0.838, recall 0.891, and F1-score 0.852) demonstrate that the proposed method KazSATR outperforms individual models in overall classification accuracy and exhibits superior capacity for aspect-level sentiment detection. These findings underscore the potential of the hybrid ensemble as a practical and scalable tool for the tourism sector in Kazakhstan. By leveraging multiple analytical paradigms, the model enables tourism professionals and policymakers to better understand traveller preferences, identify service strengths and weaknesses, and inform strategic decision-making. The proposed approach contributes to advancing sentiment analysis applications in tourism research, particularly in underrepresented geographic contexts.<\/jats:p>","DOI":"10.3390\/computation13100240","type":"journal-article","created":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T05:48:21Z","timestamp":1760420901000},"page":"240","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Sentiment Analysis of Tourist Reviews About Kazakhstan Using a Hybrid Stacking Ensemble Approach"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5024-1174","authenticated-orcid":false,"given":"Aslanbek","family":"Murzakhmetov","sequence":"first","affiliation":[{"name":"Department of Information Systems, Faculty of Technology, M.Kh. Dulaty Taraz University, Taraz 080001, Kazakhstan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4621-6646","authenticated-orcid":false,"given":"Maxatbek","family":"Satymbekov","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Al-Farabi Kazakh National University, Almaty 050040, Kazakhstan"},{"name":"School of STEM Education, Shakarim University, Semey 071410, Kazakhstan"}]},{"given":"Arseniy","family":"Bapanov","sequence":"additional","affiliation":[{"name":"Department of Information Systems, Faculty of Technology, M.Kh. Dulaty Taraz University, Taraz 080001, Kazakhstan"}]},{"given":"Nurbol","family":"Beisov","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Al-Farabi Kazakh National University, Almaty 050040, Kazakhstan"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,13]]},"reference":[{"key":"ref_1","unstructured":"Ministry of Tourism and Sports of the Republic of Kazakhstan (2025, May 23). Ministry of Tourism and Sports of the Republic of Kazakhstan, Available online: https:\/\/www.gov.kz\/memleket\/entities\/tsm?lang=ru."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1108\/CBTH-03-2022-0077","article-title":"Analyzing User-Generated Content to Improve Customer Satisfaction at Local Wine Tourism Destinations: An Analysis of Yelp and TripAdvisor Reviews","volume":"17","author":"Garner","year":"2022","journal-title":"Consum. Behav. Tour. Hosp."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Shrestha, D., Wenan, T., Shrestha, D., Rajkarnikar, N., and Jeong, S.-R. (2024). Personalized Tourist Recommender System: A Data-Driven and Machine-Learning Approach. Computation, 12.","DOI":"10.3390\/computation12030059"},{"key":"ref_4","first-page":"395","article-title":"A Two-Stage Sentiment Analysis Approach on Multilingual Restaurant Reviews in Almaty","volume":"8","author":"Uysal","year":"2025","journal-title":"Int. J. Innov. Res. Sci. Stud."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"47","DOI":"10.47703\/ejebs.v69i1.466","article-title":"Econometric Analysis of the Tourist Flow in Kazakhstan: Trends, Factors and Forecasts","volume":"69","author":"Serikbayeva","year":"2025","journal-title":"Eurasian J. Econ. Bus. Stud."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"32","DOI":"10.47703\/ejebs.v69i1.458","article-title":"Econometric Analysis of Key Factors Affecting Domestic Tourism Development in Kazakhstan","volume":"69","author":"Toleubayeva","year":"2025","journal-title":"Eurasian J. Econ. Bus. Stud."},{"key":"ref_7","unstructured":"Yeshpanov, R., and Varol, H.A. (2024). KazSAnDRA: Kazakh Sentiment Analysis Dataset of Reviews and Attitudes. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yergesh, B., Bekmanova, G., and Sharipbay, A. (2017, January 5\u20138). Sentiment Analysis on the Hotel Reviews in the Kazakh Language. Proceedings of the 2017 International Conference on Computer Science and Engineering (UBMK), Antalya, Turkey.","DOI":"10.1109\/UBMK.2017.8093531"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Nugumanova, A., Baiburin, Y., and Alimzhanov, Y. (2022, January 28\u201330). Sentiment Analysis of Reviews in Kazakh with Transfer Learning Techniques. Proceedings of the 2022 International Conference on Smart Information Systems and Technologies (SIST), Nur-Sultan, Kazakhstan.","DOI":"10.1109\/SIST54437.2022.9945811"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sadirmekova, Z., Sambetbayeva, M., Daiyrbayeva, E., Yerimbetova, A., Altynbekova, Z., and Murzakhmetov, A. (2023, January 13\u201315). Constructing the Terminological Core of NLP Ontology. Proceedings of the 2023 8th International Conference on Computer Science and Engineering (UBMK), Burdur, Turkiye.","DOI":"10.1109\/UBMK59864.2023.10286646"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"98","DOI":"10.26577\/JMMCS2024-v123-i3-9","article-title":"Creation of Information System Model for the Assessment of Tourism Objects","volume":"123","author":"Bapanov","year":"2024","journal-title":"J. Math. Mech. Comput. Sci."},{"key":"ref_12","first-page":"122","article-title":"On the path to tourism digitalization: The digital ecosystem by the example of Kazakhstan","volume":"6","author":"Shilibekova","year":"2024","journal-title":"J. Digit. Tour. Cult."},{"key":"ref_13","first-page":"411","article-title":"Sentiment and Toxicity Analysis of Tourism-Related Video through Vader, Textblob, and Perspective Model in Communalytic","volume":"6","author":"Singgalen","year":"2024","journal-title":"Build. Inform. Technol. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/s40537-023-00861-x","article-title":"Analysis of Customer Reviews with an Improved VADER Lexicon Classifier","volume":"11","author":"Barik","year":"2024","journal-title":"J. Big Data"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zeng, B., Yang, H., Xu, R., Zhou, W., and Han, X. (2019). LCF: A Local Context Focus Mechanism for Aspect-Based Sentiment Classification. Appl. Sci., 9.","DOI":"10.3390\/app9163389"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Han, H., Wang, S., Qiao, B., Dang, L., Zou, X., Xue, H., and Wang, Y. (2025). Aspect-Based Sentiment Analysis Through Graph Convolutional Networks and Joint Task Learning. Information, 16.","DOI":"10.3390\/info16030201"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tan, K.L., Lee, C.P., and Lim, K.M. (2023). RoBERTa-GRU: A Hybrid Deep Learning Model for Enhanced Sentiment Analysis. Appl. Sci., 13.","DOI":"10.3390\/app13063915"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"118246","DOI":"10.1016\/j.eswa.2022.118246","article-title":"Cross Lingual Transfer Learning for Sentiment Analysis of Italian TripAdvisor Reviews","volume":"209","author":"Catelli","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kamps, J., Goeuriot, L., Crestani, F., Maistro, M., Joho, H., Davis, B., Gurrin, C., Kruschwitz, U., and Caputo, A. (2023, January 2\u20136). TourismNLG: A Multi-Lingual Generative Benchmark for the Tourism Domain. Proceedings of the Advances in Information Retrieval, Dublin, Ireland.","DOI":"10.1007\/978-3-031-28244-7"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"60","DOI":"10.51176\/1997-9967-2024-3-60-72","article-title":"Analysis of Online User Reviews for Popular Tourist Attractions: Almaty Case","volume":"19","author":"Uysal","year":"2024","journal-title":"Econ. Strategy Pract."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Malebary, S.J., and Abulfaraj, A.W. (2024). A Stacking Ensemble Based on Lexicon and Machine Learning Methods for the Sentiment Analysis of Tweets. Mathematics, 12.","DOI":"10.3390\/math12213405"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Catelli, R., Pelosi, S., and Esposito, M. (2022). Lexicon-Based vs. Bert-Based Sentiment Analysis: A Comparative Study in Italian. Electronics, 11.","DOI":"10.3390\/electronics11030374"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nawawi, I., Ilmawan, K.F., Maarif, M.R., and Syafrudin, M. (2024). Exploring Tourist Experience through Online Reviews Using Aspect-Based Sentiment Analysis with Zero-Shot Learning for Hospitality Service Enhancement. Information, 15.","DOI":"10.3390\/info15080499"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mutinda, J., Mwangi, W., and Okeyo, G. (2023). Sentiment Analysis of Text Reviews Using Lexicon-Enhanced Bert Embedding (LeBERT) Model with Convolutional Neural Network. Appl. Sci., 13.","DOI":"10.3390\/app13031445"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zakarija, I., \u0160kopljanac-Ma\u010dina, F., Maru\u0161i\u0107, H., and Bla\u0161kovi\u0107, B. (2024). A Sentiment Analysis Model Based on User Experiences of Dubrovnik on the Tripadvisor Platform. Appl. Sci., 14.","DOI":"10.3390\/app14188304"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.3390\/stats7040090","article-title":"Sentiment Analysis for Tourism Insights: A Machine Learning Approach","volume":"7","author":"Charfaoui","year":"2024","journal-title":"Stats"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.dsm.2022.02.001","article-title":"A Novel Self-Learning Approach to Overcome Incompatibility on TripAdvisor Reviews","volume":"5","author":"Abeysinghe","year":"2022","journal-title":"Data Sci. Manag."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fang, H., Xu, G., Long, Y., and Tang, W. (2022). An Effective ELECTRA-Based Pipeline for Sentiment Analysis of Tourist Attraction Reviews. Appl. Sci., 12.","DOI":"10.3390\/app122110881"},{"key":"ref_29","unstructured":"Handhika, T., Fahrurozi, A., Sari, I., Lestari, D.P., and Zen, R.I.M. (2019, January 10\u201311). Hybrid Method for Sentiment Analysis Using Homogeneous Ensemble Classifier. Proceedings of the 2019 2nd International Conference of Computer and Informatics Engineering (IC2IE), Banyuwangi, Indonesia."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xiao, L., Mao, R., Zhao, S., Lin, Q., Jia, Y., He, L., and Cambria, E. (2025). Exploring Cognitive and Aesthetic Causality for Multimodal Aspect-Based Sentiment Analysis. arXiv.","DOI":"10.1109\/TAFFC.2025.3565506"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Saoualih, A., Safaa, L., Bouhatous, A., Bidan, M., Perkumien\u0117, D., Aleinikovas, M., \u0160ilinskas, B., and Perkumas, A. (2024). Exploring the Tourist Experience of the Majorelle Garden Using VADER-Based Sentiment Analysis and the Latent Dirichlet Allocation Algorithm: The Case of TripAdvisor Reviews. Sustainability, 16.","DOI":"10.3390\/su16156378"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"101894","DOI":"10.1016\/j.mex.2022.101894","article-title":"Analyzing Tourism Reviews Using an LDA Topic-Based Sentiment Analysis Approach","volume":"9","author":"Ali","year":"2022","journal-title":"MethodsX"},{"key":"ref_33","unstructured":"W\u00f6rndl, W., Koo, C., and Stienmetz, J.L. (2021). Do Tourists from Different Countries Interpret Travel Experience with the Same Feeling? Sentiment Analysis of TripAdvisor Reviews. Information and Communication Technologies in Tourism 2021, Springer International Publishing."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"102048","DOI":"10.1016\/j.jksuci.2024.102048","article-title":"Sentiment Analysis Methods, Applications, and Challenges: A Systematic Literature Review","volume":"36","author":"Mao","year":"2024","journal-title":"J. King Saud Univ. -Comput. Inf. Sci."},{"key":"ref_35","unstructured":"Loria, S. (2025, August 12). Textblob Documentation. Release 0.15.\u2014References\u2014Scientific Research Publishing. Available online: https:\/\/www.scirp.org\/reference\/referencespapers?referenceid=3601501."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"85721","DOI":"10.1109\/ACCESS.2021.3088838","article-title":"Determining the Efficiency of Drugs Under Special Conditions from Users\u2019 Reviews on Healthcare Web Forums","volume":"9","author":"Saad","year":"2021","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Gaye, B., Zhang, D., and Wulamu, A. (2021). A Tweet Sentiment Classification Approach Using a Hybrid Stacked Ensemble Technique. Information, 12.","DOI":"10.3390\/info12090374"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Mujahid, M., Lee, E., Rustam, F., Washington, P.B., Ullah, S., Reshi, A.A., and Ashraf, I. (2021). Sentiment Analysis and Topic Modeling on Tweets about Online Education during COVID-19. Appl. Sci., 11.","DOI":"10.3390\/app11188438"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Qi, P., Zhang, Y., Zhang, Y., Bolton, J., and Manning, C.D. (2020). Stanza: A Python Natural Language Processing Toolkit for Many Human Languages. arXiv.","DOI":"10.18653\/v1\/2020.acl-demos.14"}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/10\/240\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T06:16:27Z","timestamp":1760422587000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/10\/240"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,13]]},"references-count":39,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["computation13100240"],"URL":"https:\/\/doi.org\/10.3390\/computation13100240","relation":{},"ISSN":["2079-3197"],"issn-type":[{"value":"2079-3197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,13]]}}}