{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T08:24:15Z","timestamp":1775031855118,"version":"3.50.1"},"reference-count":31,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T00:00:00Z","timestamp":1723852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Digital"],"abstract":"<jats:p>The unprecedented production and sharing of data, opinions, and comments among people on social media and the Internet in general has highlighted sentiment analysis (SA) as a key machine learning approach in scientific and market research. Sentiment analysis can extract sentiments and opinions from user-generated text, providing useful evidence for new product decision-making and effective customer relationship management. However, there are concerns about existing standard sentiment analysis tools regarding the generation of inaccurate sentiment classification results. The objective of this paper is to determine the efficiency of off-the-shelf sentiment analysis APIs in recognizing low-resource languages, such as Greek. Specifically, we examined whether sentiment analysis performed on 300 online ordering customer reviews using the Meaning Cloud web-based tool produced meaningful results with high accuracy. According to the results of this study, we found low agreement between the web-based and the actual raters in the food delivery services related data. However, the low accuracy of the results highlights the need for specialized sentiment analysis tools capable of recognizing only one low-resource language. Finally, the results highlight the necessity of developing specialized lexicons tailored not only to a specific language but also to a particular field, such as a specific type of restaurant or shop.<\/jats:p>","DOI":"10.3390\/digital4030035","type":"journal-article","created":{"date-parts":[[2024,8,19]],"date-time":"2024-08-19T10:11:28Z","timestamp":1724062288000},"page":"698-709","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Sentiment Analysis Approach for Exploring Customer Reviews of Online Food Delivery Services: A Greek Case"],"prefix":"10.3390","volume":"4","author":[{"given":"Nikolaos","family":"Fragkos","sequence":"first","affiliation":[{"name":"Department of Agricultural Economics and Rural Development, School of Applied Economics and Social Sciences, Informatics Laboratory, Agricultural University of Athens, 75 Iera Odos St., 11855 Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6271-9022","authenticated-orcid":false,"given":"Anastasios","family":"Liapakis","sequence":"additional","affiliation":[{"name":"Department of Archival, Library and Information Studies, School of Administrative, Economics & Social Sciences, University of West Attica, 28, Ag. Spyridonos St., 12243 Egaleo, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"Ntaliani","sequence":"additional","affiliation":[{"name":"Department of Agricultural Economics and Rural Development, School of Applied Economics and Social Sciences, Informatics Laboratory, Agricultural University of Athens, 75 Iera Odos St., 11855 Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Filotheos","family":"Ntalianis","sequence":"additional","affiliation":[{"name":"Department of Business Administration, School of Economics, Business and International Studies, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534 Piraeus, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Constantina","family":"Costopoulou","sequence":"additional","affiliation":[{"name":"Department of Agricultural Economics and Rural Development, School of Applied Economics and Social Sciences, Informatics Laboratory, Agricultural University of Athens, 75 Iera Odos St., 11855 Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"46","DOI":"10.2478\/bsrj-2021-0018","article-title":"Sentiment analysis of customer feedback in online food ordering services","volume":"12","author":"Nguyen","year":"2021","journal-title":"Bus. Syst. Res. J."},{"key":"ref_2","first-page":"691","article-title":"Customer reviews analytics on food delivery services in social media: A review","volume":"9","author":"Shaeeali","year":"2020","journal-title":"IAES Int. J. Artif. Intell. (IJ-AI)"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Adak, A., Pradhan, B., and Shukla, N. (2022). Sentiment analysis of customer reviews of food delivery services using deep learning and explainable artificial intelligence: Systematic review. Foods, 11.","DOI":"10.3390\/foods11101500"},{"key":"ref_4","unstructured":"Magueresse, A., Carles, V., and Heetderks, E. (2020). Low-resource languages: A review of past work and future challenges. arXiv."},{"key":"ref_5","first-page":"841","article-title":"End-to-end aspect extraction and aspect-based sentiment analysis framework for low-resource languages","volume":"824","author":"Aivatoglou","year":"2024","journal-title":"Intell. Syst. Conf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/1500000011","article-title":"Opinion mining and sentiment analysis","volume":"2","author":"Pang","year":"2008","journal-title":"Found. Trends\u00ae Inf. Retr."},{"key":"ref_7","first-page":"1631","article-title":"Recursive deep models for semantic compositionality over a sentiment treebank","volume":"1631","author":"Socher","year":"2013","journal-title":"EMNLP"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, Y., Huang, M., Zhu, X., and Zhao, L. (2016, January 1\u20135). Attention-based LSTM for Aspect-level Sentiment Classification. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1058"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"107134","DOI":"10.1016\/j.knosys.2021.107134","article-title":"A comprehensive survey on sentiment analysis: Approaches, challenges and trends","volume":"226","author":"Birjali","year":"2021","journal-title":"Knowl. Based Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Madhoushi, Z., Hamdan, A.R., and Zainudin, S. (2015, January 28\u201330). Sentiment analysis techniques in recent works. Proceedings of the 2015 Science and Information Conference (SAI), London, UK.","DOI":"10.1109\/SAI.2015.7237157"},{"key":"ref_11","unstructured":"Thakkar, H., and Patel, D. (2015). Approaches for Sentiment Analysis on Twitter: A State-of-Art study. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Nasim, Z., Rajput, Q., and Haider, S. (2017, January 16\u201317). Sentiment analysis of student feedback using machine learning and lexicon based approaches. Proceedings of the 2017 International Conference On Research And Innovation In Information Systems (ICRIIS), Langkawi, Malaysia.","DOI":"10.1109\/ICRIIS.2017.8002475"},{"key":"ref_13","unstructured":"Sadia, A., Khan, F.K., and Bashir, F. (2024, January 24). An Overview of Lexicon-Based Approach For Sentiment Analysis. Available online: https:\/\/api.semanticscholar.org\/CorpusID:201105314."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhou, L., Zhang, C., Liu, F., Qiu, Z., and He, Y. (2019). Application of Deep Learning in Food: A Review, Blackwell Publishing Inc.","DOI":"10.1111\/1541-4337.12492"},{"key":"ref_15","first-page":"1009","article-title":"Mapping acceptance of indonesian organic food consumption under COVID-19 pandemic using sentiment analysis of twitter dataset","volume":"99","author":"Rintyarna","year":"2021","journal-title":"J. Theor. Appl. Inf. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"103058","DOI":"10.1016\/j.ipm.2022.103058","article-title":"A hybrid lexicon-based and neural approach for explainable polarity detection","volume":"59","author":"Polignano","year":"2022","journal-title":"Inf. Process Manag."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1108\/BFJ-03-2020-0192","article-title":"Using Twitter to explore consumers\u2019 sentiments and their social representations towards new food trends","volume":"123","author":"Pindado","year":"2021","journal-title":"Br. Food J."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Appel, O., Chiclana, F., Carter, J., and Fujita, H. (2016, January 2\u20134). A hybrid approach to sentiment analysis with benchmarking Results. Proceedings of the Trends in Applied Knowledge-Based Systems and Data Science: 29th International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, Morioka, Japan.","DOI":"10.1007\/978-3-319-42007-3_21"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1111\/ijcs.12877","article-title":"Analysing customers\u2019 reviews and ratings for online food deliveries: A text mining approach","volume":"47","author":"Khan","year":"2023","journal-title":"Int. J. Consum. Stud."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, W., Alqhatani, A., Asiri, F., and Salwana, E. (2023). Customer preference analysis towards online shopping decisions based on optimized feature extraction. Expert Syst., 1\u201315.","DOI":"10.1111\/exsy.13460"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3513","DOI":"10.1108\/BFJ-12-2019-0909","article-title":"Customers\u2019 experiences of fast food delivery services: Uncovering the semantic core benefits, actual and augmented product by text mining","volume":"122","author":"Teichert","year":"2020","journal-title":"Br. Food J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1108\/GKMC-04-2020-0056","article-title":"Twitter Sentiment Analysis of App Based Online Food Delivery Companies","volume":"70","author":"Trivedi","year":"2021","journal-title":"Glob. Knowl. Mem. Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1007\/s10586-023-03970-7","article-title":"Twitter sentiment analysis on online food services based on elephant herd optimization with hybrid deep learning technique","volume":"27","author":"Vatambeti","year":"2024","journal-title":"Clust. Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"102135","DOI":"10.1109\/ACCESS.2022.3208164","article-title":"Deep learning based cross domain sentiment classification for urdu language","volume":"10","author":"Altaf","year":"2022","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zulfiker, S., Chowdhury, A., Roy, D., Datta, S., and Momen, S. (2015, January 28\u201330). Bangla E-Commerce Sentiment Analysis Using Machine Learning Approach. Proceedings of the 2022 4th International Conference on Sustainable Technologies for Industry 4.0 (sti), IEEE, London, UK.","DOI":"10.1109\/STI56238.2022.10103350"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jang, J., Lee, E., and Jung, H. (2022). Analysis of food delivery using big data: Comparative study before and after COVID-19. Foods, 11.","DOI":"10.3390\/foods11193029"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"103363","DOI":"10.1016\/j.jretconser.2023.103363","article-title":"Text mining approach to explore determinants of grocery mobile app satisfaction using online customer reviews","volume":"73","author":"Kumar","year":"2023","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"21","DOI":"10.5121\/ijnlc.2020.9203","article-title":"A sentiment lexicon-based analysis for food and beverage industry reviews","volume":"9","author":"Liapakis","year":"2020","journal-title":"Greek Lang. Paradigm. Int. J. Nat. Lang. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Landis, J.R., and Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33.","DOI":"10.2307\/2529310"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1037\/1040-3590.6.4.284","article-title":"Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology","volume":"6","author":"Cicchetti","year":"1994","journal-title":"Psychol. Assess"}],"container-title":["Digital"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2673-6470\/4\/3\/35\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:38:19Z","timestamp":1760110699000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2673-6470\/4\/3\/35"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,17]]},"references-count":31,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["digital4030035"],"URL":"https:\/\/doi.org\/10.3390\/digital4030035","relation":{},"ISSN":["2673-6470"],"issn-type":[{"value":"2673-6470","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,17]]}}}