{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T15:01:40Z","timestamp":1787065300993,"version":"build-2736575974"},"reference-count":34,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T00:00:00Z","timestamp":1734912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Sentiment analysis via artificial intelligence, i.e., machine learning and large language models (LLMs), is a pivotal tool that classifies sentiments within texts as positive, negative, or neutral. It enables computers to automatically detect and interpret emotions from textual data, covering a spectrum of feelings without direct human intervention. Sentiment analysis is integral to marketing research, helping to gauge consumer emotions and opinions across various sectors. Its applications span analyzing movie reviews, monitoring social media, evaluating product feedback, assessing employee sentiments, and identifying hate speech. This study explores the application of both traditional machine learning and pre-trained LLMs for automated sentiment analysis of customer product reviews. The motivation behind this work lies in the demand for more nuanced understanding of consumer sentiments that can drive data-informed business decisions. In this research, we applied machine learning-based classifiers, i.e., Random Forest, Naive Bayes, and Support Vector Machine, alongside the GPT-4 model to benchmark their effectiveness for sentiment analysis. Traditional models show better results and efficiency in processing short, concise text, with SVM in classifying sentiment of short length comments. However, GPT-4 showed better results with more detailed texts, capturing subtle sentiments with higher precision, recall, and F1 scores to uniquely identify mixed sentiments not found in the simpler models. Conclusively, this study shows that LLMs outperform traditional models in context-rich sentiment analysis by not only providing accurate sentiment classification but also insightful explanations. These results enable LLMs to provide a superior tool for customer-centric businesses, which helps actionable insights to be derived from any textual data.<\/jats:p>","DOI":"10.3390\/bdcc8120199","type":"journal-article","created":{"date-parts":[[2024,12,24]],"date-time":"2024-12-24T02:50:56Z","timestamp":1735008656000},"page":"199","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":65,"title":["Sentiment Analysis of Product Reviews Using Machine Learning and Pre-Trained LLM"],"prefix":"10.3390","volume":"8","author":[{"given":"Pawanjit Singh","family":"Ghatora","sequence":"first","affiliation":[{"name":"Whitecliffe School of Information Technology, Auckland 1010, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2947-5582","authenticated-orcid":false,"given":"Seyed Ebrahim","family":"Hosseini","sequence":"additional","affiliation":[{"name":"Whitecliffe School of Information Technology, Auckland 1010, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0232-2356","authenticated-orcid":false,"given":"Shahbaz","family":"Pervez","sequence":"additional","affiliation":[{"name":"Whitecliffe School of Information Technology, Auckland 1010, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad Javed","family":"Iqbal","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Engineering and Technology Taxila, Taxila 47050, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8363-349X","authenticated-orcid":false,"given":"Nabil","family":"Shaukat","sequence":"additional","affiliation":[{"name":"Institute of Design, Robotics and Manufacturing, School of Mechanical Engineering, University of Leeds, Leeds LS2 9JT, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chaturvedi, S., Mishra, V., and Mishra, N. (2017, January 21\u201322). Sentiment analysis using machine learning for business intelligence. Proceedings of the 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI), Chennai, India.","DOI":"10.1109\/ICPCSI.2017.8392100"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"102183","DOI":"10.1016\/j.datak.2023.102183","article-title":"A framework for investigating the dynamics of user and community sentiments in a social platform","volume":"146","author":"Bonifazi","year":"2023","journal-title":"Data Knowl. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"103516","DOI":"10.1016\/j.ipm.2023.103516","article-title":"Investigating the emotional experiences in eSports spectatorship: The case of League of Legends","volume":"60","author":"Cauteruccio","year":"2023","journal-title":"Inf. Process. Manag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5731","DOI":"10.1007\/s10462-022-10144-1","article-title":"A survey on sentiment analysis methods, applications, and challenges","volume":"55","author":"Wankhade","year":"2022","journal-title":"Artif. Intell. Rev."},{"key":"ref_5","unstructured":"Schmidt, R.K. (2024). Automatic Document Classification in Technical Logbooks: A Comparative Study of Supervised, Weakly Supervised and Unsupervised Machine Learning Approaches. [Master\u2019s Thesis, Universidade NOVA de Lisboa]."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2064","DOI":"10.30865\/mib.v6i4.4579","article-title":"BERT implementation on news sentiment analysis and analysis benefits on branding","volume":"6","author":"Abdussalam","year":"2022","journal-title":"J. Media Inform. Budidarma"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/MIS.2013.30","article-title":"New avenues in opinion mining and sentiment analysis","volume":"28","author":"Cambria","year":"2013","journal-title":"IEEE Intell. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Fanni, S.C., Febi, M., Aghakhanyan, G., and Neri, E. (2023). Natural language processing. Introduction to Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-031-25928-9_5"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3713","DOI":"10.1007\/s11042-022-13428-4","article-title":"Natural language processing: State of the art, current trends and challenges","volume":"82","author":"Khurana","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_10","first-page":"1","article-title":"Sentiment analysis of product reviews for e-commerce recommendation based on machine learning","volume":"15","author":"Loukili","year":"2023","journal-title":"Int. J. Adv. Soft Comput. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.neucom.2023.02.015","article-title":"Machine learning and deep learning for sentiment analysis across languages: A survey","volume":"531","author":"Mercha","year":"2023","journal-title":"Neurocomputing"},{"key":"ref_12","unstructured":"Luthra, R., Bisht, G.S., and Sharma, V.K. (2023). Cardiovascular Diseases (CVD) Prediction Models: A Systematic Review, Jaypee University of Information Technology."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"67","DOI":"10.23887\/janapati.v12i1.59746","article-title":"Alternative text pre-processing using chat GPT open AI","volume":"12","author":"Julianto","year":"2023","journal-title":"J. Nas. Pendidik. Tek. Inform. JANAPATI"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s40547-024-00143-4","article-title":"Sentiment Analysis in the Age of Generative AI","volume":"11","author":"Krugmann","year":"2024","journal-title":"Cust. Needs Solut."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1016\/j.asej.2014.04.011","article-title":"Sentiment analysis algorithms and applications: A survey","volume":"5","author":"Medhat","year":"2014","journal-title":"Ain Shams Eng. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.eswa.2017.02.002","article-title":"Enhancing Deep Learning Sentiment Analysis with Ensemble Techniques in Social Applications","volume":"77","author":"Araque","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Machova, K., Mach, M., and Vasilko, M. (2021). Comparison of machine learning and sentiment analysis in detection of suspicious online reviewers on different type of data. Sensors, 22.","DOI":"10.3390\/s22010155"},{"key":"ref_18","first-page":"3563","article-title":"Sentiment analysis from unstructured hotel reviews data in social network using deep learning techniques","volume":"15","author":"Priya","year":"2023","journal-title":"Int. J. Inf. Technol."},{"key":"ref_19","first-page":"618","article-title":"Sentiment Analysis of Online Movie Reviews using Machine Learning","volume":"13","author":"Steinke","year":"2022","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"022015","DOI":"10.1088\/1742-6596\/1176\/2\/022015","article-title":"Twitter sentiment analysis: A case study for apparel brands","volume":"1176","author":"Rasool","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Mathew, L., and Bindu, V.R. (2020, January 11\u201313). A Review of Natural Language Processing Techniques for Sentiment Analysis using Pre-trained Models. Proceedings of the 2020 Fourth International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.","DOI":"10.1109\/ICCMC48092.2020.ICCMC-00064"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bellar, O., Baina, A., and Ballafkih, M. (2024). Sentiment Analysis: Predicting Product Reviews for E-Commerce Recommendations Using Deep Learning and Transformers. Mathematics, 12.","DOI":"10.3390\/math12152403"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e1253","DOI":"10.1002\/widm.1253","article-title":"Deep learning for sentiment analysis: A survey","volume":"8","author":"Zhang","year":"2018","journal-title":"WIREs Data Min. Knowl. Discov."},{"key":"ref_24","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_25","unstructured":"Chi, S., Qiu, X., Xu, Y., and Huang, X. (2019). How to Fine-Tune BERT for Text Classification?. arXiv."},{"key":"ref_26","first-page":"30","article-title":"Sentiment Analysis using Large Language Models: Methodologies, Applications, and Challenges","volume":"186","author":"Upadhye","year":"2024","journal-title":"Int. J. Comput. Appl."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Maceda, L.L., Llovido, J.L., Artiaga, M.B., and Abisado, M.B. (2023, January 15\u201317). Classifying Sentiments on Social Media Texts: A GPT-4 Preliminary Study. Proceedings of the 2023 7th International Conference on Natural Language Processing and Information Retrieval, Seoul, Republic of Korea.","DOI":"10.1145\/3639233.3639353"},{"key":"ref_28","unstructured":"Vaghani, N., and Thummar, M. (2024, May 16). Flipkart Product Reviews with Sentiment Dataset. Available online: https:\/\/www.kaggle.com\/dsv\/4940809."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"20","DOI":"10.47611\/jsr.v13i2.2471","article-title":"Comparing Bag-of-Words, SBERT, and GPT-3 for Bias Detection","volume":"13","author":"Luo","year":"2024","journal-title":"J. Stud. Res."},{"key":"ref_30","unstructured":"Jin, P., Zhang, Y., Chen, X., and Xia, Y. (2016, January 9). Bag-of-embeddings for text classification. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/s10462-018-09677-1","article-title":"Survey on supervised machine learning techniques for automatic text classification","volume":"52","author":"Kadhim","year":"2019","journal-title":"Artif. Intell. Rev."},{"key":"ref_32","first-page":"97","article-title":"Anatomy of Sentiment Analysis of Tweets Using Machine Learning Approach","volume":"23","author":"Iram","year":"2023","journal-title":"Int. J. Comput. Sci. Netw. Secur."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"El Naqa, I., Li, R., and Murphy, M.J. (2015). Performance Evaluation in Machine Learning. Machine Learning in Radiation Oncology: Theory and Applications, Springer International Publishing.","DOI":"10.1007\/978-3-319-18305-3"},{"key":"ref_34","unstructured":"Shah, D. (2024, May 16). Top Performance Metrics in Machine Learning: A Comprehensive Guide. May 2023. Available online: https:\/\/www.v7labs.com\/blog\/performance-metrics-in-machine-learning."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/8\/12\/199\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:58:49Z","timestamp":1760115529000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/8\/12\/199"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,23]]},"references-count":34,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["bdcc8120199"],"URL":"https:\/\/doi.org\/10.3390\/bdcc8120199","relation":{},"ISSN":["2504-2289"],"issn-type":[{"value":"2504-2289","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,23]]}}}