{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T07:42:22Z","timestamp":1782373342866,"version":"3.54.5"},"reference-count":28,"publisher":"World Scientific Pub Co Pte Ltd","issue":"03","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Comp. Intel. Appl."],"published-print":{"date-parts":[[2023,9]]},"abstract":"<jats:p> In recent years, with the strong and outstanding development of the Internet, the need to refer to the feedback of previous customers when shopping online is increasing. Therefore, websites are developed to allow users to share experiences, reviews, comments and feedback about the services and products of businesses and organizations. The organizations also collect user feedback about their products and services to give better directions. However, with a large amount of user feedback about certain services and products, it is difficult for users, businesses, and organizations to pay attention to them all. Thus, an automatic system is necessary to analyze the sentiment of a customer feedback. Recently, the well-known pre-trained language models for Vietnamese (PhoBERT) achieved high performance in comparison with other approaches. However, this method may not focus on the local information in the text like phrases or fragments. In this paper, we propose a Convolutional Neural Network (CNN) model based on PhoBERT for sentiment classification. The output of contextualized embeddings of the PhoBERT\u2019s last four layers is fed into the CNN. This makes the network capable of obtaining more local information from the sentiment. Besides, the PhoBERT output is also given to the transformer encoder layers in order to employ the self-attention technique, and this also makes the model more focused on the important information of the sentiment segments. The experimental results demonstrate that the proposed approach gives competitive performance compared to the existing studies on three public datasets with the opinions of Vietnamese people. <\/jats:p>","DOI":"10.1142\/s1469026823500165","type":"journal-article","created":{"date-parts":[[2023,4,5]],"date-time":"2023-04-05T07:20:55Z","timestamp":1680679255000},"source":"Crossref","is-referenced-by-count":3,"title":["Pre-Trained Language Model-Based Deep Learning for Sentiment Classification of Vietnamese Feedback"],"prefix":"10.1142","volume":"22","author":[{"given":"Cu Vinh","family":"Loc","sequence":"first","affiliation":[{"name":"Can Tho University Software Center, Can Tho University, Can Tho City, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Truong Xuan","family":"Viet","sequence":"additional","affiliation":[{"name":"Can Tho University Software Center, Can Tho University, Can Tho City, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tran Hoang","family":"Viet","sequence":"additional","affiliation":[{"name":"Can Tho University Software Center, Can Tho University, Can Tho City, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Le Hoang","family":"Thao","sequence":"additional","affiliation":[{"name":"Can Tho University Software Center, Can Tho University, Can Tho City, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nguyen Hoang","family":"Viet","sequence":"additional","affiliation":[{"name":"Can Tho University Software Center, Can Tho University, Can Tho City, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2023,4,5]]},"reference":[{"key":"S1469026823500165BIB003","volume-title":"Proc. 26th Annual Int. ACM SIGIR Conf. Research and Development in Informaion Retrieval","author":"Zhang D.","year":"2003"},{"key":"S1469026823500165BIB004","first-page":"142","volume-title":"Proc. 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies \u2014 Volume 1","author":"Maas A. L.","year":"2011"},{"key":"S1469026823500165BIB006","volume-title":"NIPS 2014 Workshop on Deep Learning, December 2014","author":"Chung J.","year":"2014"},{"key":"S1469026823500165BIB007","author":"Ha H.","year":"2019","journal-title":"Expert Systems with Applications"},{"key":"S1469026823500165BIB008","volume-title":"Smart Trends in Information Technology and Computer Communications","author":"Behdenna S.","year":"2016"},{"key":"S1469026823500165BIB010","volume-title":"2015 Science and Information Conf. (SAI)","author":"Madhoushi Z.","year":"2015"},{"key":"S1469026823500165BIB011","volume-title":"2017 Int. Conf. Intelligent Sustainable Systems (ICISS)","author":"Sankar H.","year":"2017"},{"key":"S1469026823500165BIB013","volume-title":"2010 Second Int. Conf. Knowledge and Systems Engineering","author":"Kieu B. T.","year":"2010"},{"key":"S1469026823500165BIB014","volume-title":"2020 7th NAFOSTED Conf. Information and Computer Science (NICS)","author":"Nguyen Q. T.","year":"2020"},{"key":"S1469026823500165BIB015","volume-title":"Proc. Tenth Int. Symp. Information and Communication Technology","author":"Nguyen-Thanh T.","year":"2019"},{"key":"S1469026823500165BIB016","doi-asserted-by":"crossref","DOI":"10.1007\/978-981-15-6168-9","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2020","author":"Nguyen D. Q.","year":"2020"},{"key":"S1469026823500165BIB017","volume-title":"2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conf. (UEMCON)","author":"Yenter A.","year":"2017"},{"key":"S1469026823500165BIB018","volume-title":"Proc. 6th ACM SIGSPATIAL International Workshop on Emergency Management Using GIS","author":"Yu X.","year":"2020"},{"key":"S1469026823500165BIB019","author":"Kim H.","year":"2019","journal-title":"Appl. Sci."},{"key":"S1469026823500165BIB020","author":"Suciati A.","year":"2020","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"S1469026823500165BIB021","author":"Ghorbani M.","year":"2020","journal-title":"J. Cloud Comput. Adv. Syst. Appl."},{"key":"S1469026823500165BIB022","author":"Cen D. Z. P.","year":"2020","journal-title":"J. Artif. Intell."},{"key":"S1469026823500165BIB023","volume-title":"Proc. 22nd Nordic Conf. Computational Linguistics","author":"Hoang M.","year":"2019"},{"key":"S1469026823500165BIB024","author":"Kastrati Z.","year":"2021","journal-title":"Electronics"},{"key":"S1469026823500165BIB025","author":"\u00d3bal Col\u00f3n-Ruiz C.","year":"2020","journal-title":"J. Biomed. Inform."},{"key":"S1469026823500165BIB026","volume-title":"2020 5th Int. Conf. Computer and Communication Systems (ICCCS)","author":"Dong J.","year":"2020"},{"key":"S1469026823500165BIB027","volume-title":"2018 5th NAFOSTED Conf. Information and Computer Science (NICS)","author":"Nguyen P.","year":"2018"},{"key":"S1469026823500165BIB028","volume-title":"2018 5th NAFOSTED Conf. Information and Computer Science (NICS)","author":"Nguyen H.-Q.","year":"2018"},{"key":"S1469026823500165BIB029","volume-title":"2018 10th Int. Conf. Knowledge and Systems Engineering (KSE)","author":"Nguyen V. D.","year":"2018"},{"key":"S1469026823500165BIB030","author":"Tran T. K.","year":"2019","journal-title":"Appl. Sci."},{"key":"S1469026823500165BIB031","volume-title":"Int. Conf. Knowledge and Systems Engineering","author":"Pham S.","year":"2010"},{"key":"S1469026823500165BIB032","volume-title":"2018 10th Int. Conf. Knowledge and Systems Engineering (KSE)","author":"Nguyen K. V.","year":"2018"},{"key":"S1469026823500165BIB033","volume-title":"Proc. 2018 Conf. North American Chapter of the Association for Computational Linguistics: Demonstrations","author":"Vu T.","year":"2018"}],"container-title":["International Journal of Computational Intelligence and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1469026823500165","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T12:54:59Z","timestamp":1696942499000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S1469026823500165"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,5]]},"references-count":28,"journal-issue":{"issue":"03","published-print":{"date-parts":[[2023,9]]}},"alternative-id":["10.1142\/S1469026823500165"],"URL":"https:\/\/doi.org\/10.1142\/s1469026823500165","relation":{},"ISSN":["1469-0268","1757-5885"],"issn-type":[{"value":"1469-0268","type":"print"},{"value":"1757-5885","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,5]]},"article-number":"2350016"}}