{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T19:26:46Z","timestamp":1776367606123,"version":"3.51.2"},"reference-count":37,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,4,27]],"date-time":"2021-04-27T00:00:00Z","timestamp":1619481600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003661","name":"Korea Institute for Advancement of Technology","doi-asserted-by":"publisher","award":["S2855401"],"award-info":[{"award-number":["S2855401"]}],"id":[{"id":"10.13039\/501100003661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Now that untact services are widespread and worldwide, the number of users visiting online shopping malls has increased. For example, the recommendation systems in Netflix, Amazon, etc., have gained a lot of attention by attracting many users and have made large profit by recommending suitable products to their users. In the paper, we conduct a study to enhance recommendation accuracy using Word2Vec, widely used in natural language processing. We collect user shopping history with personal click preference information of product items as data, representing a document for natural language processing. The sequence of product item clicks is fed into the Word2Vec technology algorithm to obtain the vectors symmetrically representing all of the product items clicked by users. Training and test data have a series of vectors representing a sequence of the clicked product items as inputs and a purchased product as a target. Machine learning models recommend a product as a symmetric vector for each input and calculate the similarity among the recommended vectors and all other registered products they sell in the system to recommend multiple products as final recommendation results. We use XGBoost regressor and classifier models to recommend some products that users would like and evaluate the recommendation accuracy. A finally recommended product by the models is a vector, and the system recommends some more products by calculating the similarity as mentioned above. We evaluated the classifier model\u2019s recommendation accuracy without Word2Vec encoding first and then with the Word2Vec technique. Meanwhile, we can represent the products with single or multiple dimensional vectors. We noted that the recommendation accuracy increases when we use multiple dimensions of Word2Vec vectors from the experiments. We also evaluated the performances when the system recommends one or multiple products. For the recommendation of multiple products (five here), a regression model has higher accuracy than a classification model in all dimensions of vectors.<\/jats:p>","DOI":"10.3390\/sym13050758","type":"journal-article","created":{"date-parts":[[2021,4,27]],"date-time":"2021-04-27T21:18:20Z","timestamp":1619558300000},"page":"758","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Extreme Gradient Boosting for Recommendation System by Transforming Product Classification into Regression Based on Multi-Dimensional Word2Vec"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2220-9318","authenticated-orcid":false,"given":"Se-Joon","family":"Park","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Jeju National University, Jeju-si 63243, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6297-7920","authenticated-orcid":false,"given":"Chul-Ung","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Mechatronics Engineering, Jeju National University, Jeju-si 63243, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1107-9941","authenticated-orcid":false,"given":"Yung-Cheol","family":"Byun","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Jeju National University, Jeju-si 63243, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lee, H.I., Choi, I.Y., Moon, H.S., and Kim, J.K. (2020). A Multi-Period Product Recommender System in Online Food Market based on Recurrent Neural Networks. Sustainability, 12.","DOI":"10.3390\/su12030969"},{"key":"ref_2","unstructured":"STATISTICS, K. (2021, April 22). Annual Report, 2020. Available online: https:\/\/kostat.go.kr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1108\/CAER-04-2020-0064","article-title":"The impact of online grocery shopping on stockpile behavior in Covid-19","volume":"12","author":"Hao","year":"2020","journal-title":"China Agric. Econ. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sardianos, C., Ballas Papadatos, G., and Varlamis, I. (2019). Optimizing parallel collaborative filtering approaches for improving recommendation systems performance. Information, 10.","DOI":"10.3390\/info10050155"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bock, J.R., and Maewal, A. (2020). Adversarial Learning for Product Recommendation. AI, 1.","DOI":"10.3390\/ai1030025"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gomez-Uribe, C.A., and Hunt, N. (2016). The Netflix Recommender System: Algorithms, Business Value, and Innovation. ACM Trans. Manag. Inf. Syst., 6.","DOI":"10.1145\/2843948"},{"key":"ref_7","first-page":"18","article-title":"Classification and regression by randomForest","volume":"2","author":"Liaw","year":"2002","journal-title":"R News"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1002\/widm.8","article-title":"Classification and regression trees","volume":"1","author":"Loh","year":"2011","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_9","first-page":"5","article-title":"Support vector machines for classification and regression","volume":"14","author":"Gunn","year":"1998","journal-title":"ISIS Technol. Rep."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ma, L., and Zhang, Y. (November, January 29). Using Word2Vec to process big text data. Proceedings of the 2015 IEEE International Conference on Big Data (Big Data), Santa Clara, CA, USA.","DOI":"10.1109\/BigData.2015.7364114"},{"key":"ref_11","first-page":"1","article-title":"A Hybrid Collaborative Filtering based on Online Shopping Patterns using XGBoost and Word2Vec","volume":"18","author":"Park","year":"2020","journal-title":"J. Korean Inst. Inf. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Shahbazi, Z., Hazra, D., Park, S., and Byun, Y.C. (2020). Toward Improving the Prediction Accuracy of Product Recommendation System Using Extreme Gradient Boosting and Encoding Approaches. Symmetry, 12.","DOI":"10.3390\/sym12091566"},{"key":"ref_13","unstructured":"Rong, X. (2014). Word2vec parameter learning explained. arXiv."},{"key":"ref_14","unstructured":"McCormick, C. (2021, March 03). Word2vec Tutorial-the Skip-Gram Model. Available online: http:\/\/mccormickml.com\/2016\/04\/19\/word2vec-tutorial-the-skip-gram-model."},{"key":"ref_15","unstructured":"Goldberg, Y., and Levy, O. (2014). word2vec Explained: Deriving Mikolov et al.\u2019s negative-sampling word-embedding method. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ling, W., Dyer, C., Black, A.W., and Trancoso, I. (June, January 31). Two\/too simple adaptations of word2vec for syntax problems. Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, CO, USA.","DOI":"10.3115\/v1\/N15-1142"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lilleberg, J., Zhu, Y., and Zhang, Y. (2015, January 6\u20138). Support vector machines and word2vec for text classification with semantic features. Proceedings of the 2015 IEEE 14th International Conference on Cognitive Informatics & Cognitive Computing (ICCI* CC), Beijing, China.","DOI":"10.1109\/ICCI-CC.2015.7259377"},{"key":"ref_18","unstructured":"Caselles-Dupr\u00e9, H., Lesaint, F., and Royo-Letelier, J. (October, January 27). Word2vec applied to recommendation: Hyperparameters matter. Proceedings of the 12th ACM Conference on Recommender Systems, Vancouver, BC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tezgider, M., Y\u0131ld\u0131z, B., and Ayd\u0131n, G. (2018, January 28\u201330). Improving Word Representation by Tuning Word2Vec Parameters with Deep Learning Model. Proceedings of the 2018 International Conference on Artificial Intelligence and Data Processing (IDAP), Malatya, EA, Turkey.","DOI":"10.1109\/IDAP.2018.8620919"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2681","DOI":"10.3390\/en13112681","article-title":"Machine Learning Based Hybrid System for Imputation and Efficient Energy Demand Forecasting","volume":"13","author":"Khan","year":"2020","journal-title":"Energies"},{"key":"ref_22","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Thakkar, P., Varma, K., Ukani, V., Mankad, S., and Tanwar, S. (2019). Combining user-based and item-based collaborative filtering using machine learning. Information and Communication Technology for Intelligent Systems, Springer.","DOI":"10.1007\/978-981-13-1747-7_17"},{"key":"ref_24","unstructured":"Kuhn, M. (2021, February 20). Caret: Classification and Regression Training. ASCL 2015, R Package Version 6.0-47, ascl\u20131505. Available online: http:\/\/CRAN.R-project.org\/package=caret."},{"key":"ref_25","first-page":"98","article-title":"Machine learning basics","volume":"1","author":"Goodfellow","year":"2016","journal-title":"Deep Learn."},{"key":"ref_26","first-page":"143","article-title":"SVMTorch: Support vector machines for large-scale regression problems","volume":"1","author":"Collobert","year":"2001","journal-title":"J. Mach. Learn. Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1023\/A:1007608224229","article-title":"A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms","volume":"40","author":"Lim","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1134\/S106422691606005X","article-title":"The influence of parameter initialization on the training time and accuracy of a nonlinear regression model","volume":"61","author":"Burnaev","year":"2016","journal-title":"J. Commun. Technol. Electron."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5121\/ijdkp.2015.5201","article-title":"A review on evaluation metrics for data classification evaluations","volume":"5","author":"Hossin","year":"2015","journal-title":"Int. J. Data Min. Knowl. Manag. Process"},{"key":"ref_30","unstructured":"Botchkarev, A. (2018). Performance metrics (error measures) in machine learning regression, forecasting and prognostics: Properties and typology. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5614","DOI":"10.1016\/j.ijleo.2015.09.093","article-title":"Effectiveness of the Euclidean distance in high dimensional spaces","volume":"126","author":"Xia","year":"2015","journal-title":"Optik"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1340","DOI":"10.1093\/bioinformatics\/btq134","article-title":"Permutation importance: A corrected feature importance measure","volume":"26","author":"Altmann","year":"2010","journal-title":"Bioinformatics"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zien, A., Kr\u00e4mer, N., Sonnenburg, S., and R\u00e4tsch, G. (2009, January 7\u201311). The feature importance ranking measure. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Bled, Slovenia.","DOI":"10.1007\/978-3-642-04174-7_45"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"196274","DOI":"10.1109\/ACCESS.2020.3034101","article-title":"Genetic Algorithm Based Optimized Feature Engineering and Hybrid Machine Learning for Effective Energy Consumption Prediction","volume":"8","author":"Khan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_35","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shafqat, W., and Byun, Y.C. (2021). Incorporating Similarity Measures to Optimize Graph Convolutional Neural Networks for Product Recommendation. Appl. Sci., 11.","DOI":"10.3390\/app11041366"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Shafqat, W., and Byun, Y.C. (2020). Enabling \u201cUntact\u201d Culture via Online Product Recommendations: An Optimized Graph-CNN based Approach. Appl. Sci., 10.","DOI":"10.3390\/app10165445"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/5\/758\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:53:23Z","timestamp":1760162003000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/5\/758"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,27]]},"references-count":37,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["sym13050758"],"URL":"https:\/\/doi.org\/10.3390\/sym13050758","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,27]]}}}