{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T14:36:57Z","timestamp":1786113417233,"version":"3.56.0"},"reference-count":51,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,11,20]],"date-time":"2020-11-20T00:00:00Z","timestamp":1605830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JTAER"],"abstract":"<jats:p>Online product reviews play important roles in the word-of-mouth marketing of e-commerce enterprises, but only helpful reviews actually influence customers\u2019 purchase decisions. Current research focuses on how to predict the helpfulness of a review but lacks a thorough analysis of why it is helpful. In this paper, feature sets covering review text and context cues are firstly proposed to represent review helpfulness. Then, a set of gradient boosted trees (GBT) models is introduced, and the optimal one, which as implemented in eXtreme Gradient Boosting (XGBoost), is chosen to predict and explain review helpfulness. Specially, by including the SHAP (Shapley) values method to quantify feature contribution, this paper presents an integrated framework to better interpret why a review is helpful at both the macro and micro levels. Based on real data from Amazon.cn, this paper reveals that the number of words contributes the most to the helpfulness of reviews on headsets and is interactively influenced by features like the number of sentences or feature frequency, while feature frequency contributes the most to the helpfulness of facial cleanser reviews and is interactively influenced by the number of adjectives used in the review or the review\u2019s entropy. Both datasets show that individual feature contributions vary from review to review, and individual joint contributions gradually decrease with the increase of feature values.<\/jats:p>","DOI":"10.3390\/jtaer16030029","type":"journal-article","created":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T11:50:34Z","timestamp":1606132234000},"page":"466-490","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":281,"title":["What Makes an Online Review More Helpful: An Interpretation Framework Using XGBoost and SHAP Values"],"prefix":"10.3390","volume":"16","author":[{"given":"Yuan","family":"Meng","sequence":"first","affiliation":[{"name":"School of Statistics and Information, Shanghai University of International Business and Economics, Shanghai 201620, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nianhua","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Statistics and Information, Shanghai University of International Business and Economics, Shanghai 201620, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhilin","family":"Qian","sequence":"additional","affiliation":[{"name":"School of Statistics and Information, Shanghai University of International Business and Economics, Shanghai 201620, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gaoyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information Management, Shanghai Lixin University of Accounting and Finance, Shanghai 201209, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1016\/j.ipm.2018.04.003","article-title":"Examining the relationship between specific negative emotions and the perceived helpfulness of online reviews","volume":"56","author":"Ren","year":"2019","journal-title":"Inf. Process. Manag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.ipm.2017.09.004","article-title":"An analysis of review content and reviewer variables that contribute to review helpfulness","volume":"54","author":"Malik","year":"2018","journal-title":"Inf. Process. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.dss.2018.06.012","article-title":"Which online reviews do consumers find most helpful? A multi-method investigation","volume":"113","author":"Eslami","year":"2018","journal-title":"Decis. Support Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.neunet.2015.02.008","article-title":"Diversifying customer review rankings","volume":"66","author":"Krestel","year":"2015","journal-title":"Neural Netw."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.dss.2018.01.004","article-title":"Explaining and predicting online review helpfulness: The role of content and reviewer-related signals","volume":"108","author":"Siering","year":"2018","journal-title":"Decis. Support Syst."},{"key":"ref_6","unstructured":"Lundberg, S., and Lee, S.-I. (2017, January 4\u20139). A unified approach to interpreting model predictions. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA."},{"key":"ref_7","unstructured":"Lundberg, S.M., Erion, G.G., and Lee, S.-I. (2017, January 6\u201311). Consistent individualized feature attribution for tree ensembles. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_8","first-page":"307","article-title":"A value for n-person games","volume":"28","author":"Shapley","year":"1953","journal-title":"Ann. Math. Stud."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: A gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_11","unstructured":"Ke, G.L., Meng, Q., Finley, T., Wang, T.F., Chen, W., Ma, W., Ye, Q., and Liu, T.Y. (2017, January 4\u20139). Lightgbm: A highly efficient gradient boosting decision tree. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.eswa.2017.02.017","article-title":"A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring","volume":"78","author":"Xia","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Xiao, Z., Wang, Y., Fu, K., and Wu, F. (2017). Identifying Different Transportation Modes from Trajectory Data Using Tree-Based Ensemble Classifiers. ISPRS Int. J. Geo-Inf., 6.","DOI":"10.3390\/ijgi6020057"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1274","DOI":"10.1093\/jcr\/ucx104","article-title":"Automated Text Analysis for Consumer Research","volume":"44","author":"Humphreys","year":"2017","journal-title":"J. Consum. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2016\/3795961","article-title":"Exploring Determinants of Attraction and Helpfulness of Online Product Review: A Consumer Behaviour Perspective","volume":"2016","author":"Chen","year":"2016","journal-title":"Discret. Dyn. Nat. Soc."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3751","DOI":"10.1016\/j.eswa.2014.12.044","article-title":"Linguistic features for review helpfulness prediction","volume":"42","author":"Krishnamoorthy","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1016\/j.im.2016.12.009","article-title":"The effect of user-controllable filters on the prediction of online hotel reviews","volume":"54","author":"Hu","year":"2017","journal-title":"Inf. Manag."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1177\/1470785318819979","article-title":"Predicting the helpfulness of online customer reviews: The role of title features","volume":"62","author":"Akbarabadi","year":"2018","journal-title":"Int. J. Mark. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1016\/j.dss.2010.08.023","article-title":"Quality evaluation of product reviews using an information quality framework","volume":"50","author":"Chen","year":"2011","journal-title":"Decis. Support Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.jbusres.2016.08.008","article-title":"Predicting the \u201chelpfulness\u201d of online consumer reviews","volume":"70","author":"Singh","year":"2017","journal-title":"J. Bus. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1509\/jmr.13.0379","article-title":"Keep Your Cool or Let it Out: Nonlinear Effects of Expressed Arousal on Perceptions of Consumer Reviews","volume":"54","author":"Yin","year":"2017","journal-title":"J. Mark. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1093\/jcr\/ucv003","article-title":"Attitude Predictability and Helpfulness in Online Reviews: The Role of Explained Actions and Reactions","volume":"42","author":"Moore","year":"2015","journal-title":"J. Consum. Res."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Qi, J., and Zhu, G. (2014, January 2\u20133). Mining customer requirement from helpful online reviews. Proceedings of the 2nd International Conference on Enterprise Systems, Shanghai, China.","DOI":"10.1109\/ES.2014.38"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1080\/10864415.2018.1441700","article-title":"A Unified Model for the Adoption of Electronic Word of Mouth on Social Network Sites: Facebook as the Exemplar","volume":"22","author":"Aghakhani","year":"2018","journal-title":"Int. J. Electron. Commer."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.eswa.2016.11.029","article-title":"Predicting the helpfulness of online reviews using a scripts-enriched text regression model","volume":"71","author":"Sinha","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1002\/cb.1372","article-title":"Perceived helpfulness of online consumer reviews: The role of message content and style","volume":"11","author":"Schindler","year":"2012","journal-title":"J. Consum. Behav."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.dss.2015.07.009","article-title":"Can online product reviews be more helpful? Examing characteristics of information content by product type","volume":"79","author":"Weathers","year":"2015","journal-title":"Decis. Support Syst."},{"key":"ref_28","first-page":"180","article-title":"Identifying helpful online reviews: A product designer\u2019s perspective","volume":"45","author":"Liu","year":"2013","journal-title":"Comput. Des."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1498","DOI":"10.1109\/TKDE.2010.188","article-title":"Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics","volume":"23","author":"Ghose","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1016\/j.chb.2015.08.057","article-title":"Helpfulness of user-generated reviews as a function of review sentiment, product type and information quality","volume":"54","author":"Chua","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, Q., Cui, J., and Gao, Y. (2015, January 5\u20138). The influence of social capital in an online community on online review quality in China. Proceedings of the 48th Hawaii International Conference on System Sciences, Kauai, HI, USA.","DOI":"10.1109\/HICSS.2015.74"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1016\/j.tourman.2015.07.018","article-title":"Analysis of the perceived value of online tourism reviews: Influence of readability and reviewer characteristics","volume":"52","author":"Fang","year":"2016","journal-title":"Tour. Manag."},{"key":"ref_33","unstructured":"Hong, H., and Xu, D. (2015, January 22\u201324). Research of online review helpfulness based on negative binary regress model. Proceedings of the 12th International Conference on Service Systems and Service Management (ICSSSM), Guangzhou, China."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.chb.2017.03.053","article-title":"Helpfulness of product reviews as a function of discrete positive and negative emotions","volume":"73","author":"Malik","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/0167-9236(93)E0050-N","article-title":"Toward quality data: An attribute-based approach","volume":"13","author":"Wang","year":"1995","journal-title":"Decis. Support Syst."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Otterbacher, J. (2009, January 4\u20139). Helpfulness in online communities: A measure of message quality. Proceedings of the 27th International Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/1518701.1518848"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s00199-015-0870-2","article-title":"Rational exaggeration and counter-exaggeration in information aggregation games","volume":"59","author":"Rausser","year":"2015","journal-title":"Econ. Theory"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"7674","DOI":"10.1016\/j.eswa.2010.12.147","article-title":"Sentiment classification of Internet restaurant reviews written in Cantonese","volume":"38","author":"Zhang","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Pang, B.B., and Lee, L. (2004, January 21\u201326). A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, Barcelona, Spain.","DOI":"10.3115\/1218955.1218990"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"K Liu, K., Xu, L., and Zhao, J. (2014, January 23\u201325). Extracting opinion targets and opinion words from online reviews with graph co-ranking. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistic (ACL), Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-1030"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2663359","article-title":"An Association-Based Unified Framework for Mining Features and Opinion Words","volume":"6","author":"Hai","year":"2015","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3389\/fnbot.2013.00021","article-title":"Gradient boosting machines, a tutorial","volume":"7","author":"Natekin","year":"2013","journal-title":"Front. Neurorobot."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2353","DOI":"10.1021\/acs.jcim.6b00591","article-title":"Extreme Gradient Boosting as a Method for Quantitative Structure\u2013Activity Relationships","volume":"56","author":"Sheridan","year":"2016","journal-title":"J. Chem. Inf. Model."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1023\/A:1007563306331","article-title":"Pasting Small Votes for Classification in Large Databases and On-Line","volume":"36","author":"Breiman","year":"1999","journal-title":"Mach. Learn."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forest","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10994-006-6226-1","article-title":"Extremely randomized trees","volume":"63","author":"Geurts","year":"2006","journal-title":"Mach. Learn."},{"key":"ref_49","unstructured":"Saabas, A. (2018, September 05). Interpreting Random Forests. Available online: http:\/\/blog.datadive.net\/random-forest-interpretation-with-scikit-learn\/."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Hutter, F., Hoos, H.H., and Leyton-Brown, K. (2011, January 17\u201321). Sequential model-based optimization for general algorithm configuration. Proceedings of the 5th International Conference on Learning and Intelligent Optimization, Rome, Italy.","DOI":"10.1007\/978-3-642-25566-3_40"},{"key":"ref_51","unstructured":"Levesque, J.-C., Gagne, C., and Sabourin, R. (2016, January 25\u201329). Bayesian hyperparameter optimization for ensemble learning. Proceedings of the 32nd Conference on Uncertainty in Artificial Intelligence, New York, NY, USA."}],"container-title":["Journal of Theoretical and Applied Electronic Commerce Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/0718-1876\/16\/3\/29\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:35:15Z","timestamp":1760178915000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/0718-1876\/16\/3\/29"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,20]]},"references-count":51,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["jtaer16030029"],"URL":"https:\/\/doi.org\/10.3390\/jtaer16030029","relation":{},"ISSN":["0718-1876"],"issn-type":[{"value":"0718-1876","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,20]]}}}