{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T00:53:30Z","timestamp":1761094410531,"version":"build-2065373602"},"reference-count":50,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2017,10,24]],"date-time":"2017-10-24T00:00:00Z","timestamp":1508803200000},"content-version":"vor","delay-in-days":296,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["asistdl.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Proc. Assoc. Info. Sci. Tech."],"published-print":{"date-parts":[[2017,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title><jats:p>Checking online reviews before purchasing goods or using services has become increasingly common. However, it is difficult to select useful reviews, and concerns about fake reviews are growing. Many online review systems use recency and user\u2010generated usefulness votes in order to prioritize reviews for users, but there is much room for improvement. In this work, we focus on evaluating the effectiveness of a large number of features for predicting the usefulness of online reviews, including features that have not been commonly evaluated in prior work (e.g., social network measures). Features were grouped into hierarchical categories that might represent factors impacting perceived usefulness of Yelp users. Using all features, a binary classifier achieved a high level of accuracy (0.889). Additionally, a feature ablation study found that several feature groups yielded statistically significant improvements. Interestingly, many of the features that improved performance are not the types of measures that are displayed to users in commercial online review services such as Yelp and are the measures that are rarely used to prioritize reviews for users. Our study results suggest different types of information that online review services might want to use in ranking and displaying reviews for users.<\/jats:p>","DOI":"10.1002\/pra2.2017.14505401024","type":"journal-article","created":{"date-parts":[[2017,10,24]],"date-time":"2017-10-24T03:35:36Z","timestamp":1508816136000},"page":"213-221","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Evaluation of features to predict the usefulness of online reviews"],"prefix":"10.1002","volume":"54","author":[{"given":"Heejun","family":"Kim","sequence":"first","affiliation":[{"name":"School of Information and Library Science University of North Carolina  USA"}]},{"given":"Jaime","family":"Arguello","sequence":"additional","affiliation":[{"name":"School of Information and Library Science University of North Carolina  USA"}]}],"member":"311","published-online":{"date-parts":[[2017,10,24]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0297.2012.02512.x"},{"key":"e_1_2_8_3_1","doi-asserted-by":"crossref","unstructured":"Arguello J. &Shaffer K.(2015).Predicting speech acts in MOOC forum posts. Paper presented at theIcwsm pp.2\u201311.","DOI":"10.1609\/icwsm.v9i1.14604"},{"issue":"2","key":"e_1_2_8_4_1","first-page":"47","article-title":"Pajek\u2010program for large network analysis","volume":"21","author":"Batagelj V.","year":"1998","journal-title":"Connections"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/0022-4537.00182"},{"key":"e_1_2_8_6_1","doi-asserted-by":"crossref","unstructured":"Bird S.(2006).NLTK: The natural language toolkit. Paper presented at theProceedings of the COLING\/ACL on interactive presentation sessions pp.69\u201372.","DOI":"10.3115\/1225403.1225421"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/dir.20010"},{"volume-title":"Analyzing social networks","year":"2013","author":"Borgatti S. P.","key":"e_1_2_8_8_1"},{"key":"e_1_2_8_9_1","doi-asserted-by":"crossref","unstructured":"Brin S. &Page L.(1998).Anatomy of a large\u2010scale hypertextual web search engine. 7th intl world wide web conf.","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.2753\/JEC1086-4415130402"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.43.3.345"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.2753\/MIS0742-1222230207"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.32.5.554"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1086\/383434"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.287.20.2691"},{"issue":"3","key":"e_1_2_8_16_1","first-page":"463","article-title":"On verifying the accuracy of information: Philosophical perspectives","volume":"52","author":"Fallis D.","year":"2004","journal-title":"Library Trends"},{"key":"e_1_2_8_17_1","doi-asserted-by":"crossref","unstructured":"Fogg B. Marshall J. Kameda T. Solomon J. Rangnekar A. Boyd J. et al. (2001). Web credibility research: A method for online experiments and early study results.CHI'01 Extended Abstracts on Human Factors in Computing Systems pp.295\u2013296.","DOI":"10.1145\/634067.634242"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1080.0193"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/1090198105277329"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2010.188"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2009.01.015"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-6287-4_4"},{"key":"e_1_2_8_23_1","unstructured":"Hogarth R. M.(1987).Judgment and choice: The psychology of decision John Wiley & Sons."},{"key":"e_1_2_8_24_1","doi-asserted-by":"crossref","unstructured":"Kim S. Pantel P. Chklovski T. &Pennacchiotti M.(2006).Automatically assessing review helpfulness. Paper presented at theProceedings of the 2006 conference on empirical methods in natural language processing pp.423\u2013430.","DOI":"10.3115\/1610075.1610135"},{"key":"e_1_2_8_25_1","doi-asserted-by":"crossref","unstructured":"Levi A. &Mokryn O.(2014).The social aspect of voting for useful reviews. Paper presented at theInternational conference on social computing behavioral\u2010cultural modeling and prediction pp.293\u2013300.","DOI":"10.1007\/978-3-319-05579-4_36"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2009.09.014"},{"key":"e_1_2_8_27_1","doi-asserted-by":"crossref","unstructured":"L\u00f3pez C. &Farzan R.(2014).Analysis of local online review systems as digital word\u2010of\u2010mouth. Paper presented at theProceedings of the 23rd international conference on world wide web pp.457\u2013462.","DOI":"10.1145\/2567948.2576933"},{"key":"e_1_2_8_28_1","doi-asserted-by":"crossref","unstructured":"Lu Y. Tsaparas P. Ntoulas A. &Polanyi L.(2010).Exploiting social context for review quality prediction. Paper presented at theProceedings of the 19th international conference on world wide web pp.691\u2013700.","DOI":"10.1145\/1772690.1772761"},{"key":"e_1_2_8_29_1","doi-asserted-by":"crossref","unstructured":"Luca M. &Zervas G.(2013). Fake it till you make it: Reputation competition and Yelp review fraud.Harvard Business School NOM Unit Working Paper (14\u2010006)","DOI":"10.2139\/ssrn.2293164"},{"key":"e_1_2_8_30_1","doi-asserted-by":"crossref","unstructured":"Manning C. D. Surdeanu M. Bauer J. Finkel J. R. Bethard S. &McClosky D.(2014).The stanford corenlp natural language processing toolkit. Paper presented at theACL (System Demonstrations) pp.55\u201360.","DOI":"10.3115\/v1\/P14-5010"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.52283\/NSWRCA.AJBMR.20110104A06"},{"key":"e_1_2_8_33_1","doi-asserted-by":"crossref","unstructured":"Mui L. Mohtashemi M. &Halberstadt A.(2002). A computational model of trust and reputation.System Sciences 2002. HICSS. proceedings of the 35th annual hawaii international conference On pp.2431\u20132439.","DOI":"10.1109\/HICSS.2002.994181"},{"key":"e_1_2_8_34_1","doi-asserted-by":"crossref","unstructured":"Pentina I. Bailey A. A. &Zhang L.(2015). Exploring effects of source similarity message valence and receiver regulatory focus on Yelp review persuasiveness and purchase intentions.Journal of Marketing Communications 1\u201321.","DOI":"10.1080\/13527266.2015.1005115"},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-4964-1"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0065-2601(08)60214-2"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.elerap.2012.06.003"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10017"},{"key":"e_1_2_8_39_1","unstructured":"Rieh S. Y. &Belkin N.(2000).Interaction on the web: Scholars' judgment of information quality and cognitive authority.Proceedings of the annual meeting\u2010American Society for Information Science 37. pp.25\u201338."},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/aris.2007.1440410114"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1086\/432235"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1002\/dir.20041"},{"key":"e_1_2_8_43_1","doi-asserted-by":"crossref","unstructured":"Socher R. Perelygin A. Wu J. Y. Chuang J. Manning C. D. Ng A. Y. et al. (2013).Recursive deep models for semantic compositionality over a sentiment treebank. Paper presented at theProceedings of the conference on empirical methods in natural language processing (EMNLP) 1631. pp. 1642.","DOI":"10.18653\/v1\/D13-1170"},{"key":"e_1_2_8_44_1","unstructured":"Strapparava C. &Valitutti A.(2004).WordNet affect: An affective extension of WordNet. Paper presented at theLrec 4. pp.1083\u20131086."},{"key":"e_1_2_8_45_1","doi-asserted-by":"publisher","DOI":"10.1108\/03090560810852977"},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.45.4.425"},{"key":"e_1_2_8_47_1","unstructured":"Wiegand M. Balahur A. Roth B. Klakow D. &Montoyo A.(2010).A survey on the role of negation in sentiment analysis. Paper presented at theProceedings of the workshop on negation and speculation in natural language processing pp.60\u201368."},{"volume-title":"Second\u2010hand knowledge: An inquiry into cognitive authority","year":"1983","author":"Wilson P.","key":"e_1_2_8_48_1"},{"key":"e_1_2_8_49_1","doi-asserted-by":"publisher","DOI":"10.1108\/03090561211259961"},{"key":"e_1_2_8_50_1","unstructured":"Yang W. Yuan Y. &Zhang N.(2015).Predicting Yelp ratings using user friendship network information. Retrieved fromhttp:\/\/snap.stanford.edu\/class\/cs224w-2015\/projects_2015\/Predicting_Yelp_Ratings_Using_User_Friendship_Network_Information.pdf"},{"key":"e_1_2_8_51_1","unstructured":"Yelp Inc.(2017).Yelp dataset challenge. Retrieved Mar\/21 2017 fromhttps:\/\/www.yelp.com\/dataset_challenge\/"}],"container-title":["Proceedings of the Association for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fpra2.2017.14505401024","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pra2.2017.14505401024","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/pra2.2017.14505401024","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pra2.2017.14505401024","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T16:26:14Z","timestamp":1761063974000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/pra2.2017.14505401024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,1]]}},"alternative-id":["10.1002\/pra2.2017.14505401024"],"URL":"https:\/\/doi.org\/10.1002\/pra2.2017.14505401024","archive":["Portico"],"relation":{},"ISSN":["2373-9231","2373-9231"],"issn-type":[{"type":"print","value":"2373-9231"},{"type":"electronic","value":"2373-9231"}],"subject":[],"published":{"date-parts":[[2017,1]]},"assertion":[{"value":"2017-10-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}