{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T20:06:47Z","timestamp":1784923607644,"version":"3.55.0"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001822","name":"Austrian Academy of Sciences","doi-asserted-by":"crossref","award":["DOC \/ 25005"],"award-info":[{"award-number":["DOC \/ 25005"]}],"id":[{"id":"10.13039\/501100001822","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>As video game press (\"experts\") and casual gamers (\"amateurs\") have different motivations when writing video game reviews, discrepancies in their reviews may arise. To study such potential discrepancies, we conduct a large-scale investigation of more than 1 million reviews on the Metacritic review platform. In particular, we assess the existence and nature of discrepancies in video game appraisal by experts and amateurs, and how they manifest in ratings, over time, and in review language. Leveraging these insights, we explore the predictive power of early expert vs. amateur reviews in forecasting video game reputation in the short- and long-term. We find that amateurs, in contrast to experts, give more polarized ratings of video games, rate games surprisingly long after game release, and are positively biased towards older games. On a textual level, we observe that experts write rather complex, less readable texts than amateurs, whose reviews are more emotionally charged. While in the short-term amateur reviews are remarkably predictive of game reputation among other amateurs (achieving 91% ROC AUC in a binary classification), both expert and amateur reviews are equally well suited for long-term predictions. Overall, our work is the first large-scale comparative study of video game reviewing behavior, with practical implications for amateurs when deciding which games to play, and for game developers when planning which games to design, develop, or continuously support. More broadly, our work contributes to the discussion of wisdom of the few vs. wisdom of the crowds, as we uncover the limits of experts in capturing the views of amateurs in the particular context of video game reviews.<\/jats:p>","DOI":"10.1145\/3359242","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:21Z","timestamp":1573220421000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["What's in a Review"],"prefix":"10.1145","volume":"3","author":[{"given":"Tiago","family":"Santos","sequence":"first","affiliation":[{"name":"Graz University of Technology, Graz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Florian","family":"Lemmerich","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Markus","family":"Strohmaier","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denis","family":"Helic","sequence":"additional","affiliation":[{"name":"Graz University of Technology, Graz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Xavier Amatriain Neal Lathia Josep Pujol Haewoon Kwak and Nuria Oliver. 2009. The Wisdom of the Few: A Collaborative Filtering Approach Based on Expert Opinions from the Web. In SIGIR.  Xavier Amatriain Neal Lathia Josep Pujol Haewoon Kwak and Nuria Oliver. 2009. The Wisdom of the Few: A Collaborative Filtering Approach Based on Expert Opinions from the Web. In SIGIR.","DOI":"10.1145\/1571941.1572033"},{"key":"e_1_2_1_2_1","volume-title":"Subgroup discovery. WIREs Data Mining and Knowledge Discovery","author":"Atzmueller Martin","year":"2015","unstructured":"Martin Atzmueller . 2015. Subgroup discovery. WIREs Data Mining and Knowledge Discovery ( 2015 ). Martin Atzmueller. 2015. Subgroup discovery. WIREs Data Mining and Knowledge Discovery (2015)."},{"key":"e_1_2_1_3_1","unstructured":"Douglas Biber. 2010. Longman Grammar of spoken and written English .Longman.  Douglas Biber. 2010. Longman Grammar of spoken and written English .Longman."},{"key":"e_1_2_1_4_1","volume-title":"Latent Dirichlet Allocation. JMLR","author":"Blei David","year":"2003","unstructured":"David Blei , Andrew Ng , and Michael Jordan . 2003. Latent Dirichlet Allocation. JMLR ( 2003 ). David Blei, Andrew Ng, and Michael Jordan. 2003. Latent Dirichlet Allocation. JMLR (2003)."},{"key":"e_1_2_1_5_1","volume-title":"The myopia of crowds: Cognitive load and collective evaluation of answers on Stack Exchange. PLoS ONE","author":"Burghardt Keith","year":"2017","unstructured":"Keith Burghardt , Emanuel Alsina , Michelle Girvan , William Rand , and Kristina Lerman . 2017. The myopia of crowds: Cognitive load and collective evaluation of answers on Stack Exchange. PLoS ONE ( 2017 ). Keith Burghardt, Emanuel Alsina, Michelle Girvan, William Rand, and Kristina Lerman. 2017. The myopia of crowds: Cognitive load and collective evaluation of answers on Stack Exchange. PLoS ONE (2017)."},{"key":"e_1_2_1_6_1","volume-title":"Yu Jeffrey Hu, and Byoung-Hyoun Hwang","author":"Chen Hailiang","year":"2014","unstructured":"Hailiang Chen , Prabuddha De , Yu Jeffrey Hu, and Byoung-Hyoun Hwang . 2014 . Wisdom of crowds: The value of stock opinions transmitted through social media. The Review of Financial Studies ( 2014). Hailiang Chen, Prabuddha De, Yu Jeffrey Hu, and Byoung-Hyoun Hwang. 2014. Wisdom of crowds: The value of stock opinions transmitted through social media. The Review of Financial Studies (2014)."},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Zhiyong Cheng Ying Ding Xiangnan He Lei Zhu Xuemeng Song and Mohan Kankanhalli. 2018a. Atextsuperscript3 NCF: An Adaptive Aspect Attention Model for Rating Prediction. In IJCAI.  Zhiyong Cheng Ying Ding Xiangnan He Lei Zhu Xuemeng Song and Mohan Kankanhalli. 2018a. Atextsuperscript3 NCF: An Adaptive Aspect Attention Model for Rating Prediction. In IJCAI.","DOI":"10.24963\/ijcai.2018\/521"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Zhiyong Cheng Ying Ding Lei Zhu and Mohan Kankanhalli. 2018b. Aspect-Aware Latent Factor Model: Rating Prediction with Ratings and Reviews. In WWW.  Zhiyong Cheng Ying Ding Lei Zhu and Mohan Kankanhalli. 2018b. Aspect-Aware Latent Factor Model: Rating Prediction with Ratings and Reviews. In WWW.","DOI":"10.1145\/3178876.3186145"},{"key":"e_1_2_1_9_1","volume-title":"The Effect of Word of Mouth on Sales: Online Book Reviews. Journal of Marketing Research","author":"Chevalier Judith","year":"2006","unstructured":"Judith Chevalier and Dina Mayzlin . 2006. The Effect of Word of Mouth on Sales: Online Book Reviews. Journal of Marketing Research ( 2006 ). Judith Chevalier and Dina Mayzlin. 2006. The Effect of Word of Mouth on Sales: Online Book Reviews. Journal of Marketing Research (2006)."},{"key":"e_1_2_1_10_1","volume-title":"A comparison between experienced and inexperienced video game players' perceptions. Human-centric Computing and Information Sciences","author":"Christou Georgios","year":"2013","unstructured":"Georgios Christou . 2013. A comparison between experienced and inexperienced video game players' perceptions. Human-centric Computing and Information Sciences ( 2013 ). Georgios Christou. 2013. A comparison between experienced and inexperienced video game players' perceptions. Human-centric Computing and Information Sciences (2013)."},{"key":"e_1_2_1_11_1","volume-title":"What makes a blockbuster video game? An empirical analysis of US sales data. Managerial and Decision Economics","author":"Cox Joe","year":"2014","unstructured":"Joe Cox . 2014. What makes a blockbuster video game? An empirical analysis of US sales data. Managerial and Decision Economics ( 2014 ). Joe Cox. 2014. What makes a blockbuster video game? An empirical analysis of US sales data. Managerial and Decision Economics (2014)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Cristian Danescu-Niculescu-Mizil Gueorgi Kossinets Jon Kleinberg and Lillian Lee. 2009. How Opinions are Received by Online Communities: A Case Study on Amazon.com Helpfulness Votes. In WWW.  Cristian Danescu-Niculescu-Mizil Gueorgi Kossinets Jon Kleinberg and Lillian Lee. 2009. How Opinions are Received by Online Communities: A Case Study on Amazon.com Helpfulness Votes. In WWW.","DOI":"10.1145\/1526709.1526729"},{"key":"e_1_2_1_13_1","volume-title":"Yearning for Yesterday: A Sociology of Nostalgia","author":"Davis Fred","unstructured":"Fred Davis . 1979. Yearning for Yesterday: A Sociology of Nostalgia . Free Press . Fred Davis. 1979. Yearning for Yesterday: A Sociology of Nostalgia. Free Press."},{"key":"e_1_2_1_14_1","volume-title":"Context & Media","author":"Jong Ilona De","year":"2013","unstructured":"Ilona De Jong and Christian Burgers . 2013. Do consumer critics write differently from professional critics? A genre analysis of online film reviews. Discourse , Context & Media ( 2013 ). Ilona De Jong and Christian Burgers. 2013. Do consumer critics write differently from professional critics? A genre analysis of online film reviews. Discourse, Context & Media (2013)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Qiming Diao Minghui Qiu Chao-Yuan Wu Alexander Smola Jing Jiang and Chong Wang. 2014. Jointly Modeling Aspects Ratings and Sentiments for Movie Recommendation (JMARS). In KDD.  Qiming Diao Minghui Qiu Chao-Yuan Wu Alexander Smola Jing Jiang and Chong Wang. 2014. Jointly Modeling Aspects Ratings and Sentiments for Movie Recommendation (JMARS). In KDD.","DOI":"10.1145\/2623330.2623758"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2013.08.008"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Anders Drachen Kevin Bauer and Robert Veitch. 2011. Only the Good... Get Pirated: Game Piracy Activity vs. Metacritic Score. In FDG.  Anders Drachen Kevin Bauer and Robert Veitch. 2011. Only the Good... Get Pirated: Game Piracy Activity vs. Metacritic Score. In FDG.","DOI":"10.1145\/2159365.2159416"},{"key":"e_1_2_1_18_1","volume-title":"Do online reviews matter?--An empirical investigation of panel data. Decision Support Systems","author":"Duan Wenjing","year":"2008","unstructured":"Wenjing Duan , Bin Gu , and Andrew Whinston . 2008. Do online reviews matter?--An empirical investigation of panel data. Decision Support Systems ( 2008 ). Wenjing Duan, Bin Gu, and Andrew Whinston. 2008. Do online reviews matter?--An empirical investigation of panel data. Decision Support Systems (2008)."},{"key":"e_1_2_1_19_1","volume-title":"Nature","author":"Galton Francis","year":"1907","unstructured":"Francis Galton . 1907. Vox Populi . Nature ( 1907 ). Francis Galton. 1907. Vox Populi. Nature (1907)."},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Eric Gilbert and Karrie Karahalios. 2010. Understanding Deja Reviewers. In CSCW.  Eric Gilbert and Karrie Karahalios. 2010. Understanding Deja Reviewers. In CSCW.","DOI":"10.1145\/1718918.1718961"},{"key":"e_1_2_1_21_1","volume-title":"On the Validity of Metacritic in Assessing Game Value. Eludamos. Journal for Computer Game Culture","author":"Greenwood-Ericksen Adams","year":"2013","unstructured":"Adams Greenwood-Ericksen , Scott Poorman , and Roy Papp . 2013. On the Validity of Metacritic in Assessing Game Value. Eludamos. Journal for Computer Game Culture ( 2013 ). Adams Greenwood-Ericksen, Scott Poorman, and Roy Papp. 2013. On the Validity of Metacritic in Assessing Game Value. Eludamos. Journal for Computer Game Culture (2013)."},{"key":"e_1_2_1_22_1","volume-title":"The Stanford Natural Language Processing Group (December 18","author":"The Stanford Natural Language Processing Group","year":"2010","unstructured":"The Stanford Natural Language Processing Group . 2010 . Stanford Topic Modeling Toolbox. https:\/\/nlp.stanford.edu\/software\/tmt\/tmt-0.4\/ . The Stanford Natural Language Processing Group (December 18 , 2018). The Stanford Natural Language Processing Group. 2010. Stanford Topic Modeling Toolbox. https:\/\/nlp.stanford.edu\/software\/tmt\/tmt-0.4\/. The Stanford Natural Language Processing Group (December 18, 2018)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Will Hamilton Jure Leskovec and Dan Jurafsky. 2016. Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change. In ACL.  Will Hamilton Jure Leskovec and Dan Jurafsky. 2016. Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change. In ACL.","DOI":"10.18653\/v1\/P16-1141"},{"key":"e_1_2_1_24_1","volume-title":"The relationship between reviewer judgments and motion picture success: re-analysis and extension. Journal of Cultural Economics","author":"Hennig-Thurau Thorsten","year":"2012","unstructured":"Thorsten Hennig-Thurau , Andr\u00e9 Marchand , and Barbara Hiller . 2012. The relationship between reviewer judgments and motion picture success: re-analysis and extension. Journal of Cultural Economics ( 2012 ). Thorsten Hennig-Thurau, Andr\u00e9 Marchand, and Barbara Hiller. 2012. The relationship between reviewer judgments and motion picture success: re-analysis and extension. Journal of Cultural Economics (2012)."},{"key":"e_1_2_1_25_1","volume-title":"Echoes of the Dear Departed Past: Some Work in Progress on Nostalgia. ACR North American Advances","author":"Holbrook Morris","year":"1991","unstructured":"Morris Holbrook and Robert Schindler . 1991. Echoes of the Dear Departed Past: Some Work in Progress on Nostalgia. ACR North American Advances ( 1991 ). Morris Holbrook and Robert Schindler. 1991. Echoes of the Dear Departed Past: Some Work in Progress on Nostalgia. ACR North American Advances (1991)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Nan Hu Paul Pavlou and Jennifer Zhang. 2006. Can Online Reviews Reveal a Product's True Quality? Empirical Findings and Analytical Modeling of Online Word-of-Mouth Communication. In EC.  Nan Hu Paul Pavlou and Jennifer Zhang. 2006. Can Online Reviews Reveal a Product's True Quality? Empirical Findings and Analytical Modeling of Online Word-of-Mouth Communication. In EC.","DOI":"10.1145\/1134707.1134743"},{"key":"e_1_2_1_27_1","volume-title":"VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. In ICWSM.","author":"Hutto Clayton","year":"2014","unstructured":"Clayton Hutto and Eric Gilbert . 2014 . VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. In ICWSM. Clayton Hutto and Eric Gilbert. 2014. VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. In ICWSM."},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Daniel Johnson Christopher Watling John Gardner and Lennart Nacke. 2014. The Edge of Glory: The Relationship between Metacritic Scores and Player Experience. In CHI PLAY.  Daniel Johnson Christopher Watling John Gardner and Lennart Nacke. 2014. The Edge of Glory: The Relationship between Metacritic Scores and Player Experience. In CHI PLAY.","DOI":"10.1145\/2658537.2658694"},{"key":"e_1_2_1_29_1","unstructured":"Mahesh Joshi Dipanjan Das Kevin Gimpel and Noah Smith. 2010. Movie Reviews and Revenues: An Experiment in Text Regression. In NAACL HLT.  Mahesh Joshi Dipanjan Das Kevin Gimpel and Noah Smith. 2010. Movie Reviews and Revenues: An Experiment in Text Regression. In NAACL HLT."},{"key":"e_1_2_1_30_1","volume-title":"Narrative framing of consumer sentiment in online restaurant reviews. First Monday","author":"Jurafsky Dan","year":"2014","unstructured":"Dan Jurafsky , Victor Chahuneau , Bryan Routledge , and Noah Smith . 2014. Narrative framing of consumer sentiment in online restaurant reviews. First Monday ( 2014 ). Dan Jurafsky, Victor Chahuneau, Bryan Routledge, and Noah Smith. 2014. Narrative framing of consumer sentiment in online restaurant reviews. First Monday (2014)."},{"key":"e_1_2_1_31_1","unstructured":"Andrew Kehoe and Matt Gee. 2017. \"Please please don't buy this game like I did. I feel terrible and wish I could return it!\": A corpus-based study of professional and consumer reviews of video games. In CL.  Andrew Kehoe and Matt Gee. 2017. \"Please please don't buy this game like I did. I feel terrible and wish I could return it!\": A corpus-based study of professional and consumer reviews of video games. In CL."},{"key":"e_1_2_1_32_1","unstructured":"Soo-Min Kim Patrick Pantel Tim Chklovski and Marco Pennacchiotti. 2006. Automatically assessing review helpfulness. In EMNLP.  Soo-Min Kim Patrick Pantel Tim Chklovski and Marco Pennacchiotti. 2006. Automatically assessing review helpfulness. In EMNLP."},{"key":"e_1_2_1_33_1","volume-title":"Does film criticism affect box office earnings? Evidence from movies released in the US","author":"King Timothy","year":"2003","unstructured":"Timothy King . 2007. Does film criticism affect box office earnings? Evidence from movies released in the US in 2003 . Journal of Cultural Economics ( 2007). Timothy King. 2007. Does film criticism affect box office earnings? Evidence from movies released in the US in 2003. Journal of Cultural Economics (2007)."},{"key":"e_1_2_1_34_1","volume-title":"A Second Look at the Validity of Readability Formulas. Journal of Reading Behavior","author":"Klare George","year":"1976","unstructured":"George Klare . 1976. A Second Look at the Validity of Readability Formulas. Journal of Reading Behavior ( 1976 ). George Klare. 1976. A Second Look at the Validity of Readability Formulas. Journal of Reading Behavior (1976)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Gael Lederrey and Robert West. 2018. When Sheep Shop: Measuring Herding Effects in Product Ratings with Natural Experiments. In WWW.  Gael Lederrey and Robert West. 2018. When Sheep Shop: Measuring Herding Effects in Product Ratings with Natural Experiments. In WWW.","DOI":"10.1145\/3178876.3186160"},{"key":"e_1_2_1_36_1","volume-title":"Do I Follow My Friends or the Crowd? Information Cascades in Online Movie Ratings. Management Science","author":"Lee Young-Jin","year":"2015","unstructured":"Young-Jin Lee , Kartik Hosanagar , and Yong Tan . 2015. Do I Follow My Friends or the Crowd? Information Cascades in Online Movie Ratings. Management Science ( 2015 ). Young-Jin Lee, Kartik Hosanagar, and Yong Tan. 2015. Do I Follow My Friends or the Crowd? Information Cascades in Online Movie Ratings. Management Science (2015)."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2575738"},{"key":"e_1_2_1_38_1","volume-title":"Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady","author":"Levenshtein Vladimir","year":"1966","unstructured":"Vladimir Levenshtein . 1966. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady ( 1966 ). Vladimir Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady (1966)."},{"key":"e_1_2_1_39_1","unstructured":"Ee-Peng Lim Viet-An Nguyen Nitin Jindal Bing Liu and Hady Lauw. 2010. Detecting Product Review Spammers Using Rating Behaviors. In CIKM.  Ee-Peng Lim Viet-An Nguyen Nitin Jindal Bing Liu and Hady Lauw. 2010. Detecting Product Review Spammers Using Rating Behaviors. In CIKM."},{"key":"e_1_2_1_40_1","volume-title":"An empirical study of game reviews on the Steam platform. Empirical Software Engineering","author":"Lin Dayi","year":"2019","unstructured":"Dayi Lin , Cor-Paul Bezemer , Ying Zou , and Ahmed Hassan . 2019. An empirical study of game reviews on the Steam platform. Empirical Software Engineering ( 2019 ). Dayi Lin, Cor-Paul Bezemer, Ying Zou, and Ahmed Hassan. 2019. An empirical study of game reviews on the Steam platform. Empirical Software Engineering (2019)."},{"key":"e_1_2_1_41_1","volume-title":"Ratings Meet Reviews, a Combined Approach to Recommend. In RecSys.","author":"Ling Guang","year":"2014","unstructured":"Guang Ling , Mike Lyu , and Irwin King . 2014 . Ratings Meet Reviews, a Combined Approach to Recommend. In RecSys. Guang Ling, Mike Lyu, and Irwin King. 2014. Ratings Meet Reviews, a Combined Approach to Recommend. In RecSys."},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Ian Livingston Lennart Nacke and Regan Mandryk. 2011a. The Impact of Negative Game Reviews and User Comments on Player Experience. In ACM SIGGRAPH Game Papers.  Ian Livingston Lennart Nacke and Regan Mandryk. 2011a. The Impact of Negative Game Reviews and User Comments on Player Experience. In ACM SIGGRAPH Game Papers.","DOI":"10.1145\/2037692.2037697"},{"key":"e_1_2_1_43_1","volume-title":"Influencing Experience: The Effects of Reading Game Reviews on Player Experience. In International Conference on Entertainment Computing.","author":"Livingston Ian","year":"2011","unstructured":"Ian Livingston , Lennart Nacke , and Regan Mandryk . 2011 b. Influencing Experience: The Effects of Reading Game Reviews on Player Experience. In International Conference on Entertainment Computing. Ian Livingston, Lennart Nacke, and Regan Mandryk. 2011b. Influencing Experience: The Effects of Reading Game Reviews on Player Experience. In International Conference on Entertainment Computing."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1008636108"},{"key":"e_1_2_1_45_1","volume-title":"The Case of Yelp.com. Harvard Business School NOM Unit Working Paper","author":"Luca Michael","year":"2016","unstructured":"Michael Luca . 2016. Reviews, Reputation, and Revenue : The Case of Yelp.com. Harvard Business School NOM Unit Working Paper ( 2016 ). Michael Luca. 2016. Reviews, Reputation, and Revenue: The Case of Yelp.com. Harvard Business School NOM Unit Working Paper (2016)."},{"key":"e_1_2_1_46_1","volume-title":"Fake it till you make it: Reputation, competition, and Yelp review fraud. Management Science","author":"Luca Michael","year":"2016","unstructured":"Michael Luca and Georgios Zervas . 2016. Fake it till you make it: Reputation, competition, and Yelp review fraud. Management Science ( 2016 ). Michael Luca and Georgios Zervas. 2016. Fake it till you make it: Reputation, competition, and Yelp review fraud. Management Science (2016)."},{"key":"e_1_2_1_47_1","unstructured":"Marco Lui and Timothy Baldwin. 2012. langid.py: An Off-the-shelf Language Identification Tool. In ACL System Demonstrations.  Marco Lui and Timothy Baldwin. 2012. langid.py: An Off-the-shelf Language Identification Tool. In ACL System Demonstrations."},{"key":"e_1_2_1_48_1","doi-asserted-by":"crossref","unstructured":"Julian McAuley and Jure Leskovec. 2013. Hidden Factors and Hidden Topics: Understanding Rating Dimensions with Review Text. In RecSys.  Julian McAuley and Jure Leskovec. 2013. Hidden Factors and Hidden Topics: Understanding Rating Dimensions with Review Text. In RecSys.","DOI":"10.1145\/2507157.2507163"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Julian McAuley Jure Leskovec and Dan Jurafsky. 2012. Learning Attitudes and Attributes from Multi-Aspect Reviews. In ICDM.  Julian McAuley Jure Leskovec and Dan Jurafsky. 2012. Learning Attitudes and Attributes from Multi-Aspect Reviews. In ICDM.","DOI":"10.1109\/ICDM.2012.110"},{"key":"e_1_2_1_50_1","unstructured":"Metacritic. December 18 2018. How We Create the Metascore Magic. https:\/\/www.metacritic.com\/about-metascores.  Metacritic. December 18 2018. How We Create the Metascore Magic. https:\/\/www.metacritic.com\/about-metascores."},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Loizos Michael and Jana Otterbacher. 2014. Write Like I Write: Herding in the Language of Online Reviews. In ICWSM.  Loizos Michael and Jana Otterbacher. 2014. Write Like I Write: Herding in the Language of Online Reviews. In ICWSM.","DOI":"10.1609\/icwsm.v8i1.14511"},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","unstructured":"Arjun Mukherjee Bing Liu and Nat Glance. 2012. Spotting Fake Reviewer Groups in Consumer Reviews. In WWW.  Arjun Mukherjee Bing Liu and Nat Glance. 2012. Spotting Fake Reviewer Groups in Consumer Reviews. In WWW.","DOI":"10.1145\/2187836.2187863"},{"key":"e_1_2_1_53_1","unstructured":"Arjun Mukherjee Vivek Venkataraman Bing Liu and Nat Glance. 2013. What Yelp Fake Review Filter Might Be Doing?. In ICWSM.  Arjun Mukherjee Vivek Venkataraman Bing Liu and Nat Glance. 2013. What Yelp Fake Review Filter Might Be Doing?. In ICWSM."},{"key":"e_1_2_1_54_1","volume-title":"Information and consumer behavior. Journal of Political Economy","author":"Nelson Phillip","year":"1970","unstructured":"Phillip Nelson . 1970. Information and consumer behavior. Journal of Political Economy ( 1970 ). Phillip Nelson. 1970. Information and consumer behavior. Journal of Political Economy (1970)."},{"key":"e_1_2_1_55_1","unstructured":"Myle Ott Yejin Choi Claire Cardie and Jeffrey Hancock. 2011. Finding Deceptive Opinion Spam by any Stretch of the Imagination. In ACL HLT.  Myle Ott Yejin Choi Claire Cardie and Jeffrey Hancock. 2011. Finding Deceptive Opinion Spam by any Stretch of the Imagination. In ACL HLT."},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Jo ao Palotti Guido Zuccon and Allan Hanbury. 2015. The Influence of Pre-Processing on the Estimation of Readability of Web Documents. In CIKM.  Jo ao Palotti Guido Zuccon and Allan Hanbury. 2015. The Influence of Pre-Processing on the Estimation of Readability of Web Documents. In CIKM.","DOI":"10.1145\/2806416.2806613"},{"key":"e_1_2_1_57_1","volume-title":"Correlation Analysis: Game Professional Score and User Score on Steam. International Journal of Multimedia and Ubiquitous Engineering","author":"Park Hyemin","year":"2016","unstructured":"Hyemin Park and Haewon Byun . 2016 . Correlation Analysis: Game Professional Score and User Score on Steam. International Journal of Multimedia and Ubiquitous Engineering (2016). Hyemin Park and Haewon Byun. 2016. Correlation Analysis: Game Professional Score and User Score on Steam. International Journal of Multimedia and Ubiquitous Engineering (2016)."},{"key":"e_1_2_1_58_1","volume-title":"mbox","author":"Fabian Pedregosa","year":"2011","unstructured":"Fabian Pedregosa et al mbox . 2011 . Scikit-learn : Machine Learning in Python. JMLR ( 2011). Fabian Pedregosa et almbox. 2011. Scikit-learn: Machine Learning in Python. JMLR (2011)."},{"key":"e_1_2_1_59_1","volume-title":"Do Experts and Novices Evaluate Movies the Same Way? Psychology & Marketing","author":"Plucker Jonathan","year":"2009","unstructured":"Jonathan Plucker , James Kaufman , Jason Temple , and Meihua Qian . 2009. Do Experts and Novices Evaluate Movies the Same Way? Psychology & Marketing ( 2009 ). Jonathan Plucker, James Kaufman, Jason Temple, and Meihua Qian. 2009. Do Experts and Novices Evaluate Movies the Same Way? Psychology & Marketing (2009)."},{"key":"e_1_2_1_60_1","unstructured":"Lizhen Qu Georgiana Ifrim and Gerhard Weikum. 2010. The Bag-of-Opinions Method for Review Rating Prediction from Sparse Text Patterns. In ACL.  Lizhen Qu Georgiana Ifrim and Gerhard Weikum. 2010. The Bag-of-Opinions Method for Review Rating Prediction from Sparse Text Patterns. In ACL."},{"key":"e_1_2_1_61_1","volume-title":"The Influence of Expert Reviews on Consumer Demand for Experience Goods: A Case Study of Movie Critics. The Journal of Industrial Economics","author":"Reinstein David","year":"2005","unstructured":"David Reinstein and Christopher Snyder . 2005. The Influence of Expert Reviews on Consumer Demand for Experience Goods: A Case Study of Movie Critics. The Journal of Industrial Economics ( 2005 ). David Reinstein and Christopher Snyder. 2005. The Influence of Expert Reviews on Consumer Demand for Experience Goods: A Case Study of Movie Critics. The Journal of Industrial Economics (2005)."},{"key":"e_1_2_1_62_1","unstructured":"Zhaochun Ren Shangsong Liang Piji Li Shuaiqiang Wang and Maarten de Rijke. 2017. Social Collaborative Viewpoint Regression with Explainable Recommendations. In WSDM.  Zhaochun Ren Shangsong Liang Piji Li Shuaiqiang Wang and Maarten de Rijke. 2017. Social Collaborative Viewpoint Regression with Explainable Recommendations. In WSDM."},{"key":"e_1_2_1_63_1","volume-title":"Nostalgia for early experience as a determinant of consumer preferences. Psychology & Marketing","author":"Schindler Robert","year":"2003","unstructured":"Robert Schindler and Morris Holbrook . 2003. Nostalgia for early experience as a determinant of consumer preferences. Psychology & Marketing ( 2003 ). Robert Schindler and Morris Holbrook. 2003. Nostalgia for early experience as a determinant of consumer preferences. Psychology & Marketing (2003)."},{"key":"e_1_2_1_64_1","volume-title":"The wisdom of polarized crowds. Nature Human Behaviour","author":"Shi Feng","year":"2019","unstructured":"Feng Shi , Misha Teplitskiy , Eamon Duede , and James Evans . 2019. The wisdom of polarized crowds. Nature Human Behaviour ( 2019 ). Feng Shi, Misha Teplitskiy, Eamon Duede, and James Evans. 2019. The wisdom of polarized crowds. Nature Human Behaviour (2019)."},{"key":"e_1_2_1_65_1","volume-title":"Matching methods for causal inference: A review and a look forward. Statistical science: a review journal of the Institute of Mathematical Statistics","author":"Stuart Elizabeth","year":"2010","unstructured":"Elizabeth Stuart . 2010. Matching methods for causal inference: A review and a look forward. Statistical science: a review journal of the Institute of Mathematical Statistics ( 2010 ). Elizabeth Stuart. 2010. Matching methods for causal inference: A review and a look forward. Statistical science: a review journal of the Institute of Mathematical Statistics (2010)."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.5555\/1095645"},{"key":"e_1_2_1_67_1","unstructured":"Duyu Tang Bing Qin Ting Liu and Yuekui Yang. 2015. User Modeling with Neural Network for Review Rating Prediction. In IJCAI.  Duyu Tang Bing Qin Ting Liu and Yuekui Yang. 2015. User Modeling with Neural Network for Review Rating Prediction. In IJCAI."},{"key":"e_1_2_1_68_1","volume-title":"Variation in the Player Game Review Genre. Technical Communication Quarterly","author":"Thominet Luke","year":"2016","unstructured":"Luke Thominet . 2016. 10\/10 Would Review Again : Variation in the Player Game Review Genre. Technical Communication Quarterly ( 2016 ). Luke Thominet. 2016. 10\/10 Would Review Again: Variation in the Player Game Review Genre. Technical Communication Quarterly (2016)."},{"key":"e_1_2_1_69_1","doi-asserted-by":"crossref","unstructured":"Christian Wagner Sesia Zhao Chris Schneider and Huaping Chen. 2010. The Wisdom of Reluctant Crowds. In HICSS.  Christian Wagner Sesia Zhao Chris Schneider and Huaping Chen. 2010. The Wisdom of Reluctant Crowds. In HICSS.","DOI":"10.1109\/HICSS.2010.483"},{"key":"e_1_2_1_70_1","volume-title":"Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects. Journal of Retailing","author":"Wang Feng","year":"2015","unstructured":"Feng Wang , Xuefeng Liu , and Eric Fang . 2015. User Reviews Variance , Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects. Journal of Retailing ( 2015 ). Feng Wang, Xuefeng Liu, and Eric Fang. 2015. User Reviews Variance, Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects. Journal of Retailing (2015)."},{"key":"e_1_2_1_71_1","volume-title":"Nostalgia: Content, Triggers, Functions. Journal of Personality and Social Psychology","author":"Wildschut Tim","year":"2006","unstructured":"Tim Wildschut , Constantine Sedikides , Jamie Arndt , and Clay Routledge . 2006 . Nostalgia: Content, Triggers, Functions. Journal of Personality and Social Psychology (2006). Tim Wildschut, Constantine Sedikides, Jamie Arndt, and Clay Routledge. 2006. Nostalgia: Content, Triggers, Functions. Journal of Personality and Social Psychology (2006)."},{"key":"e_1_2_1_72_1","doi-asserted-by":"crossref","unstructured":"Jason Shuo Zhang Chenhao Tan and Qin Lv. 2018. \"This is why we play\": Characterizing Online Fan Communities of the NBA Teams. In CSCW.  Jason Shuo Zhang Chenhao Tan and Qin Lv. 2018. \"This is why we play\": Characterizing Online Fan Communities of the NBA Teams. In CSCW.","DOI":"10.1145\/3274466"},{"key":"e_1_2_1_73_1","doi-asserted-by":"crossref","unstructured":"Yongfeng Zhang Guokun Lai Min Zhang Yi Zhang Yiqun Liu and Shaoping Ma. 2014. Explicit Factor Models for Explainable Recommendation based on Phrase-level Sentiment Analysis. In SIGIR.  Yongfeng Zhang Guokun Lai Min Zhang Yi Zhang Yiqun Liu and Shaoping Ma. 2014. Explicit Factor Models for Explainable Recommendation based on Phrase-level Sentiment Analysis. In SIGIR.","DOI":"10.1145\/2600428.2609579"},{"key":"e_1_2_1_74_1","unstructured":"Feng Zhu and Xiaoquan Zhang. 2006. The Influence of Online Consumer Reviews on the Demand for Experience Goods: The Case of Video Games. In ICIS.  Feng Zhu and Xiaoquan Zhang. 2006. The Influence of Online Consumer Reviews on the Demand for Experience Goods: The Case of Video Games. In ICIS."},{"key":"e_1_2_1_75_1","volume-title":"Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics. Journal of Marketing","author":"Zhu Feng","year":"2010","unstructured":"Feng Zhu and Xiaoquan Zhang . 2010. Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics. Journal of Marketing ( 2010 ). Feng Zhu and Xiaoquan Zhang. 2010. Impact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics. Journal of Marketing (2010)."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359242","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359242","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:54Z","timestamp":1750201974000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359242"}},"subtitle":["Discrepancies Between Expert and Amateur Reviews of Video Games on Metacritic"],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":75,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359242"],"URL":"https:\/\/doi.org\/10.1145\/3359242","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}