{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T04:07:40Z","timestamp":1773461260002,"version":"3.50.1"},"reference-count":48,"publisher":"MIS Quarterly","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,1]]},"abstract":"<jats:p>This paper empirically investigates how review moderation transparency affects the volume, length, and negativity of reviews. A change to the Yelp platform in 2010, introducing review moderation and displaying filtered reviews, created a natural experiment. We used a panel dataset of online reviews from the same set of restaurants on both the Yelp and TripAdvisor platforms in a difference-in-differences (DID) model to test how review moderation transparency affected our outcome variables. We found that increasing review moderation transparency negatively affects review volume but positively affects review negativity. The results also indicate that providing review moderation transparency reduces review length, especially for reviews with positive sentiment. Our findings suggest that providing review moderation transparency induces users to invest less effort in review contributions, especially when they are submitting positive reviews. We discuss the theoretical and practical implications of these results as they relate to the design and use of online review platforms.<\/jats:p>","DOI":"10.25300\/misq\/2023\/16216","type":"journal-article","created":{"date-parts":[[2024,1,22]],"date-time":"2024-01-22T15:22:10Z","timestamp":1705936930000},"page":"1693-1708","source":"Crossref","is-referenced-by-count":10,"title":["Review Moderation Transparency and Online Reviews: Evidence from a Natural Experiment"],"prefix":"10.25300","volume":"47","author":[{"given":"Lianlian (Dorothy)","family":"Jiang","sequence":"first","affiliation":[{"name":"Department of Decision & Information Sciences, Bauer College of Business, University of Houston, Houston, TX, U.S.A."}]},{"given":"T.","family":"Ravichandran","sequence":"additional","affiliation":[{"name":"Lally School of Management & Technology, Rensselaer Polytechnic Institute (RPI), Troy, NY, U.S.A."}]},{"given":"Jason","family":"Kuruzovich","sequence":"additional","affiliation":[{"name":"Lally School of Management & Technology, Rensselaer Polytechnic Institute (RPI), Troy, NY"}]}],"member":"10933","published-online":{"date-parts":[[2023,12,1]]},"reference":[{"key":"2025082212311116200_b1-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctvcm4j72","volume-title":"Mostly harmless econometrics: An empiricist\u2019s companion","author":"Angrist","year":"2008"},{"issue":"1","key":"2025082212311116200_b2-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1162\/003355304772839588","article-title":"How much should we trust differences-in-differences estimates?","volume":"119","author":"Bertrand","year":"2004","journal-title":"The Quarterly Journal of Economics"},{"issue":"4","key":"2025082212311116200_b3-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"58","DOI":"10.17645\/mac.v6i4.1493","article-title":"The moral gatekeeper? Moderation and deletion of user-generated content in a leading news forum","volume":"6","author":"Boberg","year":"2018","journal-title":"Media Communication"},{"issue":"5","key":"2025082212311116200_b4-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"949","DOI":"10.1287\/mnsc.2014.2069","article-title":"The hidden cost of accommodating crowdfunder privacy preferences: A randomized field experiment","volume":"61","author":"Burtch","year":"2015","journal-title":"Management Science"},{"issue":"2","key":"2025082212311116200_b5-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"511","DOI":"10.1016\/j.dss.2010.11.009","article-title":"Exploring determinants of voting for the \u201chelpfulness\u201d of online user reviews: A text mining approach","volume":"50","author":"Cao","year":"2011","journal-title":"Decision Support Systems"},{"issue":"10","key":"2025082212311116200_b6-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"4629","DOI":"10.1287\/mnsc.2017.2852","article-title":"The value of multidimensional rating systems: Evidence from a natural experiment and randomized experiments","volume":"64","author":"Chen","year":"2018","journal-title":"Management Science"},{"issue":"4","key":"2025082212311116200_b7-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1509\/jmr.12.006","article-title":"Temporal contiguity and negativity bias in the impact of online word of mouth","volume":"50","author":"Chen","year":"2013","journal-title":"Journal of Marketing Research"},{"issue":"3","key":"2025082212311116200_b8-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1509\/jmkr.43.3.34","article-title":"The effect of word of mouth on sales: Online book reviews","volume":"43","author":"Chevalier","year":"2006","journal-title":"Journal of Marketing Research"},{"key":"2025082212311116200_b9-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","DOI":"10.3389\/fhumd.2021.626409","article-title":"Commercial versus volunteer: Comparing user perceptions of toxicity and transparency in content moderation across social media platforms","volume":"3","author":"Cook","year":"2021","journal-title":"Frontiers in Human Dynamics"},{"issue":"4","key":"2025082212311116200_b10-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1016\/j.dss.2008.04.001","article-title":"Do online reviews matter? An empirical investigation of panel data","volume":"45","author":"Duan","year":"2008","journal-title":"Decision Support Systems"},{"key":"2025082212311116200_b11-13_rn_10_25300_misq_2023_16216","unstructured":"Erskine, R.\n           (2017). Yelp\u2019s \u201cdon\u2019t ask\u201d policy is bad for everyone ... including Yelp. Forbes. https:\/\/www.forbes.com\/sites\/ryanerskine\/2017\/11\/16\/yelps-dont-ask-policy-is-bad-for-everyone-including-yelp\/#353bdc9310.d"},{"key":"2025082212311116200_b12-13_rn_10_25300_misq_2023_16216","unstructured":"European Commission\n          . (2018). Behavioural study on transparency in online platforms. https:\/\/ec.europa.eu\/info\/publications\/behavioural-study-transparency-online-platforms-2018_en"},{"issue":"10","key":"2025082212311116200_b13-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"1498","DOI":"10.1109\/TKDE.2010.188","article-title":"Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics","volume":"23","author":"Ghose","year":"2011","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"2","key":"2025082212311116200_b14-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1287\/isre.2013.0512","article-title":"Popularity effect\u201d in user-generated content: evidence from online product reviews","volume":"25","author":"Goes","year":"2014","journal-title":"Information Systems Research"},{"issue":"9","key":"2025082212311116200_b15-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1089\/cyber.2010.0087","article-title":"Manifestations of personality in online social networks: Self-reported Facebook-related behaviors and observable profile information","volume":"14","author":"Gosling","year":"2011","journal-title":"Cyberpsychology, Behavior, and Social Networking"},{"issue":"2","key":"2025082212311116200_b16-13_rn_10_25300_misq_2023_16216","first-page":"637","article-title":"Transparency strategy: Competing with information in a digital world","volume":"37","author":"Granados","year":"2013","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082212311116200_b17-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"148","DOI":"10.17705\/1jais.00083","article-title":"the impact of it on market information and transparency: A unified theoretical framework","volume":"7","author":"Granados","year":"2006","journal-title":"Journal of the Association for Information Systems"},{"issue":"1","key":"2025082212311116200_b18-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"crossref","first-page":"163","DOI":"10.25300\/MISQ\/2017\/41.1.08","article-title":"Show me the way to go home: An empirical investigation of ride-sharing and alcohol related motor vehicle fatalities","volume":"41","author":"Greenwood","year":"2017","journal-title":"MIS Quarterly"},{"key":"2025082212311116200_b19-13_rn_10_25300_misq_2023_16216","article-title":"Can online reviews reveal a product\u2019s true quality? Empirical findings and analytical modeling of online word-of-mouth communication","author":"Hu"},{"issue":"10","key":"2025082212311116200_b20-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1145\/1562764.1562800","article-title":"Overcoming the J-shaped distribution of product reviews","volume":"52","author":"Hu","year":"2009","journal-title":"Communications of the ACM"},{"issue":"4","key":"2025082212311116200_b21-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"1035","DOI":"10.25300\/MISQ\/2017\/41.4.02","article-title":"Social network integration and user content generation: Evidence from natural experiments","volume":"41","author":"Huang","year":"2017","journal-title":"MIS Quarterly"},{"key":"2025082212311116200_b22-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","article-title":"Does transparency in moderation really matter? User behavior after content removal explanations on Reddit","author":"Jhaver","DOI":"10.1145\/3359252"},{"key":"2025082212311116200_b23-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","article-title":"Through the looking glass: Study of transparency in Reddit\u2019s moderation practices","author":"Juneja","DOI":"10.1145\/3375197"},{"key":"2025082212311116200_b24-13_rn_10_25300_misq_2023_16216","unstructured":"Klepper, D., & O\u2019Brien, M. (2021). Social platforms flex their power, lock down Trump accounts. AP. https:\/\/apnews.com\/article\/facebook-ban-trump-3e9a00e791f9806a4d925ec9a2fbe9f3"},{"issue":"1","key":"2025082212311116200_b25-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"48","DOI":"10.17705\/1jais.00386","article-title":"What makes a review voted? An empirical investigation of review voting in online review systems","volume":"16","author":"Kuan","year":"2015","journal-title":"Journal of the Association for Information Systems"},{"issue":"3","key":"2025082212311116200_b26-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1509\/jmkg.70.3.0","article-title":"Word of Mouth for Movies: Its dynamics and impact on box office revenue","volume":"70","author":"Liu","year":"2006","journal-title":"Journal of Marketing"},{"issue":"12","key":"2025082212311116200_b27-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"3412","DOI":"10.1287\/mnsc.2015.2304","article-title":"Fake it till you make it: Reputation, competition, and Yelp review fraud","volume":"62","author":"Luca","year":"2016","journal-title":"Management Science"},{"issue":"3","key":"2025082212311116200_b28-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1287\/mksc.1110.0662","article-title":"Online product opinions: incidence, evaluation, and evolution","volume":"31","author":"Moe","year":"2012","journal-title":"Marketing Science"},{"issue":"1","key":"2025082212311116200_b29-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"crossref","first-page":"185","DOI":"10.2307\/20721420","article-title":"What makes a helpful online review? A study of customer reviews on Amazon.com","volume":"34","author":"Mudambi","year":"2010","journal-title":"MIS Quarterly"},{"issue":"3","key":"2025082212311116200_b30-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"crossref","first-page":"755","DOI":"10.2307\/25148748","article-title":"Information technology and pricing decisions: Price adjustments in online computer markets","volume":"30","author":"Oh","year":"2006","journal-title":"MIS Quarterly"},{"key":"2025082212311116200_b31-13_rn_10_25300_misq_2023_16216","unstructured":"Patterson, B.\n           (2016). 5 Yelp facts business owners should know (but most don\u2019t). MarTech. https:\/\/marketingland.com\/5-yelp-facts-business-owners-should-know-163054"},{"issue":"3","key":"2025082212311116200_b32-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"503","DOI":"10.1037\/0022-3514.43.3.503","article-title":"Effects of public and private self-awareness on deindividuation and aggression","volume":"43","author":"Prentice-Dunn","year":"1982","journal-title":"Journal of Personality and Social Psychology"},{"key":"2025082212311116200_b33-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1142\/9789814417358_0013","article-title":"Risk aversion and expected-utility theory: a calibration theorem","volume-title":"Handbook of the fundamentals of financial decision making: Part I","author":"Rabin","year":"2013"},{"issue":"4","key":"2025082212311116200_b34-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1207\/S15327957PSPR050","article-title":"Negativity bias, negativity dominance, and contagion","volume":"5","author":"Rozin","year":"2001","journal-title":"Personality and Social Psychology Review"},{"issue":"7","key":"2025082212311116200_b35-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"1784","DOI":"10.1177\/0149206314525202","article-title":"Organizational transparency: A new perspective on managing trust in organization-stakeholder relationships","volume":"42","author":"Schnackenberg","year":"2016","journal-title":"Journal of Management"},{"key":"2025082212311116200_b36-13_rn_10_25300_misq_2023_16216","unstructured":"Shane, S.\n           (2018). Five takeaways from new reports on Russia\u2019s social media operations. The New York Times. https:\/\/www.nytimes.com\/2018\/12\/17\/us\/politics\/takeaways-russia-social-media-operations.html"},{"issue":"4","key":"2025082212311116200_b37-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1287\/mksc.2015.0906","article-title":"Consumer uncertainty and purchase decision reversals: Theory and evidence","volume":"34","author":"Shulman","year":"2015","journal-title":"Marketing Science"},{"key":"2025082212311116200_b38-13_rn_10_25300_misq_2023_16216","unstructured":"Snyder, B.\n           (2015). Yelp says FTC has dropped inquiry into its reviews. Fortune. https:\/\/fortune.com\/2015\/01\/06\/yelp-ftc-inquiry\/"},{"key":"2025082212311116200_b39-13_rn_10_25300_misq_2023_16216","unstructured":"Solis, N.\n           (2018). Why does Yelp filter reviews & what you can do about it. Broadly. https:\/\/broadly.com\/blog\/why-does-yelp-filter-reviews\/"},{"issue":"6","key":"2025082212311116200_b40-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"1310","DOI":"10.1016\/j.tourman.2010.12.011","article-title":"The impact of online reviews on hotel booking intentions and perception of trust","volume":"32","author":"Sparks","year":"2011","journal-title":"Tourism Management"},{"key":"2025082212311116200_b41-13_rn_10_25300_misq_2023_16216","first-page":"1526","article-title":"What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation","volume":"13","author":"Suzor","year":"2019","journal-title":"International Journal of Communication"},{"key":"2025082212311116200_b42-13_rn_10_25300_misq_2023_16216","volume-title":"The naked corporation: How the age of transparency will revolutionize business","author":"Tapscott","year":"2003"},{"issue":"1-2","key":"2025082212311116200_b43-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1207\/S15327663JCP13-1&2_13","article-title":"Information availability and consumer preference: Can online retailers benefit from providing access to competitor price information?","volume":"13","author":"Trifts","year":"2003","journal-title":"Journal of Consumer Psychology"},{"key":"2025082212311116200_b44-13_rn_10_25300_misq_2023_16216","unstructured":"Vaughan, B.\n           (2020). Don\u2019t just boycott Facebook: Create something better!\u2008Forbes. https:\/\/www.forbes.com\/sites\/benjaminvaughan\/2020\/07\/07\/I-just-boycott-face--ok--create-something-better\/#7df486a84d3d"},{"issue":"4","key":"2025082212311116200_b45-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"217","DOI":"10.2753\/MIS0742-1222230410","article-title":"Recommendation agents for electronic commerce: Effects of explanation facilities on trusting beliefs","volume":"23","author":"Wang","year":"2007","journal-title":"Journal of Management Information Systems"},{"issue":"3","key":"2025082212311116200_b46-13_rn_10_25300_misq_2023_16216","doi-asserted-by":"publisher","first-page":"744","DOI":"10.1080\/07421222.2016.1243949","article-title":"Empirical assessment of alternative designs for enhancing different types of trusting beliefs in online recommendation agents","volume":"33","author":"Wang","year":"2016","journal-title":"Journal of Management Information Systems"},{"key":"2025082212311116200_b47-13_rn_10_25300_misq_2023_16216","author":"Yelp","year":"2010","journal-title":"Yelp\u2019s recommendation software explained"},{"key":"2025082212311116200_b48-13_rn_10_25300_misq_2023_16216","unstructured":"York, J.\n           (2020). What comes next for the Santa Clara Principles: 2020 in Review. EFF. https:\/\/www.eff.org\/deeplinks\/2020\/12\/2020-year-review-what-comes-next-santa-clara-principles"}],"container-title":["MIS Quarterly"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/47\/4\/1693\/9023\/13_rn_10_25300_misq_2023_16216.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/47\/4\/1693\/9023\/13_rn_10_25300_misq_2023_16216.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T16:31:21Z","timestamp":1755880281000},"score":1,"resource":{"primary":{"URL":"https:\/\/misq.umn.edu\/misq\/article\/47\/4\/1693\/2239\/Review-Moderation-Transparency-and-Online-Reviews"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,1]]},"references-count":48,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,12,1]]},"published-print":{"date-parts":[[2023,12,1]]}},"URL":"https:\/\/doi.org\/10.25300\/misq\/2023\/16216","relation":{},"ISSN":["0276-7783","2162-9730"],"issn-type":[{"value":"0276-7783","type":"print"},{"value":"2162-9730","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,1]]}}}