DeepAI AI Chat
Log In Sign Up

When Sheep Shop: Measuring Herding Effects in Product Ratings with Natural Experiments

02/19/2018
by   Gael Lederrey, et al.
EPFL
1

As online shopping becomes ever more prevalent, customers rely increasingly on product rating websites for making purchase decisions. The reliability of online ratings, however, is potentially compromised by the so-called herding effect: when rating a product, customers may be biased to follow other customers' previous ratings of the same product. This is problematic because it skews long-term customer perception through haphazard early ratings. The study of herding poses methodological challenges. Observational studies are impeded by the lack of counterfactuals: simply correlating early with subsequent ratings is insufficient because we cannot know what the subsequent ratings would have looked like had the first ratings been different. The methodology introduced here exploits a setting that comes close to an experiment, although it is purely observational-a natural experiment. Our key methodological device consists in studying the same product on two separate rating sites, focusing on products that received a high first rating on one site, and a low first rating on the other. This largely controls for confounds such as a product's inherent quality, advertising, and producer identity, and lets us isolate the effect of the first rating on subsequent ratings. In a case study, we focus on beers as products and jointly study two beer rating sites, but our method applies to any pair of sites across which products can be matched. We find clear evidence of herding in beer ratings. For instance, if a beer receives a very high first rating, its second rating is on average half a standard deviation higher, compared to a situation where the identical beer receives a very low first rating. Moreover, herding effects tend to last a long time and are noticeable even after 20 or more ratings. Our results have important implications for the design of better rating systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/18/2020

Feature-level Rating System using Customer Reviews and Review Votes

This work studies how we can obtain feature-level ratings of the mobile ...
01/17/2018

Eliminating the effect of rating bias on reputation systems

The ongoing rapid development of the e-commercial and interest-base webs...
11/28/2020

Reconstruction Rating Model of Sovereign Debt by Logical Analysis of Data

Sovereign debt ratings provided by rating agencies measure the solvency ...
12/23/2022

Content Rating Classification for Fan Fiction

Content ratings can enable audiences to determine the suitability of var...
06/11/2020

Surveys without Questions: A Reinforcement Learning Approach

The 'old world' instrument, survey, remains a tool of choice for firms t...
09/10/2022

Application of Machine Learning for Online Reputation Systems

Users on the internet usually require venues to provide better purchasin...
10/30/2018

Designing Informative Rating Systems for Online Platforms: Evidence from Two Experiments

Platforms critically rely on rating systems to learn the quality of mark...