How Useful are Reviews for Recommendation? A Critical Review and Potential Improvements

05/25/2020
by   Noveen Sachdeva, et al.
0

We investigate a growing body of work that seeks to improve recommender systems through the use of review text. Generally, these papers argue that since reviews 'explain' users' opinions, they ought to be useful to infer the underlying dimensions that predict ratings or purchases. Schemes to incorporate reviews range from simple regularizers to neural network approaches. Our initial findings reveal several discrepancies in reported results, partly due to (e.g.) copying results across papers despite changes in experimental settings or data pre-processing. First, we attempt a comprehensive analysis to resolve these ambiguities. Further investigation calls for discussion on a much larger problem about the "importance" of user reviews for recommendation. Through a wide range of experiments, we observe several cases where state-of-the-art methods fail to outperform existing baselines, especially as we deviate from a few narrowly-defined settings where reviews are useful. We conclude by providing hypotheses for our observations, that seek to characterize under what conditions reviews are likely to be helpful. Through this work, we aim to evaluate the direction in which the field is progressing and encourage robust empirical evaluation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/05/2022

Minimizing Mindless Mentions: Recommendation with Minimal Necessary User Reviews

Recently, researchers have turned their attention to recommender systems...
research
09/28/2017

Content Recommendation through Semantic Annotation of User Reviews and Linked Data - An Extended Technical Report

Nowadays, most recommender systems exploit user-provided ratings to infe...
research
09/12/2022

On Faithfulness and Coherence of Language Explanations for Recommendation Systems

Reviews contain rich information about product characteristics and user ...
research
10/13/2020

Assessing the Helpfulness of Review Content for Explaining Recommendations

Despite the maturity already achieved by recommender systems algorithms,...
research
06/08/2021

Review Polarity-wise Recommender

Utilizing review information to enhance recommendation, the de facto rev...
research
06/05/2020

Aspect-based Sentiment Analysis of Scientific Reviews

Scientific papers are complex and understanding the usefulness of these ...
research
12/09/2019

Recurrent Point Processes for Dynamic Review Models

Recent progress in recommender system research has shown the importance ...

Please sign up or login with your details

Forgot password? Click here to reset