An Evaluation Study of Generative Adversarial Networks for Collaborative Filtering

This work explores the reproducibility of CFGAN. CFGAN and its family of models (TagRec, MTPR, and CRGAN) learn to generate personalized and fake-but-realistic rankings of preferences for top-N recommendations by using previous interactions. This work successfully replicates the results published in the original paper and discusses the impact of certain differences between the CFGAN framework and the model used in the original evaluation. The absence of random noise and the use of real user profiles as condition vectors leaves the generator prone to learn a degenerate solution in which the output vector is identical to the input vector, therefore, behaving essentially as a simple autoencoder. The work further expands the experimental analysis comparing CFGAN against a selection of simple and well-known properly optimized baselines, observing that CFGAN is not consistently competitive against them despite its high computational cost. To ensure the reproducibility of these analyses, this work describes the experimental methodology and publishes all datasets and source code.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2022

Consistent Collaborative Filtering via Tensor Decomposition

Collaborative filtering is the de facto standard for analyzing users' ac...
research
09/26/2020

Explainable Recommendations via Attentive Multi-Persona Collaborative Filtering

Two main challenges in recommender systems are modeling users with heter...
research
09/26/2018

Predicting computational reproducibility of data analysis pipelines in large population studies using collaborative filtering

Evaluating the computational reproducibility of data analysis pipelines ...
research
10/19/2012

Active Collaborative Filtering

Collaborative filtering (CF) allows the preferences of multiple users to...
research
08/01/2023

Challenging the Myth of Graph Collaborative Filtering: a Reasoned and Reproducibility-driven Analysis

The success of graph neural network-based models (GNNs) has significantl...
research
11/18/2019

A Troubling Analysis of Reproducibility and Progress in Recommender Systems Research

The design of algorithms that generate personalized ranked item lists is...

Please sign up or login with your details

Forgot password? Click here to reset