Towards Amortized Ranking-Critical Training for Collaborative Filtering

06/10/2019
by   Sam Lobel, et al.
3

Collaborative filtering is widely used in modern recommender systems. Recent research shows that variational autoencoders (VAEs) yield state-of-the-art performance by integrating flexible representations from deep neural networks into latent variable models, mitigating limitations of traditional linear factor models. VAEs are typically trained by maximizing the likelihood (MLE) of users interacting with ground-truth items. While simple and often effective, MLE-based training does not directly maximize the recommendation-quality metrics one typically cares about, such as top-N ranking. In this paper we investigate new methods for training collaborative filtering models based on actor-critic reinforcement learning, to directly optimize the non-differentiable quality metrics of interest. Specifically, we train a critic network to approximate ranking-based metrics, and then update the actor network (represented here by a VAE) to directly optimize against the learned metrics. In contrast to traditional learning-to-rank methods that require to re-run the optimization procedure for new lists, our critic-based method amortizes the scoring process with a neural network, and can directly provide the (approximate) ranking scores for new lists. Empirically, we show that the proposed methods outperform several state-of-the-art baselines, including recently-proposed deep learning approaches, on three large-scale real-world datasets. The code to reproduce the experimental results and figure plots is on Github: https://github.com/samlobel/RaCT_CF

READ FULL TEXT
research
08/15/2018

Neural Collaborative Ranking

Recommender systems are aimed at generating a personalized ranked list o...
research
06/29/2017

Actor-Critic Sequence Training for Image Captioning

Generating natural language descriptions of images is an important capab...
research
12/24/2019

RecVAE: a New Variational Autoencoder for Top-N Recommendations with Implicit Feedback

Recent research has shown the advantages of using autoencoders based on ...
research
02/16/2018

Variational Autoencoders for Collaborative Filtering

We extend variational autoencoders (VAEs) to collaborative filtering for...
research
06/26/2022

Towards Representation Alignment and Uniformity in Collaborative Filtering

Collaborative filtering (CF) plays a critical role in the development of...
research
09/09/2019

Boosting Item-based Collaborative Filtering via Nearly Uncoupled Random Walks

Item-based models are among the most popular collaborative filtering app...
research
05/30/2019

On the Effectiveness of Low-rank Approximations for Collaborative Filtering compared to Neural Networks

Even in times of deep learning, low-rank approximations by factorizing a...

Please sign up or login with your details

Forgot password? Click here to reset