Variational Factorization Machines for Preference Elicitation in Large-Scale Recommender Systems

12/20/2022
by   Jill-Jênn Vie, et al.
0

Factorization machines (FMs) are a powerful tool for regression and classification in the context of sparse observations, that has been successfully applied to collaborative filtering, especially when side information over users or items is available. Bayesian formulations of FMs have been proposed to provide confidence intervals over the predictions made by the model, however they usually involve Markov-chain Monte Carlo methods that require many samples to provide accurate predictions, resulting in slow training in the context of large-scale data. In this paper, we propose a variational formulation of factorization machines that allows us to derive a simple objective that can be easily optimized using standard mini-batch stochastic gradient descent, making it amenable to large-scale data. Our algorithm learns an approximate posterior distribution over the user and item parameters, which leads to confidence intervals over the predictions. We show, using several datasets, that it has comparable or better performance than existing methods in terms of prediction accuracy, and provide some applications in active learning strategies, e.g., preference elicitation techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2018

Higher-order approximate confidence intervals

We derive accurate confidence intervals based on higher-order approximat...
research
10/14/2019

Parallelized Training of Restricted Boltzmann Machines using Markov-Chain Monte Carlo Methods

Restricted Boltzmann Machine (RBM) is a generative stochastic neural net...
research
08/21/2018

CoBaR: Confidence-Based Recommender

Neighborhood-based collaborative filtering algorithms usually adopt a fi...
research
07/19/2021

Structured Stochastic Gradient MCMC

Stochastic gradient Markov chain Monte Carlo (SGMCMC) is considered the ...
research
07/24/2017

Stochastic Gradient Descent for Relational Logistic Regression via Partial Network Crawls

Research in statistical relational learning has produced a number of met...
research
02/21/2020

Leveraging Cross Feedback of User and Item Embeddings for Variational Autoencoder based Collaborative Filtering

Matrix factorization (MF) has been widely applied to collaborative filte...
research
05/15/2018

The Hierarchical Adaptive Forgetting Variational Filter

A common problem in Machine Learning and statistics consists in detectin...

Please sign up or login with your details

Forgot password? Click here to reset