DeepAI AI Chat
Log In Sign Up

Gradient-based Optimization for Bayesian Preference Elicitation

11/20/2019
by   Ivan Vendrov, et al.
11

Effective techniques for eliciting user preferences have taken on added importance as recommender systems (RSs) become increasingly interactive and conversational. A common and conceptually appealing Bayesian criterion for selecting queries is expected value of information (EVOI). Unfortunately, it is computationally prohibitive to construct queries with maximum EVOI in RSs with large item spaces. We tackle this issue by introducing a continuous formulation of EVOI as a differentiable network that can be optimized using gradient methods available in modern machine learning (ML) computational frameworks (e.g., TensorFlow, PyTorch). We exploit this to develop a novel, scalable Monte Carlo method for EVOI optimization, which is more scalable for large item spaces than methods requiring explicit enumeration of items. While we emphasize the use of this approach for pairwise (or k-wise) comparisons of items, we also demonstrate how our method can be adapted to queries involving subsets of item attributes or "partial items," which are often more cognitively manageable for users. Experiments show that our gradient-based EVOI technique achieves state-of-the-art performance across several domains while scaling to large item spaces.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/15/2022

COLA: Improving Conversational Recommender Systems by Collaborative Augmentation

Conversational recommender systems (CRS) aim to employ natural language ...
11/26/2021

Soliciting User Preferences in Conversational Recommender Systems via Usage-related Questions

A key distinguishing feature of conversational recommender systems over ...
05/10/2019

Active Embedding Search via Noisy Paired Comparisons

Suppose that we wish to estimate a user's preference vector w from paire...
11/15/2015

Expressive recommender systems through normalized nonnegative models

We introduce normalized nonnegative models (NNM) for explorative data an...
12/04/2019

Scalable Bayesian Preference Learning for Crowds

We propose a scalable Bayesian preference learning method for jointly pr...
03/16/2020

Supporting Hard Queries over Probabilistic Preferences

Preference analysis is widely applied in various domains such as social ...