Log In Sign Up

Learning from both experts and data

by   Rémi Besson, et al.

In this work we study the problem of inferring a discrete probability distribution using both expert knowledge and empirical data. This is an important issue for many applications where the scarcity of data prevents a purely empirical approach. In this context, it is common to rely first on an initial domain knowledge a priori before proceeding to an online data acquisition. We are particularly interested in the intermediate regime where we do not have enough data to do without the initial expert a priori of the experts, but enough to correct it if necessary. We present here a novel way to tackle this issue with a method providing an objective way to choose the weight to be given to experts compared to data. We show, both empirically and theoretically, that our proposed estimator is always more efficient than the best of the two models (expert or data) within a constant.


Episodic Bandits with Stochastic Experts

We study a version of the contextual bandit problem where an agent is gi...

Task Programming: Learning Data Efficient Behavior Representations

Specialized domain knowledge is often necessary to accurately annotate t...

Learning the Experts for Online Sequence Prediction

Online sequence prediction is the problem of predicting the next element...

Online Learning with an Almost Perfect Expert

We study the online learning problem where a forecaster makes a sequence...

Finding Experts in Transformer Models

In this work we study the presence of expert units in pre-trained Transf...

Interactive Collaborative Exploration using Incomplete Contexts

A common representation of information about relations of objects and at...

Modular interface for managing cognitive bias in experts

Expert knowledge is required to interpret data across a range of fields....