Probabilistic Active Meta-Learning

07/17/2020
by   Jean Kaddour, et al.
41

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about tasks to learn new, related tasks efficiently. Typically, a set of training tasks is assumed given or randomly chosen. However, this setting does not take into account the sequential nature that naturally arises when training a model from scratch in real-life: how do we collect a set of training tasks in a data-efficient manner? In this work, we introduce task selection based on prior experience into a meta-learning algorithm by conceptualizing the learner and the active meta-learning setting using a probabilistic latent variable model. We provide empirical evidence that our approach improves data-efficiency when compared to strong baselines on simulated robotic experiments.

READ FULL TEXT

page 8

page 11

page 14

research
10/19/2021

BAMLD: Bayesian Active Meta-Learning by Disagreement

Data-efficient learning algorithms are essential in many practical appli...
research
03/20/2018

Meta Reinforcement Learning with Latent Variable Gaussian Processes

Data efficiency, i.e., learning from small data sets, is critical in man...
research
10/26/2021

Meta-learning with an Adaptive Task Scheduler

To benefit the learning of a new task, meta-learning has been proposed t...
research
03/03/2021

Meta-Learning with Variational Bayes

The field of meta-learning seeks to improve the ability of today's machi...
research
06/09/2021

Probabilistic task modelling for meta-learning

We propose probabilistic task modelling – a generative probabilistic mod...
research
05/16/2023

Automatic learning algorithm selection for classification via convolutional neural networks

As in any other task, the process of building machine learning models ca...
research
06/17/2019

Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing

In this paper, we present an approach to incorporate retrieved datapoint...

Please sign up or login with your details

Forgot password? Click here to reset