Meta-learning Amidst Heterogeneity and Ambiguity

07/05/2021
by   Kyeongryeol Go, et al.
0

Meta-learning aims to learn a model that can handle multiple tasks generated from an unknown but shared distribution. However, typical meta-learning algorithms have assumed the tasks to be similar such that a single meta-learner is sufficient to aggregate the variations in all aspects. In addition, there has been less consideration on uncertainty when limited information is given as context. In this paper, we devise a novel meta-learning framework, called Meta-learning Amidst Heterogeneity and Ambiguity (MAHA), that outperforms previous works in terms of prediction based on its ability on task identification. By extensively conducting several experiments in regression and classification, we demonstrate the validity of our model, which turns out to be robust to both task heterogeneity and ambiguity.

READ FULL TEXT
research
09/27/2021

ST-MAML: A Stochastic-Task based Method for Task-Heterogeneous Meta-Learning

Optimization-based meta-learning typically assumes tasks are sampled fro...
research
01/03/2020

Automated Relational Meta-learning

In order to efficiently learn with small amount of data on new tasks, me...
research
01/27/2022

The Effect of Diversity in Meta-Learning

Few-shot learning aims to learn representations that can tackle novel ta...
research
06/18/2022

EEML: Ensemble Embedded Meta-learning

To accelerate learning process with few samples, meta-learning resorts t...
research
07/08/2022

MACFE: A Meta-learning and Causality Based Feature Engineering Framework

Feature engineering has become one of the most important steps to improv...
research
09/30/2022

Beyond Bayes-optimality: meta-learning what you know you don't know

Meta-training agents with memory has been shown to culminate in Bayes-op...
research
06/09/2021

Probabilistic task modelling for meta-learning

We propose probabilistic task modelling – a generative probabilistic mod...

Please sign up or login with your details

Forgot password? Click here to reset