DeepAI
Log In Sign Up

Combat Data Shift in Few-shot Learning with Knowledge Graph

01/27/2021
by   Yongchun Zhu, et al.
2

Many few-shot learning approaches have been designed under the meta-learning framework, which learns from a variety of learning tasks and generalizes to new tasks. These meta-learning approaches achieve the expected performance in the scenario where all samples are drawn from the same distributions (i.i.d. observations). However, in real-world applications, few-shot learning paradigm often suffers from data shift, i.e., samples in different tasks, even in the same task, could be drawn from various data distributions. Most existing few-shot learning approaches are not designed with the consideration of data shift, and thus show downgraded performance when data distribution shifts. However, it is non-trivial to address the data shift problem in few-shot learning, due to the limited number of labeled samples in each task. Targeting at addressing this problem, we propose a novel metric-based meta-learning framework to extract task-specific representations and task-shared representations with the help of knowledge graph. The data shift within/between tasks can thus be combated by the combination of task-shared and task-specific representations. The proposed model is evaluated on popular benchmarks and two constructed new challenging datasets. The evaluation results demonstrate its remarkable performance.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 7

page 8

page 9

01/26/2019

Few-shot Learning with Meta Metric Learners

Few-shot Learning aims to learn classifiers for new classes with only a ...
08/13/2019

Meta Reasoning over Knowledge Graphs

The ability to reason over learned knowledge is an innate ability for hu...
05/17/2021

HetMAML: Task-Heterogeneous Model-Agnostic Meta-Learning for Few-Shot Learning Across Modalities

Most of existing gradient-based meta-learning approaches to few-shot lea...
10/06/2022

Hypernetwork approach to Bayesian MAML

The main goal of Few-Shot learning algorithms is to enable learning from...
05/08/2021

MetaKernel: Learning Variational Random Features with Limited Labels

Few-shot learning deals with the fundamental and challenging problem of ...
02/14/2021

Model-Agnostic Graph Regularization for Few-Shot Learning

In many domains, relationships between categories are encoded in the kno...
05/24/2018

Decision-Theoretic Meta-Learning: Versatile and Efficient Amortization of Few-Shot Learning

This paper develops a general framework for data efficient and versatile...