DAMSL: Domain Agnostic Meta Score-based Learning

06/06/2021
by   John Cai, et al.
0

In this paper, we propose Domain Agnostic Meta Score-based Learning (DAMSL), a novel, versatile and highly effective solution that delivers significant out-performance over state-of-the-art methods for cross-domain few-shot learning. We identify key problems in previous meta-learning methods over-fitting to the source domain, and previous transfer-learning methods under-utilizing the structure of the support set. The core idea behind our method is that instead of directly using the scores from a fine-tuned feature encoder, we use these scores to create input coordinates for a domain agnostic metric space. A graph neural network is applied to learn an embedding and relation function over these coordinates to process all information contained in the score distribution of the support set. We test our model on both established CD-FSL benchmarks and new domains and show that our method overcomes the limitations of previous meta-learning and transfer-learning methods to deliver substantial improvements in accuracy across both smaller and larger domain shifts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/03/2020

SB-MTL: Score-based Meta Transfer-Learning for Cross-Domain Few-Shot Learning

While many deep learning methods have seen significant success in tackli...
research
05/21/2020

Cross-Domain Few-Shot Learning with Meta Fine-Tuning

In this paper, we tackle the new Cross-Domain Few-Shot Learning benchmar...
research
01/20/2022

Cross-Domain Few-Shot Graph Classification

We study the problem of few-shot graph classification across domains wit...
research
05/12/2022

Cross-domain Few-shot Meta-learning Using Stacking

Cross-domain few-shot meta-learning (CDFSML) addresses learning problems...
research
08/02/2022

The Curse of Low Task Diversity: On the Failure of Transfer Learning to Outperform MAML and Their Empirical Equivalence

Recently, it has been observed that a transfer learning solution might b...
research
06/13/2020

MetaPerturb: Transferable Regularizer for Heterogeneous Tasks and Architectures

Regularization and transfer learning are two popular techniques to enhan...
research
02/16/2018

A Systematic Study of Cross-Project Defect Prediction With Meta-Learning

The prediction of defects in a target project based on data from externa...

Please sign up or login with your details

Forgot password? Click here to reset