Adaptive manifold for imbalanced transductive few-shot learning

04/27/2023
by   Michalis Lazarou, et al.
0

Transductive few-shot learning algorithms have showed substantially superior performance over their inductive counterparts by leveraging the unlabeled queries. However, the vast majority of such methods are evaluated on perfectly class-balanced benchmarks. It has been shown that they undergo remarkable drop in performance under a more realistic, imbalanced setting. To this end, we propose a novel algorithm to address imbalanced transductive few-shot learning, named Adaptive Manifold. Our method exploits the underlying manifold of the labeled support examples and unlabeled queries by using manifold similarity to predict the class probability distribution per query. It is parameterized by one centroid per class as well as a set of graph-specific parameters that determine the manifold. All parameters are optimized through a loss function that can be tuned towards class-balanced or imbalanced distributions. The manifold similarity shows substantial improvement over Euclidean distance, especially in the 1-shot setting. Our algorithm outperforms or is on par with other state of the art methods in three benchmark datasets, namely miniImageNet, tieredImageNet and CUB, and three different backbones, namely ResNet-18, WideResNet-28-10 and DenseNet-121. In certain cases, our algorithm outperforms the previous state of the art by as much as 4.2

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/24/2022

Realistic Evaluation of Transductive Few-Shot Learning

Transductive inference is widely used in few-shot learning, as it levera...
research
11/26/2022

A Maximum Log-Likelihood Method for Imbalanced Few-Shot Learning Tasks

Few-shot learning is a rapidly evolving area of research in machine lear...
research
08/06/2023

Prototypes-oriented Transductive Few-shot Learning with Conditional Transport

Transductive Few-Shot Learning (TFSL) has recently attracted increasing ...
research
07/27/2018

Few Shot Learning with Simplex

Deep learning has made remarkable achievement in many fields. However, l...
research
01/07/2021

Few-Shot Learning with Class Imbalance

Few-shot learning aims to train models on a limited number of labeled sa...
research
10/13/2022

Rebalanced Zero-shot Learning

Zero-shot learning (ZSL) aims to identify unseen classes with zero sampl...
research
08/22/2019

LoRAS: An oversampling approach for imbalanced datasets

The Synthetic Minority Oversampling TEchnique (SMOTE) is widely-used for...

Please sign up or login with your details

Forgot password? Click here to reset