Few-Shot Learning with Part Discovery and Augmentation from Unlabeled Images

05/25/2021
by   Wentao Chen, et al.
0

Few-shot learning is a challenging task since only few instances are given for recognizing an unseen class. One way to alleviate this problem is to acquire a strong inductive bias via meta-learning on similar tasks. In this paper, we show that such inductive bias can be learned from a flat collection of unlabeled images, and instantiated as transferable representations among seen and unseen classes. Specifically, we propose a novel part-based self-supervised representation learning scheme to learn transferable representations by maximizing the similarity of an image to its discriminative part. To mitigate the overfitting in few-shot classification caused by data scarcity, we further propose a part augmentation strategy by retrieving extra images from a base dataset. We conduct systematic studies on miniImageNet and tieredImageNet benchmarks. Remarkably, our method yields impressive results, outperforming the previous best unsupervised methods by 7.74 5-way 1-shot and 5-way 5-shot settings, which are comparable with state-of-the-art supervised methods.

READ FULL TEXT

page 3

page 6

research
10/06/2020

Shot in the Dark: Few-Shot Learning with No Base-Class Labels

Few-shot learning aims to learn classifiers for new objects from a small...
research
11/28/2018

Unsupervised Meta-Learning For Few-Shot Image and Video Classification

Few-shot or one-shot learning of classifiers for images or videos is an ...
research
11/29/2022

PatchMix Augmentation to Identify Causal Features in Few-shot Learning

The task of Few-shot learning (FSL) aims to transfer the knowledge learn...
research
02/18/2022

Towards better understanding and better generalization of few-shot classification in histology images with contrastive learning

Few-shot learning is an established topic in natural images for years, b...
research
10/19/2022

Few-shot Transferable Robust Representation Learning via Bilevel Attacks

Existing adversarial learning methods for enhancing the robustness of de...
research
10/08/2019

When Does Self-supervision Improve Few-shot Learning?

We present a technique to improve the generalization of deep representat...
research
03/14/2022

Self-Promoted Supervision for Few-Shot Transformer

The few-shot learning ability of vision transformers (ViTs) is rarely in...

Please sign up or login with your details

Forgot password? Click here to reset