Wave-SAN: Wavelet based Style Augmentation Network for Cross-Domain Few-Shot Learning

03/15/2022
by   Yuqian Fu, et al.
0

Previous few-shot learning (FSL) works mostly are limited to natural images of general concepts and categories. These works assume very high visual similarity between the source and target classes. In contrast, the recently proposed cross-domain few-shot learning (CD-FSL) aims at transferring knowledge from general nature images of many labeled examples to novel domain-specific target categories of only a few labeled examples. The key challenge of CD-FSL lies in the huge data shift between source and target domains, which is typically in the form of totally different visual styles. This makes it very nontrivial to directly extend the classical FSL methods to address the CD-FSL task. To this end, this paper studies the problem of CD-FSL by spanning the style distributions of the source dataset. Particularly, wavelet transform is introduced to enable the decomposition of visual representations into low-frequency components such as shape and style and high-frequency components e.g., texture. To make our model robust to visual styles, the source images are augmented by swapping the styles of their low-frequency components with each other. We propose a novel Style Augmentation (StyleAug) module to implement this idea. Furthermore, we present a Self-Supervised Learning (SSL) module to ensure the predictions of style-augmented images are semantically similar to the unchanged ones. This avoids the potential semantic drift problem in exchanging the styles. Extensive experiments on two CD-FSL benchmarks show the effectiveness of our method. Our codes and models will be released.

READ FULL TEXT

page 5

page 18

research
02/18/2023

Meta Style Adversarial Training for Cross-Domain Few-Shot Learning

Cross-Domain Few-Shot Learning (CD-FSL) is a recently emerging task that...
research
01/19/2023

Exploiting Style Transfer-based Task Augmentation for Cross-Domain Few-Shot Learning

In cross-domain few-shot learning, the core issue is that the model trai...
research
10/11/2022

ME-D2N: Multi-Expert Domain Decompositional Network for Cross-Domain Few-Shot Learning

Recently, Cross-Domain Few-Shot Learning (CD-FSL) which aims at addressi...
research
09/07/2023

CDFSL-V: Cross-Domain Few-Shot Learning for Videos

Few-shot video action recognition is an effective approach to recognizin...
research
08/17/2022

Cross-Domain Few-Shot Classification via Inter-Source Stylization

Cross-Domain Few Shot Classification (CDFSC) leverages prior knowledge l...
research
03/15/2023

Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey

Deep learning has been highly successful in computer vision with large a...
research
11/29/2022

PatchMix Augmentation to Identify Causal Features in Few-shot Learning

The task of Few-shot learning (FSL) aims to transfer the knowledge learn...

Please sign up or login with your details

Forgot password? Click here to reset