Learning Dynamic Alignment via Meta-filter for Few-shot Learning

03/25/2021
by   Chengming Xu, et al.
1

Few-shot learning (FSL), which aims to recognise new classes by adapting the learned knowledge with extremely limited few-shot (support) examples, remains an important open problem in computer vision. Most of the existing methods for feature alignment in few-shot learning only consider image-level or spatial-level alignment while omitting the channel disparity. Our insight is that these methods would lead to poor adaptation with redundant matching, and leveraging channel-wise adjustment is the key to well adapting the learned knowledge to new classes. Therefore, in this paper, we propose to learn a dynamic alignment, which can effectively highlight both query regions and channels according to different local support information. Specifically, this is achieved by first dynamically sampling the neighbourhood of the feature position conditioned on the input few shot, based on which we further predict a both position-dependent and channel-dependent Dynamic Meta-filter. The filter is used to align the query feature with position-specific and channel-specific knowledge. Moreover, we adopt Neural Ordinary Differential Equation (ODE) to enable a more accurate control of the alignment. In such a sense our model is able to better capture fine-grained semantic context of the few-shot example and thus facilitates dynamical knowledge adaptation for few-shot learning. The resulting framework establishes the new state-of-the-arts on major few-shot visual recognition benchmarks, including miniImageNet and tieredImageNet.

READ FULL TEXT

page 1

page 4

page 8

04/15/2021

Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignment

Few-shot object detection (FSOD) aims to detect objects using only few e...
08/06/2020

Few-shot Classification via Adaptive Attention

Training a neural network model that can quickly adapt to a new task is ...
02/29/2020

Learning to Compare Relation: Semantic Alignment for Few-Shot Learning

Few-shot learning is a fundamental and challenging problem since it requ...
03/11/2019

Alignment Based Matching Networks for One-Shot Classification and Open-Set Recognition

Deep learning for object classification relies heavily on convolutional ...
04/08/2019

L2AE-D: Learning to Aggregate Embeddings for Few-shot Learning with Meta-level Dropout

Few-shot learning focuses on learning a new visual concept with very lim...
05/05/2021

MCGNet: Partial Multi-view Few-shot Learning via Meta-alignment and Context Gated-aggregation

In this paper, we propose a new challenging task named as partial multi-...
05/11/2021

Learning Implicit Temporal Alignment for Few-shot Video Classification

Few-shot video classification aims to learn new video categories with on...