MCGNet: Partial Multi-view Few-shot Learning via Meta-alignment and Context Gated-aggregation

by   Yuan Zhou, et al.

In this paper, we propose a new challenging task named as partial multi-view few-shot learning, which unifies two tasks, i.e. few-shot learning and partial multi-view learning, together. Different from the traditional few-shot learning, this task aims to solve the few-shot learning problem given the incomplete multi-view prior knowledge, which conforms more with the real-world applications. However, this brings about two difficulties within this task. First, the gaps among different views can be large and hard to reduce, especially with sample scarcity. Second, due to the incomplete view information, few-shot learning becomes more challenging than the traditional one. To deal with the above issues, we propose a new Meta-alignment and Context Gated-aggregation Network by equipping meta-alignment and context gated-aggregation with partial multi-view GNNs. Specifically, the meta-alignment effectively maps the features from different views into a more compact latent space, thereby reducing the view gaps. Moreover, the context gated-aggregation alleviates the view-missing influence by leveraging the cross-view context. Extensive experiments are conducted on the PIE and ORL dataset for evaluating our proposed method. By comparing with other few-shot learning methods, our method obtains the state-of-the-art performance especially with heavily-missing views.



page 1

page 2

page 3

page 4


Deep Partial Multi-View Learning

Although multi-view learning has made signifificant progress over the pa...

Recurrent Aggregation Learning for Multi-View Echocardiographic Sequences Segmentation

Multi-view echocardiographic sequences segmentation is crucial for clini...

Binocular Mutual Learning for Improving Few-shot Classification

Most of the few-shot learning methods learn to transfer knowledge from d...

Edge-Labeling based Directed Gated Graph Network for Few-shot Learning

Existing graph-network-based few-shot learning methods obtain similarity...

Multi-view Alignment and Generation in CCA via Consistent Latent Encoding

Multi-view alignment, achieving one-to-one correspondence of multi-view ...

Gated Context Aggregation Network for Image Dehazing and Deraining

Image dehazing aims to recover the uncorrupted content from a hazy image...

Learning Dynamic Alignment via Meta-filter for Few-shot Learning

Few-shot learning (FSL), which aims to recognise new classes by adapting...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.