Hybrid Graph Neural Networks for Few-Shot Learning

12/13/2021
by   Tianyuan Yu, et al.
0

Graph neural networks (GNNs) have been used to tackle the few-shot learning (FSL) problem and shown great potentials under the transductive setting. However under the inductive setting, existing GNN based methods are less competitive. This is because they use an instance GNN as a label propagation/classification module, which is jointly meta-learned with a feature embedding network. This design is problematic because the classifier needs to adapt quickly to new tasks while the embedding does not. To overcome this problem, in this paper we propose a novel hybrid GNN (HGNN) model consisting of two GNNs, an instance GNN and a prototype GNN. Instead of label propagation, they act as feature embedding adaptation modules for quick adaptation of the meta-learned feature embedding to new tasks. Importantly they are designed to deal with a fundamental yet often neglected challenge in FSL, that is, with only a handful of shots per class, any few-shot classifier would be sensitive to badly sampled shots which are either outliers or can cause inter-class distribution overlapping. of poorly sampled few-shots respectively and their complementarity is exploited in the hybrid GNN model. Extensive experiments show that our HGNN obtains new state-of-the-art on three FSL benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/14/2020

Attentive Graph Neural Networks for Few-Shot Learning

Graph Neural Networks (GNN) has demonstrated the superior performance in...
research
01/25/2021

ATRM: Attention-based Task-level Relation Module for GNN-based Few-shot Learning

Recently, graph neural networks (GNNs) have shown powerful ability to ha...
research
09/24/2022

Graph Neural Network Expressivity and Meta-Learning for Molecular Property Regression

We demonstrate the applicability of model-agnostic algorithms for meta-l...
research
08/31/2023

Domain-adaptive Message Passing Graph Neural Network

Cross-network node classification (CNNC), which aims to classify nodes i...
research
09/01/2020

Evasion Attacks to Graph Neural Networks via Influence Function

Graph neural networks (GNNs) have achieved state-of-the-art performance ...
research
05/03/2019

Generating Classification Weights with GNN Denoising Autoencoders for Few-Shot Learning

Given an initial recognition model already trained on a set of base clas...
research
02/06/2023

Energy-based Out-of-Distribution Detection for Graph Neural Networks

Learning on graphs, where instance nodes are inter-connected, has become...

Please sign up or login with your details

Forgot password? Click here to reset