RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classification

08/04/2023
by   Zhengyang Mao, et al.
0

Graph classification is a crucial task in many real-world multimedia applications, where graphs can represent various multimedia data types such as images, videos, and social networks. Previous efforts have applied graph neural networks (GNNs) in balanced situations where the class distribution is balanced. However, real-world data typically exhibit long-tailed class distributions, resulting in a bias towards the head classes when using GNNs and limited generalization ability over the tail classes. Recent approaches mainly focus on re-balancing different classes during model training, which fails to explicitly introduce new knowledge and sacrifices the performance of the head classes. To address these drawbacks, we propose a novel framework called Retrieval Augmented Hybrid Network (RAHNet) to jointly learn a robust feature extractor and an unbiased classifier in a decoupled manner. In the feature extractor training stage, we develop a graph retrieval module to search for relevant graphs that directly enrich the intra-class diversity for the tail classes. Moreover, we innovatively optimize a category-centered supervised contrastive loss to obtain discriminative representations, which is more suitable for long-tailed scenarios. In the classifier fine-tuning stage, we balance the classifier weights with two weight regularization techniques, i.e., Max-norm and weight decay. Experiments on various popular benchmarks verify the superiority of the proposed method against state-of-the-art approaches.

READ FULL TEXT
research
07/11/2023

Class Instance Balanced Learning for Long-Tailed Classification

The long-tailed image classification task remains important in the devel...
research
08/22/2022

LTE4G: Long-Tail Experts for Graph Neural Networks

Existing Graph Neural Networks (GNNs) usually assume a balanced situatio...
research
05/17/2023

Characterizing Long-Tail Categories on Graphs

Long-tail data distributions are prevalent in many real-world networks, ...
research
03/27/2022

Long-Tailed Recognition via Weight Balancing

In the real open world, data tends to follow long-tailed class distribut...
research
05/26/2023

Exploring Weight Balancing on Long-Tailed Recognition Problem

Recognition problems in long-tailed data, where the sample size per clas...
research
06/12/2023

LIVABLE: Exploring Long-Tailed Classification of Software Vulnerability Types

Prior studies generally focus on software vulnerability detection and ha...
research
04/25/2023

GARCIA: Powering Representations of Long-tail Query with Multi-granularity Contrastive Learning

Recently, the growth of service platforms brings great convenience to bo...

Please sign up or login with your details

Forgot password? Click here to reset