TopoImb: Toward Topology-level Imbalance in Learning from Graphs

12/16/2022
by   Tianxiang Zhao, et al.
0

Graph serves as a powerful tool for modeling data that has an underlying structure in non-Euclidean space, by encoding relations as edges and entities as nodes. Despite developments in learning from graph-structured data over the years, one obstacle persists: graph imbalance. Although several attempts have been made to target this problem, they are limited to considering only class-level imbalance. In this work, we argue that for graphs, the imbalance is likely to exist at the sub-class topology group level. Due to the flexibility of topology structures, graphs could be highly diverse, and learning a generalizable classification boundary would be difficult. Therefore, several majority topology groups may dominate the learning process, rendering others under-represented. To address this problem, we propose a new framework and design (1 a topology extractor, which automatically identifies the topology group for each instance with explicit memory cells, (2 a training modulator, which modulates the learning process of the target GNN model to prevent the case of topology-group-wise under-representation. can be used as a key component in GNN models to improve their performances under the data imbalance setting. Analyses on both topology-level imbalance and the proposed are provided theoretically, and we empirically verify its effectiveness with both node-level and graph-level classification as the target tasks.

READ FULL TEXT

page 2

page 8

research
10/08/2021

Topology-Imbalance Learning for Semi-Supervised Node Classification

The class imbalance problem, as an important issue in learning node repr...
research
08/17/2022

Position-aware Structure Learning for Graph Topology-imbalance by Relieving Under-reaching and Over-squashing

Topology-imbalance is a graph-specific imbalance problem caused by the u...
research
04/11/2023

Hyperbolic Geometric Graph Representation Learning for Hierarchy-imbalance Node Classification

Learning unbiased node representations for imbalanced samples in the gra...
research
07/01/2022

Characterizing the Effect of Class Imbalance on the Learning Dynamics

Data imbalance is a common problem in the machine learning literature th...
research
08/27/2023

Topological Augmentation for Class-Imbalanced Node Classification

Class imbalance is prevalent in real-world node classification tasks and...
research
10/01/2022

Diving into Unified Data-Model Sparsity for Class-Imbalanced Graph Representation Learning

Even pruned by the state-of-the-art network compression methods, Graph N...

Please sign up or login with your details

Forgot password? Click here to reset