Semantic-aware Node Synthesis for Imbalanced Heterogeneous Information Networks

02/27/2023
by   Xinyi Gao, et al.
0

Heterogeneous graph neural networks (HGNNs) have exhibited exceptional efficacy in modeling the complex heterogeneity in heterogeneous information networks (HINs). The critical advantage of HGNNs is their ability to handle diverse node and edge types in HINs by extracting and utilizing the abundant semantic information for effective representation learning. However, as a widespread phenomenon in many real-world scenarios, the class-imbalance distribution in HINs creates a performance bottleneck for existing HGNNs. Apart from the quantity imbalance of nodes, another more crucial and distinctive challenge in HINs is semantic imbalance. Minority classes in HINs often lack diverse and sufficient neighbor nodes, resulting in biased and incomplete semantic information. This semantic imbalance further compounds the difficulty of accurately classifying minority nodes, leading to the performance degradation of HGNNs. To tackle the imbalance of minority classes and supplement their inadequate semantics, we present the first method for the semantic imbalance problem in imbalanced HINs named Semantic-aware Node Synthesis (SNS). By assessing the influence on minority classes, SNS adaptively selects the heterogeneous neighbor nodes and augments the network with synthetic nodes while preserving the minority semantics. In addition, we introduce two regularization approaches for HGNNs that constrain the representation of synthetic nodes from both semantic and class perspectives to effectively suppress the potential noises from synthetic nodes, facilitating more expressive embeddings for classification. The comprehensive experimental study demonstrates that SNS consistently outperforms existing methods by a large margin in different benchmark datasets.

READ FULL TEXT
research
08/31/2021

Heterogeneous Graph Neural Network with Multi-view Representation Learning

Graph neural networks for heterogeneous graph embedding is to project no...
research
11/27/2022

ReGrAt: Regularization in Graphs using Attention to handle class imbalance

Node classification is an important task to solve in graph-based learnin...
research
06/26/2022

TAM: Topology-Aware Margin Loss for Class-Imbalanced Node Classification

Learning unbiased node representations under class-imbalanced graph data...
research
09/18/2022

Imbalanced Nodes Classification for Graph Neural Networks Based on Valuable Sample Mining

Node classification is an important task in graph neural networks, but m...
research
10/08/2021

Topology-Imbalance Learning for Semi-Supervised Node Classification

The class imbalance problem, as an important issue in learning node repr...
research
09/03/2020

MixBoost: Synthetic Oversampling with Boosted Mixup for Handling Extreme Imbalance

Training a classification model on a dataset where the instances of one ...
research
08/17/2022

Position-aware Structure Learning for Graph Topology-imbalance by Relieving Under-reaching and Over-squashing

Topology-imbalance is a graph-specific imbalance problem caused by the u...

Please sign up or login with your details

Forgot password? Click here to reset