ReGrAt: Regularization in Graphs using Attention to handle class imbalance

11/27/2022
by   Neeraja Kirtane, et al.
0

Node classification is an important task to solve in graph-based learning. Even though a lot of work has been done in this field, imbalance is neglected. Real-world data is not perfect, and is imbalanced in representations most of the times. Apart from text and images, data can be represented using graphs, and thus addressing the imbalance in graphs has become of paramount importance. In the context of node classification, one class has less examples than others. Changing data composition is a popular way to address the imbalance in node classification. This is done by resampling the data to balance the dataset. However, that can sometimes lead to loss of information or add noise to the dataset. Therefore, in this work, we implicitly solve the problem by changing the model loss. Specifically, we study how attention networks can help tackle imbalance. Moreover, we observe that using a regularizer to assign larger weights to minority nodes helps to mitigate this imbalance. We achieve State of the Art results than the existing methods on several standard citation benchmark datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2023

Semantic-aware Node Synthesis for Imbalanced Heterogeneous Information Networks

Heterogeneous graph neural networks (HGNNs) have exhibited exceptional e...
research
07/10/2018

Deep Imbalanced Attribute Classification using Visual Attention Aggregation

For many computer vision applications such as image description and huma...
research
09/18/2022

Imbalanced Nodes Classification for Graph Neural Networks Based on Valuable Sample Mining

Node classification is an important task in graph neural networks, but m...
research
07/30/2021

Foundations of data imbalance and solutions for a data democracy

Dealing with imbalanced data is a prevalent problem while performing cla...
research
04/19/2022

Neural Collapse Inspired Attraction-Repulsion-Balanced Loss for Imbalanced Learning

Class imbalance distribution widely exists in real-world engineering. Ho...
research
03/18/2023

UNREAL:Unlabeled Nodes Retrieval and Labeling for Heavily-imbalanced Node Classification

Extremely skewed label distributions are common in real-world node class...
research
11/22/2019

Investigating bankruptcy prediction models in the presence of extreme class imbalance and multiple stages of economy

In the area of credit risk analytics, current Bankruptcy Prediction Mode...

Please sign up or login with your details

Forgot password? Click here to reset