SAILOR: Structural Augmentation Based Tail Node Representation Learning

08/13/2023
by   Jie Liao, et al.
0

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in representation learning for graphs recently. However, the effectiveness of GNNs, which capitalize on the key operation of message propagation, highly depends on the quality of the topology structure. Most of the graphs in real-world scenarios follow a long-tailed distribution on their node degrees, that is, a vast majority of the nodes in the graph are tail nodes with only a few connected edges. GNNs produce inferior node representations for tail nodes since they lack structural information. In the pursuit of promoting the expressiveness of GNNs for tail nodes, we explore how the deficiency of structural information deteriorates the performance of tail nodes and propose a general Structural Augmentation based taIL nOde Representation learning framework, dubbed as SAILOR, which can jointly learn to augment the graph structure and extract more informative representations for tail nodes. Extensive experiments on public benchmark datasets demonstrate that SAILOR can significantly improve the tail node representations and outperform the state-of-the-art baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2021

Uniting Heterogeneity, Inductiveness, and Efficiency for Graph Representation Learning

With the ubiquitous graph-structured data in various applications, model...
research
03/24/2023

Structural Imbalance Aware Graph Augmentation Learning

Graph machine learning (GML) has made great progress in node classificat...
research
06/16/2022

ResNorm: Tackling Long-tailed Degree Distribution Issue in Graph Neural Networks via Normalization

Graph Neural Networks (GNNs) have attracted much attention due to their ...
research
10/30/2020

Deep Active Graph Representation Learning

Graph neural networks (GNNs) aim to learn graph representations that pre...
research
03/17/2023

SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization

Graph Neural Networks (GNNs) are de facto solutions to structural data l...
research
04/25/2023

GARCIA: Powering Representations of Long-tail Query with Multi-granularity Contrastive Learning

Recently, the growth of service platforms brings great convenience to bo...
research
06/15/2022

CLNode: Curriculum Learning for Node Classification

Node classification is a fundamental graph-based task that aims to predi...

Please sign up or login with your details

Forgot password? Click here to reset