Local Structure-aware Graph Contrastive Representation Learning

08/07/2023
by   Kai Yang, et al.
0

Traditional Graph Neural Network (GNN), as a graph representation learning method, is constrained by label information. However, Graph Contrastive Learning (GCL) methods, which tackle the label problem effectively, mainly focus on the feature information of the global graph or small subgraph structure (e.g., the first-order neighborhood). In the paper, we propose a Local Structure-aware Graph Contrastive representation Learning method (LS-GCL) to model the structural information of nodes from multiple views. Specifically, we construct the semantic subgraphs that are not limited to the first-order neighbors. For the local view, the semantic subgraph of each target node is input into a shared GNN encoder to obtain the target node embeddings at the subgraph-level. Then, we use a pooling function to generate the subgraph-level graph embeddings. For the global view, considering the original graph preserves indispensable semantic information of nodes, we leverage the shared GNN encoder to learn the target node embeddings at the global graph-level. The proposed LS-GCL model is optimized to maximize the common information among similar instances at three various perspectives through a multi-level contrastive loss function. Experimental results on five datasets illustrate that our method outperforms state-of-the-art graph representation learning approaches for both node classification and link prediction tasks.

READ FULL TEXT

page 13

page 16

research
07/06/2021

Multi-Level Graph Contrastive Learning

Graph representation learning has attracted a surge of interest recently...
research
05/03/2018

SURREAL: SUbgraph Robust REpresentAtion Learning

The success of graph embeddings or node representation learning in a var...
research
10/25/2022

Line Graph Contrastive Learning for Link Prediction

Link prediction task aims to predict the connection of two nodes in the ...
research
11/22/2021

Learnable Structural Semantic Readout for Graph Classification

With the great success of deep learning in various domains, graph neural...
research
04/14/2021

Dependency Parsing based Semantic Representation Learning with Graph Neural Network for Enhancing Expressiveness of Text-to-Speech

Semantic information of a sentence is crucial for improving the expressi...
research
03/21/2023

Labeled Subgraph Entropy Kernel

In recent years, kernel methods are widespread in tasks of similarity me...
research
07/12/2023

Autonomous and Ubiquitous In-node Learning Algorithms of Active Directed Graphs and Its Storage Behavior

Memory is an important cognitive function for humans. How a brain with s...

Please sign up or login with your details

Forgot password? Click here to reset