Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning

04/30/2022
by   Di Jin, et al.
12

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be annotated, which is costly and time-consuming. Self-supervised contrastive learning has been proposed to address the problem of requiring annotated data by mining intrinsic information hidden within the given data. However, the existing contrastive learning methods are inadequate for heterogeneous graphs because they construct contrastive views only based on data perturbation or pre-defined structural properties (e.g., meta-path) in graph data while ignore the noises that may exist in both node attributes and graph topologies. We develop for the first time a novel and robust heterogeneous graph contrastive learning approach, namely HGCL, which introduces two views on respective guidance of node attributes and graph topologies and integrates and enhances them by reciprocally contrastive mechanism to better model heterogeneous graphs. In this new approach, we adopt distinct but most suitable attribute and topology fusion mechanisms in the two views, which are conducive to mining relevant information in attributes and topologies separately. We further use both attribute similarity and topological correlation to construct high-quality contrastive samples. Extensive experiments on three large real-world heterogeneous graphs demonstrate the superiority and robustness of HGCL over state-of-the-art methods.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 7

page 8

page 9

research
01/10/2022

Cross-view Self-Supervised Learning on Heterogeneous Graph Neural Network via Bootstrapping

Heterogeneous graph neural networks can represent information of heterog...
research
05/19/2021

Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning

Heterogeneous graph neural networks (HGNNs) as an emerging technique hav...
research
08/21/2022

Heterogeneous Graph Masked Autoencoders

Generative self-supervised learning (SSL), especially masked autoencoder...
research
12/14/2020

Distance-wise Graph Contrastive Learning

Contrastive learning (CL) has proven highly effective in graph-based sem...
research
06/25/2022

Geometry Contrastive Learning on Heterogeneous Graphs

Self-supervised learning (especially contrastive learning) methods on he...
research
12/10/2021

A Self-supervised Mixed-curvature Graph Neural Network

Graph representation learning received increasing attentions in recent y...
research
03/11/2023

Contrastive Learning under Heterophily

Graph Neural Networks are powerful tools for learning node representatio...

Please sign up or login with your details

Forgot password? Click here to reset