Cross-view Self-Supervised Learning on Heterogeneous Graph Neural Network via Bootstrapping

01/10/2022
by   Minjae Park, et al.
0

Heterogeneous graph neural networks can represent information of heterogeneous graphs with excellent ability. Recently, self-supervised learning manner is researched which learns the unique expression of a graph through a contrastive learning method. In the absence of labels, this learning methods show great potential. However, contrastive learning relies heavily on positive and negative pairs, and generating high-quality pairs from heterogeneous graphs is difficult. In this paper, in line with recent innovations in self-supervised learning called BYOL or bootstrapping, we introduce a that can generate good representations without generating large number of pairs. In addition, paying attention to the fact that heterogeneous graphs can be viewed from two perspectives, network schema and meta-path views, high-level expressions in the graphs are captured and expressed. The proposed model showed state-of-the-art performance than other methods in various real world datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/19/2021

Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning

Heterogeneous graph neural networks (HGNNs) as an emerging technique hav...
research
04/30/2022

Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning

Heterogeneous graph neural network (HGNN) is a very popular technique fo...
research
10/19/2022

Self-supervised Heterogeneous Graph Pre-training Based on Structural Clustering

Recent self-supervised pre-training methods on Heterogeneous Information...
research
03/26/2022

Contrastive Graph Learning for Population-based fMRI Classification

Contrastive self-supervised learning has recently benefited fMRI classif...
research
04/11/2022

How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervision

Attention mechanism in graph neural networks is designed to assign large...
research
02/12/2021

Bootstrapped Representation Learning on Graphs

Current state-of-the-art self-supervised learning methods for graph neur...
research
03/15/2023

RGI : Regularized Graph Infomax for self-supervised learning on graphs

Self-supervised learning is gaining considerable attention as a solution...

Please sign up or login with your details

Forgot password? Click here to reset