Pre-Training on Dynamic Graph Neural Networks

02/24/2021
by   Jiajun Zhang, et al.
15

The pre-training on the graph neural network model can learn the general features of large-scale networks or networks of the same type by self-supervised methods, which allows the model to work even when node labels are missing. However, the existing pre-training methods do not take network evolution into consideration. This paper proposes a pre-training method on dynamic graph neural networks (PT-DGNN), which uses dynamic attributed graph generation tasks to simultaneously learn the structure, semantics, and evolution features of the graph. The method includes two steps: 1) dynamic sub-graph sampling, and 2) pre-training with dynamic attributed graph generation task. Comparative experiments on three realistic dynamic network datasets show that the proposed method achieves the best results on the link prediction fine-tuning task.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

research
10/26/2021

Pairwise Half-graph Discrimination: A Simple Graph-level Self-supervised Strategy for Pre-training Graph Neural Networks

Self-supervised learning has gradually emerged as a powerful technique f...
research
06/27/2020

GPT-GNN: Generative Pre-Training of Graph Neural Networks

Graph neural networks (GNNs) have been demonstrated to be powerful in mo...
research
05/23/2021

Hypergraph Pre-training with Graph Neural Networks

Despite the prevalence of hypergraphs in a variety of high-impact applic...
research
01/20/2023

Ontology Pre-training for Poison Prediction

Integrating human knowledge into neural networks has the potential to im...
research
12/02/2021

GraphCode2Vec: Generic Code Embedding via Lexical and Program Dependence Analyses

Code embedding is a keystone in the application of machine learning on s...
research
08/15/2023

Freshness or Accuracy, Why Not Both? Addressing Delayed Feedback via Dynamic Graph Neural Networks

The delayed feedback problem is one of the most pressing challenges in p...
research
06/02/2022

Invertible Neural Networks for Graph Prediction

In this work, we address conditional generation using deep invertible ne...

Please sign up or login with your details

Forgot password? Click here to reset