Graph Context Encoder: Graph Feature Inpainting for Graph Generation and Self-supervised Pretraining

06/18/2021
by   Oriel Frigo, et al.
0

We propose the Graph Context Encoder (GCE), a simple but efficient approach for graph representation learning based on graph feature masking and reconstruction. GCE models are trained to efficiently reconstruct input graphs similarly to a graph autoencoder where node and edge labels are masked. In particular, our model is also allowed to change graph structures by masking and reconstructing graphs augmented by random pseudo-edges. We show that GCE can be used for novel graph generation, with applications for molecule generation. Used as a pretraining method, we also show that GCE improves baseline performances in supervised classification tasks tested on multiple standard benchmark graph datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2023

PRODIGY: Enabling In-context Learning Over Graphs

In-context learning is the ability of a pretrained model to adapt to nov...
research
10/14/2022

Using Graph Algorithms to Pretrain Graph Completion Transformers

Recent work on Graph Neural Networks has demonstrated that self-supervis...
research
01/07/2022

MGAE: Masked Autoencoders for Self-Supervised Learning on Graphs

We introduce a novel masked graph autoencoder (MGAE) framework to perfor...
research
04/10/2023

GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learner

Graph self-supervised learning (SSL), including contrastive and generati...
research
03/03/2022

Graph Representation Learning Beyond Node and Homophily

Unsupervised graph representation learning aims to distill various graph...
research
09/08/2023

3D Denoisers are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation

Pretraining molecular representations from large unlabeled data is essen...
research
11/07/2022

Implicit Graphon Neural Representation

Graphons are general and powerful models for generating graphs of varyin...

Please sign up or login with your details

Forgot password? Click here to reset