Deep Graph Infomax

09/27/2018
by   Petar Veličković, et al.
4

We present Deep Graph Infomax (DGI), a general approach for learning node representations within graph-structured data in an unsupervised manner. DGI relies on maximizing mutual information between patch representations and corresponding high-level summaries of graphs---both derived using established graph convolutional network architectures. The learnt patch representations summarize subgraphs centered around nodes of interest, and can thus be reused for downstream node-wise learning tasks. In contrast to most prior approaches to graph representation learning, DGI does not rely on random walks, and is readily applicable to both transductive and inductive learning setups. We demonstrate competitive performance on a variety of node classification benchmarks, which at times even exceeds the performance of supervised learning.

READ FULL TEXT

page 8

page 13

page 15

research
03/18/2020

Unsupervised Hierarchical Graph Representation Learning by Mutual Information Maximization

Graph representation learning based on graph neural networks (GNNs) can ...
research
08/31/2023

Contrastive Representation Learning Based on Multiple Node-centered Subgraphs

As the basic element of graph-structured data, node has been recognized ...
research
10/07/2022

Unsupervised Semantic Representation Learning of Scientific Literature Based on Graph Attention Mechanism and Maximum Mutual Information

Since most scientific literature data are unlabeled, this makes unsuperv...
research
03/15/2023

RGI : Regularized Graph Infomax for self-supervised learning on graphs

Self-supervised learning is gaining considerable attention as a solution...
research
07/26/2021

Local2Global: Scaling global representation learning on graphs via local training

We propose a decentralised "local2global" approach to graph representati...
research
02/17/2023

Creating generalizable downstream graph models with random projections

We investigate graph representation learning approaches that enable mode...
research
01/12/2022

Local2Global: A distributed approach for scaling representation learning on graphs

We propose a decentralised "local2global"' approach to graph representat...

Please sign up or login with your details

Forgot password? Click here to reset