Variational Disentangled Graph Auto-Encoders for Link Prediction

06/20/2023
by   Jun Fu, et al.
19

With the explosion of graph-structured data, link prediction has emerged as an increasingly important task. Embedding methods for link prediction utilize neural networks to generate node embeddings, which are subsequently employed to predict links between nodes. However, the existing embedding methods typically take a holistic strategy to learn node embeddings and ignore the entanglement of latent factors. As a result, entangled embeddings fail to effectively capture the underlying information and are vulnerable to irrelevant information, leading to unconvincing and uninterpretable link prediction results. To address these challenges, this paper proposes a novel framework with two variants, the disentangled graph auto-encoder (DGAE) and the variational disentangled graph auto-encoder (VDGAE). Our work provides a pioneering effort to apply the disentanglement strategy to link prediction. The proposed framework infers the latent factors that cause edges in the graph and disentangles the representation into multiple channels corresponding to unique latent factors, which contributes to improving the performance of link prediction. To further encourage the embeddings to capture mutually exclusive latent factors, we introduce mutual information regularization to enhance the independence among different channels. Extensive experiments on various real-world benchmarks demonstrate that our proposed methods achieve state-of-the-art results compared to a variety of strong baselines on link prediction tasks. Qualitative analysis on the synthetic dataset also illustrates that the proposed methods can capture distinct latent factors that cause links, providing empirical evidence that our models are able to explain the results of link prediction to some extent. All code will be made publicly available upon publication of the paper.

READ FULL TEXT

page 1

page 10

page 11

page 13

research
08/03/2022

Link Prediction on Heterophilic Graphs via Disentangled Representation Learning

Link prediction is an important task that has wide applications in vario...
research
09/30/2021

Latent Network Embedding via Adversarial Auto-encoders

Graph auto-encoders have proved to be useful in network embedding task. ...
research
03/21/2021

Deepened Graph Auto-Encoders Help Stabilize and Enhance Link Prediction

Graph neural networks have been used for a variety of learning tasks, su...
research
06/20/2023

Contrastive Disentangled Learning on Graph for Node Classification

Contrastive learning methods have attracted considerable attention due t...
research
11/30/2019

Disentanglement Challenge: From Regularization to Reconstruction

The challenge of learning disentangled representation has recently attra...
research
02/02/2023

Causal Lifting and Link Prediction

Current state-of-the-art causal models for link prediction assume an und...
research
05/14/2019

Stochastic Blockmodels meet Graph Neural Networks

Stochastic blockmodels (SBM) and their variants, e.g., mixed-membership ...

Please sign up or login with your details

Forgot password? Click here to reset