On Generalization of Graph Autoencoders with Adversarial Training

07/06/2021
by   Tianjin Huang, et al.
7

Adversarial training is an approach for increasing model's resilience against adversarial perturbations. Such approaches have been demonstrated to result in models with feature representations that generalize better. However, limited works have been done on adversarial training of models on graph data. In this paper, we raise such a question does adversarial training improve the generalization of graph representations. We formulate L2 and L1 versions of adversarial training in two powerful node embedding methods: graph autoencoder (GAE) and variational graph autoencoder (VGAE). We conduct extensive experiments on three main applications, i.e. link prediction, node clustering, graph anomaly detection of GAE and VGAE, and demonstrate that both L2 and L1 adversarial training boost the generalization of GAE and VGAE.

READ FULL TEXT
research
06/07/2018

On Adversarial Risk and Training

In this work we formally define the notions of adversarial perturbations...
research
08/30/2019

Adversarial Training Methods for Network Embedding

Network Embedding is the task of learning continuous node representation...
research
01/04/2019

Learning Graph Embedding with Adversarial Training Methods

Graph embedding aims to transfer a graph into vectors to facilitate subs...
research
05/17/2021

Understanding and Improvement of Adversarial Training for Network Embedding from an Optimization Perspective

Network Embedding aims to learn a function mapping the nodes to Euclidea...
research
06/27/2023

Adversarial Training for Graph Neural Networks

Despite its success in the image domain, adversarial training does not (...
research
10/13/2022

Improving Out-of-Distribution Generalization by Adversarial Training with Structured Priors

Deep models often fail to generalize well in test domains when the data ...
research
06/27/2019

Latent Optimization for Non-adversarial Representation Disentanglement

Disentanglement between pose and content is a key task for artificial in...

Please sign up or login with your details

Forgot password? Click here to reset