Understanding and Improvement of Adversarial Training for Network Embedding from an Optimization Perspective

05/17/2021
by   Lun Du, et al.
0

Network Embedding aims to learn a function mapping the nodes to Euclidean space contribute to multiple learning analysis tasks on networks. However, the noisy information behind the real-world networks and the overfitting problem both negatively impact the quality of embedding vectors. To tackle these problems, researchers utilize Adversarial Training for Network Embedding (AdvTNE) and achieve state-of-the-art performance. Unlike the mainstream methods introducing perturbations on the network structure or the data feature, AdvTNE directly perturbs the model parameters, which provides a new chance to understand the mechanism behind. In this paper, we explain AdvTNE theoretically from an optimization perspective. Considering the Power-law property of networks and the optimization objective, we analyze the reason for its excellent results. According to the above analysis, we propose a new activation to enhance the performance of AdvTNE. We conduct extensive experiments on four real networks to validate the effectiveness of our method in node classification and link prediction. The results demonstrate that our method is superior to the state-of-the-art baseline methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2019

Adversarial Training Methods for Network Embedding

Network Embedding is the task of learning continuous node representation...
research
07/06/2021

On Generalization of Graph Autoencoders with Adversarial Training

Adversarial training is an approach for increasing model's resilience ag...
research
03/21/2022

Unsupervised Heterophilous Network Embedding via r-Ego Network Discrimination

Recently, supervised network embedding (NE) has emerged as a predominant...
research
07/05/2021

Adversarial Robustness of Probabilistic Network Embedding for Link Prediction

In today's networked society, many real-world problems can be formalized...
research
08/07/2022

The Influence of Network Structural Preference on Node Classification and Link Prediction

Recent advances in complex network analysis opened a wide range of possi...
research
02/10/2018

Low-Norm Graph Embedding

Learning distributed representations for nodes in graphs has become an i...
research
06/27/2019

Latent Optimization for Non-adversarial Representation Disentanglement

Disentanglement between pose and content is a key task for artificial in...

Please sign up or login with your details

Forgot password? Click here to reset