Adversarial Context Aware Network Embeddings for Textual Networks

11/05/2020
by   Tony Gracious, et al.
0

Representation learning of textual networks poses a significant challenge as it involves capturing amalgamated information from two modalities: (i) underlying network structure, and (ii) node textual attributes. For this, most existing approaches learn embeddings of text and network structure by enforcing embeddings of connected nodes to be similar. Then for achieving a modality fusion they use the similarities between text embedding of a node with the structure embedding of its connected node and vice versa. This implies that these approaches require edge information for learning embeddings and they cannot learn embeddings of unseen nodes. In this paper we propose an approach that achieves both modality fusion and the capability to learn embeddings of unseen nodes. The main feature of our model is that it uses an adversarial mechanism between text embedding based discriminator, and structure embedding based generator to learn efficient representations. Then for learning embeddings of unseen nodes, we use the supervision provided by the text embedding based discriminator. In addition this, we propose a novel architecture for learning text embedding that can combine both mutual attention and topological attention mechanism, which give more flexible text embeddings. Through extensive experiments on real-world datasets, we demonstrate that our model makes substantial gains over several state-of-the-art benchmarks. In comparison with previous state-of-the-art, it gives up to 7 performance in predicting links among nodes seen in the training and up to 12 improvement in performance in predicting links involving nodes not seen in training. Further, in the node classification task, it gives up to 2 improvement in performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2020

AnomalyDAE: Dual autoencoder for anomaly detection on attributed networks

Anomaly detection on attributed networks aims at finding nodes whose pat...
research
06/05/2019

Improving Textual Network Embedding with Global Attention via Optimal Transport

Constituting highly informative network embeddings is an important tool ...
research
08/29/2019

A Deep Neural Information Fusion Architecture for Textual Network Embeddings

Textual network embeddings aim to learn a low-dimensional representation...
research
05/24/2020

Integrated Node Encoder for Labelled Textual Networks

Voluminous works have been implemented to exploit content-enhanced netwo...
research
08/17/2020

Ensemble Node Embeddings using Tensor Decomposition: A Case-Study on DeepWalk

Node embeddings have been attracting increasing attention during the pas...
research
06/11/2020

Attention improves concentration when learning node embeddings

We consider the problem of predicting edges in a graph from node attribu...
research
10/10/2016

A General Framework for Content-enhanced Network Representation Learning

This paper investigates the problem of network embedding, which aims at ...

Please sign up or login with your details

Forgot password? Click here to reset