A Capsule Network-based Model for Learning Node Embeddings

11/12/2019
by   Dai Quoc Nguyen, et al.
31

In this paper, we focus on learning low-dimensional embeddings of entity nodes from graph-structured data, where we can use the learned node embeddings for a downstream task of node classification. Existing node embedding models often suffer from a limitation of exploiting graph information to infer plausible embeddings of unseen nodes. To address this issue, we propose Caps2NE—a new unsupervised embedding model using a network of two capsule layers. Given a target node and its context nodes, Caps2NE applies a routing process to aggregate features of the context nodes at the first capsule layer, then feed these features into the second capsule layer to produce an embedding vector. This embedding vector is then used to infer a plausible embedding for the target node. Experimental results for the node classification task on six well-known benchmark datasets show that our Caps2NE obtains state-of-the-art performances.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/22/2020

A Self-Attention Network based Node Embedding Model

Despite several signs of progress have been made recently, limited resea...
research
08/17/2020

Ensemble Node Embeddings using Tensor Decomposition: A Case-Study on DeepWalk

Node embeddings have been attracting increasing attention during the pas...
research
09/26/2019

Unsupervised Universal Self-Attention Network for Graph Classification

Existing graph embedding models often have weaknesses in exploiting grap...
research
05/29/2020

A Process for the Evaluation of Node Embedding Methods in the Context of Node Classification

Node embedding methods find latent lower-dimensional representations whi...
research
07/20/2019

Improving Skip-Gram based Graph Embeddings via Centrality-Weighted Sampling

Network embedding techniques inspired by word2vec represent an effective...
research
08/13/2018

A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalization

In this paper, we introduce an embedding model, named CapsE, exploring a...
research
07/13/2019

Relational Memory-based Knowledge Graph Embedding

Knowledge graph embedding models often suffer from a limitation of remem...

Please sign up or login with your details

Forgot password? Click here to reset