DeepAI AI Chat
Log In Sign Up

Learning Representations using Spectral-Biased Random Walks on Graphs

by   Charu Sharma, et al.

Several state-of-the-art neural graph embedding methods are based on short random walks (stochastic processes) because of their ease of computation, simplicity in capturing complex local graph properties, scalability, and interpretibility. In this work, we are interested in studying how much a probabilistic bias in this stochastic process affects the quality of the nodes picked by the process. In particular, our biased walk, with a certain probability, favors movement towards nodes whose neighborhoods bear a structural resemblance to the current node's neighborhood. We succinctly capture this neighborhood as a probability measure based on the spectrum of the node's neighborhood subgraph represented as a normalized laplacian matrix. We propose the use of a paragraph vector model with a novel Wasserstein regularization term. We empirically evaluate our approach against several state-of-the-art node embedding techniques on a wide variety of real-world datasets and demonstrate that our proposed method significantly improves upon existing methods on both link prediction and node classification tasks.


page 1

page 2

page 3

page 4


Residual2Vec: Debiasing graph embedding with random graphs

Graph embedding maps a graph into a convenient vector-space representati...

Degree-Based Random Walk Approach for Graph Embedding

Graph embedding, representing local and global neighborhood information ...

Accurately Modeling Biased Random Walks on Weighted Graphs Using Node2vec+

Node embedding is a powerful approach for representing the structural ro...

Supervised Q-walk for Learning Vector Representation of Nodes in Networks

Automatic feature learning algorithms are at the forefront of modern day...

Compatibility, embedding and regularization of non-local random walks on graphs

Several variants of the graph Laplacian have been introduced to model no...

Can NetGAN be improved by short random walks originated from dense vertices?

Graphs are useful structures that can model several important real-world...

div2vec: Diversity-Emphasized Node Embedding

Recently, the interest of graph representation learning has been rapidly...