Vertex-Context Sampling for Weighted Network Embedding

11/01/2017
by   Chih-Ming Chen, et al.
0

In recent years, network embedding methods have garnered increasing attention because of their effectiveness in various information retrieval tasks. The goal is to learn low-dimensional representations of vertexes in an information network and simultaneously capture and preserve the network structure. Critical to the performance of a network embedding method is how the edges/vertexes of the network is sampled for the learning process. Many existing methods adopt a uniform sampling method to reduce learning complexity, but when the network is non-uniform (i.e. a weighted network) such uniform sampling incurs information loss. The goal of this paper is to present a generalized vertex sampling framework that works seamlessly with most existing network embedding methods to support weighted instead of uniform vertex/edge sampling. For efficiency, we propose a delicate sequential vertex-to-context graph data structure, such that sampling a training pair for learning takes only constant time. For scalability and memory efficiency, we design the graph data structure in a way that keeps space consumption low without requiring additional space. In addition to implementing existing network embedding methods, the proposed framework can be used to implement extensions that feature high-order proximity modeling and weighted relation modeling. Experiments conducted on three datasets, including a commercial large-scale one, verify the effectiveness and efficiency of the proposed weighted network embedding methods on a variety of tasks, including word similarity search, multi-label classification, and item recommendation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/29/2018

Improved Semantic-Aware Network Embedding with Fine-Grained Word Alignment

Network embeddings, which learn low-dimensional representations for each...
research
07/05/2019

Network Embedding: on Compression and Learning

Recently, network embedding that encodes structural information of graph...
research
01/22/2018

A Novel Weighted Distance Measure for Multi-Attributed Graph

Due to exponential growth of complex data, graph structure has become in...
research
03/04/2020

EPINE: Enhanced Proximity Information Network Embedding

Unsupervised homogeneous network embedding (NE) represents every vertex ...
research
02/05/2020

Improved Subsampled Randomized Hadamard Transform for Linear SVM

Subsampled Randomized Hadamard Transform (SRHT), a popular random projec...
research
03/13/2018

VERSE: Versatile Graph Embeddings from Similarity Measures

Embedding a web-scale information network into a low-dimensional vector ...
research
08/25/2023

Network Embedding Using Sparse Approximations of Random Walks

In this paper, we propose an efficient numerical implementation of Netwo...

Please sign up or login with your details

Forgot password? Click here to reset