Document Network Projection in Pretrained Word Embedding Space

01/16/2020
by   Antoine Gourru, et al.
0

We present Regularized Linear Embedding (RLE), a novel method that projects a collection of linked documents (e.g. citation network) into a pretrained word embedding space. In addition to the textual content, we leverage a matrix of pairwise similarities providing complementary information (e.g., the network proximity of two documents in a citation graph). We first build a simple word vector average for each document, and we use the similarities to alter this average representation. The document representations can help to solve many information retrieval tasks, such as recommendation, classification and clustering. We demonstrate that our approach outperforms or matches existing document network embedding methods on node classification and link prediction tasks. Furthermore, we show that it helps identifying relevant keywords to describe document classes.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

08/20/2019

CatE: Category-Name GuidedWord Embedding

Unsupervised word embedding has benefited a wide spectrum of NLP tasks d...
06/05/2019

Terminology-based Text Embedding for Computing Document Similarities on Technical Content

We propose in this paper a new, hybrid document embedding approach in or...
05/10/2018

hyperdoc2vec: Distributed Representations of Hypertext Documents

Hypertext documents, such as web pages and academic papers, are of great...
12/06/2019

Document Network Embedding: Coping for Missing Content and Missing Links

Searching through networks of documents is an important task. A promisin...
09/12/2017

StarSpace: Embed All The Things!

We present StarSpace, a general-purpose neural embedding model that can ...
12/20/2016

SCDV : Sparse Composite Document Vectors using soft clustering over distributional representations

We present a feature vector formation technique for documents - Sparse C...
08/24/2015

A Framework for Comparing Groups of Documents

We present a general framework for comparing multiple groups of document...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.