Hierarchical Sparse Variational Autoencoder for Text Encoding

09/25/2020
by   Victor Prokhorov, et al.
0

In this paper we focus on unsupervised representation learning and propose a novel framework, Hierarchical Sparse Variational Autoencoder (HSVAE), that imposes sparsity on sentence representations via direct optimisation of Evidence Lower Bound (ELBO). Our experimental results illustrate that HSVAE is flexible and adapts nicely to the underlying characteristics of the corpus which is reflected by the level of sparsity and its distributional patterns.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset