Variational Capsule Encoder

10/18/2020
by   Harish RaviPrakash, et al.
22

We propose a novel capsule network based variational encoder architecture, called Bayesian capsules (B-Caps), to modulate the mean and standard deviation of the sampling distribution in the latent space. We hypothesized that this approach can learn a better representation of features in the latent space than traditional approaches. Our hypothesis was tested by using the learned latent variables for image reconstruction task, where for MNIST and Fashion-MNIST datasets, different classes were separated successfully in the latent space using our proposed model. Our experimental results have shown improved reconstruction and classification performances for both datasets adding credence to our hypothesis. We also showed that by increasing the latent space dimension, the proposed B-Caps was able to learn a better representation when compared to the traditional variational auto-encoders (VAE). Hence our results indicate the strength of capsule networks in representation learning which has never been examined under the VAE settings before.

READ FULL TEXT

page 4

page 6

research
04/18/2019

Catch Me If You Can

As advances in signature recognition have reached a new plateau of perfo...
research
11/04/2016

Semantic Noise Modeling for Better Representation Learning

Latent representation learned from multi-layered neural networks via hie...
research
10/01/2021

Unsupervised Belief Representation Learning in Polarized Networks with Information-Theoretic Variational Graph Auto-Encoders

This paper develops a novel unsupervised algorithm for belief representa...
research
01/21/2021

Knowledge Generation – Variational Bayes on Knowledge Graphs

This thesis is a proof of concept for the potential of Variational Auto-...
research
05/23/2021

EXoN: EXplainable encoder Network

We propose a new semi-supervised learning method of Variational AutoEnco...
research
03/04/2020

Variational Auto-Encoder: not all failures are equal

We claim that a source of severe failures for Variational Auto-Encoders ...
research
02/04/2023

PartitionVAE – a human-interpretable VAE

VAEs, or variational autoencoders, are autoencoders that explicitly lear...

Please sign up or login with your details

Forgot password? Click here to reset