DeepAI AI Chat
Log In Sign Up

Multi-Facet Clustering Variational Autoencoders

06/09/2021
by   Fabian Falck, et al.
20

Work in deep clustering focuses on finding a single partition of data. However, high-dimensional data, such as images, typically feature multiple interesting characteristics one could cluster over. For example, images of objects against a background could be clustered over the shape of the object and separately by the colour of the background. In this paper, we introduce Multi-Facet Clustering Variational Autoencoders (MFCVAE), a novel class of variational autoencoders with a hierarchy of latent variables, each with a Mixture-of-Gaussians prior, that learns multiple clusterings simultaneously, and is trained fully unsupervised and end-to-end. MFCVAE uses a progressively-trained ladder architecture which leads to highly stable performance. We provide novel theoretical results for optimising the ELBO analytically with respect to the categorical variational posterior distribution, and corrects earlier influential theoretical work. On image benchmarks, we demonstrate that our approach separates out and clusters over different aspects of the data in a disentangled manner. We also show other advantages of our model: the compositionality of its latent space and that it provides controlled generation of samples.

READ FULL TEXT

page 7

page 8

page 10

page 37

page 39

page 40

page 41

09/25/2019

Disentangling to Cluster: Gaussian Mixture Variational Ladder Autoencoders

In clustering we normally output one cluster variable for each datapoint...
05/10/2020

Variational Clustering: Leveraging Variational Autoencoders for Image Clustering

Recent advances in deep learning have shown their ability to learn stron...
07/25/2021

Invariance-based Multi-Clustering of Latent Space Embeddings for Equivariant Learning

Variational Autoencoders (VAEs) have been shown to be remarkably effecti...
02/20/2023

Variational Autoencoding Neural Operators

Unsupervised learning with functional data is an emerging paradigm of ma...
10/23/2019

Deep Clustering of Compressed Variational Embeddings

Motivated by the ever-increasing demands for limited communication bandw...
07/10/2019

Perturbation theory approach to study the latent space degeneracy of Variational Autoencoders

The use of Variational Autoencoders in different Machine Learning tasks ...
12/18/2018

Sparsity in Variational Autoencoders

Working in high-dimensional latent spaces, the internal encoding of data...

Code Repositories

mfcvae

💊 Multi-Facet Clustering Variatonal Autoencoders (MFCVAE)💊 A class of variational autoencoders to find multiple disentangled clusterings of data. Official PyTorch implementation.


view repo