Top-Down Deep Clustering with Multi-generator GANs

12/06/2021
by   Daniel de Mello, et al.
15

Deep clustering (DC) leverages the representation power of deep architectures to learn embedding spaces that are optimal for cluster analysis. This approach filters out low-level information irrelevant for clustering and has proven remarkably successful for high dimensional data spaces. Some DC methods employ Generative Adversarial Networks (GANs), motivated by the powerful latent representations these models are able to learn implicitly. In this work, we propose HC-MGAN, a new technique based on GANs with multiple generators (MGANs), which have not been explored for clustering. Our method is inspired by the observation that each generator of a MGAN tends to generate data that correlates with a sub-region of the real data distribution. We use this clustered generation to train a classifier for inferring from which generator a given image came from, thus providing a semantically meaningful clustering for the real distribution. Additionally, we design our method so that it is performed in a top-down hierarchical clustering tree, thus proposing the first hierarchical DC method, to the best of our knowledge. We conduct several experiments to evaluate the proposed method against recent DC methods, obtaining competitive results. Last, we perform an exploratory analysis of the hierarchical clustering tree that highlights how accurately it organizes the data in a hierarchy of semantically coherent patterns.

READ FULL TEXT

page 3

page 4

page 5

page 7

page 10

page 11

research
11/05/2019

Hierarchical Mixtures of Generators for Adversarial Learning

Generative adversarial networks (GANs) are deep neural networks that all...
research
04/25/2023

Directed Chain Generative Adversarial Networks

Real-world data can be multimodal distributed, e.g., data describing the...
research
12/12/2017

Conditional Generative Adversarial Networks for Emoji Synthesis with Word Embedding Manipulation

Emojis have become a very popular part of daily digital communication. T...
research
06/03/2018

Disconnected Manifold Learning for Generative Adversarial Networks

Real images often lie on a union of disjoint manifolds rather than one g...
research
05/14/2020

SAGE: Sequential Attribute Generator for Analyzing Glioblastomas using Limited Dataset

While deep learning approaches have shown remarkable performance in many...
research
05/22/2023

Deep Clustering for Data Cleaning and Integration

Deep Learning (DL) techniques now constitute the state-of-the-art for im...
research
05/16/2020

Simple, Scalable, and Stable Variational Deep Clustering

Deep clustering (DC) has become the state-of-the-art for unsupervised cl...

Please sign up or login with your details

Forgot password? Click here to reset