Deep Clustering and Representation Learning that Preserves Geometric Structures

09/21/2020
by   Lirong Wu, et al.
0

In this paper, we propose a novel framework for Deep Clustering and Representation Learning (DCRL) that preserves the geometric structure of data. In the proposed DCRL framework, the clustering of data points from different manifolds is done in the latent space guided by a clustering loss. To overcome the problem that clustering-oriented losses may deteriorate the geometric structure of embeddings in the latent space, two structure-oriented losses, namely an isometric loss and a ranking loss, are proposed to preserve intra-manifold structure locally and inter-manifold structure globally. Experimental results on various datasets show that the DCRL framework leads to comparable performances to current state-of-the-art deep clustering algorithms, yet exhibits superior performance for downstream tasks. Our results also demonstrate the importance and effectiveness of the proposed method in preserving geometric structure in terms of visualization and performance metrics.

READ FULL TEXT

page 14

page 17

research
04/27/2021

Learning low bending and low distortion manifold embeddings

Autoencoders are a widespread tool in machine learning to transform high...
research
06/05/2020

Improving k-Means Clustering Performance with Disentangled Internal Representations

Deep clustering algorithms combine representation learning and clusterin...
research
12/18/2018

Clustering-Oriented Representation Learning with Attractive-Repulsive Loss

The standard loss function used to train neural network classifiers, cat...
research
12/25/2020

Learning Robust Representation for Clustering through Locality Preserving Variational Discriminative Network

Clustering is one of the fundamental problems in unsupervised learning. ...
research
07/11/2020

Relation-Guided Representation Learning

Deep auto-encoders (DAEs) have achieved great success in learning data r...
research
09/15/2023

A Geometric Perspective on Autoencoders

This paper presents the geometric aspect of the autoencoder framework, w...
research
06/11/2021

A deep learning approach to clustering visual arts

Clustering artworks is difficult for several reasons. On the one hand, r...

Please sign up or login with your details

Forgot password? Click here to reset