Maximum Entropy Subspace Clustering Network

12/06/2020
by   Zhihao Peng, et al.
10

Deep subspace clustering network (DSC-Net) and its numerous variants have achieved impressive performance for subspace clustering, in which an auto-encoder non-linearly maps input data into a latent space, and a fully connected layer named self-expressiveness module is introduced between the encoder and the decoder to learn an affinity matrix. However, the adopted regularization on the affinity matrix (e.g., sparse, Tikhonov, or low-rank) is still insufficient to drive the learning of an ideal affinity matrix, thus limiting their performance. In addition, in DSC-Net, the self-expressiveness module and the auto-encoder module are tightly coupled, making the training of the DSC-Net non-trivial. To this end, in this paper, we propose a novel deep learning-based clustering method named Maximum Entropy Subspace Clustering Network (MESC-Net). Specifically, MESC-Net maximizes the learned affinity matrix's entropy to encourage it to exhibit an ideal affinity matrix structure. We theoretically prove that the affinity matrix driven by MESC-Net obeys the block-diagonal property, and experimentally show that its elements corresponding to the same subspace are uniformly and densely distributed, which gives better clustering performance. Moreover, we explicitly decouple the auto-encoder module and the self-expressiveness module. Extensive quantitative and qualitative results on commonly used benchmark datasets validate MESC-Net significantly outperforms state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 8

page 10

research
09/28/2021

Adaptive Attribute and Structure Subspace Clustering Network

Deep self-expressiveness-based subspace clustering methods have demonstr...
research
06/20/2023

Deep Double Self-Expressive Subspace Clustering

Deep subspace clustering based on auto-encoder has received wide attenti...
research
07/02/2021

Subspace Clustering Based Analysis of Neural Networks

Tools to analyze the latent space of deep neural networks provide a step...
research
05/21/2022

Semi-Supervised Subspace Clustering via Tensor Low-Rank Representation

In this letter, we propose a novel semi-supervised subspace clustering m...
research
06/10/2022

Self-Supervised Deep Subspace Clustering with Entropy-norm

Auto-Encoder based deep subspace clustering (DSC) is widely used in comp...
research
09/27/2020

Learning Self-Expression Metrics for Scalable and Inductive Subspace Clustering

Subspace clustering has established itself as a state-of-the-art approac...
research
04/08/2021

Pseudo-supervised Deep Subspace Clustering

Auto-Encoder (AE)-based deep subspace clustering (DSC) methods have achi...

Please sign up or login with your details

Forgot password? Click here to reset