Pseudo-supervised Deep Subspace Clustering

04/08/2021
by   Juncheng Lv, et al.
0

Auto-Encoder (AE)-based deep subspace clustering (DSC) methods have achieved impressive performance due to the powerful representation extracted using deep neural networks while prioritizing categorical separability. However, self-reconstruction loss of an AE ignores rich useful relation information and might lead to indiscriminative representation, which inevitably degrades the clustering performance. It is also challenging to learn high-level similarity without feeding semantic labels. Another unsolved problem facing DSC is the huge memory cost due to n× n similarity matrix, which is incurred by the self-expression layer between an encoder and decoder. To tackle these problems, we use pairwise similarity to weigh the reconstruction loss to capture local structure information, while a similarity is learned by the self-expression layer. Pseudo-graphs and pseudo-labels, which allow benefiting from uncertain knowledge acquired during network training, are further employed to supervise similarity learning. Joint learning and iterative training facilitate to obtain an overall optimal solution. Extensive experiments on benchmark datasets demonstrate the superiority of our approach. By combining with the k-nearest neighbors algorithm, we further show that our method can address the large-scale and out-of-sample problems.

READ FULL TEXT

page 1

page 6

page 7

page 8

page 9

research
06/20/2023

Deep Double Self-Expressive Subspace Clustering

Deep subspace clustering based on auto-encoder has received wide attenti...
research
06/10/2022

Self-Supervised Deep Subspace Clustering with Entropy-norm

Auto-Encoder based deep subspace clustering (DSC) is widely used in comp...
research
11/16/2020

Overcomplete Deep Subspace Clustering Networks

Deep Subspace Clustering Networks (DSC) provide an efficient solution to...
research
12/03/2019

Structure Learning with Similarity Preserving

Leveraging on the underlying low-dimensional structure of data, low-rank...
research
12/06/2020

Maximum Entropy Subspace Clustering Network

Deep subspace clustering network (DSC-Net) and its numerous variants hav...
research
10/12/2019

Residual Encoder-Decoder Network for Deep Subspace Clustering

Subspace clustering aims to cluster unlabeled data that lies in a union ...
research
04/25/2019

Discrete Optimal Graph Clustering

Graph based clustering is one of the major clustering methods. Most of i...

Please sign up or login with your details

Forgot password? Click here to reset