DeepAI
Log In Sign Up

Pseudo-supervised Deep Subspace Clustering

04/08/2021
by   Juncheng Lv, et al.
0

Auto-Encoder (AE)-based deep subspace clustering (DSC) methods have achieved impressive performance due to the powerful representation extracted using deep neural networks while prioritizing categorical separability. However, self-reconstruction loss of an AE ignores rich useful relation information and might lead to indiscriminative representation, which inevitably degrades the clustering performance. It is also challenging to learn high-level similarity without feeding semantic labels. Another unsolved problem facing DSC is the huge memory cost due to n× n similarity matrix, which is incurred by the self-expression layer between an encoder and decoder. To tackle these problems, we use pairwise similarity to weigh the reconstruction loss to capture local structure information, while a similarity is learned by the self-expression layer. Pseudo-graphs and pseudo-labels, which allow benefiting from uncertain knowledge acquired during network training, are further employed to supervise similarity learning. Joint learning and iterative training facilitate to obtain an overall optimal solution. Extensive experiments on benchmark datasets demonstrate the superiority of our approach. By combining with the k-nearest neighbors algorithm, we further show that our method can address the large-scale and out-of-sample problems.

READ FULL TEXT

page 1

page 6

page 7

page 8

page 9

06/10/2022

Self-Supervised Deep Subspace Clustering with Entropy-norm

Auto-Encoder based deep subspace clustering (DSC) is widely used in comp...
11/16/2020

Overcomplete Deep Subspace Clustering Networks

Deep Subspace Clustering Networks (DSC) provide an efficient solution to...
12/06/2020

Maximum Entropy Subspace Clustering Network

Deep subspace clustering network (DSC-Net) and its numerous variants hav...
12/03/2019

Structure Learning with Similarity Preserving

Leveraging on the underlying low-dimensional structure of data, low-rank...
10/12/2019

Residual Encoder-Decoder Network for Deep Subspace Clustering

Subspace clustering aims to cluster unlabeled data that lies in a union ...
01/19/2020

Multi-Level Representation Learning for Deep Subspace Clustering

This paper proposes a novel deep subspace clustering approach which uses...
09/27/2020

Learning Self-Expression Metrics for Scalable and Inductive Subspace Clustering

Subspace clustering has established itself as a state-of-the-art approac...