Generative approach to unsupervised deep local learning

06/19/2019
by   Changlu Chen, et al.
0

Most existing feature learning methods optimize inflexible handcrafted features and the affinity matrix is constructed by shallow linear embedding methods. Different from these conventional methods, we pretrain a generative neural network by stacking convolutional autoencoders to learn the latent data representation and then construct an affinity graph with them as a prior. Based on the pretrained model and the constructed graph, we add a self-expressive layer to complete the generative model and then fine-tune it with a new loss function, including the reconstruction loss and a deliberately defined locality-preserving loss. The locality-preserving loss designed by the constructed affinity graph serves as prior to preserve the local structure during the fine-tuning stage, which in turn improves the quality of feature representation effectively. Furthermore, the self-expressive layer between the encoder and decoder is based on the assumption that each latent feature is a linear combination of other latent features, so the weighted combination coefficients of the self-expressive layer are used to construct a new refined affinity graph for representing the data structure. We conduct experiments on four datasets to demonstrate the superiority of the representation ability of our proposed model over the state-of-the-art methods.

READ FULL TEXT
research
06/19/2019

A generative approach to unsupervised deep local learning

Most existing feature learning methods optimize inflexible handcrafted f...
research
10/12/2020

Locality Preserving Dense Graph Convolutional Networks with Graph Context-Aware Node Representations

Graph convolutional networks (GCNs) have been widely used for representa...
research
09/28/2021

Adaptive Attribute and Structure Subspace Clustering Network

Deep self-expressiveness-based subspace clustering methods have demonstr...
research
08/15/2023

A Graph Encoder-Decoder Network for Unsupervised Anomaly Detection

A key component of many graph neural networks (GNNs) is the pooling oper...
research
04/17/2018

Deep Multimodal Subspace Clustering Networks

We present convolutional neural network (CNN) based approaches for unsup...
research
02/09/2018

Multiple Target Tracking by Learning Feature Representation and Distance Metric Jointly

Designing a robust affinity model is the key issue in multiple target tr...
research
02/12/2018

Recovering Loss to Followup Information Using Denoising Autoencoders

Loss to followup is a significant issue in healthcare and has serious co...

Please sign up or login with your details

Forgot password? Click here to reset