Relation-Guided Representation Learning

07/11/2020
by   Zhao Kang, et al.
5

Deep auto-encoders (DAEs) have achieved great success in learning data representations via the powerful representability of neural networks. But most DAEs only focus on the most dominant structures which are able to reconstruct the data from a latent space and neglect rich latent structural information. In this work, we propose a new representation learning method that explicitly models and leverages sample relations, which in turn is used as supervision to guide the representation learning. Different from previous work, our framework well preserves the relations between samples. Since the prediction of pairwise relations themselves is a fundamental problem, our model adaptively learns them from data. This provides much flexibility to encode real data manifold. The important role of relation and representation learning is evaluated on the clustering task. Extensive experiments on benchmark data sets demonstrate the superiority of our approach. By seeking to embed samples into subspace, we further show that our method can address the large-scale and out-of-sample problem.

READ FULL TEXT

page 9

page 14

page 16

research
06/09/2023

On the Importance of Feature Decorrelation for Unsupervised Representation Learning in Reinforcement Learning

Recently, unsupervised representation learning (URL) has improved the sa...
research
06/24/2012

Representation Learning: A Review and New Perspectives

The success of machine learning algorithms generally depends on data rep...
research
02/11/2018

On the Latent Space of Wasserstein Auto-Encoders

We study the role of latent space dimensionality in Wasserstein auto-enc...
research
05/31/2021

Clustering-friendly Representation Learning via Instance Discrimination and Feature Decorrelation

Clustering is one of the most fundamental tasks in machine learning. Rec...
research
09/23/2020

Representation Learning from Limited Educational Data with Crowdsourced Labels

Representation learning has been proven to play an important role in the...
research
11/18/2019

Unsupervised Representation Learning by Discovering Reliable Image Relations

Learning robust representations that allow to reliably establish relatio...
research
09/21/2020

Deep Clustering and Representation Learning that Preserves Geometric Structures

In this paper, we propose a novel framework for Deep Clustering and Repr...

Please sign up or login with your details

Forgot password? Click here to reset