Trace Quotient with Sparsity Priors for Learning Low Dimensional Image Representations

10/08/2018
by   Xian Wei, et al.
4

This work studies the problem of learning appropriate low dimensional image representations. We propose a generic algorithmic framework, which leverages two classic representation learning paradigms, i.e., sparse representation and the trace quotient criterion. The former is a well-known powerful tool to identify underlying self-explanatory factors of data, while the latter is known for disentangling underlying low dimensional discriminative factors in data. Our developed solutions disentangle sparse representations of images by employing the trace quotient criterion. We construct a unified cost function, coined as the SPARse LOW dimensional representation (SparLow) function, for jointly learning both a sparsifying dictionary and a dimensionality reduction transformation. The SparLow function is widely applicable for developing various algorithms in three classic machine learning scenarios, namely, unsupervised, supervised, and semi-supervised learning. In order to develop efficient joint learning algorithms for maximizing the SparLow function, we deploy a framework of sparse coding with appropriate convex priors to ensure the sparse representations to be locally differentiable. Moreover, we develop an efficient geometric conjugate gradient algorithm to maximize the SparLow function on its underlying Riemannian manifold. Performance of the proposed SparLow algorithmic framework is investigated on several image processing tasks, such as 3D data visualization, face/digit recognition, and object/scene categorization.

READ FULL TEXT

page 12

page 15

03/24/2019

Joint Learning of Discriminative Low-dimensional Image Representations Based on Dictionary Learning and Two-layer Orthogonal Projections

This work investigates the problem of efficiently learning discriminativ...
06/24/2012

Representation Learning: A Review and New Perspectives

The success of machine learning algorithms generally depends on data rep...
12/18/2018

Deep Variational Sufficient Dimensionality Reduction

We consider the problem of sufficient dimensionality reduction (SDR), wh...
02/22/2018

MagnifyMe: Aiding Cross Resolution Face Recognition via Identity Aware Synthesis

Enhancing low resolution images via super-resolution or image synthesis ...
10/18/2021

TLDR: Twin Learning for Dimensionality Reduction

Dimensionality reduction methods are unsupervised approaches which learn...
11/19/2019

Deep Tile Coder: an Efficient Sparse Representation Learning Approach with applications in Reinforcement Learning

Representation learning is critical to the success of modern large-scale...
10/04/2012

Learning Locality-Constrained Collaborative Representation for Face Recognition

The model of low-dimensional manifold and sparse representation are two ...