A complete characterization of optimal dictionaries for least squares representation

10/18/2017
by   Mohammed Rayyan Sheriff, et al.
0

Dictionaries are collections of vectors used for representations of elements in Euclidean spaces. While recent research on optimal dictionaries is focussed on providing sparse (i.e., ℓ_0-optimal,) representations, here we consider the problem of finding optimal dictionaries such that representations of samples of a random vector are optimal in an ℓ_2-sense. For us, optimality of representation is equivalent to minimization of the average ℓ_2-norm of the coefficients used to represent the random vector, with the lengths of the dictionary vectors being specified a priori. With the help of recent results on rank-1 decompositions of symmetric positive semidefinite matrices and the theory of majorization, we provide a complete characterization of ℓ_2-optimal dictionaries. Our results are accompanied by polynomial time algorithms that construct ℓ_2-optimal dictionaries from given data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/07/2016

Optimal dictionary for least squares representation

Dictionaries are collections of vectors used for representations of rand...
research
04/23/2018

Towards Learning Sparsely Used Dictionaries with Arbitrary Supports

Dictionary learning is a popular approach for inferring a hidden basis o...
research
01/27/2011

A Panorama on Multiscale Geometric Representations, Intertwining Spatial, Directional and Frequency Selectivity

The richness of natural images makes the quest for optimal representatio...
research
09/08/2013

A Clustering Approach to Learn Sparsely-Used Overcomplete Dictionaries

We consider the problem of learning overcomplete dictionaries in the con...
research
09/04/2019

Optimal translational-rotational invariant dictionaries for images

We provide the construction of a set of square matrices whose translates...
research
12/06/2022

Pareto Optimal Compression of Genomic Dictionaries, with or without Random Access in Main Memory

Motivation: A Genomic Dictionary, i.e., the set of the k-mers appearing ...
research
09/07/2009

Sparse image representation by discrete cosine/spline based dictionaries

Mixed dictionaries generated by cosine and B-spline functions are consid...

Please sign up or login with your details

Forgot password? Click here to reset