Complete Dictionary Learning via ℓ_p-norm Maximization

02/24/2020
by   Yifei Shen, et al.
0

Dictionary learning is a classic representation learning method that has been widely applied in signal processing and data analytics. In this paper, we investigate a family of ℓ_p-norm (p>2,p ∈N) maximization approaches for the complete dictionary learning problem from theoretical and algorithmic aspects. Specifically, we prove that the global maximizers of these formulations are very close to the true dictionary with high probability, even when Gaussian noise is present. Based on the generalized power method (GPM), an efficient algorithm is then developed for the ℓ_p-based formulations. We further show the efficacy of the developed algorithm: for the population GPM algorithm over the sphere constraint, it first quickly enters the neighborhood of a global maximizer, and then converges linearly in this region. Extensive experiments will demonstrate that the ℓ_p-based approaches enjoy a higher computational efficiency and better robustness than conventional approaches and p=3 performs the best.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

05/31/2021

PUDLE: Implicit Acceleration of Dictionary Learning by Backpropagation

The dictionary learning problem, representing data as a combination of f...
03/02/2021

Online Orthogonal Dictionary Learning Based on Frank-Wolfe Method

Dictionary learning is a widely used unsupervised learning method in sig...
06/12/2013

Optimization of Clustering for Clustering-based Image Denoising

In this paper, the problem of de-noising of an image contaminated with a...
11/15/2015

Complete Dictionary Recovery over the Sphere II: Recovery by Riemannian Trust-region Method

We consider the problem of recovering a complete (i.e., square and inver...
06/06/2019

Complete Dictionary Learning via ℓ^4-Norm Maximization over the Orthogonal Group

This paper considers the fundamental problem of learning a complete (ort...
11/11/2015

Complete Dictionary Recovery over the Sphere I: Overview and the Geometric Picture

We consider the problem of recovering a complete (i.e., square and inver...
04/26/2015

Complete Dictionary Recovery over the Sphere

We consider the problem of recovering a complete (i.e., square and inver...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.