Analysis of Fast Alternating Minimization for Structured Dictionary Learning

02/01/2018
by   Saiprasad Ravishankar, et al.
0

Methods exploiting sparsity have been popular in imaging and signal processing applications including compression, denoising, and imaging inverse problems. Data-driven approaches such as dictionary learning and transform learning enable one to discover complex image features from datasets and provide promising performance over analytical models. Alternating minimization algorithms have been particularly popular in dictionary or transform learning. In this work, we study the properties of alternating minimization for structured (unitary) sparsifying operator learning. While the algorithm converges to the stationary points of the non-convex problem in general, we prove rapid local linear convergence to the underlying generative model under mild assumptions. Our experiments show that the unitary operator learning algorithm is robust to initialization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2018

Analysis of Fast Structured Dictionary Learning

Sparsity-based models and techniques have been exploited in many signal ...
research
11/09/2017

Alternating minimization for dictionary learning with random initialization

We present theoretical guarantees for an alternating minimization algori...
research
04/17/2016

Identifying global optimality for dictionary learning

Learning new representations of input observations in machine learning i...
research
07/24/2021

A Tensor-Train Dictionary Learning algorithm based on Spectral Proximal Alternating Linearized Minimization

Dictionary Learning (DL) is one of the leading sparsity promoting techni...
research
01/13/2015

ℓ_0 Sparsifying Transform Learning with Efficient Optimal Updates and Convergence Guarantees

Many applications in signal processing benefit from the sparsity of sign...
research
06/10/2015

Convolutional Dictionary Learning through Tensor Factorization

Tensor methods have emerged as a powerful paradigm for consistent learni...
research
10/17/2014

Generalized Conditional Gradient for Sparse Estimation

Structured sparsity is an important modeling tool that expands the appli...

Please sign up or login with your details

Forgot password? Click here to reset