Analysis of Fast Structured Dictionary Learning

05/31/2018
by   Saiprasad Ravishankar, et al.
0

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and transform learning enable learning rich image features from data, and can outperform analytical models. In particular, alternating optimization algorithms for dictionary learning have been popular. In this work, we focus on alternating minimization for a specific structured unitary operator learning problem, and provide a convergence analysis. While the algorithm converges to the critical points of the problem generally, our analysis establishes under mild assumptions, the local linear convergence of the algorithm to the underlying generating model of the data. Analysis and numerical simulations show that our assumptions hold well for standard probabilistic data models. In practice, the algorithm is robust to initialization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2018

Analysis of Fast Alternating Minimization for Structured Dictionary Learning

Methods exploiting sparsity have been popular in imaging and signal proc...
research
05/31/2021

PUDLE: Implicit Acceleration of Dictionary Learning by Backpropagation

The dictionary learning problem, representing data as a combination of f...
research
11/09/2017

Alternating minimization for dictionary learning with random initialization

We present theoretical guarantees for an alternating minimization algori...
research
04/17/2016

Identifying global optimality for dictionary learning

Learning new representations of input observations in machine learning i...
research
10/17/2014

Generalized Conditional Gradient for Sparse Estimation

Structured sparsity is an important modeling tool that expands the appli...
research
10/23/2022

Simple Alternating Minimization Provably Solves Complete Dictionary Learning

This paper focuses on complete dictionary learning problem, where the go...
research
06/10/2015

Convolutional Dictionary Learning through Tensor Factorization

Tensor methods have emerged as a powerful paradigm for consistent learni...

Please sign up or login with your details

Forgot password? Click here to reset