Convolutional Dictionary Learning through Tensor Factorization

06/10/2015
by   Furong Huang, et al.
0

Tensor methods have emerged as a powerful paradigm for consistent learning of many latent variable models such as topic models, independent component analysis and dictionary learning. Model parameters are estimated via CP decomposition of the observed higher order input moments. However, in many domains, additional invariances such as shift invariances exist, enforced via models such as convolutional dictionary learning. In this paper, we develop novel tensor decomposition algorithms for parameter estimation of convolutional models. Our algorithm is based on the popular alternating least squares method, but with efficient projections onto the space of stacked circulant matrices. Our method is embarrassingly parallel and consists of simple operations such as fast Fourier transforms and matrix multiplications. Our algorithm converges to the dictionary much faster and more accurately compared to the alternating minimization over filters and activation maps.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2021

A Tensor-Train Dictionary Learning algorithm based on Spectral Proximal Alternating Linearized Minimization

Dictionary Learning (DL) is one of the leading sparsity promoting techni...
research
08/18/2015

A Dictionary Learning Approach for Factorial Gaussian Models

In this paper, we develop a parameter estimation method for factorially ...
research
04/04/2023

Convergence of alternating minimisation algorithms for dictionary learning

In this paper we derive sufficient conditions for the convergence of two...
research
05/31/2018

Analysis of Fast Structured Dictionary Learning

Sparsity-based models and techniques have been exploited in many signal ...
research
02/01/2018

Analysis of Fast Alternating Minimization for Structured Dictionary Learning

Methods exploiting sparsity have been popular in imaging and signal proc...
research
07/06/2014

Dictionary Learning and Tensor Decomposition via the Sum-of-Squares Method

We give a new approach to the dictionary learning (also known as "sparse...
research
10/17/2018

Hierarchical Methods of Moments

Spectral methods of moments provide a powerful tool for learning the par...

Please sign up or login with your details

Forgot password? Click here to reset