Trainlets: Dictionary Learning in High Dimensions

01/31/2016
by   Jeremias Sulam, et al.
0

Sparse representations has shown to be a very powerful model for real world signals, and has enabled the development of applications with notable performance. Combined with the ability to learn a dictionary from signal examples, sparsity-inspired algorithms are often achieving state-of-the-art results in a wide variety of tasks. Yet, these methods have traditionally been restricted to small dimensions mainly due to the computational constraints that the dictionary learning problem entails. In the context of image processing, this implies handling small image patches. In this work we show how to efficiently handle bigger dimensions and go beyond the small patches in sparsity-based signal and image processing methods. We build our approach based on a new cropped wavelet decomposition, which enables a multi-scale analysis with virtually no border effects. We then employ this as the base dictionary within a double sparsity model to enable the training of adaptive dictionaries. To cope with the increase of training data, while at the same time improving the training performance, we present an Online Sparse Dictionary Learning (OSDL) algorithm to train this model effectively, enabling it to handle millions of examples. This work shows that dictionary learning can be up-scaled to tackle a new level of signal dimensions, obtaining large adaptable atoms that we call trainlets.

READ FULL TEXT

page 6

page 13

page 14

page 15

research
06/14/2018

Finding GEMS: Multi-Scale Dictionaries for High-Dimensional Graph Signals

Modern data introduces new challenges to classic signal processing appro...
research
01/16/2013

Jitter-Adaptive Dictionary Learning - Application to Multi-Trial Neuroelectric Signals

Dictionary Learning has proven to be a powerful tool for many image proc...
research
12/16/2017

Sparse travel time tomography with adaptive dictionaries

We develop a 2D travel time tomography method which regularizes the inve...
research
07/17/2015

Multiscale Adaptive Representation of Signals: I. The Basic Framework

We introduce a framework for designing multi-scale, adaptive, shift-inva...
research
08/23/2016

Deep Double Sparsity Encoder: Learning to Sparsify Not Only Features But Also Parameters

This paper emphasizes the significance to jointly exploit the problem st...
research
05/09/2017

Convolutional Dictionary Learning via Local Processing

Convolutional Sparse Coding (CSC) is an increasingly popular model in th...
research
12/18/2014

Example Selection For Dictionary Learning

In unsupervised learning, an unbiased uniform sampling strategy is typic...

Please sign up or login with your details

Forgot password? Click here to reset