Efficient Dictionary Learning via Very Sparse Random Projections

Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections may be used, including sparse ones. More precisely, we examine compressive K-means clustering as a special case of compressive dictionary learning and give theoretical guarantees for its performance for a very general class of random projections. We then propose a memory and computation efficient dictionary learning algorithm, specifically designed for analyzing large volumes of high-dimensional data, which learns the dictionary from very sparse random projections. Experimental results demonstrate that our approach allows for reduction of computational complexity and memory/data access, with controllable loss in accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/06/2015

On the Invariance of Dictionary Learning and Sparse Representation to Projecting Data to a Discriminative Space

In this paper, it is proved that dictionary learning and sparse represen...
research
12/02/2015

Compressive hyperspectral imaging via adaptive sampling and dictionary learning

In this paper, we propose a new sampling strategy for hyperspectral sign...
research
08/25/2019

RandNet: deep learning with compressed measurements of images

Principal component analysis, dictionary learning, and auto-encoders are...
research
06/02/2011

Learning Hierarchical Sparse Representations using Iterative Dictionary Learning and Dimension Reduction

This paper introduces an elemental building block which combines Diction...
research
06/11/2020

Recovery and Generalization in Over-Realized Dictionary Learning

In over two decades of research, the field of dictionary learning has ga...
research
10/11/2021

Revisit Dictionary Learning for Video Compressive Sensing under the Plug-and-Play Framework

Aiming at high-dimensional (HD) data acquisition and analysis, snapshot ...
research
06/13/2022

Compressive Clustering with an Optical Processing Unit

We explore the use of Optical Processing Units (OPU) to compute random F...

Please sign up or login with your details

Forgot password? Click here to reset