Multiscale Geometric Methods for Data Sets II: Geometric Multi-Resolution Analysis

05/25/2011
by   William K. Allard, et al.
0

Data sets are often modeled as point clouds in R^D, for D large. It is often assumed that the data has some interesting low-dimensional structure, for example that of a d-dimensional manifold M, with d much smaller than D. When M is simply a linear subspace, one may exploit this assumption for encoding efficiently the data by projecting onto a dictionary of d vectors in R^D (for example found by SVD), at a cost (n+D)d for n data points. When M is nonlinear, there are no "explicit" constructions of dictionaries that achieve a similar efficiency: typically one uses either random dictionaries, or dictionaries obtained by black-box optimization. In this paper we construct data-dependent multi-scale dictionaries that aim at efficient encoding and manipulating of the data. Their construction is fast, and so are the algorithms that map data points to dictionary coefficients and vice versa. In addition, data points are guaranteed to have a sparse representation in terms of the dictionary. We think of dictionaries as the analogue of wavelets, but for approximating point clouds rather than functions.

READ FULL TEXT

page 15

page 16

page 17

page 18

page 19

research
02/28/2014

An Incidence Geometry approach to Dictionary Learning

We study the Dictionary Learning (aka Sparse Coding) problem of obtainin...
research
11/03/2016

Adaptive Geometric Multiscale Approximations for Intrinsically Low-dimensional Data

We consider the problem of efficiently approximating and encoding high-d...
research
03/07/2016

Optimal dictionary for least squares representation

Dictionaries are collections of vectors used for representations of rand...
research
01/31/2020

Learning Deep Analysis Dictionaries – Part II: Convolutional Dictionaries

In this paper, we introduce a Deep Convolutional Analysis Dictionary Mod...
research
04/06/2019

Local Regularization of Noisy Point Clouds: Improved Global Geometric Estimates and Data Analysis

Several data analysis techniques employ similarity relationships between...
research
12/25/2014

Cloud K-SVD: A Collaborative Dictionary Learning Algorithm for Big, Distributed Data

This paper studies the problem of data-adaptive representations for big,...
research
04/28/2021

Weighed ℓ_1 on the simplex: Compressive sensing meets locality

Sparse manifold learning algorithms combine techniques in manifold learn...

Please sign up or login with your details

Forgot password? Click here to reset