Statistical Learning Guarantees for Compressive Clustering and Compressive Mixture Modeling

04/17/2020
by   Rémi Gribonval, et al.
0

We provide statistical learning guarantees for two unsupervised learning tasks in the context of compressive statistical learning, a general framework for resource-efficient large-scale learning that we introduced in a companion paper. The principle of compressive statistical learning is to compress a training collection, in one pass, into a low-dimensional sketch (a vector of random empirical generalized moments) that captures the information relevant to the considered learning task. We explicit random feature functions which empirical averages preserve the needed information for compressive clustering and compressive Gaussian mixture modeling with fixed known variance, and establish sufficient sketch sizes given the problem dimensions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/22/2017

Compressive Statistical Learning with Random Feature Moments

We describe a general framework --compressive statistical learning-- for...
research
12/04/2018

Compressive Classification (Machine Learning without learning)

Compressive learning is a framework where (so far unsupervised) learning...
research
12/01/2021

Controlling Wasserstein distances by Kernel norms with application to Compressive Statistical Learning

Comparing probability distributions is at the crux of many machine learn...
research
06/13/2022

Compressive Clustering with an Optical Processing Unit

We explore the use of Optical Processing Units (OPU) to compute random F...
research
10/21/2021

Mean Nyström Embeddings for Adaptive Compressive Learning

Compressive learning is an approach to efficient large scale learning ba...
research
06/09/2016

Sketching for Large-Scale Learning of Mixture Models

Learning parameters from voluminous data can be prohibitive in terms of ...
research
02/12/2020

Compressive Learning of Generative Networks

Generative networks implicitly approximate complex densities from their ...

Please sign up or login with your details

Forgot password? Click here to reset