Nyström Kernel Mean Embeddings

01/31/2022
by   Antoine Chatalic, et al.
0

Kernel mean embeddings are a powerful tool to represent probability distributions over arbitrary spaces as single points in a Hilbert space. Yet, the cost of computing and storing such embeddings prohibits their direct use in large-scale settings. We propose an efficient approximation procedure based on the Nyström method, which exploits a small random subset of the dataset. Our main result is an upper bound on the approximation error of this procedure. It yields sufficient conditions on the subsample size to obtain the standard n^-1/2 rate while reducing computational costs. We discuss applications of this result for the approximation of the maximum mean discrepancy and quadrature rules, and illustrate our theoretical findings with numerical experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2019

Quantum Mean Embedding of Probability Distributions

The kernel mean embedding of probability distributions is commonly used ...
research
01/19/2021

Performance analysis of greedy algorithms for minimising a Maximum Mean Discrepancy

We analyse the performance of several iterative algorithms for the quant...
research
12/02/2019

A Rigorous Theory of Conditional Mean Embeddings

Conditional mean embeddings (CME) have proven themselves to be a powerfu...
research
05/02/2013

Testing Hypotheses by Regularized Maximum Mean Discrepancy

Do two data samples come from different distributions? Recent studies of...
research
03/01/2015

Sparse Approximation of a Kernel Mean

Kernel means are frequently used to represent probability distributions ...
research
07/01/2019

Strong equivalences of approximation numbers and tractability of weighted anisotropic Sobolev embeddings

In this paper, we study multivariate approximation defined over weighted...
research
04/05/2016

Nonparametric Detection of Geometric Structures over Networks

Nonparametric detection of existence of an anomalous structure over a ne...

Please sign up or login with your details

Forgot password? Click here to reset