Kernel Mean Shrinkage Estimators

05/21/2014
by   Krikamol Muandet, et al.
0

A mean function in a reproducing kernel Hilbert space (RKHS), or a kernel mean, is central to kernel methods in that it is used by many classical algorithms such as kernel principal component analysis, and it also forms the core inference step of modern kernel methods that rely on embedding probability distributions in RKHSs. Given a finite sample, an empirical average has been used commonly as a standard estimator of the true kernel mean. Despite a widespread use of this estimator, we show that it can be improved thanks to the well-known Stein phenomenon. We propose a new family of estimators called kernel mean shrinkage estimators (KMSEs), which benefit from both theoretical justifications and good empirical performance. The results demonstrate that the proposed estimators outperform the standard one, especially in a "large d, small n" paradigm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2013

Kernel Mean Estimation and Stein's Effect

A mean function in reproducing kernel Hilbert space, or a kernel mean, i...
research
07/10/2021

Kernel Mean Estimation by Marginalized Corrupted Distributions

Estimating the kernel mean in a reproducing kernel Hilbert space is a cr...
research
11/04/2014

Kernel Mean Estimation via Spectral Filtering

The problem of estimating the kernel mean in a reproducing kernel Hilber...
research
02/13/2018

MONK -- Outlier-Robust Mean Embedding Estimation by Median-of-Means

Mean embeddings provide an extremely flexible and powerful tool in machi...
research
05/28/2020

Boundary-free Estimators of the Mean Residual Life Function by Transformation

We propose two new kernel-type estimators of the mean residual life func...
research
10/15/2021

Kernel Minimum Divergence Portfolios

Portfolio optimization is a key challenge in finance with the aim of cre...
research
03/29/2023

One-Step Estimation of Differentiable Hilbert-Valued Parameters

We present estimators for smooth Hilbert-valued parameters, where smooth...

Please sign up or login with your details

Forgot password? Click here to reset