Finite sample properties of parametric MMD estimation: robustness to misspecification and dependence

Many works in statistics aim at designing a universal estimation procedure. This question is of major interest, in particular because it leads to robust estimators, a very hot topic in statistics and machine learning. In this paper, we tackle the problem of universal estimation using a minimum distance estimator presented in Briol et al. (2019) based on the Maximum Mean Discrepancy. We show that the estimator is robust to both dependence and to the presence of outliers in the dataset. We also highlight the connections that may exist with minimum distance estimators using L2-distance. Finally, we provide a theoretical study of the stochastic gradient descent algorithm used to compute the estimator, and we support our findings with numerical simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2020

Universal Robust Regression via Maximum Mean Discrepancy

Many datasets are collected automatically, and are thus easily contamina...
research
09/19/2019

Generalized Resilience and Robust Statistics

Robust statistics traditionally focuses on outliers, or perturbations in...
research
01/08/2019

Efficient Minimum Distance Estimation of Pareto Exponent from Top Income Shares

We propose an efficient estimation method for the income Pareto exponent...
research
06/02/2020

Robust and efficient mean estimation: approach based on the properties of self-normalized sums

Let X be a random variable with unknown mean and finite variance. We pre...
research
06/11/2018

Robust test statistics for the two-way MANOVA based on the minimum covariance determinant estimator

Robust test statistics for the two-way MANOVA based on the minimum covar...
research
09/29/2019

MMD-Bayes: Robust Bayesian Estimation via Maximum Mean Discrepancy

In some misspecified settings, the posterior distribution in Bayesian st...
research
02/13/2018

MONK -- Outlier-Robust Mean Embedding Estimation by Median-of-Means

Mean embeddings provide an extremely flexible and powerful tool in machi...

Please sign up or login with your details

Forgot password? Click here to reset