Distribution free MMD tests for model selection with estimated parameters

by   Florian Brück, et al.

Several kernel based testing procedures are proposed to solve the problem of model selection in the presence of parameter estimation in a family of candidate models. Extending the two sample test of Gretton et al. (2006), we first provide a way of testing whether some data is drawn from a given parametric model (model specification). Second, we provide a test statistic to decide whether two parametric models are equally valid to describe some data (model comparison), in the spirit of Vuong (1989). All our tests are asymptotically standard normal under the null, even when the true underlying distribution belongs to the competing parametric families.Some simulations illustrate the performance of our tests in terms of power and level.


page 1

page 2

page 3

page 4


Asymptotically Distribution-Free Goodness-of-Fit Testing for Copulas

Consider a random sample from a continuous multivariate distribution fun...

Selective Sequential Model Selection

Many model selection algorithms produce a path of fits specifying a sequ...

Robust Hypothesis Testing and Model Selection for Parametric Proportional Hazard Regression Models

The semi-parametric Cox proportional hazards regression model has been w...

Zipper: Addressing degeneracy in algorithm-agnostic inference

The widespread use of black box prediction methods has sparked an increa...

Entropy-based Characterization of Modeling Constraints

In most data-scientific approaches, the principle of Maximum Entropy (Ma...

Exact Semiparametric Inference and Model Selection for Load-Sharing Systems

As a specific proportional hazard rates model, sequential order statisti...

A model sufficiency test using permutation entropy

Using the ordinal pattern concept in permutation entropy, we propose a m...

Please sign up or login with your details

Forgot password? Click here to reset