KSD Aggregated Goodness-of-fit Test

02/02/2022
by   Antonin Schrab, et al.
9

We investigate properties of goodness-of-fit tests based on the Kernel Stein Discrepancy (KSD). We introduce a strategy to construct a test, called KSDAgg, which aggregates multiple tests with different kernels. KSDAgg avoids splitting the data to perform kernel selection (which leads to a loss in test power), and rather maximises the test power over a collection of kernels. We provide theoretical guarantees on the power of KSDAgg: we show it achieves the smallest uniform separation rate of the collection, up to a logarithmic term. KSDAgg can be computed exactly in practice as it relies either on a parametric bootstrap or on a wild bootstrap to estimate the quantiles and the level corrections. In particular, for the crucial choice of bandwidth of a fixed kernel, it avoids resorting to arbitrary heuristics (such as median or standard deviation) or to data splitting. We find on both synthetic and real-world data that KSDAgg outperforms other state-of-the-art adaptive KSD-based goodness-of-fit testing procedures.

READ FULL TEXT
research
10/28/2021

MMD Aggregated Two-Sample Test

We propose a novel nonparametric two-sample test based on the Maximum Me...
research
02/21/2023

Boosting the Power of Kernel Two-Sample Tests

The kernel two-sample test based on the maximum mean discrepancy (MMD) i...
research
10/11/2022

On RKHS Choices for Assessing Graph Generators via Kernel Stein Statistics

Score-based kernelised Stein discrepancy (KSD) tests have emerged as a p...
research
11/19/2021

Composite Goodness-of-fit Tests with Kernels

Model misspecification can create significant challenges for the impleme...
research
10/07/2021

A Fast and Effective Large-Scale Two-Sample Test Based on Kernels

Kernel two-sample tests have been widely used and the development of eff...
research
06/18/2022

Efficient Aggregated Kernel Tests using Incomplete U-statistics

We propose a series of computationally efficient, nonparametric tests fo...
research
10/19/2022

A kernel Stein test of goodness of fit for sequential models

We propose a goodness-of-fit measure for probability densities modeling ...

Please sign up or login with your details

Forgot password? Click here to reset