Large-Scale Kernel Methods for Independence Testing

06/25/2016
by   Qinyi Zhang, et al.
0

Representations of probability measures in reproducing kernel Hilbert spaces provide a flexible framework for fully nonparametric hypothesis tests of independence, which can capture any type of departure from independence, including nonlinear associations and multivariate interactions. However, these approaches come with an at least quadratic computational cost in the number of observations, which can be prohibitive in many applications. Arguably, it is exactly in such large-scale datasets that capturing any type of dependence is of interest, so striking a favourable tradeoff between computational efficiency and test performance for kernel independence tests would have a direct impact on their applicability in practice. In this contribution, we provide an extensive study of the use of large-scale kernel approximations in the context of independence testing, contrasting block-based, Nystrom and random Fourier feature approaches. Through a variety of synthetic data experiments, it is demonstrated that our novel large scale methods give comparable performance with existing methods whilst using significantly less computation time and memory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/31/2022

A general framework for the analysis of kernel-based tests

Kernel-based tests provide a simple yet effective framework that use the...
research
02/18/2019

Aggregated test of independence based on HSIC measures

Dependence measures based on reproducing kernel Hilbert spaces, also kno...
research
06/18/2022

Efficient Aggregated Kernel Tests using Incomplete U-statistics

We propose a series of computationally efficient, nonparametric tests fo...
research
04/05/2022

Learning new physics efficiently with nonparametric methods

We present a machine learning approach for model-independent new physics...
research
10/19/2020

independence: Fast Rank Tests

In 1948 Hoeffding devised a nonparametric test that detects dependence b...
research
02/20/2023

Nyström M-Hilbert-Schmidt Independence Criterion

Kernel techniques are among the most popular and powerful approaches of ...
research
11/02/2016

Sensitivity Maps of the Hilbert-Schmidt Independence Criterion

Kernel dependence measures yield accurate estimates of nonlinear relatio...

Please sign up or login with your details

Forgot password? Click here to reset