Fast Conditional Independence Test for Vector Variables with Large Sample Sizes

04/08/2018
by   Krzysztof Chalupka, et al.
0

We present and evaluate the Fast (conditional) Independence Test (FIT) -- a nonparametric conditional independence test. The test is based on the idea that when P(X | Y, Z) = P(X | Y), Z is not useful as a feature to predict X, as long as Y is also a regressor. On the contrary, if P(X | Y, Z) ≠ P(X | Y), Z might improve prediction results. FIT applies to thousand-dimensional random variables with a hundred thousand samples in a fraction of the time required by alternative methods. We provide an extensive evaluation that compares FIT to six extant nonparametric independence tests. The evaluation shows that FIT has low probability of making both Type I and Type II errors compared to other tests, especially as the number of available samples grows. Our implementation of FIT is publicly available.

READ FULL TEXT
research
08/17/2020

A Bayesian Nonparametric Conditional Two-sample Test with an Application to Local Causal Discovery

The performance of constraint-based causal discovery algorithms is promi...
research
10/19/2020

independence: Fast Rank Tests

In 1948 Hoeffding devised a nonparametric test that detects dependence b...
research
02/24/2020

Testing Goodness of Fit of Conditional Density Models with Kernels

We propose two nonparametric statistical tests of goodness of fit for co...
research
07/01/2021

A conditional independence test for causality in econometrics

The Y-test is a useful tool for detecting missing confounders in the con...
research
11/29/2022

Towards Dynamic Causal Discovery with Rare Events: A Nonparametric Conditional Independence Test

Causal phenomena associated with rare events occur across a wide range o...
research
09/05/2007

Using Data Compressors to Construct Rank Tests

Nonparametric rank tests for homogeneity and component independence are ...
research
01/10/2013

A Bayesian Multiresolution Independence Test for Continuous Variables

In this paper we present a method ofcomputing the posterior probability ...

Please sign up or login with your details

Forgot password? Click here to reset