DeepAI AI Chat
Log In Sign Up

Mimic and Classify : A meta-algorithm for Conditional Independence Testing

06/25/2018
by   Rajat Sen, et al.
The University of Texas at Austin
ibm
University of Washington
0

Given independent samples generated from the joint distribution p(x,y,z), we study the problem of Conditional Independence (CI-Testing), i.e., whether the joint equals the CI distribution p^CI(x,y,z)= p(z) p(y|z)p(x|z) or not. We cast this problem under the purview of the proposed, provable meta-algorithm, "Mimic and Classify", which is realized in two-steps: (a) Mimic the CI distribution close enough to recover the support, and (b) Classify to distinguish the joint and the CI distribution. Thus, as long as we have a good generative model and a good classifier, we potentially have a sound CI Tester. With this modular paradigm, CI Testing becomes amiable to be handled by state-of-the-art, both generative and classification methods from the modern advances in Deep Learning, which in general can handle issues related to curse of dimensionality and operation in small sample regime. We show intensive numerical experiments on synthetic and real datasets where new mimic methods such conditional GANs, Regression with Neural Nets, outperform the current best CI Testing performance in the literature. Our theoretical results provide analysis on the estimation of null distribution as well as allow for general measures, i.e., when either some of the random variables are discrete and some are continuous or when one or more of them are discrete-continuous mixtures.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/18/2017

Model-Powered Conditional Independence Test

We consider the problem of non-parametric Conditional Independence testi...
01/09/2020

Minimax Optimal Conditional Independence Testing

We consider the problem of conditional independence testing of X and Y g...
06/05/2019

CCMI : Classifier based Conditional Mutual Information Estimation

Conditional Mutual Information (CMI) is a measure of conditional depende...
04/09/2023

Nearest-Neighbor Sampling Based Conditional Independence Testing

The conditional randomization test (CRT) was recently proposed to test w...
07/15/2016

Learning from Conditional Distributions via Dual Embeddings

Many machine learning tasks, such as learning with invariance and policy...
10/27/2019

A simple measure of conditional dependence

We propose a coefficient of conditional dependence between two random va...
01/30/2018

A Rational Distributed Process-level Account of Independence Judgment

It is inconceivable how chaotic the world would look to humans, faced wi...