Conditional Independence Testing via Latent Representation Learning

09/04/2022
by   Bao Duong, et al.
0

Detecting conditional independencies plays a key role in several statistical and machine learning tasks, especially in causal discovery algorithms. In this study, we introduce LCIT (Latent representation based Conditional Independence Test)-a novel non-parametric method for conditional independence testing based on representation learning. Our main contribution involves proposing a generative framework in which to test for the independence between X and Y given Z, we first learn to infer the latent representations of target variables X and Y that contain no information about the conditioning variable Z. The latent variables are then investigated for any significant remaining dependencies, which can be performed using the conventional partial correlation test. The empirical evaluations show that LCIT outperforms several state-of-the-art baselines consistently under different evaluation metrics, and is able to adapt really well to both non-linear and high-dimensional settings on a diverse collection of synthetic and real data sets.

READ FULL TEXT
research
11/20/2022

Diffeomorphic Information Neural Estimation

Mutual Information (MI) and Conditional Mutual Information (CMI) are mul...
research
03/30/2016

A latent-observed dissimilarity measure

Quantitatively assessing relationships between latent variables and obse...
research
06/09/2022

A Simple Unified Approach to Testing High-Dimensional Conditional Independences for Categorical and Ordinal Data

Conditional independence (CI) tests underlie many approaches to model te...
research
12/16/2022

Efficient Conditionally Invariant Representation Learning

We introduce the Conditional Independence Regression CovariancE (CIRCE),...
research
06/20/2023

Conditional Independence Testing with Heteroskedastic Data and Applications to Causal Discovery

Conditional independence (CI) testing is frequently used in data analysi...
research
06/30/2022

Non-Parametric Inference of Relational Dependence

Independence testing plays a central role in statistical and causal infe...
research
10/29/2021

Properties from Mechanisms: An Equivariance Perspective on Identifiable Representation Learning

A key goal of unsupervised representation learning is "inverting" a data...

Please sign up or login with your details

Forgot password? Click here to reset