On Distance and Kernel Measures of Conditional Independence

12/02/2019
by   Tianhong Sheng, et al.
0

Measuring conditional independence is one of the important tasks in statistical inference and is fundamental in causal discovery, feature selection, dimensionality reduction, Bayesian network learning, and others. In this work, we explore the connection between conditional independence measures induced by distances on a metric space and reproducing kernels associated with a reproducing kernel Hilbert space (RKHS). For certain distance and kernel pairs, we show the distance-based conditional independence measures to be equivalent to that of kernel-based measures. On the other hand, we also show that some popular—in machine learning—kernel conditional independence measures based on the Hilbert-Schmidt norm of a certain cross-conditional covariance operator, do not have a simple distance representation, except in some limiting cases. This paper, therefore, shows the distance and kernel measures of conditional independence to be not quite equivalent unlike in the case of joint independence as shown by Sejdinovic et al. (2013).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2012

Kernel-based Conditional Independence Test and Application in Causal Discovery

Conditional independence testing is an important problem, especially in ...
research
07/04/2017

Kernel Feature Selection via Conditional Covariance Minimization

We propose a framework for feature selection that employs kernel-based m...
research
01/25/2015

A simpler condition for consistency of a kernel independence test

A statistical test of independence may be constructed using the Hilbert-...
research
06/21/2014

Graphical structure of conditional independencies in determinantal point processes

Determinantal point process have recently been used as models in machine...
research
06/03/2022

Angle Based Dependence Measures in Metric Spaces

In this article, we introduce a general framework of angle based indepen...
research
05/15/2022

Evaluating Independence and Conditional Independence Measures

Independence and Conditional Independence (CI) are two fundamental conce...
research
01/10/2020

Discussion of "Functional Models for Time-Varying Random Objects” by Dubey and Müller

The discussion focuses on metric covariance, a new association measure b...

Please sign up or login with your details

Forgot password? Click here to reset