Sensitivity Maps of the Hilbert-Schmidt Independence Criterion

11/02/2016
by   Adrián Pérez-Suay, et al.
0

Kernel dependence measures yield accurate estimates of nonlinear relations between random variables, and they are also endorsed with solid theoretical properties and convergence rates. Besides, the empirical estimates are easy to compute in closed form just involving linear algebra operations. However, they are hampered by two important problems: the high computational cost involved, as two kernel matrices of the sample size have to be computed and stored, and the interpretability of the measure, which remains hidden behind the implicit feature map. We here address these two issues. We introduce the Sensitivity Maps (SMs) for the Hilbert-Schmidt independence criterion (HSIC). Sensitivity maps allow us to explicitly analyze and visualize the relative relevance of both examples and features on the dependence measure. We also present the randomized HSIC (RHSIC) and its corresponding sensitivity maps to cope with large scale problems. We build upon the framework of random features and the Bochner's theorem to approximate the involved kernels in the canonical HSIC. The power of the RHSIC measure scales favourably with the number of samples, and it approximates HSIC and the sensitivity maps efficiently. Convergence bounds of both the measure and the sensitivity map are also provided. Our proposal is illustrated in synthetic examples, and challenging real problems of dependence estimation, feature selection, and causal inference from empirical data.

READ FULL TEXT
research
12/07/2020

Causal Inference in Geosciences with Kernel Sensitivity Maps

Establishing causal relations between random variables from observationa...
research
02/20/2023

Nyström M-Hilbert-Schmidt Independence Criterion

Kernel techniques are among the most popular and powerful approaches of ...
research
11/11/2013

Global Sensitivity Analysis with Dependence Measures

Global sensitivity analysis with variance-based measures suffers from se...
research
12/07/2020

Causal Inference in Geoscience and Remote Sensing from Observational Data

Establishing causal relations between random variables from observationa...
research
06/25/2016

Large-Scale Kernel Methods for Independence Testing

Representations of probability measures in reproducing kernel Hilbert sp...
research
11/11/2019

Kernel Dependence Regularizers and Gaussian Processes with Applications to Algorithmic Fairness

Current adoption of machine learning in industrial, societal and economi...
research
05/17/2021

A Distribution Free Conditional Independence Test with Applications to Causal Discovery

This paper is concerned with test of the conditional independence. We fi...

Please sign up or login with your details

Forgot password? Click here to reset