Sensitivity Maps of the Hilbert-Schmidt Independence Criterion

11/02/2016
by   Adrián Pérez-Suay, et al.
0

Kernel dependence measures yield accurate estimates of nonlinear relations between random variables, and they are also endorsed with solid theoretical properties and convergence rates. Besides, the empirical estimates are easy to compute in closed form just involving linear algebra operations. However, they are hampered by two important problems: the high computational cost involved, as two kernel matrices of the sample size have to be computed and stored, and the interpretability of the measure, which remains hidden behind the implicit feature map. We here address these two issues. We introduce the Sensitivity Maps (SMs) for the Hilbert-Schmidt independence criterion (HSIC). Sensitivity maps allow us to explicitly analyze and visualize the relative relevance of both examples and features on the dependence measure. We also present the randomized HSIC (RHSIC) and its corresponding sensitivity maps to cope with large scale problems. We build upon the framework of random features and the Bochner's theorem to approximate the involved kernels in the canonical HSIC. The power of the RHSIC measure scales favourably with the number of samples, and it approximates HSIC and the sensitivity maps efficiently. Convergence bounds of both the measure and the sensitivity map are also provided. Our proposal is illustrated in synthetic examples, and challenging real problems of dependence estimation, feature selection, and causal inference from empirical data.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 11

12/07/2020

Causal Inference in Geosciences with Kernel Sensitivity Maps

Establishing causal relations between random variables from observationa...
11/11/2013

Global Sensitivity Analysis with Dependence Measures

Global sensitivity analysis with variance-based measures suffers from se...
12/07/2020

Causal Inference in Geoscience and Remote Sensing from Observational Data

Establishing causal relations between random variables from observationa...
06/25/2016

Large-Scale Kernel Methods for Independence Testing

Representations of probability measures in reproducing kernel Hilbert sp...
06/18/2012

Copula-based Kernel Dependency Measures

The paper presents a new copula based method for measuring dependence be...
11/11/2019

Kernel Dependence Regularizers and Gaussian Processes with Applications to Algorithmic Fairness

Current adoption of machine learning in industrial, societal and economi...
11/04/2020

Kernel Dependence Network

We propose a greedy strategy to spectrally train a deep network for mult...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.