Measuring Statistical Dependencies via Maximum Norm and Characteristic Functions

08/16/2022
by   Povilas Daniusis, et al.
0

In this paper, we focus on the problem of statistical dependence estimation using characteristic functions. We propose a statistical dependence measure, based on the maximum-norm of the difference between joint and product-marginal characteristic functions. The proposed measure can detect arbitrary statistical dependence between two random vectors of possibly different dimensions, is differentiable, and easily integrable into modern machine learning and deep learning pipelines. We also conduct experiments both with simulated and real data. Our simulations show, that the proposed method can measure statistical dependencies in high-dimensional, non-linear data, and is less affected by the curse of dimensionality, compared to the previous work in this line of research. The experiments with real data demonstrate the potential applicability of our statistical measure for two different empirical inference scenarios, showing statistically significant improvement in the performance characteristics when applied for supervised feature extraction and deep neural network regularization. In addition, we provide a link to the accompanying open-source repository https://bit.ly/3d4ch5I.

READ FULL TEXT
research
10/11/2021

Sliced Mutual Information: A Scalable Measure of Statistical Dependence

Mutual information (MI) is a fundamental measure of statistical dependen...
research
01/25/2021

Measuring Dependence with Matrix-based Entropy Functional

Measuring the dependence of data plays a central role in statistics and ...
research
11/21/2018

Multi-Panel Kendall Plot in Light of an ROC Curve Analysis Applied to Measuring Dependence

The Kendall plot (-plot) is a plot measuring dependence between the comp...
research
11/24/2020

An AUK-based index for measuring and testing the joint dependence of a random vector

We present an index of dependence that allows one to measure the joint o...
research
11/25/2017

Distance Metrics for Measuring Joint Dependence with Application to Causal Inference

Many statistical applications require the quantification of joint depend...
research
07/05/2023

Neural Fields for Interactive Visualization of Statistical Dependencies in 3D Simulation Ensembles

We present the first neural network that has learned to compactly repres...
research
07/12/2020

Explaining the data or explaining a model? Shapley values that uncover non-linear dependencies

Shapley values have become increasingly popular in the machine learning ...

Please sign up or login with your details

Forgot password? Click here to reset