Distribution-free joint independence testing and robust independent component analysis using optimal transport

11/28/2022
by   Ziang Niu, et al.
0

In this paper we study the problem of measuring and testing joint independence for a collection of multivariate random variables. Using the emerging theory of optimal transport (OT) based multivariate ranks, we propose a distribution-free test for multivariate joint independence. Towards this we introduce the notion of rank joint distance covariance (RJdCov), the higher-order rank analogue of the celebrated distance covariance measure, that captures the dependencies among all the subsets of the variables. The RJdCov can be easily estimated from the data without any moment assumptions and the associated test for joint independence is universally consistent. We can calibrate the test without any knowledge of the (unknown) marginal distributions (due to the distribution-free property), both asymptotically and in finite samples. In addition to being distribution-free and universally consistent, the proposed test is also statistically efficient, that is, it has non-trivial asymptotic (Pitman) efficiency. We demonstrate this by computing the limiting local power of the test for both mixture alternatives and joint Konijn alternatives. We also use the RJdCov measure to develop a method for independent component analysis (ICA) that is easy to implement and robust to outliers and contamination. Extensive simulations are performed to illustrate the efficacy of the proposed test in comparison to other existing methods. Finally, we apply the proposed test to learn the higher-order dependence structure among different US industries based on stock prices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/05/2021

Efficiency Lower Bounds for Distribution-Free Hotelling-Type Two-Sample Tests Based on Optimal Transport

The Wilcoxon rank-sum test is one of the most popular distribution-free ...
research
09/22/2019

Distribution-free consistent independence tests via Hallin's multivariate rank

This paper investigates the problem of testing independence of two rando...
research
07/04/2020

Rate-optimality of consistent distribution-free tests of independence based on center-outward ranks and signs

Rank correlations have found many innovative applications in the last de...
research
06/10/2019

Nonparametric Independence Testing for Right-Censored Data using Optimal Transport

We propose a nonparametric test of independence, termed OPT-HSIC, betwee...
research
11/25/2017

Distance Metrics for Measuring Joint Dependence with Application to Causal Inference

Many statistical applications require the quantification of joint depend...
research
12/18/2017

Dependence structures - estimation and visualization using distance multivariance

Distance multivariance was recently introduced as a measure of multivari...
research
11/06/2021

Metric Distributional Discrepancy in Metric Space

Independence analysis is an indispensable step before regression analysi...

Please sign up or login with your details

Forgot password? Click here to reset