On Rank Energy Statistics via Optimal Transport: Continuity, Convergence, and Change Point Detection

02/15/2023
by   Matthew Werenski, et al.
0

This paper considers the use of recently proposed optimal transport-based multivariate test statistics, namely rank energy and its variant the soft rank energy derived from entropically regularized optimal transport, for the unsupervised nonparametric change point detection (CPD) problem. We show that the soft rank energy enjoys both fast rates of statistical convergence and robust continuity properties which lead to strong performance on real datasets. Our theoretical analyses remove the need for resampling and out-of-sample extensions previously required to obtain such rates. In contrast the rank energy suffers from the curse of dimensionality in statistical estimation and moreover can signal a change point from arbitrarily small perturbations, which leads to a high rate of false alarms in CPD. Additionally, under mild regularity conditions, we quantify the discrepancy between soft rank energy and rank energy in terms of the regularization parameter. Finally, we show our approach performs favorably in numerical experiments compared to several other optimal transport-based methods as well as maximum mean discrepancy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/16/2021

Soft and subspace robust multivariate rank tests based on entropy regularized optimal transport

In this paper, we extend the recently proposed multivariate rank energy ...
research
10/29/2021

Learning generative models for valid knockoffs using novel multivariate-rank based statistics

We consider the problem of generating valid knockoffs for knockoff filte...
research
10/29/2021

Robust and efficient change point detection using novel multivariate rank-energy GoF test

In this paper, we use and further develop upon a recently proposed multi...
research
08/12/2021

Change Point Analysis of Multivariate Data via Multivariate Rank-based Distribution-free Nonparametric Testing Using Measure Transportation

In this paper, I propose a general algorithm for multiple change point a...
research
01/13/2021

A dimension free computational upper-bound for smooth optimal transport estimation

It is well-known that plug-in statistical estimation of optimal transpor...
research
05/14/2023

From Soft-Minoration to Information-Constrained Optimal Transport and Spiked Tensor Models

Let P_Z be a given distribution on ℝ^n. For any y∈ℝ^n, we may interpret ...

Please sign up or login with your details

Forgot password? Click here to reset