Kernel MMD Two-Sample Tests for Manifold Data

05/07/2021
by   Xiuyuan Cheng, et al.
0

We present a study of kernel MMD two-sample test statistics in the manifold setting, assuming the high-dimensional observations are close to a low-dimensional manifold. We characterize the property of the test (level and power) in relation to the kernel bandwidth, the number of samples, and the intrinsic dimensionality of the manifold. Specifically, we show that when data densities are supported on a d-dimensional sub-manifold ℳ embedded in an m-dimensional space, the kernel MMD two-sample test for data sampled from a pair of distributions (p, q) that are Hölder with order β is consistent and powerful when the number of samples n is greater than δ_2(p,q)^-2-d/β up to certain constant, where δ_2 is the squared ℓ_2-divergence between two distributions on manifold. Moreover, to achieve testing consistency under this scaling of n, our theory suggests that the kernel bandwidth γ scales with n^-1/(d+2β). These results indicate that the kernel MMD two-sample test does not have a curse-of-dimensionality when the data lie on the low-dimensional manifold. We demonstrate the validity of our theory and the property of the MMD test for manifold data using several numerical experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/04/2022

A Manifold Two-Sample Test Study: Integral Probability Metric with Neural Networks

Two-sample tests are important areas aiming to determine whether two col...
research
09/25/2019

Classification Logit Two-sample Testing by Neural Networks

The recent success of generative adversarial networks and variational le...
research
03/22/2013

Sparse Projections of Medical Images onto Manifolds

Manifold learning has been successfully applied to a variety of medical ...
research
05/02/2023

Representation Learning via Manifold Flattening and Reconstruction

This work proposes an algorithm for explicitly constructing a pair of ne...
research
10/30/2020

Denoising and Interior Detection Problems

Let ℳ be a compact manifold of ℝ^d. The goal of this paper is to decide,...
research
10/30/2020

The Mathematical Foundations of Manifold Learning

Manifold learning is a popular and quickly-growing subfield of machine l...
research
04/18/2019

A kernel-based method for coarse graining complex dynamical systems

We present a novel kernel-based machine learning algorithm for identifyi...

Please sign up or login with your details

Forgot password? Click here to reset