On minimax density estimation via measure transport

07/20/2022
by   Sven Wang, et al.
0

We study the convergence properties, in Hellinger and related distances, of nonparametric density estimators based on measure transport. These estimators represent the measure of interest as the pushforward of a chosen reference distribution under a transport map, where the map is chosen via a maximum likelihood objective (equivalently, minimizing an empirical Kullback-Leibler loss) or a penalized version thereof. We establish concentration inequalities for a general class of penalized measure transport estimators, by combining techniques from M-estimation with analytical properties of the transport-based density representation. We then demonstrate the implications of our theory for the case of triangular Knothe-Rosenblatt (KR) transports on the d-dimensional unit cube, and show that both penalized and unpenalized versions of such estimators achieve minimax optimal convergence rates over Hölder classes of densities. Specifically, we establish optimal rates for unpenalized nonparametric maximum likelihood estimation over bounded Hölder-type balls, and then for certain Sobolev-penalized estimators and sieved wavelet estimators.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/08/2023

Density estimation and regression analysis on S^d in the presence of measurement error

This paper studies density estimation and regression analysis with conta...
research
08/29/2020

Statistical Analysis of Multi-Relational Network Recovery

In this paper, we develop asymptotic theories for a class of latent vari...
research
09/03/2023

Distribution learning via neural differential equations: a nonparametric statistical perspective

Ordinary differential equations (ODEs), via their induced flow maps, pro...
research
04/06/2021

Nonparametric needlet estimation for partial derivatives of a probability density function on the d-torus

This paper is concerned with the estimation of the partial derivatives o...
research
04/09/2017

Distributed Statistical Estimation and Rates of Convergence in Normal Approximation

This paper presents new algorithms for distributed statistical estimatio...
research
06/02/2020

Cube root weak convergence of empirical estimators of a density level set

Given n independent random vectors with common density f on ℝ^d, we stud...
research
03/26/2020

Nonconvex sparse regularization for deep neural networks and its optimality

Recent theoretical studies proved that deep neural network (DNN) estimat...

Please sign up or login with your details

Forgot password? Click here to reset