Near-Optimal Sample Complexity Bounds for Maximum Likelihood Estimation of Multivariate Log-concave Densities

02/28/2018
by   Timothy Carpenter, et al.
0

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on R^d, for all d ≥ 4. Prior to this work, no finite sample upper bound was known for this estimator in more than 3 dimensions. In more detail, we prove that for any d ≥ 1 and ϵ>0, given Õ_d((1/ϵ)^(d+3)/2) samples drawn from an unknown log-concave density f_0 on R^d, the MLE outputs a hypothesis h that with high probability is ϵ-close to f_0, in squared Hellinger loss. A sample complexity lower bound of Ω_d((1/ϵ)^(d+1)/2) was previously known for any learning algorithm that achieves this guarantee. We thus establish that the sample complexity of the log-concave MLE is near-optimal, up to an Õ(1/ϵ) factor.

READ FULL TEXT
research
12/30/2018

Adaptation in multivariate log-concave density estimation

We study the adaptation properties of the multivariate log-concave maxim...
research
03/13/2019

The Log-Concave Maximum Likelihood Estimator is Optimal in High Dimensions

We study the problem of learning a d-dimensional log-concave distributio...
research
02/14/2020

Local continuity of log-concave projection, with applications to estimation under model misspecification

The log-concave projection is an operator that maps a d-dimensional dist...
research
06/16/2019

Global Convergence of Least Squares EM for Demixing Two Log-Concave Densities

This work studies the location estimation problem for a mixture of two r...
research
01/16/2020

Constrained Functional Value under General Convexity Conditions with Applications to Distributed Simulation

We show a general phenomenon of the constrained functional value for den...
research
08/19/2021

Threshold Phenomena in Learning Halfspaces with Massart Noise

We study the problem of PAC learning halfspaces on ℝ^d with Massart nois...
research
03/14/2019

High-dimensional nonparametric density estimation via symmetry and shape constraints

We tackle the problem of high-dimensional nonparametric density estimati...

Please sign up or login with your details

Forgot password? Click here to reset