Fast Multivariate Log-Concave Density Estimation

05/18/2018
by   Fabian Rathke, et al.
0

We present a computational approach to log-concave density estimation. The state-of- the-art approach of Cule et al. (2010) utilizes the piecewise-affine parametrization of the density induced by the given sample set. The number of parameters as well as non-smooth subgradient-based convex optimization for determining the maximum likelihood density estimate cause long runtimes for dimensions d ≥ 2 and large sample sets. Our approach is based on mildly non-convex smooth approximations of the objective function and sparse, adaptive piecewise-affine density parametrization. Established memory-efficient numerical optimization techniques enable to process larger data sets for dimensions d ≥ 2. While there is no guarantee that the algorithm returns the maximum likelihood estimate for every problem instance, we provide comprehensive numerical evidence that it does, after significantly shorter runtimes. For example, a sample set of size n = 10000 in R^2 is processed in less then a second, rather than in ≈ 5 hours required by the approach of (Cule et al., 2010) to terminate. For higher dimensions, density estimation becomes tractable as well: Processing a sample set of size n = 10000 in R^6 requires 35 minutes. The software is publicly available as CRAN R package fmlogcondens.

READ FULL TEXT

page 3

page 4

page 12

page 17

research
03/10/2020

Exact Solutions in Log-Concave Maximum Likelihood Estimation

We study probability density functions that are log-concave. Despite the...
research
07/04/2018

Comments on Cooperative Density Estimation in Random Wireless Ad Hoc Networks

In Onur et al. ["Cooperative density estimation in random wireless ad ho...
research
06/10/2022

Log-concave density estimation in undirected graphical models

We study the problem of maximum likelihood estimation of densities that ...
research
08/28/2018

Active set algorithms for estimating shape-constrained density ratios

We review and modify the active set algorithm by Duembgen et al. (2011) ...
research
05/24/2021

A new computational framework for log-concave density estimation

In Statistics, log-concave density estimation is a central problem withi...
research
04/06/2020

TraDE: Transformers for Density Estimation

We present TraDE, an attention-based architecture for auto-regressive de...
research
06/15/2021

Learning-based Support Estimation in Sublinear Time

We consider the problem of estimating the number of distinct elements in...

Please sign up or login with your details

Forgot password? Click here to reset