Estimating Gaussian mixtures using sparse polynomial moment systems

06/29/2021
by   Julia Lindberg, et al.
0

The method of moments is a statistical technique for density estimation that solves a system of moment equations to estimate the parameters of an unknown distribution. A fundamental question critical to understanding identifiability asks how many moment equations are needed to get finitely many solutions and how many solutions there are. We answer this question for classes of Gaussian mixture models using the tools of polyhedral geometry. Using these results, we present an algorithm that performs parameter recovery, and therefore density estimation, for high dimensional Gaussian mixture models that scales linearly in the dimension.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2018

From Adaptive Kernel Density Estimation to Sparse Mixture Models

We introduce a balloon estimator in a generalized expectation-maximizati...
research
04/15/2021

Polynomial methods in statistical inference: theory and practice

This survey provides an exposition of a suite of techniques based on the...
research
07/19/2018

Optimal estimation of Gaussian mixtures via denoised method of moments

The Method of Moments [Pea94] is one of the most widely used methods in ...
research
08/09/2014

Warped Mixtures for Nonparametric Cluster Shapes

A mixture of Gaussians fit to a single curved or heavy-tailed cluster wi...
research
09/06/2019

AutoGMM: Automatic Gaussian Mixture Modeling in Python

Gaussian mixture modeling is a fundamental tool in clustering, as well a...
research
07/17/2018

A transformation-based approach to Gaussian mixture density estimation for bounded data

Finite mixture of Gaussian distributions provide a flexible semi-paramet...
research
12/06/2020

Multivariate Density Estimation with Deep Neural Mixture Models

Albeit worryingly underrated in the recent literature on machine learnin...

Please sign up or login with your details

Forgot password? Click here to reset