Algebraic and Analytic Approaches for Parameter Learning in Mixture Models

01/19/2020
by   Akshay Krishnamurthy, et al.
0

We present two different approaches for parameter learning in several mixture models in one dimension. Our first approach uses complex-analytic methods and applies to Gaussian mixtures with shared variance, binomial mixtures with shared success probability, and Poisson mixtures, among others. An example result is that (O(N^1/3)) samples suffice to exactly learn a mixture of k<N Poisson distributions, each with integral rate parameters bounded by N. Our second approach uses algebraic and combinatorial tools and applies to binomial mixtures with shared trial parameter N and differing success parameters, as well as to mixtures of geometric distributions. Again, as an example, for binomial mixtures with k components and success parameters discretized to resolution ϵ, O(k^2(N/ϵ)^8/√(ϵ)) samples suffice to exactly recover the parameters. For some of these distributions, our results represent the first guarantees for parameter estimation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/24/2022

On Learning Mixture Models with Sparse Parameters

Mixture models are widely used to fit complex and multimodal datasets. I...
research
06/21/2018

Mixtures of Experts Models

Mixtures of experts models provide a framework in which covariates may b...
research
08/14/2020

Characterizing the Zeta Distribution via Continuous Mixtures

We offer two novel characterizations of the Zeta distribution: first, as...
research
11/25/2021

Path Guiding Using Spatio-Directional Mixture Models

We propose a learning-based method for light-path construction in path t...
research
04/30/2019

Long-tailed distributions of inter-event times as mixtures of exponential distributions

Inter-event times of various human behavior are apparently non-Poissonia...
research
03/23/2017

Training Mixture Models at Scale via Coresets

How can we train a statistical mixture model on a massive data set? In t...
research
11/28/2013

Using Multiple Samples to Learn Mixture Models

In the mixture models problem it is assumed that there are K distributio...

Please sign up or login with your details

Forgot password? Click here to reset