The Parametric Stability of Well-separated Spherical Gaussian Mixtures

02/01/2023
by   Hanyu Zhang, et al.
0

We quantify the parameter stability of a spherical Gaussian Mixture Model (sGMM) under small perturbations in distribution space. Namely, we derive the first explicit bound to show that for a mixture of spherical Gaussian P (sGMM) in a pre-defined model class, all other sGMM close to P in this model class in total variation distance has a small parameter distance to P. Further, this upper bound only depends on P. The motivation for this work lies in providing guarantees for fitting Gaussian mixtures; with this aim in mind, all the constants involved are well defined and distribution free conditions for fitting mixtures of spherical Gaussians. Our results tighten considerably the existing computable bounds, and asymptotically match the known sharp thresholds for this problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/02/2021

Lower Bounds on the Total Variation Distance Between Mixtures of Two Gaussians

Mixtures of high dimensional Gaussian distributions have been studied ex...
research
07/03/2023

Learning Mixtures of Gaussians Using the DDPM Objective

Recent works have shown that diffusion models can learn essentially any ...
research
06/29/2018

Guaranteed Deterministic Bounds on the Total Variation Distance between Univariate Mixtures

The total variation distance is a core statistical distance between prob...
research
09/01/2019

Gaussian mixture model decomposition of multivariate signals

We propose a greedy variational method for decomposing a non-negative mu...
research
02/18/2022

Gaussian Mixture Convolution Networks

This paper proposes a novel method for deep learning based on the analyt...
research
08/12/2017

Dimension Reduction for Polynomials over Gaussian Space and Applications

We introduce a new technique for reducing the dimension of the ambient s...
research
03/10/2019

One-Pass Sparsified Gaussian Mixtures

We present a one-pass sparsified Gaussian mixture model (SGMM). Given P-...

Please sign up or login with your details

Forgot password? Click here to reset