Deep Gaussian Mixture Models

11/18/2017
by   Cinzia Viroli, et al.
0

Deep learning is a hierarchical inference method formed by subsequent multiple layers of learning able to more efficiently describe complex relationships. In this work, Deep Gaussian Mixture Models are introduced and discussed. A Deep Gaussian Mixture model (DGMM) is a network of multiple layers of latent variables, where, at each layer, the variables follow a mixture of Gaussian distributions. Thus, the deep mixture model consists of a set of nested mixtures of linear models, which globally provide a nonlinear model able to describe the data in a very flexible way. In order to avoid overparameterized solutions, dimension reduction by factor models can be applied at each layer of the architecture thus resulting in deep mixtures of factor analysers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/04/2021

Variational Inference and Sparsity in High-Dimensional Deep Gaussian Mixture Models

Gaussian mixture models are a popular tool for model-based clustering, a...
research
09/20/2011

VC dimension of ellipsoids

We will establish that the VC dimension of the class of d-dimensional el...
research
06/16/2020

On the Variational Posterior of Dirichlet Process Deep Latent Gaussian Mixture Models

Thanks to the reparameterization trick, deep latent Gaussian models have...
research
11/04/2014

Tied Probabilistic Linear Discriminant Analysis for Speech Recognition

Acoustic models using probabilistic linear discriminant analysis (PLDA) ...
research
02/23/2017

Analyzing Learned Convnet Features with Dirichlet Process Gaussian Mixture Models

Convolutional Neural Networks (Convnets) have achieved good results in a...
research
02/01/2022

A Statistical Model of Serve Return Impact Patterns in Professional Tennis

The spread in the use of tracking systems in sport has made fine-grained...
research
01/21/2020

Random Matrix Theory Proves that Deep Learning Representations of GAN-data Behave as Gaussian Mixtures

This paper shows that deep learning (DL) representations of data produce...

Please sign up or login with your details

Forgot password? Click here to reset