Mixtures and products in two graphical models

09/15/2017
by   Anna Seigal, et al.
1

We compare two statistical models of three binary random variables. One is a mixture model and the other is a product of mixtures model called a restricted Boltzmann machine. Although the two models we study look different from their parametrizations, we show that they represent the same set of distributions on the interior of the probability simplex, and are equal up to closure. We give a semi-algebraic description of the model in terms of six binomial inequalities and obtain closed form expressions for the maximum likelihood estimates. We briefly discuss extensions to larger models.

READ FULL TEXT

page 16

page 17

research
01/27/2021

Hadamard Powers and the Identification of Mixtures of Products

The Hadamard Power of a matrix is the matrix consisting of all Hadamard ...
research
03/04/2012

Learning High-Dimensional Mixtures of Graphical Models

We consider unsupervised estimation of mixtures of discrete graphical mo...
research
06/18/2012

Deep Mixtures of Factor Analysers

An efficient way to learn deep density models that have many layers of l...
research
03/14/2019

Discrete Statistical Models with Rational Maximum Likelihood Estimator

A discrete statistical model is a subset of a probability simplex. Its m...
research
02/28/2019

Learning rates for Gaussian mixtures under group invariance

We study the pointwise maximum likelihood estimation rates for a class o...
research
01/31/2022

On the identifiability of mixtures of ranking models

Mixtures of ranking models are standard tools for ranking problems. Howe...
research
05/02/2022

Graphical Evidence

Marginal likelihood, also known as model evidence, is a fundamental quan...

Please sign up or login with your details

Forgot password? Click here to reset