Convolutional Factor Graphs as Probabilistic Models

07/11/2012
by   Yongyi Mao, et al.
0

Based on a recent development in the area of error control coding, we introduce the notion of convolutional factor graphs (CFGs) as a new class of probabilistic graphical models. In this context, the conventional factor graphs are referred to as multiplicative factor graphs (MFGs). This paper shows that CFGs are natural models for probability functions when summation of independent latent random variables is involved. In particular, CFGs capture a large class of linear models, where the linearity is in the sense that the observed variables are obtained as a linear ransformation of the latent variables taking arbitrary distributions. We use Gaussian models and independent factor models as examples to emonstrate the use of CFGs. The requirement of a linear transformation between latent variables (with certain independence restriction) and the bserved variables, to an extent, limits the modelling flexibility of CFGs. This structural restriction however provides a powerful analytic tool to the framework of CFGs; that is, upon taking the Fourier transform of the function represented by the CFG, the resulting function is represented by a FG with identical structure. This Fourier transform duality allows inference problems on a CFG to be solved on the corresponding dual MFG.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2022

High-dimensional factor copula models with estimation of latent variables

Factor models are a parsimonious way to explain the dependence of variab...
research
12/19/2020

Probabilistic Dependency Graphs

We introduce Probabilistic Dependency Graphs (PDGs), a new class of dire...
research
02/06/2023

Identifiability of latent-variable and structural-equation models: from linear to nonlinear

An old problem in multivariate statistics is that linear Gaussian models...
research
04/13/2022

LDPC codes: comparing cluster graphs to factor graphs

We present a comparison study between a cluster and factor graph represe...
research
07/17/2019

Factor copula models for mixed data

We develop factor copula models for analysing the dependence among mixed...
research
06/18/2012

Deep Mixtures of Factor Analysers

An efficient way to learn deep density models that have many layers of l...
research
02/18/2023

Autocodificadores Variacionales (VAE) Fundamentos Teóricos y Aplicaciones

VAEs are probabilistic graphical models based on neural networks that al...

Please sign up or login with your details

Forgot password? Click here to reset