Discrete Independent Component Analysis (DICA) with Belief Propagation

05/26/2015
by   Francesco A. N. Palmieri, et al.
0

We apply belief propagation to a Bayesian bipartite graph composed of discrete independent hidden variables and discrete visible variables. The network is the Discrete counterpart of Independent Component Analysis (DICA) and it is manipulated in a factor graph form for inference and learning. A full set of simulations is reported for character images from the MNIST dataset. The results show that the factorial code implemented by the sources contributes to build a good generative model for the data that can be used in various inference modes.

READ FULL TEXT

page 4

page 5

page 6

research
11/02/2022

Independent component analysis in the light of Information Geometry

I recall my first encounter with Professor Shun-ichi Amari who, once upo...
research
06/19/2020

Notion of information and independent component analysis

Partial orderings and measures of information for continuous univariate ...
research
03/04/2020

Neural Enhanced Belief Propagation on Factor Graphs

A graphical model is a structured representation of locally dependent ra...
research
05/05/2019

Free Component Analysis: Theory, Algorithms & Applications

We describe a method for unmixing mixtures of freely independent random ...
research
06/30/2016

Lifted Region-Based Belief Propagation

Due to the intractable nature of exact lifted inference, research has re...
research
04/11/2014

A Tutorial on Independent Component Analysis

Independent component analysis (ICA) has become a standard data analysis...
research
07/08/2015

The Information Sieve

We introduce a new framework for unsupervised learning of representation...

Please sign up or login with your details

Forgot password? Click here to reset