Learning Topic Models and Latent Bayesian Networks Under Expansion Constraints

09/24/2012
by   Daniel Hsu, et al.
0

Unsupervised estimation of latent variable models is a fundamental problem central to numerous applications of machine learning and statistics. This work presents a principled approach for estimating broad classes of such models, including probabilistic topic models and latent linear Bayesian networks, using only second-order observed moments. The sufficient conditions for identifiability of these models are primarily based on weak expansion constraints on the topic-word matrix, for topic models, and on the directed acyclic graph, for Bayesian networks. Because no assumptions are made on the distribution among the latent variables, the approach can handle arbitrary correlations among the topics or latent factors. In addition, a tractable learning method via ℓ_1 optimization is proposed and studied in numerical experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/05/2015

Bayesian Estimation of Multidimensional Latent Variables and Its Asymptotic Accuracy

Hierarchical learning models, such as mixture models and Bayesian networ...
research
08/13/2013

When are Overcomplete Topic Models Identifiable? Uniqueness of Tensor Tucker Decompositions with Structured Sparsity

Overcomplete latent representations have been very popular for unsupervi...
research
01/09/2015

Margins of discrete Bayesian networks

Bayesian network models with latent variables are widely used in statist...
research
01/17/2021

Disentangling Observed Causal Effects from Latent Confounders using Method of Moments

Discovering the complete set of causal relations among a group of variab...
research
07/08/2014

Inferring latent structures via information inequalities

One of the goals of probabilistic inference is to decide whether an empi...
research
11/01/2021

NOTMAD: Estimating Bayesian Networks with Sample-Specific Structures and Parameters

Context-specific Bayesian networks (i.e. directed acyclic graphs, DAGs) ...
research
01/18/2019

Optimized Realization of Bayesian Networks in Reduced Normal Form using Latent Variable Model

Bayesian networks in their Factor Graph Reduced Normal Form (FGrn) are a...

Please sign up or login with your details

Forgot password? Click here to reset