Learning the Dimensionality of Hidden Variables

by   Gal Elidan, et al.

A serious problem in learning probabilistic models is the presence of hidden variables. These variables are not observed, yet interact with several of the observed variables. Detecting hidden variables poses two problems: determining the relations to other variables in the model and determining the number of states of the hidden variable. In this paper, we address the latter problem in the context of Bayesian networks. We describe an approach that utilizes a score-based agglomerative state-clustering. As we show, this approach allows us to efficiently evaluate models with a range of cardinalities for the hidden variable. We show how to extend this procedure to deal with multiple interacting hidden variables. We demonstrate the effectiveness of this approach by evaluating it on synthetic and real-life data. We show that our approach learns models with hidden variables that generalize better and have better structure than previous approaches.



There are no comments yet.


page 1

page 2

page 3

page 4

page 5

page 6

page 7


"Ideal Parent" Structure Learning for Continuous Variable Networks

In recent years, there is a growing interest in learning Bayesian networ...

Discovering the Hidden Structure of Complex Dynamic Systems

Dynamic Bayesian networks provide a compact and natural representation f...

Lurking Variable Detection via Dimensional Analysis

Lurking variables represent hidden information, and preclude a full unde...

Hierarchical Models as Marginals of Hierarchical Models

We investigate the representation of hierarchical models in terms of mar...

Bundled Causal History Interaction

Complex system arises as a result of the nonlinear interactions between ...

Unsupervised Learning of Noisy-Or Bayesian Networks

This paper considers the problem of learning the parameters in Bayesian ...

Joint inference of multiple graphs with hidden variables from stationary graph signals

Learning graphs from sets of nodal observations represents a prominent p...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.