Sparse Nested Markov models with Log-linear Parameters

09/26/2013
by   Ilya Shpitser, et al.
0

Hidden variables are ubiquitous in practical data analysis, and therefore modeling marginal densities and doing inference with the resulting models is an important problem in statistics, machine learning, and causal inference. Recently, a new type of graphical model, called the nested Markov model, was developed which captures equality constraints found in marginals of directed acyclic graph (DAG) models. Some of these constraints, such as the so called `Verma constraint', strictly generalize conditional independence. To make modeling and inference with nested Markov models practical, it is necessary to limit the number of parameters in the model, while still correctly capturing the constraints in the marginal of a DAG model. Placing such limits is similar in spirit to sparsity methods for undirected graphical models, and regression models. In this paper, we give a log-linear parameterization which allows sparse modeling with nested Markov models. We illustrate the advantages of this parameterization with a simulation study.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/20/2012

Parameter and Structure Learning in Nested Markov Models

The constraints arising from DAG models with latent variables can be nat...
research
01/09/2015

Margins of discrete Bayesian networks

Bayesian network models with latent variables are widely used in statist...
research
12/14/2017

Context-specific independencies for ordinal variables in chain regression models

In this work we handle with categorical (ordinal) variables and we focus...
research
01/27/2023

Ananke: A Python Package For Causal Inference Using Graphical Models

We implement Ananke: an object-oriented Python package for causal infere...
research
01/09/2008

Parameterizations and fitting of bi-directed graph models to categorical data

We discuss two parameterizations of models for marginal independencies f...
research
06/06/2018

Semiparametric Classification of Forest Graphical Models

We propose a new semiparametric approach to binary classification that e...
research
09/08/2021

Parameterizing and Simulating from Causal Models

Many statistical problems in causal inference involve a probability dist...

Please sign up or login with your details

Forgot password? Click here to reset