Improved Mean and Variance Approximations for Belief Net Responses via Network Doubling

05/09/2012
by   Peter Hooper, et al.
0

A Bayesian belief network models a joint distribution with an directed acyclic graph representing dependencies among variables and network parameters characterizing conditional distributions. The parameters are viewed as random variables to quantify uncertainty about their values. Belief nets are used to compute responses to queries; i.e., conditional probabilities of interest. A query is a function of the parameters, hence a random variable. Van Allen et al. (2001, 2008) showed how to quantify uncertainty about a query via a delta method approximation of its variance. We develop more accurate approximations for both query mean and variance. The key idea is to extend the query mean approximation to a "doubled network" involving two independent replicates. Our method assumes complete data and can be applied to discrete, continuous, and hybrid networks (provided discrete variables have only discrete parents). We analyze several improvements, and provide empirical studies to demonstrate their effectiveness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/10/2013

Bayesian Error-Bars for Belief Net Inference

A Bayesian Belief Network (BN) is a model of a joint distribution over a...
research
11/04/2016

Reparameterization trick for discrete variables

Low-variance gradient estimation is crucial for learning directed graphi...
research
10/19/2012

Efficient Inference in Large Discrete Domains

In this paper we examine the problem of inference in Bayesian Networks w...
research
02/17/2023

Optimal Training of Mean Variance Estimation Neural Networks

This paper focusses on the optimal implementation of a Mean Variance Est...
research
11/02/2016

The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables

The reparameterization trick enables optimizing large scale stochastic c...
research
12/20/2020

Bayesian Conditional Transformation Models

Recent developments in statistical regression methodology establish flex...
research
12/06/2021

Approximations for STERGMs Based on Cross-Sectional Data

Temporal exponential-family random graph models (TERGMs) are a flexible ...

Please sign up or login with your details

Forgot password? Click here to reset