Expectation Propagation on the Maximum of Correlated Normal Variables

10/01/2009
by   Philipp Hennig, et al.
0

Many inference problems involving questions of optimality ask for the maximum or the minimum of a finite set of unknown quantities. This technical report derives the first two posterior moments of the maximum of two correlated Gaussian variables and the first two posterior moments of the two generating variables (corresponding to Gaussian approximations minimizing relative entropy). It is shown how this can be used to build a heuristic approximation to the maximum relationship over a finite set of Gaussian variables, allowing approximate inference by Expectation Propagation on such quantities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2019

Conditional Expectation Propagation

Expectation propagation (EP) is a powerful approximate inference algorit...
research
02/25/2016

Expectation Consistent Approximate Inference: Generalizations and Convergence

Approximations of loopy belief propagation, including expectation propag...
research
05/27/2019

Gaussian Approximations for Maxima of Random Vectors under (2+ι)-th Moments

We derive a Gaussian approximation result for the maximum of a sum of ra...
research
01/12/2013

Perturbative Corrections for Approximate Inference in Gaussian Latent Variable Models

Expectation Propagation (EP) provides a framework for approximate infere...
research
09/01/2021

Measuring Information from Moments

We investigate the problem of representing information measures in terms...
research
03/01/2017

Semi-analytical approximations to statistical moments of sigmoid and softmax mappings of normal variables

This note is concerned with accurate and computationally efficient appro...
research
02/11/2021

Uncertainty Propagation in Convolutional Neural Networks: Technical Report

In this technical report we study the problem of propagation of uncertai...

Please sign up or login with your details

Forgot password? Click here to reset