Testing for the Important Components of Posterior Predictive Variance

09/01/2022
by   Dean Dustin, et al.
0

We give a decomposition of the posterior predictive variance using the law of total variance and conditioning on a finite dimensional discrete random variable. This random variable summarizes various features of modeling that are used to form the prediction for a future outcome. Then, we test which terms in this decomposition are small enough to ignore. This allows us identify which of the discrete random variables are most important to prediction intervals. The terms in the decomposition admit interpretations based on conditional means and variances and are analogous to the terms in a Cochran's theorem decomposition of squared error often used in analysis of variance. Thus, the modeling features are treated as factors in completely randomized design. In cases where there are multiple decompositions we suggest choosing the one that that gives the best predictive coverage with the smallest variance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2019

Cramér-Rao-type Bound and Stam's Inequality for Discrete Random Variables

The variance and the entropy power of a continuous random variable are b...
research
03/26/2023

Prediction and estimation of random variables with infinite mean or variance

In this paper we propose an optimal predictor of a random variable that ...
research
05/29/2023

On the Variance, Admissibility, and Stability of Empirical Risk Minimization

It is well known that Empirical Risk Minimization (ERM) with squared los...
research
11/02/2016

The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables

The reparameterization trick enables optimizing large scale stochastic c...
research
10/19/2012

Efficient Inference in Large Discrete Domains

In this paper we examine the problem of inference in Bayesian Networks w...
research
11/04/2016

Reparameterization trick for discrete variables

Low-variance gradient estimation is crucial for learning directed graphi...
research
04/23/2022

Continuity and Additivity Properties of Information Decompositions

Information decompositions quantify how the Shannon information about a ...

Please sign up or login with your details

Forgot password? Click here to reset