Inferential Moments of Uncertain Multivariable Systems

05/03/2023
by   Kevin Vanslette, et al.
0

This article offers a new paradigm for analyzing the behavior of uncertain multivariable systems using a set of quantities we call inferential moments. Marginalization is an uncertainty quantification process that averages conditional probabilities to quantify the expected value of a probability of interest. Inferential moments are higher order conditional probability moments that describe how a distribution is expected to respond to new information. Of particular interest in this article is the inferential deviation, which is the expected fluctuation of the probability of one variable in response to an inferential update of another. We find a power series expansion of the Mutual Information in terms of inferential moments, which implies that inferential moment logic may be useful for tasks typically performed with information theoretic tools. We explore this in two applications that analyze the inferential deviations of a Bayesian Network to improve situational awareness and decision-making. We implement a simple greedy algorithm for optimal sensor tasking using inferential deviations that generally outperforms a similar greedy Mutual Information algorithm in terms of predictive probabilistic error.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2022

Higher-order in-and-outeractions reveal synergy and logical dependence beyond Shannon-information

Information-theoretic quantities reveal dependencies among variables in ...
research
12/17/2020

Individually Conditional Individual Mutual Information Bound on Generalization Error

We propose a new information-theoretic bound on generalization error bas...
research
01/24/2022

Analytic Mutual Information in Bayesian Neural Networks

Bayesian neural networks have successfully designed and optimized a robu...
research
06/16/2018

Information Aging through Queues: A Mutual Information Perspective

In this paper, we propose a new measure for the freshness of information...
research
09/18/2019

Value of Information in Probabilistic Logic Programs

In medical decision making, we have to choose among several expensive di...
research
05/10/2023

Average conditioning of underdetermined polynomial systems

In this article the expected value of the moments of the normalized cond...
research
04/09/2022

Moment estimates in the first Borel-Cantelli Lemma with applications to mean deviation frequencies

We quantify the elementary Borel-Cantelli Lemma by higher moments of the...

Please sign up or login with your details

Forgot password? Click here to reset