Uncertainty Principles in Risk-Aware Statistical Estimation

04/29/2021
by   Nikolas P. Koumpis, et al.
0

We present a new uncertainty principle for risk-aware statistical estimation, effectively quantifying the inherent trade-off between mean squared error () and risk, the latter measured by the associated average predictive squared error variance (), for every admissible estimator of choice. Our uncertainty principle has a familiar form and resembles fundamental and classical results arising in several other areas, such as the Heisenberg principle in statistical and quantum mechanics, and the Gabor limit (time-scale trade-offs) in harmonic analysis. In particular, we prove that, provided a joint generative model of states and observables, the product between and is bounded from below by a computable model-dependent constant, which is explicitly related to the Pareto frontier of a recently studied -constrained minimum (MMSE) estimation problem. Further, we show that the aforementioned constant is inherently connected to an intuitive new and rigorously topologically grounded statistical measure of distribution skewness in multiple dimensions, consistent with Pearson's moment coefficient of skewness for variables on the line. Our results are also illustrated via numerical simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2019

Risk-Aware MMSE Estimation

Despite the simplicity and intuitive interpretation of Minimum Mean Squa...
research
05/25/2021

Model Mismatch Trade-offs in LMMSE Estimation

We consider a linear minimum mean squared error (LMMSE) estimation frame...
research
11/22/2021

Nonparametric estimator of the tail dependence coefficient: balancing bias and variance

A theoretical expression is derived for the mean squared error of a nonp...
research
03/15/2023

Mean-variance constrained priors have finite maximum Bayes risk in the normal location model

Consider a normal location model X |θ∼ N(θ, σ^2) with known σ^2. Suppose...
research
01/30/2023

On the Statistical Benefits of Temporal Difference Learning

Given a dataset on actions and resulting long-term rewards, a direct est...
research
06/06/2023

Asymptotics of Bayesian Uncertainty Estimation in Random Features Regression

In this paper we compare and contrast the behavior of the posterior pred...
research
05/13/2023

A note on bounded distance-based information loss metrics for statistical disclosure control of numeric microdata

In the field of statistical disclosure control, the tradeoff between dat...

Please sign up or login with your details

Forgot password? Click here to reset