The existence of the least favorable noise

03/16/2023
by   Dongzhou Huang, et al.
0

Suppose that a random variable X of interest is observed. This paper concerns "the least favorable noise" Ŷ_ϵ, which maximizes the prediction error E [X - E[X|X+Y]]^2 (or minimizes the variance of E[X| X+Y]) in the class of Y with Y independent of X and var Y ≤ϵ^2. This problem was first studied by Ernst, Kagan, and Rogers ([3]). In the present manuscript, we show that the least favorable noise Ŷ_ϵ must exist and that its variance must be ϵ^2. The proof of existence relies on a convergence result we develop for variances of conditional expectations. Further, we show that the function inf_var Y ≤ϵ^2 var E[X|X+Y] is both strictly decreasing and right continuous in ϵ.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/17/2021

The least favorable noise

Suppose that a random variable X of interest is observed perturbed by in...
research
01/20/2023

Almost everywhere continuity of conditional expectations

A necessary and sufficient condition on a sequence {𝔄_n}_n∈ℕ of σ-subalg...
research
10/29/2019

Feature relevance quantification in explainable AI: A causality problem

We discuss promising recent contributions on quantifying feature relevan...
research
06/24/2019

Distribution-Independent PAC Learning of Halfspaces with Massart Noise

We study the problem of distribution-independent PAC learning of halfsp...
research
10/06/2022

On the new properties of conditional expectations with applications in finance

The concept of conditional expectation is important in applications of p...
research
10/22/2020

Multivariate mean estimation with direction-dependent accuracy

We consider the problem of estimating the mean of a random vector based ...
research
05/05/2009

Feasibility of random basis function approximators for modeling and control

We discuss the role of random basis function approximators in modeling a...

Please sign up or login with your details

Forgot password? Click here to reset