A Note on Taylor's Expansion and Mean Value Theorem With Respect to a Random Variable

02/20/2021
by   Yifan Yang, et al.
0

We introduce a stochastic version of Taylor's expansion and Mean Value Theorem, originally proved by Aliprantis and Border (1999), and extend them to a multivariate case. For a univariate case, the theorem asserts that "suppose a real-valued function f has a continuous derivative f' on a closed interval I and X is a random variable on a probability space (Ω, ℱ, P). Fix a ∈ I, there exists a random variable ξ such that ξ(ω) ∈ I for every ω∈Ω and f(X(ω)) = f(a) + f'(ξ(ω))(X(ω) - a)." The proof is not trivial. By applying these results in statistics, one may simplify some details in the proofs of the Delta method or the asymptotic properties for a maximum likelihood estimator. In particular, when mentioning "there exists θ ^ * between θ̂ (a maximum likelihood estimator) and θ_0 (the true value)", a stochastic version of Mean Value Theorem guarantees θ ^ * is a random variable (or a random vector).

READ FULL TEXT

page 1

page 2

page 3

page 4

08/17/2018

Non-Asymptotic Behavior of the Maximum Likelihood Estimate of a Discrete Distribution

In this paper, we study the maximum likelihood estimate of the probabili...
05/31/2021

On some properties of the bimodal normal distribution and its bivariate version

In this work, we derive some novel properties of the bimodal normal dist...
05/22/2020

Asymptotic accuracy of the saddlepoint approximation for maximum likelihood estimation

The saddlepoint approximation gives an approximation to the density of a...
01/11/2021

Some characterisation results on classical and free Poisson thinning

Poisson thinning is an elementary result in probability, which is of gre...
05/01/2014

A Structural Approach to Coordinate-Free Statistics

We consider the question of learning in general topological vector space...
11/08/2019

A Spline Chaos Expansion

A spline chaos expansion, referred to as SCE, is introduced for uncertai...
02/23/2021

A robust multivariate linear non-parametric maximum likelihood model for ties

Statistical analysis in applied research, across almost every field (e.g...