A Stochastic Contraction Mapping Theorem

07/01/2022
by   Anthony Almudevar, et al.
0

In this paper we define contractive and nonexpansive properties for adapted stochastic processes X_1, X_2, … which can be used to deduce limiting properties. In general, nonexpansive processes possess finite limits while contractive processes converge to zero a.e. Extensions to multivariate processes are given. These properties may be used to model a number of important processes, including stochastic approximation and least-squares estimation of controlled linear models, with convergence properties derivable from a single theory. The approach has the advantage of not in general requiring analytical regularity properties such as continuity and differentiability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2019

Quantitative Central Limit Theorems for Discrete Stochastic Processes

In this paper, we establish a generalization of the classical Central Li...
research
10/14/2020

Stochastic modelling of Gaussian processes by improper linear functionals

Various approaches to stochastic processes exist, noting that key proper...
research
03/31/2015

Two Timescale Stochastic Approximation with Controlled Markov noise and Off-policy temporal difference learning

We present for the first time an asymptotic convergence analysis of two ...
research
12/05/2018

Evolution of k-mer Frequencies and Entropy in Duplication and Substitution Mutation Systems

Genomic evolution can be viewed as string-editing processes driven by mu...
research
02/12/2022

Formalization of a Stochastic Approximation Theorem

Stochastic approximation algorithms are iterative procedures which are u...
research
06/25/2018

Distance covariance for discretized stochastic processes

Given an iid sequence of pairs of stochastic processes on the unit inter...
research
03/21/2023

Formulae for mixed moments of Wiener processes and a stochastic area integral

This paper deals with the expectation of monomials with respect to the s...

Please sign up or login with your details

Forgot password? Click here to reset