Deviation inequalities for stochastic approximation by averaging

02/17/2021
by   Xiequan Fan, et al.
0

We introduce a class of Markov chains, that contains the model of stochastic approximation by averaging and non-averaging. Using martingale approximation method, we establish various deviation inequalities for separately Lipschitz functions of such a chain, with different moment conditions on some dominating random variables of martingale differences.Finally, we apply these inequalities to the stochastic approximation by averaging.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2019

Deviation inequalities for separately Lipschitz functionals of composition of random functions

We consider a class of non-homogeneous Markov chains, that contains many...
research
03/10/2023

Rosenthal-type inequalities for linear statistics of Markov chains

In this paper, we establish novel deviation bounds for additive function...
research
07/26/2018

Rademacher Generalization Bounds for Classifier Chains

In this paper, we propose a new framework to study the generalization pr...
research
09/23/2019

On Model Stability as a Function of Random Seed

In this paper, we focus on quantifying model stability as a function of ...
research
02/14/2012

Risk Bounds for Infinitely Divisible Distribution

In this paper, we study the risk bounds for samples independently drawn ...
research
06/01/2023

Extragradient SVRG for Variational Inequalities: Error Bounds and Increasing Iterate Averaging

We study variance reduction methods for extragradient (EG) algorithms fo...
research
12/10/2021

Comparison of Markov chains via weak Poincaré inequalities with application to pseudo-marginal MCMC

We investigate the use of a certain class of functional inequalities kno...

Please sign up or login with your details

Forgot password? Click here to reset