Nonlinear consensus+innovations under correlated heavy-tailed noises: Mean square convergence rate and asymptotics

12/22/2022
by   Manojlo Vukovic, et al.
0

We consider distributed recursive estimation of consensus+innovations type in the presence of heavy-tailed sensing and communication noises. We allow that the sensing and communication noises are mutually correlated while independent identically distributed (i.i.d.) in time, and that they may both have infinite moments of order higher than one (hence having infinite variances). Such heavy-tailed, infinite-variance noises are highly relevant in practice and are shown to occur, e.g., in dense internet of things (IoT) deployments. We develop a consensus+innovations distributed estimator that employs a general nonlinearity in both consensus and innovations steps to combat the noise. We establish the estimator's almost sure convergence, asymptotic normality, and mean squared error (MSE) convergence. Moreover, we establish and explicitly quantify for the estimator a sublinear MSE convergence rate. We then quantify through analytical examples the effects of the nonlinearity choices and the noises correlation on the system performance. Finally, numerical examples corroborate our findings and verify that the proposed method works in the simultaneous heavy-tail communication-sensing noise setting, while existing methods fail under the same noise conditions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/09/2020

Improved Estimator of the Conditional Tail Expectation in the case of heavy-tailed losses

In this paper, we investigate the extreme-value methodology, to propose ...
research
04/06/2022

Nonlinear gradient mappings and stochastic optimization: A general framework with applications to heavy-tail noise

We introduce a general framework for nonlinear stochastic gradient desce...
research
08/31/2020

Estimating Rank-One Spikes from Heavy-Tailed Noise via Self-Avoiding Walks

We study symmetric spiked matrix models with respect to a general class ...
research
10/06/2016

Constrained Maximum Correntropy Adaptive Filtering

Constrained adaptive filtering algorithms inculding constrained least me...
research
09/18/2022

Convergence Rate of Sample Mean for φ-Mixing Random Variables with Heavy-Tailed Distributions

This article studies the convergence rate of the sample mean for φ-mixin...
research
03/01/2023

Mean-Square Analysis of Discretized Itô Diffusions for Heavy-tailed Sampling

We analyze the complexity of sampling from a class of heavy-tailed distr...
research
07/25/2021

Revisiting Analog Over-the-Air Machine Learning: The Blessing and Curse of Interference

We study a distributed machine learning problem carried out by an edge s...

Please sign up or login with your details

Forgot password? Click here to reset