Fundamental Limitations in Sequential Prediction and Recursive Algorithms: L_p Bounds via an Entropic Analysis

12/03/2019
by   Song Fang, et al.
0

In this paper, we obtain fundamental L_p bounds in sequential prediction and recursive algorithms via an entropic analysis. Both classes of problems are examined by investigating the underlying entropic relationships of the data and/or noises involved, and the derived lower bounds may all be quantified in a conditional entropy characterization. We also study the conditions to achieve the generic bounds from an innovations' viewpoint.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2019

Generic Bounds on the Maximum Deviations in Sequential Prediction: An Information-Theoretic Analysis

In this paper, we derive generic bounds on the maximum deviations in pre...
research
01/12/2020

Fundamental Limits of Online Learning: An Entropic-Innovations Viewpoint

In this paper, we examine the fundamental performance limitations of onl...
research
12/22/2020

Fundamental Limits on the Maximum Deviations in Control Systems: How Short Can Distribution Tails be Made by Feedback?

In this paper, we adopt an information-theoretic approach to investigate...
research
04/09/2019

Generic Variance Bounds on Estimation and Prediction Errors in Time Series Analysis: An Entropy Perspective

In this paper, we obtain generic bounds on the variances of estimation a...
research
01/09/2020

A Connection between Feedback Capacity and Kalman Filter for Colored Gaussian Noises

In this paper, we establish a connection between the feedback capacity o...
research
12/11/2019

Fundamental Entropic Laws and L_p Limitations of Feedback Systems: Implications for Machine-Learning-in-the-Loop Control

In this paper, we study the fundamental performance limitations for gene...
research
08/27/2019

Singletons for Simpletons: Revisiting Windowed Backoff using Chernoff Bounds

For the well-known problem of balls dropped uniformly at random into bin...

Please sign up or login with your details

Forgot password? Click here to reset