Risk bounds for reservoir computing

10/30/2019
by   Lukas Gonon, et al.
0

We analyze the practices of reservoir computing in the framework of statistical learning theory. In particular, we derive finite sample upper bounds for the generalization error committed by specific families of reservoir computing systems when processing discrete-time inputs under various hypotheses on their dependence structure. Non-asymptotic bounds are explicitly written down in terms of the multivariate Rademacher complexities of the reservoir systems and the weak dependence structure of the signals that are being handled. This allows, in particular, to determine the minimal number of observations needed in order to guarantee a prescribed estimation accuracy with high probability for a given reservoir family. At the same time, the asymptotic behavior of the devised bounds guarantees the consistency of the empirical risk minimization procedure for various hypothesis classes of reservoir functionals.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/17/2020

Discrete-time signatures and randomness in reservoir computing

A new explanation of geometric nature of the reservoir computing phenome...
research
07/17/2023

Reducing hyperparameter dependence by external timescale tailoring

Task specific hyperparameter tuning in reservoir computing is an open is...
research
10/25/2019

Towards Deep Physical Reservoir Computing Through Automatic Task Decomposition And Mapping

Photonic reservoir computing is a promising candidate for low-energy com...
research
02/16/2019

Differentiable reservoir computing

Much effort has been devoted in the last two decades to characterize the...
research
09/16/2022

Transport in reservoir computing

Reservoir computing systems are constructed using a driven dynamical sys...
research
01/08/2023

Stochastic Reservoir Calculations

Prabhu (1958) obtained the stationary distribution of storage level Z_t ...
research
09/04/2019

Empirical Hypothesis Space Reduction

Selecting appropriate regularization coefficients is critical to perform...

Please sign up or login with your details

Forgot password? Click here to reset