Performance boost of time-delay reservoir computing by non-resonant clock cycle

05/07/2019
by   Florian Stelzer, et al.
0

The time-delay-based reservoir computing setup has seen tremendous success in both experiment and simulation. It allows for the construction of large neuromorphic computing systems with only few components. However, until now the interplay of the different timescales has not been investigated thoroughly. In this manuscript, we investigate the effects of a mismatch between the time-delay and the clock cycle for a general model. Typically, these two time scales are considered to be equal. Here we show that the case of equal or rationally related time-delay and clock cycle could be actively detrimental and leads to an increase of the approximation error of the reservoir. In particular, we can show that non-resonant ratios of these time scales have maximal memory capacities. We achieve this by translating the periodically driven delay-dynamical system into an equivalent network. Networks that originate from a system with resonant delay-times and clock cycles fail to utilize all of their degrees of freedom, which causes the degradation of their performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2018

Reservoir computing with simple oscillators: Virtual and real networks

The reservoir computing scheme is a machine learning mechanism which uti...
research
06/11/2020

Deep Time-Delay Reservoir Computing: Dynamics and Memory Capacity

The Deep Time-Delay Reservoir Computing concept utilizes unidirectionall...
research
07/13/2023

Impact of Free-carrier Nonlinearities on Silicon Microring-based Reservoir Computing

We quantify the impact of thermo-optic and free-carrier effects on time-...
research
05/23/2018

Concentric ESN: Assessing the Effect of Modularity in Cycle Reservoirs

The paper introduces concentric Echo State Network, an approach to desig...
research
08/28/2021

Master memory function for delay-based reservoir computers with single-variable dynamics

We show that many delay-based reservoir computers considered in the lite...
research
09/12/2018

An FPGA Implementation of a Time Delay Reservoir Using Stochastic Logic

This paper presents and demonstrates a stochastic logic time delay reser...
research
12/30/2020

Reservoir Transformer

We demonstrate that transformers obtain impressive performance even when...

Please sign up or login with your details

Forgot password? Click here to reset