Reducing hyperparameter dependence by external timescale tailoring

07/17/2023
by   Lina C. Jaurigue, et al.
0

Task specific hyperparameter tuning in reservoir computing is an open issue, and is of particular relevance for hardware implemented reservoirs. We investigate the influence of directly including externally controllable task specific timescales on the performance and hyperparameter sensitivity of reservoir computing approaches. We show that the need for hyperparameter optimisation can be reduced if timescales of the reservoir are tailored to the specific task. Our results are mainly relevant for temporal tasks requiring memory of past inputs, for example chaotic timeseries prediciton. We consider various methods of including task specific timescales in the reservoir computing approach and demonstrate the universality of our message by looking at both time-multiplexed and spatially multiplexed reservoir computing.

READ FULL TEXT

page 12

page 17

page 19

research
07/13/2023

Impact of Free-carrier Nonlinearities on Silicon Microring-based Reservoir Computing

We quantify the impact of thermo-optic and free-carrier effects on time-...
research
06/07/2022

Asymptotic Stability in Reservoir Computing

Reservoir Computing is a class of Recurrent Neural Networks with interna...
research
10/30/2019

Risk bounds for reservoir computing

We analyze the practices of reservoir computing in the framework of stat...
research
09/29/2017

Reservoir Computing using Stochastic p-Bits

We present a general hardware framework for building networks that direc...
research
05/14/2021

Hierarchical Architectures in Reservoir Computing Systems

Reservoir computing (RC) offers efficient temporal data processing with ...
research
06/01/2017

Integer Echo State Networks: Hyperdimensional Reservoir Computing

We propose an integer approximation of Echo State Networks (ESN) based o...
research
11/29/2021

Quantifying the Computational Capability of a Nanomagnetic Reservoir Computing Platform with Emergent Magnetization Dynamics

Arrays of interconnected magnetic nano-rings with emergent magnetization...

Please sign up or login with your details

Forgot password? Click here to reset