Attractor Metadynamics in Adapting Neural Networks

04/22/2014
by   Claudius Gros, et al.
0

Slow adaption processes, like synaptic and intrinsic plasticity, abound in the brain and shape the landscape for the neural dynamics occurring on substantially faster timescales. At any given time the network is characterized by a set of internal parameters, which are adapting continuously, albeit slowly. This set of parameters defines the number and the location of the respective adiabatic attractors. The slow evolution of network parameters hence induces an evolving attractor landscape, a process which we term attractor metadynamics. We study the nature of the metadynamics of the attractor landscape for several continuous-time autonomous model networks. We find both first- and second-order changes in the location of adiabatic attractors and argue that the study of the continuously evolving attractor landscape constitutes a powerful tool for understanding the overall development of the neural dynamics.

READ FULL TEXT
research
04/13/2017

Reward-based stochastic self-configuration of neural circuits

Synaptic connections between neurons in the brain are dynamic because of...
research
12/05/2018

Neuromodulated Learning in Deep Neural Networks

In the brain, learning signals change over time and synaptic location, a...
research
09/01/2023

Structure and Gradient Dynamics Near Global Minima of Two-layer Neural Networks

Under mild assumptions, we investigate the structure of loss landscape o...
research
07/18/2012

Complex-network analysis of combinatorial spaces: The NK landscape case

We propose a network characterization of combinatorial fitness landscape...
research
10/28/2020

Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel

In suitably initialized wide networks, small learning rates transform de...
research
02/01/2019

Passed & Spurious: analysing descent algorithms and local minima in spiked matrix-tensor model

In this work we analyse quantitatively the interplay between the loss la...
research
06/28/2022

Cooperative Multi-Agent Search on Endogenously-Changing Fitness Landscapes

We use a multi-agent system to model how agents (representing firms) may...

Please sign up or login with your details

Forgot password? Click here to reset