Introducing Neuromodulation in Deep Neural Networks to Learn Adaptive Behaviours

12/21/2018
by   Nicolas Vecoven, et al.
22

In this paper, we propose a new deep neural network architecture, called NMD net, that has been specifically designed to learn adaptive behaviours. This architecture exploits a biological mechanism called neuromodulation that sustains adaptation in biological organisms. This architecture has been introduced in a deep-reinforcement learning architecture for interacting with Markov decision processes in a meta-reinforcement learning setting where the action space is continuous. The deep-reinforcement learning architecture is trained using an advantage actor-critic algorithm. Experiments are carried on several test problems. Results show that the neural network architecture with neuromodulation provides significantly better results than state-of-the-art recurrent neural networks which do not exploit this mechanism.

READ FULL TEXT

page 22

page 23

research
07/03/2021

Traffic Signal Control with Communicative Deep Reinforcement Learning Agents: a Case Study

In this work we analyze Multi-Agent Advantage Actor-Critic (MA2C) a rece...
research
07/12/2021

R3L: Connecting Deep Reinforcement Learning to Recurrent Neural Networks for Image Denoising via Residual Recovery

State-of-the-art image denoisers exploit various types of deep neural ne...
research
11/02/2022

Spatial-temporal recurrent reinforcement learning for autonomous ships

The paper proposes a spatial-temporal recurrent neural network architect...
research
09/15/2018

Towards Better Interpretability in Deep Q-Networks

Deep reinforcement learning techniques have demonstrated superior perfor...
research
09/30/2018

Deep Quality-Value (DQV) Learning

We introduce a novel Deep Reinforcement Learning (DRL) algorithm called ...
research
09/21/2019

Deep Reinforcement Learning with Modulated Hebbian plus Q Network Architecture

This paper introduces the modulated Hebbian plus Q network architecture ...
research
07/25/2022

Flowsheet synthesis through hierarchical reinforcement learning and graph neural networks

Process synthesis experiences a disruptive transformation accelerated by...

Please sign up or login with your details

Forgot password? Click here to reset