Learning and Transfer of Modulated Locomotor Controllers

10/17/2016
by   Nicolas Heess, et al.
0

We study a novel architecture and training procedure for locomotion tasks. A high-frequency, low-level "spinal" network with access to proprioceptive sensors learns sensorimotor primitives by training on simple tasks. This pre-trained module is fixed and connected to a low-frequency, high-level "cortical" network, with access to all sensors, which drives behavior by modulating the inputs to the spinal network. Where a monolithic end-to-end architecture fails completely, learning with a pre-trained spinal module succeeds at multiple high-level tasks, and enables the effective exploration required to learn from sparse rewards. We test our proposed architecture on three simulated bodies: a 16-dimensional swimming snake, a 20-dimensional quadruped, and a 54-dimensional humanoid. Our results are illustrated in the accompanying video at https://youtu.be/sboPYvhpraQ

READ FULL TEXT

page 5

page 6

page 8

research
05/22/2019

Hierarchical Reinforcement Learning for Quadruped Locomotion

Legged locomotion is a challenging task for learning algorithms, especia...
research
01/18/2020

Learning to See Analogies: A Connectionist Exploration

This dissertation explores the integration of learning and analogy-makin...
research
10/10/2019

Hierarchical Reinforcement Learning with Advantage-Based Auxiliary Rewards

Hierarchical Reinforcement Learning (HRL) is a promising approach to sol...
research
02/05/2022

ASHA: Assistive Teleoperation via Human-in-the-Loop Reinforcement Learning

Building assistive interfaces for controlling robots through arbitrary, ...
research
09/04/2022

An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling

Masked visual modeling (MVM) has been recently proven effective for visu...
research
05/24/2019

An Explicitly Relational Neural Network Architecture

With a view to bridging the gap between deep learning and symbolic AI, w...
research
06/01/2023

DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection

Existing deepfake detection methods fail to generalize well to unseen or...

Please sign up or login with your details

Forgot password? Click here to reset