Data-efficient Co-Adaptation of Morphology and Behaviour with Deep Reinforcement Learning

by   Kevin Sebastian Luck, et al.

Humans and animals are capable of quickly learning new behaviours to solve new tasks. Yet, we often forget that they also rely on a highly specialized morphology that co-adapted with motor control throughout thousands of years. Although compelling, the idea of co-adapting morphology and behaviours in robots is often unfeasible because of the long manufacturing times, and the need to re-design an appropriate controller for each morphology. In this paper, we propose a novel approach to automatically and efficiently co-adapt a robot morphology and its controller. Our approach is based on recent advances in deep reinforcement learning, and specifically the soft actor critic algorithm. Key to our approach is the possibility of leveraging previously tested morphologies and behaviors to estimate the performance of new candidate morphologies. As such, we can make full use of the information available for making more informed decisions, with the ultimate goal of achieving a more data-efficient co-adaptation (i.e., reducing the number of morphologies and behaviors tested). Simulated experiments show that our approach requires drastically less design prototypes to find good morphology-behaviour combinations, making this method particularly suitable for future co-adaptation of robot designs in the real world.


page 2

page 6

page 7

page 8

page 12

page 13

page 14


What Robot do I Need? Fast Co-Adaptation of Morphology and Control using Graph Neural Networks

The co-adaptation of robot morphology and behaviour becomes increasingly...

Data-efficient Learning of Morphology and Controller for a Microrobot

Robot design is often a slow and difficult process requiring the iterati...

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

With the rise of computing power, using data-driven approaches for co-de...

Co-Imitation: Learning Design and Behaviour by Imitation

The co-adaptation of robots has been a long-standing research endeavour ...

Control and Morphology Optimization of Passive Asymmetric Structures for Robotic Swimming

Aquatic creatures exhibit remarkable adaptations of their body to effici...

Jointly Learning to Construct and Control Agents using Deep Reinforcement Learning

The physical design of a robot and the policy that controls its motion a...

Switching Model Predictive Control for Online Structural Reformations of a Foldable Quadrotor

The aim of this article is the formulation of a switching model predicti...

Please sign up or login with your details

Forgot password? Click here to reset