Deep Reinforcement Learning for Single-Shot Diagnosis and Adaptation in Damaged Robots

10/02/2019
by   Shresth Verma, et al.
0

Robotics has proved to be an indispensable tool in many industrial as well as social applications, such as warehouse automation, manufacturing, disaster robotics, etc. In most of these scenarios, damage to the agent while accomplishing mission-critical tasks can result in failure. To enable robotic adaptation in such situations, the agent needs to adopt policies which are robust to a diverse set of damages and must do so with minimum computational complexity. We thus propose a damage aware control architecture which diagnoses the damage prior to gait selection while also incorporating domain randomization in the damage space for learning a robust policy. To implement damage awareness, we have used a Long Short Term Memory based supervised learning network which diagnoses the damage and predicts the type of damage. The main novelty of this approach is that only a single policy is trained to adapt against a wide variety of damages and the diagnosis is done in a single trial at the time of damage.

READ FULL TEXT

page 5

page 7

research
11/17/2020

Fault-Aware Robust Control via Adversarial Reinforcement Learning

Robots have limited adaptation ability compared to humans and animals in...
research
07/13/2014

Robots that can adapt like animals

As robots leave the controlled environments of factories to autonomously...
research
06/06/2022

Real2Sim or Sim2Real: Robotics Visual Insertion using Deep Reinforcement Learning and Real2Sim Policy Adaptation

Reinforcement learning has shown a wide usage in robotics tasks, such as...
research
05/14/2022

The multi-robber damage number of a graph

In many variants of the game of Cops and Robbers on graphs, multiple cop...
research
08/18/2023

The damage number of the Cartesian product of graphs

We consider a variation of Cops and Robber, introduced in [D. Cox and A....
research
10/17/2021

Rheumatoid Arthritis: Automated Scoring of Radiographic Joint Damage

Rheumatoid arthritis is an autoimmune disease that causes joint damage d...
research
05/15/2017

Probabilistically Safe Policy Transfer

Although learning-based methods have great potential for robotics, one c...

Please sign up or login with your details

Forgot password? Click here to reset