Learning Vision-Guided Dynamic Locomotion Over Challenging Terrains

09/09/2021
by   Zhaocheng Liu, et al.
0

Legged robots are becoming increasingly powerful and popular in recent years for their potential to bring the mobility of autonomous agents to the next level. This work presents a deep reinforcement learning approach that learns a robust Lidar-based perceptual locomotion policy in a partially observable environment using Proximal Policy Optimisation. Visual perception is critical to actively overcome challenging terrains, and to do so, we propose a novel learning strategy: Dynamic Reward Strategy (DRS), which serves as effective heuristics to learn a versatile gait using a neural network architecture without the need to access the history data. Moreover, in a modified version of the OpenAI gym environment, the proposed work is evaluated with scores over 90 success rate in all tested challenging terrains.

READ FULL TEXT

page 5

page 7

research
09/28/2021

Learning Perceptual Locomotion on Uneven Terrains using Sparse Visual Observations

Legged robots have achieved remarkable performance in blind walking usin...
research
03/08/2021

An Energy-Saving Snake Locomotion Gait Policy Using Deep Reinforcement Learning

Snake robots, comprised of sequentially connected joint actuators, have ...
research
05/03/2023

Enhancing Efficiency of Quadrupedal Locomotion over Challenging Terrains with Extensible Feet

Recent advancements in legged locomotion research have made legged robot...
research
09/26/2022

Advanced Skills by Learning Locomotion and Local Navigation End-to-End

The common approach for local navigation on challenging environments wit...
research
03/20/2022

Hierarchical Reinforcement Learning of Locomotion Policies in Response to Approaching Objects: A Preliminary Study

Animals such as rabbits and birds can instantly generate locomotion beha...
research
02/22/2018

Structured Control Nets for Deep Reinforcement Learning

In recent years, Deep Reinforcement Learning has made impressive advance...
research
05/05/2022

Chemoreception and chemotaxis of a three-sphere swimmer

The coupled problem of hydrodynamics and solute transport for the Najafi...

Please sign up or login with your details

Forgot password? Click here to reset