DeepAI AI Chat
Log In Sign Up

Learning Bipedal Walking On Planned Footsteps For Humanoid Robots

by   Rohan Pratap Singh, et al.
National Institute of Advanced Industrial Science and Technology

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in real-world settings, it is crucial to build a system that can achieve robust walking in any direction, on 2D and 3D terrains, and be controllable by a user-command. In this paper, we tackle this problem by learning a policy to follow a given step sequence. The policy is trained with the help of a set of procedurally generated step sequences (also called footstep plans). We show that simply feeding the upcoming 2 steps to the policy is sufficient to achieve omnidirectional walking, turning in place, standing, and climbing stairs. Our method employs curriculum learning on the complexity of terrains, and circumvents the need for reference motions or pre-trained weights. We demonstrate the application of our proposed method to learn RL policies for 2 new robot platforms - HRP5P and JVRC-1 - in the MuJoCo simulation environment. The code for training and evaluation is available online.


page 1

page 3

page 6


Learning Bipedal Walking for Humanoids with Current Feedback

Recent advances in deep reinforcement learning (RL) based techniques com...

Reinforcement Learning Meets Hybrid Zero Dynamics: A Case Study for RABBIT

The design of feedback controllers for bipedal robots is challenging due...

Sim-to-Real Learning of Footstep-Constrained Bipedal Dynamic Walking

Recently, work on reinforcement learning (RL) for bipedal robots has suc...

Guided Curriculum Learning for Walking Over Complex Terrain

Reliable bipedal walking over complex terrain is a challenging problem, ...

Adversarial Body Shape Search for Legged Robots

We propose an evolutionary computation method for an adversarial attack ...

Air Learning: An AI Research Platform for Algorithm-Hardware Benchmarking of Autonomous Aerial Robots

We introduce Air Learning, an AI research platform for benchmarking algo...