Learning Dynamic Bipedal Walking Across Stepping Stones

05/03/2022
by   Helei Duan, et al.
0

In this work, we propose a learning approach for 3D dynamic bipedal walking when footsteps are constrained to stepping stones. While recent work has shown progress on this problem, real-world demonstrations have been limited to relatively simple open-loop, perception-free scenarios. Our main contribution is a more advanced learning approach that enables real-world demonstrations, using the Cassie robot, of closed-loop dynamic walking over moderately difficult stepping-stone patterns. Our approach first uses reinforcement learning (RL) in simulation to train a controller that maps footstep commands onto joint actions without any reference motion information. We then learn a model of that controller's capabilities, which enables prediction of feasible footsteps given the robot's current dynamic state. The resulting controller and model are then integrated with a real-time overhead camera system for detecting stepping stone locations. For evaluation, we develop a benchmark set of stepping stone patterns, which are used to test performance in both simulation and the real world. Overall, we demonstrate that sim-to-real learning is extremely promising for enabling dynamic locomotion over stepping stones. We also identify challenges remaining that motivate important future research directions.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
03/15/2022

Sim-to-Real Learning of Footstep-Constrained Bipedal Dynamic Walking

Recently, work on reinforcement learning (RL) for bipedal robots has suc...
research
09/20/2022

Real-time Digital Double Framework to Predict Collapsible Terrains for Legged Robots

Inspired by the digital twinning systems, a novel real-time digital doub...
research
12/04/2017

Deep Visual Perception for Dynamic Walking on Discrete Terrain

Dynamic bipedal walking on discrete terrain, like stepping stones, is a ...
research
05/18/2021

Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learning

Accurate and precise terrain estimation is a difficult problem for robot...
research
09/15/2022

Learning to Exploit Elastic Actuators for Quadruped Locomotion

Spring-based actuators in legged locomotion provide energy-efficiency an...
research
10/09/2018

Realizing Learned Quadruped Locomotion Behaviors through Kinematic Motion Primitives

Humans and animals are believed to use a very minimal set of trajectorie...
research
04/21/2023

AMP in the wild: Learning robust, agile, natural legged locomotion skills

The successful transfer of a learned controller from simulation to the r...

Please sign up or login with your details

Forgot password? Click here to reset