DeepQ Stepper: A framework for reactive dynamic walking on uneven terrain

10/28/2020
by   Avadesh Meduri, et al.
0

Reactive stepping and push recovery for biped robots is often restricted to flat terrains because of the difficulty in computing capture regions for nonlinear dynamic models. In this paper, we address this limitation by using reinforcement learning to approximately learn the 3D capture region for such systems. We propose a novel 3D reactive stepper, The DeepQ stepper, that computes optimal step locations for walking at different velocities using the 3D capture regions approximated by the action-value function. We demonstrate the ability of the approach to learn stepping with a simplified 3D pendulum model and a full robot dynamics. Further, the stepper achieves a higher performance when it learns approximate capture regions while taking into account the entire dynamics of the robot that are often ignored in existing reactive steppers based on simplified models. The DeepQ stepper can handle non convex terrain with obstacles, walk on restricted surfaces like stepping stones and recover from external disturbances for a constant computational cost.

READ FULL TEXT

page 5

page 7

research
01/26/2022

Robust Disturbance Rejection for Robotic Bipedal Walking: System-Level-Synthesis with Step-to-step Dynamics Approximation

We present a stepping stabilization control that addresses external push...
research
09/20/2021

Fast Online Optimization for Terrain-Blind Bipedal Robot Walking with a Decoupled Actuated SLIP Model

We present a highly reactive controller which enables bipedal robots to ...
research
07/22/2023

Reachability Aware Capture Regions with Time Adjustment and Cross-Over for Step Recovery

For humanoid robots to live up to their potential utility, they must be ...
research
06/05/2019

Comparison Study of Well-Known Inverted Pendulum Models for Balance Recovery in Humanoid Robot

Bipedal robots are essentially unstable because of their complex kinemat...
research
10/18/2017

Data Driven Computational Model for Bipedal Walking and Push Recovery

In this research, we have developed the data driven computational walkin...
research
11/09/2021

Footstep Adjustment for Biped Push Recovery on Slippery Surfaces

Despite extensive studies on motion stabilization of bipeds, they still ...
research
01/21/2022

Computation of Regions of Attraction for Hybrid Limit Cycles Using Reachability: An Application to Walking Robots

Contact-rich robotic systems, such as legged robots and manipulators, ar...

Please sign up or login with your details

Forgot password? Click here to reset