Bayesian Optimization Meets Hybrid Zero Dynamics: Safe Parameter Learning for Bipedal Locomotion Control

03/04/2022
by   Lizhi Yang, et al.
9

In this paper, we propose a multi-domain control parameter learning framework that combines Bayesian Optimization (BO) and Hybrid Zero Dynamics (HZD) for locomotion control of bipedal robots. We leverage BO to learn the control parameters used in the HZD-based controller. The learning process is firstly deployed in simulation to optimize different control parameters for a large repertoire of gaits. Next, to tackle the discrepancy between the simulation and the real world, the learning process is applied on the physical robot to learn for corrections to the control parameters learned in simulation while also respecting a safety constraint for gait stability. This method empowers an efficient sim-to-real transition with a small number of samples in the real world, and does not require a valid controller to initialize the training in simulation. Our proposed learning framework is experimentally deployed and validated on a bipedal robot Cassie to perform versatile locomotion skills with improved performance on smoothness of walking gaits and reduction of steady-state tracking errors.

READ FULL TEXT
research
03/05/2022

Safe Reinforcement Learning for Legged Locomotion

Designing control policies for legged locomotion is complex due to the u...
research
04/27/2018

Sim-to-Real: Learning Agile Locomotion For Quadruped Robots

Designing agile locomotion for quadruped robots often requires extensive...
research
09/20/2022

Real-time Digital Double Framework to Predict Collapsible Terrains for Legged Robots

Inspired by the digital twinning systems, a novel real-time digital doub...
research
01/25/2021

Scaffolded Gait Learning of a Quadruped Robot with Bayesian Optimization

During learning trials, systems are exposed to different failure conditi...
research
09/17/2019

First Steps Towards Full Model Based Motion Planning and Control of Quadrupeds: A Hybrid Zero Dynamics Approach

The hybrid zero dynamics (HZD) approach has become a powerful tool for t...
research
01/21/2020

Learning Directed Locomotion in Modular Robots with Evolvable Morphologies

We generalize the well-studied problem of gait learning in modular robot...
research
03/06/2023

Learning Humanoid Locomotion with Transformers

We present a sim-to-real learning-based approach for real-world humanoid...

Please sign up or login with your details

Forgot password? Click here to reset