Neural Gaits: Learning Bipedal Locomotion via Control Barrier Functions and Zero Dynamics Policies

This work presents Neural Gaits, a method for learning dynamic walking gaits through the enforcement of set invariance that can be refined episodically using experimental data from the robot. We frame walking as a set invariance problem enforceable via control barrier functions (CBFs) defined on the reduced-order dynamics quantifying the underactuated component of the robot: the zero dynamics. Our approach contains two learning modules: one for learning a policy that satisfies the CBF condition, and another for learning a residual dynamics model to refine imperfections of the nominal model. Importantly, learning only over the zero dynamics significantly reduces the dimensionality of the learning problem while using CBFs allows us to still make guarantees for the full-order system. The method is demonstrated experimentally on an underactuated bipedal robot, where we are able to show agile and dynamic locomotion, even with partially unknown dynamics.

READ FULL TEXT
research
05/04/2021

Episodic Learning for Safe Bipedal Locomotion with Control Barrier Functions and Projection-to-State Safety

This paper combines episodic learning and control barrier functions in t...
research
07/09/2021

Control Lyapunov Functions for Compliant Hybrid Zero Dynamic Walking

The ability to realize nonlinear controllers with formal guarantees on d...
research
10/15/2020

Dynamic Walking: Toward Agile and Efficient Bipedal Robots

Dynamic walking on bipedal robots has evolved from an idea in science fi...
research
10/18/2020

Inverse Dynamics Control of Compliant Hybrid Zero Dynamic Walking

We present a trajectory planning and control architecture for bipedal lo...
research
09/10/2021

Natural Multicontact Walking for Robotic Assistive Devices via Musculoskeletal Models and Hybrid Zero Dynamics

Generating provably stable walking gaits that yield natural locomotion w...
research
09/23/2019

Optimal Reduced-order Modeling of Bipedal Locomotion

State-of-the-art approaches to legged locomotion are widely dependent on...
research
06/10/2019

Data Efficient and Safe Learning for Locomotion via Simplified Model

In this letter, we formulate a novel Markov Decision Process (MDP) for d...

Please sign up or login with your details

Forgot password? Click here to reset