Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behavior

12/06/2022
by   Gabriel B. Margolis, et al.
0

Learned locomotion policies can rapidly adapt to diverse environments similar to those experienced during training but lack a mechanism for fast tuning when they fail in an out-of-distribution test environment. This necessitates a slow and iterative cycle of reward and environment redesign to achieve good performance on a new task. As an alternative, we propose learning a single policy that encodes a structured family of locomotion strategies that solve training tasks in different ways, resulting in Multiplicity of Behavior (MoB). Different strategies generalize differently and can be chosen in real-time for new tasks or environments, bypassing the need for time-consuming retraining. We release a fast, robust open-source MoB locomotion controller, Walk These Ways, that can execute diverse gaits with variable footswing, posture, and speed, unlocking diverse downstream tasks: crouching, hopping, high-speed running, stair traversal, bracing against shoves, rhythmic dance, and more. Video and code release: https://gmargo11.github.io/walk-these-ways/

READ FULL TEXT

page 1

page 3

page 7

page 8

page 11

page 12

page 13

page 14

research
07/02/2022

Learning fast and agile quadrupedal locomotion over complex terrain

In this paper, we propose a robust controller that achieves natural and ...
research
04/20/2021

GLiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model

Model-free reinforcement learning (RL) for legged locomotion commonly re...
research
09/24/2022

Open-Ended Diverse Solution Discovery with Regulated Behavior Patterns for Cross-Domain Adaptation

While Reinforcement Learning can achieve impressive results for complex ...
research
03/04/2019

Sim-to-Real Transfer for Biped Locomotion

We present a new approach for transfer of dynamic robot control policies...
research
09/24/2021

Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning

In this work, we present and study a training set-up that achieves fast ...
research
06/14/2022

Open-Ended Learning Strategies for Learning Complex Locomotion Skills

Teaching robots to learn diverse locomotion skills under complex three-d...
research
08/16/2022

Generating a Terrain-Robustness Benchmark for Legged Locomotion: A Prototype via Terrain Authoring and Active Learning

Terrain-aware locomotion has become an emerging topic in legged robotics...

Please sign up or login with your details

Forgot password? Click here to reset