First Steps: Latent-Space Control with Semantic Constraints for Quadruped Locomotion

07/03/2020
∙
by   Alexander L. Mitchell, et al.
∙
1
∙

Traditional approaches to quadruped control frequently employ simplified, hand-derived models. This significantly reduces the capability of the robot since its effective kinematic range is curtailed. In addition, kinodynamic constraints are often non-differentiable and difficult to implement in an optimisation approach. In this work, these challenges are addressed by framing quadruped control as optimisation in a structured latent space. A deep generative model captures a statistical representation of feasible joint configurations, whilst complex dynamic and terminal constraints are expressed via high-level, semantic indicators and represented by learned classifiers operating upon the latent space. As a consequence, complex constraints are rendered differentiable and evaluated an order of magnitude faster than analytical approaches. We validate the feasibility of locomotion trajectories optimised using our approach both in simulation and on a real-world ANYmal quadruped. Our results demonstrate that this approach is capable of generating smooth and realisable trajectories. To the best of our knowledge, this is the first time latent space control has been successfully applied to a complex, real robot platform.

READ FULL TEXT

page 1

page 7

research
∙ 10/21/2022

Reaching Through Latent Space: From Joint Statistics to Path Planning in Manipulation

We present a novel approach to path planning for robotic manipulators, i...
research
∙ 03/06/2023

Leveraging Scene Embeddings for Gradient-Based Motion Planning in Latent Space

Motion planning framed as optimisation in structured latent spaces has r...
research
∙ 08/09/2021

Mapless Humanoid Navigation Using Learned Latent Dynamics

In this paper, we propose a novel Deep Reinforcement Learning approach t...
research
∙ 06/24/2015

Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images

We introduce Embed to Control (E2C), a method for model learning and con...
research
∙ 07/01/2020

Molecular Latent Space Simulators

Small integration time steps limit molecular dynamics (MD) simulations t...
research
∙ 10/24/2021

DiffSRL: Learning Dynamic-aware State Representation for Deformable Object Control with Differentiable Simulator

Dynamic state representation learning is an important task in robot lear...
research
∙ 11/20/2022

Vibration Free Flexible Object Handling with a Robot Manipulator Using Learning Control

Many industries extensively use flexible materials. Effective approaches...

Please sign up or login with your details

Forgot password? Click here to reset