Learning-based Design and Control for Quadrupedal Robots with Parallel-Elastic Actuators

01/09/2023
by   Filip Bjelonic, et al.
0

Parallel-elastic joints can improve the efficiency and strength of robots by assisting the actuators with additional torques. For these benefits to be realized, a spring needs to be carefully designed. However, designing robots is an iterative and tedious process, often relying on intuition and heuristics. We introduce a design optimization framework that allows us to co-optimize a parallel elastic knee joint and locomotion controller for quadrupedal robots with minimal human intuition. We design a parallel elastic joint and optimize its parameters with respect to the efficiency in a model-free fashion. In the first step, we train a design-conditioned policy using model-free Reinforcement Learning, capable of controlling the quadruped in the predefined range of design parameters. Afterwards, we use Bayesian Optimization to find the best design using the policy. We use this framework to optimize the parallel-elastic spring parameters for the knee of our quadrupedal robot ANYmal together with the optimal controller. We evaluate the optimized design and controller in real-world experiments over various terrains. Our results show that the new system improves the torque-square efficiency of the robot by 33 the baseline and reduces maximum joint torque by 30 tracking performance. The improved design resulted in 11 on flat terrain.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
10/06/2022

Meta Reinforcement Learning for Optimal Design of Legged Robots

The process of robot design is a complex task and the majority of design...
research
09/15/2022

Learning to Exploit Elastic Actuators for Quadruped Locomotion

Spring-based actuators in legged locomotion provide energy-efficiency an...
research
07/01/2019

Model-free Friction Observers for Flexible Joint Robots with Torque Measurements

This paper tackles a friction compensation problem without using a frict...
research
09/01/2021

Modeling and Trajectory Optimization for Standing Long Jumping of a Quadruped with A Preloaded Elastic Prismatic Spine

This paper presents a novel methodology to model and optimize trajectori...
research
02/27/2018

Exploiting the Natural Dynamics of Series Elastic Robots by Actuator-Centered Sequential Linear Programming

Series elastic robots are best able to follow trajectories which obey th...
research
12/22/2020

Workspace Analysis and Optimal Design of Cable-Driven Parallel Robots via Auxiliary Counterbalances

Cable-driven parallel robots (CDPRs) are widely investigated and applied...
research
01/04/2018

Jointly Learning to Construct and Control Agents using Deep Reinforcement Learning

The physical design of a robot and the policy that controls its motion a...

Please sign up or login with your details

Forgot password? Click here to reset