Fast and Continuous Foothold Adaptation for Dynamic Locomotion through Convolutional Neural Networks

09/25/2018
by   Octavio Villarreal, et al.
0

Legged robots can outperform wheeled machines for most navigation tasks across unknown and rough terrains. For such tasks, visual feedback is a fundamental asset to provide robots with terrain-awareness. However, robust dynamic locomotion on difficult terrains with real-time performance guarantees remains a challenge. Indeed, the computational effort demanded by visual processing limits the potential for realtime control and planning strategies. In this paper, we present a real-time, dynamic foothold adaptation strategy based on visual feedback. Our method adjusts the landing position of the feet in a fully reactive manner, using only on-board computers and sensors. The correction is computed and executed continuously along the swing phase trajectory of each leg. To efficiently adapt the landing position, we implement a self-supervised foothold classifier based on a Convolutional Neural Network (CNN). The training set is automatically generated by a heuristic algorithm that jointly evaluates terrain morphology, kinematics, and leg collisions. Our method results in an up to 200 times faster computation with respect to the full-blown heuristics. Our goal is to react to visual stimuli from the environment, bridging the gap between blind reactive locomotion and purely vision-based planning strategies. We assess the performance of our method on the dynamic quadruped robot HyQ, executing static and dynamic gaits (at speeds up to 0.5 m/s) in both simulated and real scenarios; the benefit of safe foothold adaptation is clearly demonstrated by the overall robot behavior.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

research
07/17/2023

Vision-Based Reactive Planning and Control of Quadruped Robots in Unstructured Dynamic Environments

Quadruped robots have received increasing attention for the past few yea...
research
12/02/2022

ViTAL: Vision-Based Terrain-Aware Locomotion for Legged Robots

This work is on vision-based planning strategies for legged robots that ...
research
09/30/2019

MPC-based Controller with Terrain Insight for Dynamic Legged Locomotion

We present a novel control strategy for dynamic legged locomotion in com...
research
10/09/2021

Vision-based Navigation for a Small-scale Quadruped Robot Pegasus-Mini

Quadruped locomotion is currently a vibrant research area, which has rea...
research
12/01/2022

On Terrain-Aware Locomotion for Legged Robots

(Simplified Abstract) To accomplish breakthroughs in dynamic whole-body ...
research
05/12/2021

Mobility-enhanced MPC for Legged Locomotion on Rough Terrain

Re-planning in legged locomotion is crucial to track a given set-point w...
research
06/27/2017

Material Recognition CNNs and Hierarchical Planning for Biped Robot Locomotion on Slippery Terrain

In this paper we tackle the problem of visually predicting surface frict...

Please sign up or login with your details

Forgot password? Click here to reset