Fast Traversability Estimation for Wild Visual Navigation

05/15/2023
by   Jonas Frey, et al.
0

Natural environments such as forests and grasslands are challenging for robotic navigation because of the false perception of rigid obstacles from high grass, twigs, or bushes. In this work, we propose Wild Visual Navigation (WVN), an online self-supervised learning system for traversability estimation which uses only vision. The system is able to continuously adapt from a short human demonstration in the field. It leverages high-dimensional features from self-supervised visual transformer models, with an online scheme for supervision generation that runs in real-time on the robot. We demonstrate the advantages of our approach with experiments and ablation studies in challenging environments in forests, parks, and grasslands. Our system is able to bootstrap the traversable terrain segmentation in less than 5 min of in-field training time, enabling the robot to navigate in complex outdoor terrains - negotiating obstacles in high grass as well as a 1.4 km footpath following. While our experiments were executed with a quadruped robot, ANYmal, the approach presented can generalize to any ground robot.

READ FULL TEXT

page 1

page 4

page 5

page 8

page 9

page 10

page 11

page 13

research
02/13/2020

BADGR: An Autonomous Self-Supervised Learning-Based Navigation System

Mobile robot navigation is typically regarded as a geometric problem, in...
research
10/18/2020

Evaluation of a Vision-to-Audition Substitution System that Provides 2D WHERE Information and Fast User Learning

Vision to audition substitution devices are designed to convey visual in...
research
03/07/2022

Monocular Robot Navigation with Self-Supervised Pretrained Vision Transformers

In this work, we consider the problem of learning a perception model for...
research
03/22/2022

WayFAST: Traversability Predictive Navigation for Field Robots

We present a self-supervised approach for learning to predict traversabl...
research
06/16/2020

Robot Perception enables Complex Navigation Behavior via Self-Supervised Learning

Learning visuomotor control policies in robotic systems is a fundamental...
research
02/25/2022

TerraPN: Unstructured terrain navigation using Online Self-Supervised Learning

We present TerraPN, a novel method that learns the surface properties (t...
research
05/04/2021

Self-Improving Semantic Perception on a Construction Robot

We propose a novel robotic system that can improve its semantic percepti...

Please sign up or login with your details

Forgot password? Click here to reset