Contrastive Label Disambiguation for Self-Supervised Terrain Traversability Learning in Off-Road Environments

07/06/2023
by   Hanzhang Xue, et al.
0

Discriminating the traversability of terrains is a crucial task for autonomous driving in off-road environments. However, it is challenging due to the diverse, ambiguous, and platform-specific nature of off-road traversability. In this paper, we propose a novel self-supervised terrain traversability learning framework, utilizing a contrastive label disambiguation mechanism. Firstly, weakly labeled training samples with pseudo labels are automatically generated by projecting actual driving experiences onto the terrain models constructed in real time. Subsequently, a prototype-based contrastive representation learning method is designed to learn distinguishable embeddings, facilitating the self-supervised updating of those pseudo labels. As the iterative interaction between representation learning and pseudo label updating, the ambiguities in those pseudo labels are gradually eliminated, enabling the learning of platform-specific and task-specific traversability without any human-provided annotations. Experimental results on the RELLIS-3D dataset and our Gobi Desert driving dataset demonstrate the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 3

page 5

page 7

research
05/30/2023

Learning Off-Road Terrain Traversability with Self-Supervisions Only

Estimating the traversability of terrain should be reliable and accurate...
research
10/25/2020

An iterative framework for self-supervised deep speaker representation learning

In this paper, we propose an iterative framework for self-supervised spe...
research
05/28/2023

Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery

Generalized intent discovery aims to extend a closed-set in-domain inten...
research
07/22/2022

Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness

Adversarial training (AT) for robust representation learning and self-su...
research
08/07/2023

Multi-Label Self-Supervised Learning with Scene Images

Self-supervised learning (SSL) methods targeting scene images have seen ...
research
03/10/2020

Off-Road Drivable Area Extraction Using 3D LiDAR Data

We propose a method for off-road drivable area extraction using 3D LiDAR...
research
06/07/2021

Multi-task Transformation Learning for Robust Out-of-Distribution Detection

Detecting out-of-distribution (OOD) samples plays a key role in open-wor...

Please sign up or login with your details

Forgot password? Click here to reset