An Active and Contrastive Learning Framework for Fine-Grained Off-Road Semantic Segmentation

02/18/2022
by   Biao Gao, et al.
0

Off-road semantic segmentation with fine-grained labels is necessary for autonomous vehicles to understand driving scenes, as the coarse-grained road detection can not satisfy off-road vehicles with various mechanical properties. Fine-grained semantic segmentation in off-road scenes usually has no unified category definition due to ambiguous nature environments, and the cost of pixel-wise labeling is extremely high. Furthermore, semantic properties of off-road scenes can be very changeable due to various precipitations, temperature, defoliation, etc. To address these challenges, this research proposes an active and contrastive learning-based method that does not rely on pixel-wise labels, but only on patch-based weak annotations for model learning. There is no need for predefined semantic categories, the contrastive learning-based feature representation and adaptive clustering will discover the category model from scene data. In order to actively adapt to new scenes, a risk evaluation method is proposed to discover and select hard frames with high-risk predictions for supplemental labeling, so as to update the model efficiently. Experiments conducted on our self-developed off-road dataset and DeepScene dataset demonstrate that fine-grained semantic segmentation can be learned with only dozens of weakly labeled frames, and the model can efficiently adapt across scenes by weak supervision, while achieving almost the same level of performance as typical fully supervised baselines.

READ FULL TEXT

page 1

page 3

page 6

page 8

page 9

page 10

page 11

research
03/05/2021

Fine-Grained Off-Road Semantic Segmentation and Mapping via Contrastive Learning

Road detection or traversability analysis has been a key technique for a...
research
10/11/2022

TriangleNet: Edge Prior Augmented Network for Semantic Segmentation through Cross-Task Consistency

Semantic segmentation is a classic computer vision problem dedicated to ...
research
03/01/2021

Fool Me Once: Robust Selective Segmentation via Out-of-Distribution Detection with Contrastive Learning

In this work, we train a network to simultaneously perform segmentation ...
research
03/24/2021

A Fine-Grained Dataset and its Efficient Semantic Segmentation for Unstructured Driving Scenarios

Research in autonomous driving for unstructured environments suffers fro...
research
08/03/2023

Contrastive Multi-FaceForensics: An End-to-end Bi-grained Contrastive Learning Approach for Multi-face Forgery Detection

DeepFakes have raised serious societal concerns, leading to a great surg...
research
03/10/2021

An Image-based Approach of Task-driven Driving Scene Categorization

Categorizing driving scenes via visual perception is a key technology fo...
research
12/09/2021

Exploring Event-driven Dynamic Context for Accident Scene Segmentation

The robustness of semantic segmentation on edge cases of traffic scene i...

Please sign up or login with your details

Forgot password? Click here to reset