NSS-VAEs: Generative Scene Decomposition for Visual Navigable Space Construction

10/29/2021
by   Zheng Chen, et al.
0

Detecting navigable space is the first and also a critical step for successful robot navigation. In this work, we treat the visual navigable space segmentation as a scene decomposition problem and propose a new network, NSS-VAEs (Navigable Space Segmentation Variational AutoEncoders), a representation-learning-based framework to enable robots to learn the navigable space segmentation in an unsupervised manner. Different from prevalent segmentation techniques which heavily rely on supervised learning strategies and typically demand immense pixel-level annotated images, the proposed framework leverages a generative model - Variational Auto-Encoder (VAE) - to learn a probabilistic polyline representation that compactly outlines the desired navigable space boundary. Uniquely, our method also assesses the prediction uncertainty related to the unstructuredness of the scenes, which is important for robot navigation in unstructured environments. Through extensive experiments, we have validated that our proposed method can achieve remarkably high accuracy (>90 prediction of NSS-VAEs can be further improved using few labels with results significantly outperforming the SOTA fully supervised-learning-based method.

READ FULL TEXT

page 3

page 4

research
10/29/2021

Polyline Based Generative Navigable Space Segmentation for Autonomous Visual Navigation

Detecting navigable space is a fundamental capability for mobile robots ...
research
05/04/2021

Combining Supervised and Un-supervised Learning for Automatic Citrus Segmentation

Citrus segmentation is a key step of automatic citrus picking. While mos...
research
02/16/2022

Label Propagation for Annotation-Efficient Nuclei Segmentation from Pathology Images

Nuclei segmentation is a crucial task for whole slide image analysis in ...
research
03/03/2019

Variational Auto-Decoder: Neural Generative Modeling from Partial Data

Learning a generative model from partial data (data with missingness) is...
research
08/25/2023

Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

Text segmentation tasks have a very wide range of application values, su...
research
12/06/2019

Self-Supervised Visual Terrain Classification from Unsupervised Acoustic Feature Learning

Mobile robots operating in unknown urban environments encounter a wide r...
research
01/10/2019

Stroke-based sketched symbol reconstruction and segmentation

Hand-drawn objects usually consist of multiple semantically meaningful p...

Please sign up or login with your details

Forgot password? Click here to reset