Free-Space Detection with Self-Supervised and Online Trained Fully Convolutional Networks

04/08/2016
by   Willem P. Sanberg, et al.
0

Recently, vision-based Advanced Driver Assist Systems have gained broad interest. In this work, we investigate free-space detection, for which we propose to employ a Fully Convolutional Network (FCN). We show that this FCN can be trained in a self-supervised manner and achieve similar results compared to training on manually annotated data, thereby reducing the need for large manually annotated training sets. To this end, our self-supervised training relies on a stereo-vision disparity system, to automatically generate (weak) training labels for the color-based FCN. Additionally, our self-supervised training facilitates online training of the FCN instead of offline. Consequently, given that the applied FCN is relatively small, the free-space analysis becomes highly adaptive to any traffic scene that the vehicle encounters. We have validated our algorithm using publicly available data and on a new challenging benchmark dataset that is released with this paper. Experiments show that the online training boosts performance with 5 compared to offline training, both for Fmax and AP.

READ FULL TEXT

page 1

page 4

page 5

page 7

research
04/05/2021

An Empirical Study of Training Self-Supervised Vision Transformers

This paper does not describe a novel method. Instead, it studies a strai...
research
12/18/2020

Self-supervised Learning with Fully Convolutional Networks

Although deep learning based methods have achieved great success in many...
research
05/02/2018

Lidar Cloud Detection with Fully Convolutional Networks

In this contribution, we present a novel approach for segmenting laser r...
research
09/11/2021

Quantitative reconstruction of defects in multi-layered bonded composites using fully convolutional network-based ultrasonic inversion

Ultrasonic methods have great potential applications to detect and chara...
research
06/13/2018

Online Self-supervised Scene Segmentation for Micro Aerial Vehicles

Recently, there have been numerous advances in the development of payloa...
research
03/09/2020

Restore from Restored: Video Restoration with Pseudo Clean Video

In this paper, we propose a self-supervised video denoising method calle...
research
12/18/2020

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

In ophthalmology, the study of the retinal microcirculation is a key iss...

Please sign up or login with your details

Forgot password? Click here to reset