DeepAI AI Chat
Log In Sign Up

Semantic Road Layout Understanding by Generative Adversarial Inpainting

by   Federico Becattini, et al.

Autonomous driving is becoming a reality, yet vehicles still need to rely on complex sensor fusion techniques to fully understand the scene they act in. Being able to discern the static environment from the dynamic entities that populate it, will improve scene comprehension algorithms and will pose constraints to the reasoning process about moving objects. With this in mind, we propose a scene comprehension task aimed at providing a complete understanding of the static surroundings, with a particular attention to road layout. In order to cut to the bare minimum the sensor requirements to be deployed on-board, we solely rely on semantic segmentation masks, which can be reliably obtained with computer vision algorithms from any RGB source. We cast this problem as an inpainting task based on a Generative Adversarial Network model to remove all dynamic objects from the scene and focus on understanding its static components such as streets, sidewalks and buildings. We evaluate this task on a synthetically generated dataset obtained with the CARLA simulator, demonstrating the effectiveness of our method.


page 2

page 3

page 5


RGB-D Image Inpainting Using Generative Adversarial Network with a Late Fusion Approach

Diminished reality is a technology that aims to remove objects from vide...

Empty Cities: Image Inpainting for a Dynamic-Object-Invariant Space

In this paper we present an end-to-end deep learning framework to turn i...

Empty Cities: a Dynamic-Object-Invariant Space for Visual SLAM

In this paper we present a data-driven approach to obtain the static ima...

Using Image Priors to Improve Scene Understanding

Semantic segmentation algorithms that can robustly segment objects acros...

Incorporating Luminance, Depth and Color Information by Fusion-based Networks for Semantic Segmentation

Semantic segmentation is paramount to accomplish many scene understandin...

Learning to Look around Objects for Top-View Representations of Outdoor Scenes

Given a single RGB image of a complex outdoor road scene in the perspect...

The Right (Angled) Perspective: Improving the Understanding of Road Scenes using Boosted Inverse Perspective Mapping

Many tasks performed by autonomous vehicles such as road marking detecti...