Environment reconstruction on depth images using Generative Adversarial Networks

12/09/2019
by   Lucas P. N. Matias, et al.
10

Robust perception systems are essential for autonomous vehicle safety. To navigate in a complex urban environment, it is necessary precise sensors with reliable data. The task of understanding the surroundings is hard by itself; for intelligent vehicles, it is even more critical due to the high speed in which the vehicle navigates. To successfully navigate in an urban environment, the perception system must quickly receive, process, and execute an action to guarantee both passenger and pedestrian safety. Stereo cameras collect environment information at many levels, e.g., depth, color, texture, shape, which guarantee ample knowledge about the surroundings. Even so, when compared to human, computational methods lack the ability to deal with missing information, i.e., occlusions. For many perception tasks, this lack of data can be a hindrance due to the environment incomplete information. In this paper, we address this problem and discuss recent methods to deal with occluded areas inference. We then introduce a loss function focused on disparity and environment depth data reconstruction, and a Generative Adversarial Network (GAN) architecture able to deal with occluded information inference. Our results present a coherent reconstruction on depth maps, estimating regions occluded by different obstacles. Our final contribution is a loss function focused on disparity data and a GAN able to extract depth features and estimate depth data by inpainting disparity images.

READ FULL TEXT

page 1

page 4

page 5

page 8

page 9

page 10

page 11

research
04/25/2019

A Conditional Adversarial Network for Scene Flow Estimation

The problem of Scene flow estimation in depth videos has been attracting...
research
06/03/2019

Y-GAN: A Generative Adversarial Network for Depthmap Estimation from Multi-camera Stereo Images

Depth perception is a key component for autonomous systems that interact...
research
03/18/2018

Sdf-GAN: Semi-supervised Depth Fusion with Multi-scale Adversarial Networks

Fusing disparity maps from different algorithms to exploit their complem...
research
06/24/2020

Road obstacles positional and dynamic features extraction combining object detection, stereo disparity maps and optical flow data

One of the most relevant tasks in an intelligent vehicle navigation syst...
research
10/13/2022

Two approaches to inpainting microstructure with deep convolutional generative adversarial networks

Imaging is critical to the characterisation of materials. However, even ...
research
06/25/2017

Efficient and accurate monitoring of the depth information in a Wireless Multimedia Sensor Network based surveillance

Wireless Multimedia Sensor Network (WMSN) is a promising technology capt...
research
06/06/2023

SDR-GAIN: A High Real-Time Occluded Pedestrian Pose Completion Method for Autonomous Driving

To mitigate the challenges arising from partial occlusion in human pose ...

Please sign up or login with your details

Forgot password? Click here to reset