DeepAI
Log In Sign Up

SimuGAN: Unsupervised forward modeling and optimal design of a LIDAR Camera

12/16/2020
by   Nir Diamant, et al.
1

Energy-saving LIDAR camera for short distances estimates an object's distance using temporally intensity-coded laser light pulses and calculates the maximum correlation with the back-scattered pulse. Though on low power, the backs-scattered pulse is noisy and unstable, which leads to inaccurate and unreliable depth estimation. To address this problem, we use GANs (Generative Adversarial Networks), which are two neural networks that can learn complicated class distributions through an adversarial process. We learn the LIDAR camera's hidden properties and behavior, creating a novel, fully unsupervised forward model that simulates the camera. Then, we use the model's differentiability to explore the camera parameter space and optimize those parameters in terms of depth, accuracy, and stability. To achieve this goal, we also propose a new custom loss function designated to the back-scattered code distribution's weaknesses and its circular behavior. The results are demonstrated on both synthetic and real data.

READ FULL TEXT

page 1

page 4

page 6

09/08/2021

LiDARTouch: Monocular metric depth estimation with a few-beam LiDAR

Vision-based depth estimation is a key feature in autonomous systems, wh...
12/17/2020

Multi-Modal Depth Estimation Using Convolutional Neural Networks

This paper addresses the problem of dense depth predictions from sparse ...
03/28/2018

Motion Guided LIDAR-camera Autocalibration and Accelerated Depth Super Resolution

In this work we propose a novel motion guided method for automatic and t...
06/28/2022

Accurate and Real-time Pseudo Lidar Detection: Is Stereo Neural Network Really Necessary?

The proposal of Pseudo-Lidar representation has significantly narrowed t...
02/13/2019

Gated2Depth: Real-time Dense Lidar from Gated Images

We present an imaging framework which converts three images from a gated...
11/21/2017

Towards Stable Adversarial Feature Learning for LiDAR based Loop Closure Detection

Stable feature extraction is the key for the Loop closure detection (LCD...