SimuGAN: Unsupervised forward modeling and optimal design of a LIDAR Camera

12/16/2020
by   Nir Diamant, et al.
1

Energy-saving LIDAR camera for short distances estimates an object's distance using temporally intensity-coded laser light pulses and calculates the maximum correlation with the back-scattered pulse. Though on low power, the backs-scattered pulse is noisy and unstable, which leads to inaccurate and unreliable depth estimation. To address this problem, we use GANs (Generative Adversarial Networks), which are two neural networks that can learn complicated class distributions through an adversarial process. We learn the LIDAR camera's hidden properties and behavior, creating a novel, fully unsupervised forward model that simulates the camera. Then, we use the model's differentiability to explore the camera parameter space and optimize those parameters in terms of depth, accuracy, and stability. To achieve this goal, we also propose a new custom loss function designated to the back-scattered code distribution's weaknesses and its circular behavior. The results are demonstrated on both synthetic and real data.

READ FULL TEXT

page 1

page 4

page 6

research
09/08/2021

LiDARTouch: Monocular metric depth estimation with a few-beam LiDAR

Vision-based depth estimation is a key feature in autonomous systems, wh...
research
09/20/2023

BroadBEV: Collaborative LiDAR-camera Fusion for Broad-sighted Bird's Eye View Map Construction

A recent sensor fusion in a Bird's Eye View (BEV) space has shown its ut...
research
12/17/2020

Multi-Modal Depth Estimation Using Convolutional Neural Networks

This paper addresses the problem of dense depth predictions from sparse ...
research
03/28/2018

Motion Guided LIDAR-camera Autocalibration and Accelerated Depth Super Resolution

In this work we propose a novel motion guided method for automatic and t...
research
03/23/2023

Collaboration Helps Camera Overtake LiDAR in 3D Detection

Camera-only 3D detection provides an economical solution with a simple c...
research
11/21/2017

Towards Stable Adversarial Feature Learning for LiDAR based Loop Closure Detection

Stable feature extraction is the key for the Loop closure detection (LCD...
research
05/27/2021

Avancee-1 Mission and SaDoD Method: LiDAR-based stimulated atomic disintegration of space debris (SaDoD) using Optical Neural Networks

The surface degradation of satellites in Low Earth Orbit (LEO) is affect...

Please sign up or login with your details

Forgot password? Click here to reset