DeepAI AI Chat
Log In Sign Up

LiDAR Sensor modeling and Data augmentation with GANs for Autonomous driving

by   Ahmad El Sallab, et al.

In the autonomous driving domain, data collection and annotation from real vehicles are expensive and sometimes unsafe. Simulators are often used for data augmentation, which requires realistic sensor models that are hard to formulate and model in closed forms. Instead, sensors models can be learned from real data. The main challenge is the absence of paired data set, which makes traditional supervised learning techniques not suitable. In this work, we formulate the problem as image translation from unpaired data and employ CycleGANs to solve the sensor modeling problem for LiDAR, to produce realistic LiDAR from simulated LiDAR (sim2real). Further, we generate high-resolution, realistic LiDAR from lower resolution one (real2real). The LiDAR 3D point cloud is processed in Bird-eye View and Polar 2D representations. The experimental results show a high potential of the proposed approach.


page 4

page 5


Unsupervised Neural Sensor Models for Synthetic LiDAR Data Augmentation

Data scarcity is a bottleneck to machine learning-based perception modul...

A Lightweight Machine Learning Pipeline for LiDAR-simulation

Virtual testing is a crucial task to ensure safety in autonomous driving...

End-to-end sensor modeling for LiDAR Point Cloud

Advanced sensors are a key to enable self-driving cars technology. Laser...

Domain Adaptation for Vehicle Detection from Bird's Eye View LiDAR Point Cloud Data

Point cloud data from 3D LiDAR sensors are one of the most crucial senso...

Simulation-based Lidar Super-resolution for Ground Vehicles

We propose a methodology for lidar super-resolution with ground vehicles...

Recovering and Simulating Pedestrians in the Wild

Sensor simulation is a key component for testing the performance of self...

Autonomous Driving without a Burden: View from Outside with Elevated LiDAR

The current autonomous driving architecture places a heavy burden in sig...