Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weather

08/11/2021
by   Martin Hahner, et al.
7

This work addresses the challenging task of LiDAR-based 3D object detection in foggy weather. Collecting and annotating data in such a scenario is very time, labor and cost intensive. In this paper, we tackle this problem by simulating physically accurate fog into clear-weather scenes, so that the abundant existing real datasets captured in clear weather can be repurposed for our task. Our contributions are twofold: 1) We develop a physically valid fog simulation method that is applicable to any LiDAR dataset. This unleashes the acquisition of large-scale foggy training data at no extra cost. These partially synthetic data can be used to improve the robustness of several perception methods, such as 3D object detection and tracking or simultaneous localization and mapping, on real foggy data. 2) Through extensive experiments with several state-of-the-art detection approaches, we show that our fog simulation can be leveraged to significantly improve the performance for 3D object detection in the presence of fog. Thus, we are the first to provide strong 3D object detection baselines on the Seeing Through Fog dataset. Our code is available at www.trace.ethz.ch/lidar_fog_simulation.

READ FULL TEXT

page 1

page 2

page 6

page 8

research
03/28/2022

LiDAR Snowfall Simulation for Robust 3D Object Detection

3D object detection is a central task for applications such as autonomou...
research
12/06/2019

A Benchmark for Lidar Sensors in Fog: Is Detection Breaking Down?

Autonomous driving at level five does not only means self-driving in the...
research
08/27/2019

Physics-Based Rendering for Improving Robustness to Rain

To improve the robustness to rain, we present a physically-based rain re...
research
03/14/2020

What happens for a ToF LiDAR in fog?

This article focuses on analyzing the performance of a typical time-of-f...
research
05/15/2023

t-RAIN: Robust generalization under weather-aliasing label shift attacks

In the classical supervised learning settings, classifiers are fit with ...
research
02/24/2019

Seeing Through Fog Without Seeing Fog: Deep Sensor Fusion in the Absence of Labeled Training Data

The fusion of color and lidar data plays a critical role in object detec...
research
05/04/2022

Dual Branch Neural Network for Sea Fog Detection in Geostationary Ocean Color Imager

Sea fog significantly threatens the safety of maritime activities. This ...

Please sign up or login with your details

Forgot password? Click here to reset