Energy-based Detection of Adverse Weather Effects in LiDAR Data

05/25/2023
by   Aldi Piroli, et al.
0

Autonomous vehicles rely on LiDAR sensors to perceive the environment. Adverse weather conditions like rain, snow, and fog negatively affect these sensors, reducing their reliability by introducing unwanted noise in the measurements. In this work, we tackle this problem by proposing a novel approach for detecting adverse weather effects in LiDAR data. We reformulate this problem as an outlier detection task and use an energy-based framework to detect outliers in point clouds. More specifically, our method learns to associate low energy scores with inlier points and high energy scores with outliers allowing for robust detection of adverse weather effects. In extensive experiments, we show that our method performs better in adverse weather detection and has higher robustness to unseen weather effects than previous state-of-the-art methods. Furthermore, we show how our method can be used to perform simultaneous outlier detection and semantic segmentation. Finally, to help expand the research field of LiDAR perception in adverse weather, we release the SemanticSpray dataset, which contains labeled vehicle spray data in highway-like scenarios. The dataset is available at http://dx.doi.org/10.18725/OPARU-48815 .

READ FULL TEXT
research
07/11/2022

Detection of Condensed Vehicle Gas Exhaust in LiDAR Point Clouds

LiDAR sensors used in autonomous driving applications are negatively aff...
research
03/26/2022

How Do We Fail? Stress Testing Perception in Autonomous Vehicles

Autonomous vehicles (AVs) rely on environment perception and behavior pr...
research
09/15/2021

DSOR: A Scalable Statistical Filter for Removing Falling Snow from LiDAR Point Clouds in Severe Winter Weather

For autonomous vehicles to viably replace human drivers they must conten...
research
07/14/2021

Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection

Lidar-based object detectors are critical parts of the 3D perception pip...
research
09/04/2021

RiWNet: A moving object instance segmentation Network being Robust in adverse Weather conditions

Segmenting each moving object instance in a scene is essential for many ...
research
05/24/2022

Robust 3D Object Detection in Cold Weather Conditions

Adverse weather conditions can negatively affect LiDAR-based object dete...
research
04/03/2023

3D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Clouds

Robust point cloud parsing under all-weather conditions is crucial to le...

Please sign up or login with your details

Forgot password? Click here to reset