Detecting Safety Problems of Multi-Sensor Fusion in Autonomous Driving

09/14/2021
by   Ziyuan Zhong, et al.
0

Autonomous driving (AD) systems have been thriving in recent years. In general, they receive sensor data, compute driving decisions, and output control signals to the vehicles. To smooth out the uncertainties brought by sensor inputs, AD systems usually leverage multi-sensor fusion (MSF) to fuse the sensor inputs and produce a more reliable understanding of the surroundings. However, MSF cannot completely eliminate the uncertainties since it lacks the knowledge about which sensor provides the most accurate data. As a result, critical consequences might happen unexpectedly. In this work, we observed that the popular MSF methods in an industry-grade Advanced Driver-Assistance System (ADAS) can mislead the car control and result in serious safety hazards. Misbehavior can happen regardless of the used fusion methods and the accurate data from at least one sensor. To attribute the safety hazards to a MSF method, we formally define the fusion errors and propose a way to distinguish safety violations causally induced by such errors. Further, we develop a novel evolutionary-based domain-specific search framework, FusionFuzz, for the efficient detection of fusion errors. We evaluate our framework on two widely used MSF methods. Experimental results show that FusionFuzz identifies more than 150 fusion errors. Finally, we provide several suggestions to improve the MSF methods under study.

READ FULL TEXT

page 3

page 4

page 6

page 7

research
02/22/2023

Transformer-Based Sensor Fusion for Autonomous Driving: A Survey

Sensor fusion is an essential topic in many perception systems, such as ...
research
07/28/2022

Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer

Large-scale deployment of autonomous vehicles has been continually delay...
research
06/17/2021

Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks

In Autonomous Driving (AD) systems, perception is both security and safe...
research
02/12/2019

Towards Self-Supervised High Level Sensor Fusion

In this paper, we present a framework to control a self-driving car by f...
research
07/13/2023

NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception

Multi-agent multi-lidar sensor fusion between connected vehicles for coo...
research
03/20/2022

FUTR3D: A Unified Sensor Fusion Framework for 3D Detection

Sensor fusion is an essential topic in many perception systems, such as ...
research
08/23/2023

Bayesian Learning for Dynamic Target Localization with Human-provided Spatial Information

This paper considers a human-autonomy collaborative sensor data fusion f...

Please sign up or login with your details

Forgot password? Click here to reset