DoubleStar: Long-Range Attack Towards Depth Estimation based Obstacle Avoidance in Autonomous Systems

10/07/2021
by   Ce Zhou, et al.
4

Depth estimation-based obstacle avoidance has been widely adopted by autonomous systems (drones and vehicles) for safety purpose. It normally relies on a stereo camera to automatically detect obstacles and make flying/driving decisions, e.g., stopping several meters ahead of the obstacle in the path or moving away from the detected obstacle. In this paper, we explore new security risks associated with the stereo vision-based depth estimation algorithms used for obstacle avoidance. By exploiting the weaknesses of the stereo matching in depth estimation algorithms and the lens flare effect in optical imaging, we propose DoubleStar, a long-range attack that injects fake obstacle depth by projecting pure light from two complementary light sources. DoubleStar includes two distinctive attack formats: beams attack and orbs attack, which leverage projected light beams and lens flare orbs respectively to cause false depth perception. We successfully attack two commercial stereo cameras designed for autonomous systems (ZED and Intel RealSense). The visualization of fake depth perceived by the stereo cameras illustrates the false stereo matching induced by DoubleStar. We further use Ardupilot to simulate the attack and demonstrate its impact on drones. To validate the attack on real systems, we perform a real-world attack towards a commercial drone equipped with state-of-the-art obstacle avoidance algorithms. Our attack can continuously bring a flying drone to a sudden stop or drift it away across a long distance under various lighting conditions, even bypassing sensor fusion mechanisms. Specifically, our experimental results show that DoubleStar creates fake depth up to 15 meters in distance at night and up to 8 meters during the daytime. To mitigate this newly discovered threat, we provide discussions on potential countermeasures to defend against DoubleStar.

READ FULL TEXT

page 1

page 4

page 8

page 9

page 10

page 13

page 19

research
05/11/2017

Obstacle Avoidance Using Stereo Camera

In this paper we present a novel method for obstacle avoidance using the...
research
07/07/2023

Depth Estimation Analysis of Orthogonally Divergent Fisheye Cameras with Distortion Removal

Stereo vision systems have become popular in computer vision application...
research
10/29/2020

Night vision obstacle detection and avoidance based on Bio-Inspired Vision Sensors

Moving towards autonomy, unmanned vehicles rely heavily on state-of-the-...
research
10/21/2022

Context-Enhanced Stereo Transformer

Stereo depth estimation is of great interest for computer vision researc...
research
10/18/2020

Real-time Quadrotor Navigation Through Planning in Depth Space in Unstructured Environments

This paper addresses the problem of real-time vision-based autonomous ob...
research
01/15/2020

Correcting Decalibration of Stereo Cameras in Self-Driving Vehicles

We address the problem of optical decalibration in mobile stereo camera ...
research
01/21/2020

GhostImage: Perception Domain Attacks against Vision-based Object Classification Systems

In vision-based object classification systems, imaging sensors perceive ...

Please sign up or login with your details

Forgot password? Click here to reset