They See Me Rollin': Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensors

01/25/2021
by   Sebastian Köhler, et al.
4

Cameras have become a fundamental component of vision-based intelligent systems. As a balance between production costs and image quality, most modern cameras use Complementary Metal-Oxide Semiconductor image sensors that implement an electronic rolling shutter mechanism, where image rows are captured consecutively rather than all-at-once. In this paper, we describe how the electronic rolling shutter can be exploited using a bright, modulated light source (e.g., an inexpensive, off-the-shelf laser), to inject fine-grained image disruptions. These disruptions substantially affect camera-based computer vision systems, where high-frequency data is crucial in extracting informative features from objects. We study the fundamental factors affecting a rolling shutter attack, such as environmental conditions, angle of the incident light, laser to camera distance, and aiming precision. We demonstrate how these factors affect the intensity of the injected distortion and how an adversary can take them into account by modeling the properties of the camera. We introduce a general pipeline of a practical attack, which consists of: (i) profiling several properties of the target camera and (ii) partially simulating the attack to find distortions that satisfy the adversary's goal. Then, we instantiate the attack to the scenario of object detection, where the adversary's goal is to maximally disrupt the detection of objects in the image. We show that the adversary can modulate the laser to hide up to 75 state-of-the-art detectors while controlling the amount of perturbation to keep the attack inconspicuous. Our results indicate that rolling shutter attacks can substantially reduce the performance and reliability of vision-based intelligent systems.

READ FULL TEXT

page 1

page 2

page 10

page 17

research
08/19/2021

Signal Injection Attacks against CCD Image Sensors

Since cameras have become a crucial part in many safety-critical systems...
research
01/21/2020

GhostImage: Perception Domain Attacks against Vision-based Object Classification Systems

In vision-based object classification systems, imaging sensors perceive ...
research
04/17/2020

Robotic Room Traversal using Optical Range Finding

Consider the goal of visiting every part of a room that is not blocked b...
research
03/02/2023

AdvRain: Adversarial Raindrops to Attack Camera-based Smart Vision Systems

Vision-based perception modules are increasingly deployed in many applic...
research
04/06/2022

Rolling Colors: Adversarial Laser Exploits against Traffic Light Recognition

Traffic light recognition is essential for fully autonomous driving in u...
research
12/20/2020

Enabling Tangible Interaction through Detection and Augmentation of Everyday Objects

Digital interaction with everyday objects has become popular since the p...
research
03/07/2022

Using Statistical Models to Detect Occupancy in Buildings through Monitoring VOC, CO_2, and other Environmental Factors

Dynamic models of occupancy patterns have shown to be effective in optim...

Please sign up or login with your details

Forgot password? Click here to reset