DeepAI AI Chat
Log In Sign Up

Fooling Detection Alone is Not Enough: First Adversarial Attack against Multiple Object Tracking

by   Yunhan Jia, et al.
University of California, Irvine
Baidu, Inc.

Recent work in adversarial machine learning started to focus on the visual perception in autonomous driving and studied Adversarial Examples (AEs) for object detection models. However, in such visual perception pipeline the detected objects must also be tracked, in a process called Multiple Object Tracking (MOT), to build the moving trajectories of surrounding obstacles. Since MOT is designed to be robust against errors in object detection, it poses a general challenge to existing attack techniques that blindly target objection detection: we find that a success rate of over 98 actually affect the tracking results, a requirement that no existing attack technique can satisfy. In this paper, we are the first to study adversarial machine learning attacks against the complete visual perception pipeline in autonomous driving, and discover a novel attack technique, tracker hijacking, that can effectively fool MOT using AEs on object detection. Using our technique, successful AEs on as few as one single frame can move an existing object in to or out of the headway of an autonomous vehicle to cause potential safety hazards. We perform evaluation using the Berkeley Deep Drive dataset and find that on average when 3 frames are attacked, our attack can have a nearly 100 up to 25


page 4

page 6


TraSw: Tracklet-Switch Adversarial Attacks against Multi-Object Tracking

Benefiting from the development of Deep Neural Networks, Multi-Object Tr...

3D Object Detection for Autonomous Driving: A Review and New Outlooks

Autonomous driving, in recent years, has been receiving increasing atten...

Automated Driving Systems Data Acquisition and Processing Platform

This paper presents an automated driving system (ADS) data acquisition a...

Few-Shot Backdoor Attacks on Visual Object Tracking

Visual object tracking (VOT) has been widely adopted in mission-critical...

Confidence Trigger Detection: An Approach to Build Real-time Tracking-by-detection System

With deep learning based image analysis getting popular in recent years,...

It's Raining Cats or Dogs? Adversarial Rain Attack on DNN Perception

Rain is a common phenomenon in nature and an essential factor for many d...

DG-Labeler and DGL-MOTS Dataset: Boost the Autonomous Driving Perception

Multi-object tracking and segmentation (MOTS) is a critical task for aut...