Optimal Smoothing Distribution Exploration for Backdoor Neutralization in Deep Learning-based Traffic Systems

03/24/2023
by   Yue Wang, et al.
0

Deep Reinforcement Learning (DRL) enhances the efficiency of Autonomous Vehicles (AV), but also makes them susceptible to backdoor attacks that can result in traffic congestion or collisions. Backdoor functionality is typically incorporated by contaminating training datasets with covert malicious data to maintain high precision on genuine inputs while inducing the desired (malicious) outputs for specific inputs chosen by adversaries. Current defenses against backdoors mainly focus on image classification using image-based features, which cannot be readily transferred to the regression task of DRL-based AV controllers since the inputs are continuous sensor data, i.e., the combinations of velocity and distance of AV and its surrounding vehicles. Our proposed method adds well-designed noise to the input to neutralize backdoors. The approach involves learning an optimal smoothing (noise) distribution to preserve the normal functionality of genuine inputs while neutralizing backdoors. By doing so, the resulting model is expected to be more resilient against backdoor attacks while maintaining high accuracy on genuine inputs. The effectiveness of the proposed method is verified on a simulated traffic system based on a microscopic traffic simulator, where experimental results showcase that the smoothed traffic controller can neutralize all trigger samples and maintain the performance of relieving traffic congestion

READ FULL TEXT

page 1

page 4

page 5

page 6

research
03/17/2020

Watch your back: Backdoor Attacks in Deep Reinforcement Learning-based Autonomous Vehicle Control Systems

Autonomous Vehicles (AVs) with Deep Reinforcement Learning (DRL)-based c...
research
06/28/2022

Traffic Management of Autonomous Vehicles using Policy Based Deep Reinforcement Learning and Intelligent Routing

Deep Reinforcement Learning (DRL) uses diverse, unstructured data and ma...
research
05/28/2021

Towards a Very Large Scale Traffic Simulator for Multi-Agent Reinforcement Learning Testbeds

Smart traffic control and management become an emerging application for ...
research
06/24/2022

Dynamic network congestion pricing based on deep reinforcement learning

Traffic congestion is a serious problem in urban areas. Dynamic congesti...
research
08/23/2023

BaDExpert: Extracting Backdoor Functionality for Accurate Backdoor Input Detection

We present a novel defense, against backdoor attacks on Deep Neural Netw...

Please sign up or login with your details

Forgot password? Click here to reset