Attacking Compressed Vision Transformers

09/28/2022
by   Swapnil Parekh, et al.
7

Vision Transformers are increasingly embedded in industrial systems due to their superior performance, but their memory and power requirements make deploying them to edge devices a challenging task. Hence, model compression techniques are now widely used to deploy models on edge devices as they decrease the resource requirements and make model inference very fast and efficient. But their reliability and robustness from a security perspective is another major issue in safety-critical applications. Adversarial attacks are like optical illusions for ML algorithms and they can severely impact the accuracy and reliability of models. In this work we investigate the transferability of adversarial samples across the SOTA Vision Transformer models across 3 SOTA compressed versions and infer the effects different compression techniques have on adversarial attacks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2023

Adversarial Attacks on Machine Learning in Embedded and IoT Platforms

Machine learning (ML) algorithms are increasingly being integrated into ...
research
09/29/2018

To compress or not to compress: Understanding the Interactions between Adversarial Attacks and Neural Network Compression

As deep neural networks (DNNs) become widely used, pruned and quantised ...
research
03/22/2021

Tiny Transformers for Environmental Sound Classification at the Edge

With the growth of the Internet of Things and the rise of Big Data, data...
research
08/01/2022

Understanding Adversarial Robustness of Vision Transformers via Cauchy Problem

Recent research on the robustness of deep learning has shown that Vision...
research
06/16/2022

Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Survey

Adversarial attacks in deep learning models, especially for safety-criti...
research
11/19/2018

Heterogeneous Reliability Modes with Efficient State Compression for Out-of-Order Superscalar Processors

Reliability has emerged as a key topic of interest for researchers aroun...
research
08/23/2022

A Comprehensive Study of Real-Time Object Detection Networks Across Multiple Domains: A Survey

Deep neural network based object detectors are continuously evolving and...

Please sign up or login with your details

Forgot password? Click here to reset