Online Adversarial Purification based on Self-Supervision

01/23/2021
by   Changhao Shi, et al.
5

Deep neural networks are known to be vulnerable to adversarial examples, where a perturbation in the input space leads to an amplified shift in the latent network representation. In this paper, we combine canonical supervised learning with self-supervised representation learning, and present Self-supervised Online Adversarial Purification (SOAP), a novel defense strategy that uses a self-supervised loss to purify adversarial examples at test-time. Our approach leverages the label-independent nature of self-supervised signals and counters the adversarial perturbation with respect to the self-supervised tasks. SOAP yields competitive robust accuracy against state-of-the-art adversarial training and purification methods, with considerably less training complexity. In addition, our approach is robust even when adversaries are given knowledge of the purification defense strategy. To the best of our knowledge, our paper is the first that generalizes the idea of using self-supervised signals to perform online test-time purification.

READ FULL TEXT

page 5

page 8

page 14

page 15

research
11/15/2019

Self-supervised Adversarial Training

Recent work has demonstrated that neural networks are vulnerable to adve...
research
08/31/2022

Be Your Own Neighborhood: Detecting Adversarial Example by the Neighborhood Relations Built on Self-Supervised Learning

Deep Neural Networks (DNNs) have achieved excellent performance in vario...
research
03/15/2022

Task-Agnostic Robust Representation Learning

It has been reported that deep learning models are extremely vulnerable ...
research
04/22/2021

Self-Supervised Learning from Semantically Imprecise Data

Learning from imprecise labels such as "animal" or "bird", but making pr...
research
05/27/2019

Evolving Self-supervised Neural Networks: Autonomous Intelligence from Evolved Self-teaching

This paper presents a technique called evolving self-supervised neural n...
research
05/18/2022

TTAPS: Test-Time Adaption by Aligning Prototypes using Self-Supervision

Nowadays, deep neural networks outperform humans in many tasks. However,...
research
02/22/2019

Learning about an exponential amount of conditional distributions

We introduce the Neural Conditioner (NC), a self-supervised machine able...

Please sign up or login with your details

Forgot password? Click here to reset