Robust Semantic Segmentation: Strong Adversarial Attacks and Fast Training of Robust Models

06/22/2023
by   Francesco Croce, et al.
0

While a large amount of work has focused on designing adversarial attacks against image classifiers, only a few methods exist to attack semantic segmentation models. We show that attacking segmentation models presents task-specific challenges, for which we propose novel solutions. Our final evaluation protocol outperforms existing methods, and shows that those can overestimate the robustness of the models. Additionally, so far adversarial training, the most successful way for obtaining robust image classifiers, could not be successfully applied to semantic segmentation. We argue that this is because the task to be learned is more challenging, and requires significantly higher computational effort than for image classification. As a remedy, we show that by taking advantage of recent advances in robust ImageNet classifiers, one can train adversarially robust segmentation models at limited computational cost by fine-tuning robust backbones.

READ FULL TEXT

page 2

page 20

page 21

research
06/30/2021

Single-Step Adversarial Training for Semantic Segmentation

Even though deep neural networks succeed on many different tasks includi...
research
05/25/2023

PEARL: Preprocessing Enhanced Adversarial Robust Learning of Image Deraining for Semantic Segmentation

In light of the significant progress made in the development and applica...
research
09/13/2022

Certified Defences Against Adversarial Patch Attacks on Semantic Segmentation

Adversarial patch attacks are an emerging security threat for real world...
research
06/14/2022

Proximal Splitting Adversarial Attacks for Semantic Segmentation

Classification has been the focal point of research on adversarial attac...
research
04/03/2022

Adversarially robust segmentation models learn perceptually-aligned gradients

The effects of adversarial training on semantic segmentation networks ha...
research
08/03/2021

Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentation

In this paper, we tackle the detection of out-of-distribution (OOD) obje...
research
08/23/2021

SegMix: Co-occurrence Driven Mixup for Semantic Segmentation and Adversarial Robustness

In this paper, we present a strategy for training convolutional neural n...

Please sign up or login with your details

Forgot password? Click here to reset