CosPGD: a unified white-box adversarial attack for pixel-wise prediction tasks

02/04/2023
by   Shashank Agnihotri, et al.
0

While neural networks allow highly accurate predictions in many tasks, their lack in robustness towards even slight input perturbations hampers their deployment in many real-world applications. Recent research towards evaluating the robustness of neural networks such as the seminal projected gradient descent (PGD) attack and subsequent works and benchmarks have therefore drawn significant attention. Yet, such methods focus predominantly on classification tasks, while only a few approaches specifically address the analysis of pixel-wise prediction tasks such as semantic segmentation, optical flow, or disparity estimation. One notable exception is the recently proposed SegPGD attack, which could showcase the importance of pixel-wise attacks for evaluating semantic segmentation. While SegPGD is limited to pixel-wise classification (i.e. segmentation), in this work, we propose CosPGD, a novel white-box adversarial attack that allows to optimize dedicated attacks for any pixel-wise prediction task in a unified setting. It leverages the cosine similarity between the predictions and ground truth to extend directly from classification tasks to regression settings. Further, we empirically show the superior performance of CosPGD for semantic segmentation as well as for optical flow and disparity estimation.

READ FULL TEXT

page 1

page 6

page 7

research
03/24/2022

A Perturbation Constrained Adversarial Attack for Evaluating the Robustness of Optical Flow

Recent optical flow methods are almost exclusively judged in terms of ac...
research
11/16/2021

Consistent Semantic Attacks on Optical Flow

We present a novel approach for semantically targeted adversarial attack...
research
07/25/2023

On the unreasonable vulnerability of transformers for image restoration – and an easy fix

Following their success in visual recognition tasks, Vision Transformers...
research
11/29/2019

Indirect Local Attacks for Context-aware Semantic Segmentation Networks

Recently, deep networks have achieved impressive semantic segmentation p...
research
03/27/2018

Three Birds One Stone: A Unified Framework for Salient Object Segmentation, Edge Detection and Skeleton Extraction

In this paper, we aim at solving pixel-wise binary problems, including s...
research
08/31/2018

A Unified Mammogram Analysis Method via Hybrid Deep Supervision

Automatic mammogram classification and mass segmentation play a critical...

Please sign up or login with your details

Forgot password? Click here to reset