A Perturbation Constrained Adversarial Attack for Evaluating the Robustness of Optical Flow

03/24/2022
by   Jenny Schmalfuss, et al.
0

Recent optical flow methods are almost exclusively judged in terms of accuracy, while analyzing their robustness is often neglected. Although adversarial attacks offer a useful tool to perform such an analysis, current attacks on optical flow methods rather focus on real-world attacking scenarios than on a worst case robustness assessment. Hence, in this work, we propose a novel adversarial attack - the Perturbation Constrained Flow Attack (PCFA) - that emphasizes destructivity over applicability as a real-world attack. More precisely, PCFA is a global attack that optimizes adversarial perturbations to shift the predicted flow towards a specified target flow, while keeping the L2 norm of the perturbation below a chosen bound. Our experiments not only demonstrate PCFA's applicability in white- and black-box settings, but also show that it finds stronger adversarial samples for optical flow than previous attacking frameworks. Moreover, based on these strong samples, we provide the first common ranking of optical flow methods in the literature considering both prediction quality and adversarial robustness, indicating that high quality methods are not necessarily robust. Our source code will be publicly available.

READ FULL TEXT

page 1

page 6

page 10

page 16

page 18

page 19

research
11/16/2021

Consistent Semantic Attacks on Optical Flow

We present a novel approach for semantically targeted adversarial attack...
research
02/04/2023

CosPGD: a unified white-box adversarial attack for pixel-wise prediction tasks

While neural networks allow highly accurate predictions in many tasks, t...
research
10/20/2022

Attacking Motion Estimation with Adversarial Snow

Current adversarial attacks for motion estimation (optical flow) optimiz...
research
03/30/2021

What Causes Optical Flow Networks to be Vulnerable to Physical Adversarial Attacks

Recent work demonstrated the lack of robustness of optical flow networks...
research
05/11/2023

Distracting Downpour: Adversarial Weather Attacks for Motion Estimation

Current adversarial attacks on motion estimation, or optical flow, optim...
research
06/11/2020

Investigating Robustness of Adversarial Samples Detection for Automatic Speaker Verification

Recently adversarial attacks on automatic speaker verification (ASV) sys...
research
07/20/2022

Illusionary Attacks on Sequential Decision Makers and Countermeasures

Autonomous intelligent agents deployed to the real-world need to be robu...

Please sign up or login with your details

Forgot password? Click here to reset