Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentation

08/03/2021
by   Victor Besnier, et al.
3

In this paper, we tackle the detection of out-of-distribution (OOD) objects in semantic segmentation. By analyzing the literature, we found that current methods are either accurate or fast but not both which limits their usability in real world applications. To get the best of both aspects, we propose to mitigate the common shortcomings by following four design principles: decoupling the OOD detection from the segmentation task, observing the entire segmentation network instead of just its output, generating training data for the OOD detector by leveraging blind spots in the segmentation network and focusing the generated data on localized regions in the image to simulate OOD objects. Our main contribution is a new OOD detection architecture called ObsNet associated with a dedicated training scheme based on Local Adversarial Attacks (LAA). We validate the soundness of our approach across numerous ablation studies. We also show it obtains top performances both in speed and accuracy when compared to ten recent methods of the literature on three different datasets.

READ FULL TEXT

page 5

page 6

page 8

page 13

research
05/22/2023

Uncertainty-based Detection of Adversarial Attacks in Semantic Segmentation

State-of-the-art deep neural networks have proven to be highly powerful ...
research
10/06/2019

Unrestricted Adversarial Attacks for Semantic Segmentation

Semantic segmentation is one of the most impactful applications of machi...
research
06/22/2023

Robust Semantic Segmentation: Strong Adversarial Attacks and Fast Training of Robust Models

While a large amount of work has focused on designing adversarial attack...
research
09/02/2019

This is not what I imagined: Error Detection for Semantic Segmentation through Visual Dissimilarity

There has been a remarkable progress in the accuracy of semantic segment...
research
06/14/2022

Proximal Splitting Adversarial Attacks for Semantic Segmentation

Classification has been the focal point of research on adversarial attac...
research
11/29/2019

Indirect Local Attacks for Context-aware Semantic Segmentation Networks

Recently, deep networks have achieved impressive semantic segmentation p...
research
09/13/2022

Certified Defences Against Adversarial Patch Attacks on Semantic Segmentation

Adversarial patch attacks are an emerging security threat for real world...

Please sign up or login with your details

Forgot password? Click here to reset