Unmasking Anomalies in Road-Scene Segmentation

07/25/2023
by   Shyam Nandan Rai, et al.
0

Anomaly segmentation is a critical task for driving applications, and it is approached traditionally as a per-pixel classification problem. However, reasoning individually about each pixel without considering their contextual semantics results in high uncertainty around the objects' boundaries and numerous false positives. We propose a paradigm change by shifting from a per-pixel classification to a mask classification. Our mask-based method, Mask2Anomaly, demonstrates the feasibility of integrating an anomaly detection method in a mask-classification architecture. Mask2Anomaly includes several technical novelties that are designed to improve the detection of anomalies in masks: i) a global masked attention module to focus individually on the foreground and background regions; ii) a mask contrastive learning that maximizes the margin between an anomaly and known classes; and iii) a mask refinement solution to reduce false positives. Mask2Anomaly achieves new state-of-the-art results across a range of benchmarks, both in the per-pixel and component-level evaluations. In particular, Mask2Anomaly reduces the average false positives rate by 60 page: https://github.com/shyam671/Mask2Anomaly-Unmasking-Anomalies-in-Road-Scene-Segmentation.

READ FULL TEXT

page 3

page 6

page 7

page 15

page 16

page 17

page 18

page 19

research
09/08/2023

Mask2Anomaly: Mask Transformer for Universal Open-set Segmentation

Segmenting unknown or anomalous object instances is a critical task in a...
research
07/13/2021

Per-Pixel Classification is Not All You Need for Semantic Segmentation

Modern approaches typically formulate semantic segmentation as a per-pix...
research
02/15/2022

Few-shot semantic segmentation via mask aggregation

Few-shot semantic segmentation aims to recognize novel classes with only...
research
08/30/2017

Incorporating Feedback into Tree-based Anomaly Detection

Anomaly detectors are often used to produce a ranked list of statistical...
research
01/09/2023

On advantages of Mask-level Recognition for Open-set Segmentation in the Wild

Most dense recognition methods bring a separate decision in each particu...
research
08/03/2023

UGainS: Uncertainty Guided Anomaly Instance Segmentation

A single unexpected object on the road can cause an accident or may lead...
research
05/15/2018

Vision-based Automated Bridge Component Recognition Integrated With High-level Scene Understanding

Image data has a great potential of helping conventional visual inspecti...

Please sign up or login with your details

Forgot password? Click here to reset