Masked Transformer for image Anomaly Localization

10/27/2022
by   Axel De Nardin, et al.
0

Image anomaly detection consists in detecting images or image portions that are visually different from the majority of the samples in a dataset. The task is of practical importance for various real-life applications like biomedical image analysis, visual inspection in industrial production, banking, traffic management, etc. Most of the current deep learning approaches rely on image reconstruction: the input image is projected in some latent space and then reconstructed, assuming that the network (mostly trained on normal data) will not be able to reconstruct the anomalous portions. However, this assumption does not always hold. We thus propose a new model based on the Vision Transformer architecture with patch masking: the input image is split in several patches, and each patch is reconstructed only from the surrounding data, thus ignoring the potentially anomalous information contained in the patch itself. We then show that multi-resolution patches and their collective embeddings provide a large improvement in the model's performance compared to the exclusive use of the traditional square patches. The proposed model has been tested on popular anomaly detection datasets such as MVTec and head CT and achieved good results when compared to other state-of-the-art approaches.

READ FULL TEXT

page 6

page 7

page 8

page 9

page 13

research
04/20/2021

VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localization

We present a transformer-based image anomaly detection and localization ...
research
04/28/2021

Inpainting Transformer for Anomaly Detection

Anomaly detection in computer vision is the task of identifying images w...
research
07/04/2023

Anomaly detection in image or latent space of patch-based auto-encoders for industrial image analysis

We study several methods for detecting anomalies in color images, constr...
research
07/20/2022

Unsupervised Industrial Anomaly Detection via Pattern Generative and Contrastive Networks

It is hard to collect enough flaw images for training deep learning netw...
research
10/29/2021

PEDENet: Image Anomaly Localization via Patch Embedding and Density Estimation

A neural network targeting at unsupervised image anomaly localization, c...
research
11/22/2022

Image Anomaly Detection and Localization with Position and Neighborhood Information

Anomaly detection and localization are essential in many areas, where co...
research
06/30/2021

One-class Steel Detector Using Patch GAN Discriminator for Visualising Anomalous Feature Map

For steel product manufacturing in indoor factories, steel defect detect...

Please sign up or login with your details

Forgot password? Click here to reset