Log In Sign Up

Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows

by   Marco Rudolph, et al.

The detection of manufacturing errors is crucial in fabrication processes to ensure product quality and safety standards. Since many defects occur very rarely and their characteristics are mostly unknown a priori, their detection is still an open research question. To this end, we propose DifferNet: It leverages the descriptiveness of features extracted by convolutional neural networks to estimate their density using normalizing flows. Normalizing flows are well-suited to deal with low dimensional data distributions. However, they struggle with the high dimensionality of images. Therefore, we employ a multi-scale feature extractor which enables the normalizing flow to assign meaningful likelihoods to the images. Based on these likelihoods we develop a scoring function that indicates defects. Moreover, propagating the score back to the image enables pixel-wise localization. To achieve a high robustness and performance we exploit multiple transformations in training and evaluation. In contrast to most other methods, ours does not require a large number of training samples and performs well with as low as 16 images. We demonstrate the superior performance over existing approaches on the challenging and newly proposed MVTec AD and Magnetic Tile Defects datasets.


page 1

page 5

page 8


Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection

In industrial manufacturing processes, errors frequently occur at unpred...

VQ-Flows: Vector Quantized Local Normalizing Flows

Normalizing flows provide an elegant approach to generative modeling tha...

Computer Vision and Normalizing Flow Based Defect Detection

Surface defect detection is essential and necessary for controlling the ...

Tooth Instance Segmentation from Cone-Beam CT Images through Point-based Detection and Gaussian Disentanglement

Individual tooth segmentation and identification from cone-beam computed...

Gaussianization Flows

Iterative Gaussianization is a fixed-point iteration procedure that can ...

Semi-Supervised Building Footprint Generation with Feature and Output Consistency Training

Accurate and reliable building footprint maps are vital to urban plannin...