Why Normalizing Flows Fail to Detect Out-of-Distribution Data

06/15/2020
by   Polina Kirichenko, et al.
13

Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distribution data: a flow trained on pictures of clothing assigns higher likelihood to handwritten digits. We investigate why normalizing flows perform poorly for OOD detection. We demonstrate that flows learn local pixel correlations and generic image-to-latent-space transformations which are not specific to the target image dataset. We show that by modifying the architecture of flow coupling layers we can bias the flow towards learning the semantic structure of the target data, improving OOD detection. Our investigation reveals that properties that enable flows to generate high-fidelity images can have a detrimental effect on OOD detection.

READ FULL TEXT

page 20

page 21

page 23

page 24

page 26

06/10/2021

InFlow: Robust outlier detection utilizing Normalizing Flows

Normalizing flows are prominent deep generative models that provide trac...
06/17/2019

Normalizing flows for novelty detection in industrial time series data

Flow-based deep generative models learn data distributions by transformi...
12/03/2020

Integrable Nonparametric Flows

We introduce a method for reconstructing an infinitesimal normalizing fl...
02/02/2021

Low-Rate Overuse Flow Tracer (LOFT): An Efficient and Scalable Algorithm for Detecting Overuse Flows

Current probabilistic flow-size monitoring can only detect heavy hitters...
03/23/2021

Out-of-Distribution Detection of Melanoma using Normalizing Flows

Generative modelling has been a topic at the forefront of machine learni...
08/27/2022

Improving debris flow evacuation alerts in Taiwan using machine learning

Taiwan has the highest susceptibility to and fatalities from debris flow...
08/28/2020

Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows

The detection of manufacturing errors is crucial in fabrication processe...

Code Repositories

Glow-OOD-Exp

Glow model implementation


view repo

Deep-Generative-Models

Deep Generative Models that I have implemented, trained and experimented with.


view repo