DeepAI
Log In Sign Up

Multi-task Transformation Learning for Robust Out-of-Distribution Detection

06/07/2021
by   Sina Mohseni, et al.
0

Detecting out-of-distribution (OOD) samples plays a key role in open-world and safety-critical applications such as autonomous systems and healthcare. Self-supervised representation learning techniques (e.g., contrastive learning and pretext learning) are well suited for learning representation that can identify OOD samples. In this paper, we propose a simple framework that leverages multi-task transformation learning for training effective representation for OOD detection which outperforms state-of-the-art OOD detection performance and robustness on several image datasets. We empirically observe that the OOD performance depends on the choice of data transformations which itself depends on the in-domain training set. To address this problem, we propose a simple mechanism for selecting the transformations automatically and modulate their effect on representation learning without requiring any OOD training samples. We characterize the criteria for a desirable OOD detector for real-world applications and demonstrate the efficacy of our proposed technique against a diverse range of the state-of-the-art OOD detection techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/11/2021

Robust Representation Learning via Perceptual Similarity Metrics

A fundamental challenge in artificial intelligence is learning useful re...
04/06/2022

RODD: A Self-Supervised Approach for Robust Out-of-Distribution Detection

Recent studies have addressed the concern of detecting and rejecting the...
03/21/2020

NeuCrowd: Neural Sampling Network for Representation Learning with Crowdsourced Labels

Representation learning approaches require a massive amount of discrimin...
01/17/2022

Self-Supervised Anomaly Detection by Self-Distillation and Negative Sampling

Detecting whether examples belong to a given in-distribution or are Out-...
04/23/2021

Lightweight Detection of Out-of-Distribution and Adversarial Samples via Channel Mean Discrepancy

Detecting out-of-distribution (OOD) and adversarial samples is essential...
02/17/2022

Survey on Self-supervised Representation Learning Using Image Transformations

Deep neural networks need huge amount of training data, while in real wo...
11/03/2020

Out-of-Distribution Detection for Automotive Perception

Neural networks (NNs) are widely used for object recognition tasks in au...