AUTO: Adaptive Outlier Optimization for Online Test-Time OOD Detection

03/22/2023
by   Puning Yang, et al.
0

Out-of-distribution (OOD) detection is a crucial aspect of deploying machine learning models in open-world applications. Empirical evidence suggests that training with auxiliary outliers substantially improves OOD detection. However, such outliers typically exhibit a distribution gap compared to the test OOD data and do not cover all possible test OOD scenarios. Additionally, incorporating these outliers introduces additional training burdens. In this paper, we introduce a novel paradigm called test-time OOD detection, which utilizes unlabeled online data directly at test time to improve OOD detection performance. While this paradigm is efficient, it also presents challenges such as catastrophic forgetting. To address these challenges, we propose adaptive outlier optimization (AUTO), which consists of an in-out-aware filter, an ID memory bank, and a semantically-consistent objective. AUTO adaptively mines pseudo-ID and pseudo-OOD samples from test data, utilizing them to optimize networks in real time during inference. Extensive results on CIFAR-10, CIFAR-100, and ImageNet benchmarks demonstrate that AUTO significantly enhances OOD detection performance.

READ FULL TEXT
research
07/18/2023

Towards Trustworthy Dataset Distillation

Efficiency and trustworthiness are two eternal pursuits when applying de...
research
06/28/2022

POEM: Out-of-Distribution Detection with Posterior Sampling

Out-of-distribution (OOD) detection is indispensable for machine learnin...
research
12/10/2020

Learn what you can't learn: Regularized Ensembles for Transductive Out-of-distribution Detection

Machine learning models are often used in practice if they achieve good ...
research
02/07/2022

Training OOD Detectors in their Natural Habitats

Out-of-distribution (OOD) detection is important for machine learning mo...
research
04/06/2022

Efficient Test-Time Model Adaptation without Forgetting

Test-time adaptation (TTA) seeks to tackle potential distribution shifts...
research
11/24/2020

Lethean Attack: An Online Data Poisoning Technique

Data poisoning is an adversarial scenario where an attacker feeds a spec...
research
12/01/2021

Provable Guarantees for Understanding Out-of-distribution Detection

Out-of-distribution (OOD) detection is important for deploying machine l...

Please sign up or login with your details

Forgot password? Click here to reset