Balanced Energy Regularization Loss for Out-of-distribution Detection

06/18/2023
by   Hyunjun Choi, et al.
0

In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/hyunjunChhoi/Balanced_Energy.

READ FULL TEXT
research
10/06/2021

Long-tailed Distribution Adaptation

Recognizing images with long-tailed distributions remains a challenging ...
research
08/22/2022

Towards Calibrated Hyper-Sphere Representation via Distribution Overlap Coefficient for Long-tailed Learning

Long-tailed learning aims to tackle the crucial challenge that head clas...
research
07/19/2022

Invariant Feature Learning for Generalized Long-Tailed Classification

Existing long-tailed classification (LT) methods only focus on tackling ...
research
02/25/2020

Relevant-features based Auxiliary Cells for Energy Efficient Detection of Natural Errors

Deep neural networks have demonstrated state-of-the-art performance on m...
research
08/13/2021

Effective semantic segmentation in Cataract Surgery: What matters most?

Our work proposes neural network design choices that set the state-of-th...
research
12/30/2022

Delving into Semantic Scale Imbalance

Model bias triggered by long-tailed data has been widely studied. Howeve...
research
08/19/2023

DatasetEquity: Are All Samples Created Equal? In The Quest For Equity Within Datasets

Data imbalance is a well-known issue in the field of machine learning, a...

Please sign up or login with your details

Forgot password? Click here to reset