DeepAI AI Chat
Log In Sign Up

Using Semantic Information for Defining and Detecting OOD Inputs

by   Ramneet Kaur, et al.

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose their ability to function effectively on out-of-distribution inputs. Thus, out-of-distribution (OOD) detection has received some attention recently. In the vast majority of cases, it uses the distribution estimated by the training dataset for OOD detection. We demonstrate that the current detectors inherit the biases in the training dataset, unfortunately. This is a serious impediment, and can potentially restrict the utility of the trained model. This can render the current OOD detectors impermeable to inputs lying outside the training distribution but with the same semantic information (e.g. training class labels). To remedy this situation, we begin by defining what should ideally be treated as an OOD, by connecting inputs with their semantic information content. We perform OOD detection on semantic information extracted from the training data of MNIST and COCO datasets and show that it not only reduces false alarms but also significantly improves the detection of OOD inputs with spurious features from the training data.


page 2

page 3

page 8

page 9

page 10


Defending against Adversarial Denial-of-Service Attacks

Data poisoning is one of the most relevant security threats against mach...

CODiT: Conformal Out-of-Distribution Detection in Time-Series Data

Machine learning models are prone to making incorrect predictions on inp...

An optimization method for out-of-distribution anomaly detection models

Frequent false alarms impede the promotion of unsupervised anomaly detec...

Deep Anomaly Detection with Outlier Exposure

It is important to detect and handle anomalous inputs when deploying mac...

Full-Spectrum Out-of-Distribution Detection

Existing out-of-distribution (OOD) detection literature clearly defines ...

DenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognition

Anomaly detection can be conceived either through generative modelling o...

MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

Detecting out-of-distribution (OOD) inputs is a central challenge for sa...