A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detection

09/26/2022
by   Navid Ghassemi, et al.
0

With recent advancements in artificial intelligence, its applications can be seen in every aspect of humans' daily life. From voice assistants to mobile healthcare and autonomous driving, we rely on the performance of AI methods for many critical tasks; therefore, it is essential to assert the performance of models in proper means to prevent damage. One of the shortfalls of AI models in general, and deep machine learning in particular, is a drop in performance when faced with shifts in the distribution of data. Nonetheless, these shifts are always expected in real-world applications; thus, a field of study has emerged, focusing on detecting out-of-distribution data subsets and enabling a more comprehensive generalization. Furthermore, as many deep learning based models have achieved near-perfect results on benchmark datasets, the need to evaluate these models' reliability and trustworthiness for pushing towards real-world applications is felt more strongly than ever. This has given rise to a growing number of studies in the field of out-of-distribution detection and domain generalization, which begs the need for surveys that compare these studies from various perspectives and highlight their straightens and weaknesses. This paper presents a survey that, in addition to reviewing more than 70 papers in this field, presents challenges and directions for future works and offers a unifying look into various types of data shifts and solutions for better generalization.

READ FULL TEXT
research
11/25/2022

Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time

Distribution shift occurs when the test distribution differs from the tr...
research
09/08/2022

Survey on Applications of Neurosymbolic Artificial Intelligence

In recent years, the Neurosymbolic framework has attracted a lot of atte...
research
12/14/2020

WILDS: A Benchmark of in-the-Wild Distribution Shifts

Distribution shifts can cause significant degradation in a broad range o...
research
02/02/2023

A Survey on Compositional Generalization in Applications

The field of compositional generalization is currently experiencing a re...
research
04/26/2018

PANDA: Facilitating Usable AI Development

Recent advances in artificial intelligence (AI) and machine learning hav...
research
09/20/2018

Can Deep Clinical Models Handle Real-World Domain Shifts?

The hypothesis that computational models can be reliable enough to be ad...
research
05/04/2023

Recent Advances in the Foundations and Applications of Unbiased Learning to Rank

Since its inception, the field of unbiased learning to rank (ULTR) has r...

Please sign up or login with your details

Forgot password? Click here to reset