Robust Uncertainty Estimation for Classification of Maritime Objects

07/03/2023
by   Jonathan Becktor, et al.
0

We explore the use of uncertainty estimation in the maritime domain, showing the efficacy on toy datasets (CIFAR10) and proving it on an in-house dataset, SHIPS. We present a method joining the intra-class uncertainty achieved using Monte Carlo Dropout, with recent discoveries in the field of outlier detection, to gain more holistic uncertainty measures. We explore the relationship between the introduced uncertainty measures and examine how well they work on CIFAR10 and in a real-life setting. Our work improves the FPR95 by 8 current highest-performing work when the models are trained without out-of-distribution data. We increase the performance by 77 vanilla implementation of the Wide ResNet. We release the SHIPS dataset and show the effectiveness of our method by improving the FPR95 by 44.2 respect to the baseline. Our approach is model agnostic, easy to implement, and often does not require model retraining.

READ FULL TEXT

page 1

page 3

page 5

research
06/28/2021

An Uncertainty Estimation Framework for Probabilistic Object Detection

In this paper, we introduce a new technique that combines two popular me...
research
12/06/2018

Prior Networks for Detection of Adversarial Attacks

Adversarial examples are considered a serious issue for safety critical ...
research
10/27/2020

Know Where To Drop Your Weights: Towards Faster Uncertainty Estimation

Estimating epistemic uncertainty of models used in low-latency applicati...
research
08/04/2020

On Feature Relevance Uncertainty: A Monte Carlo Dropout Sampling Approach

Understanding decisions made by neural networks is key for the deploymen...
research
08/02/2019

Uncertainty Quantification in Computer-Aided Diagnosis: Make Your Model say "I don't know" for Ambiguous Cases

We evaluate two different methods for the integration of prediction unce...
research
06/05/2022

Which models are innately best at uncertainty estimation?

Deep neural networks must be equipped with an uncertainty estimation mec...

Please sign up or login with your details

Forgot password? Click here to reset