Fast Monte Carlo Dropout and Error Correction for Radio Transmitter Classification

01/31/2020
by   Liangping Ma, et al.
0

Monte Carlo dropout may effectively capture model uncertainty in deep learning, where a measure of uncertainty is obtained by using multiple instances of dropout at test time. However, Monte Carlo dropout is applied across the whole network and thus significantly increases the computational complexity, proportional to the number of instances. To reduce the computational complexity, at test time we enable dropout layers only near the output of the neural network and reuse the computation from prior layers while keeping, if any, other dropout layers disabled. Additionally, we leverage the side information about the ideal distributions for various input samples to do `error correction' on the predictions. We apply these techniques to the radio frequency (RF) transmitter classification problem and show that the proposed algorithm is able to provide better prediction uncertainty than the simple ensemble average algorithm and can be used to effectively identify transmitters that are not in the training data set while correctly classifying transmitters it has been trained on.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2023

Single-shot Bayesian approximation for neural networks

Deep neural networks (NNs) are known for their high-prediction performan...
research
04/04/2023

Uncertainty estimation in Deep Learning for Panoptic segmentation

As deep learning-based computer vision algorithms continue to improve an...
research
12/02/2021

Quantifying the uncertainty of neural networks using Monte Carlo dropout for deep learning based quantitative MRI

Dropout is conventionally used during the training phase as regularizati...
research
02/06/2023

Dropout Injection at Test Time for Post Hoc Uncertainty Quantification in Neural Networks

Among Bayesian methods, Monte-Carlo dropout provides principled tools fo...
research
11/12/2021

Monte Carlo dropout increases model repeatability

The integration of artificial intelligence into clinical workflows requi...
research
02/15/2022

Improving the repeatability of deep learning models with Monte Carlo dropout

The integration of artificial intelligence into clinical workflows requi...

Please sign up or login with your details

Forgot password? Click here to reset