Augmenting Monte Carlo Dropout Classification Models with Unsupervised Learning Tasks for Detecting and Diagnosing Out-of-Distribution Faults

09/10/2019
by   Baihong Jin, et al.
19

The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications to improve the classification performance on incipient faults. In this paper, we propose a novel approach of augmenting the classification model with an additional unsupervised learning task. We justify our choice of algorithm design via an information-theoretical analysis. Our experimental results on three datasets from diverse application domains show that the proposed method leads to improved fault detection and diagnosis performance, especially on out-of-distribution examples including both incipient and unknown faults.

READ FULL TEXT

page 7

page 10

page 11

page 12

research
02/18/2019

Detecting and Diagnosing Incipient Building Faults Using Uncertainty Information from Deep Neural Networks

Early detection of incipient faults is of vital importance to reducing m...
research
12/07/2020

Hierarchical Deep Recurrent Neural Network based Method for Fault Detection and Diagnosis

A Deep Neural Network (DNN) based algorithm is proposed for the detectio...
research
11/12/2021

Monte Carlo dropout increases model repeatability

The integration of artificial intelligence into clinical workflows requi...
research
12/02/2021

Quantifying the uncertainty of neural networks using Monte Carlo dropout for deep learning based quantitative MRI

Dropout is conventionally used during the training phase as regularizati...
research
02/15/2022

Improving the repeatability of deep learning models with Monte Carlo dropout

The integration of artificial intelligence into clinical workflows requi...
research
04/14/2021

Unsupervised Learning in Next-Generation Networks: Real-Time Performance Self-Diagnosis

This letter demonstrates the use of unsupervised machine learning to ena...
research
10/27/2022

Adapting Neural Models with Sequential Monte Carlo Dropout

The ability to adapt to changing environments and settings is essential ...

Please sign up or login with your details

Forgot password? Click here to reset