Looking in the Right place for Anomalies: Explainable AI through Automatic Location Learning

by   Satyananda Kashyap, et al.

Deep learning has now become the de facto approach to the recognition of anomalies in medical imaging. Their 'black box' way of classifying medical images into anomaly labels poses problems for their acceptance, particularly with clinicians. Current explainable AI methods offer justifications through visualizations such as heat maps but cannot guarantee that the network is focusing on the relevant image region fully containing the anomaly. In this paper, we develop an approach to explainable AI in which the anomaly is assured to be overlapping the expected location when present. This is made possible by automatically extracting location-specific labels from textual reports and learning the association of expected locations to labels using a hybrid combination of Bi-Directional Long Short-Term Memory Recurrent Neural Networks (Bi-LSTM) and DenseNet-121. Use of this expected location to bias the subsequent attention-guided inference network based on ResNet101 results in the isolation of the anomaly at the expected location when present. The method is evaluated on a large chest X-ray dataset.


page 4

page 5


Deep learning for understanding multilabel imbalanced Chest X-ray datasets

Over the last few years, convolutional neural networks (CNNs) have domin...

Smart Metering System Capable of Anomaly Detection by Bi-directional LSTM Autoencoder

Anomaly detection is concerned with a wide range of applications such as...

Modelling Radiological Language with Bidirectional Long Short-Term Memory Networks

Motivated by the need to automate medical information extraction from fr...

Spatially-Preserving Flattening for Location-Aware Classification of Findings in Chest X-Rays

Chest X-rays have become the focus of vigorous deep learning research in...

Unsupervised Anomaly Detection for X-Ray Images

Obtaining labels for medical (image) data requires scarce and expensive ...

DistAD: Software Anomaly Detection Based on Execution Trace Distribution

Modern software systems have become increasingly complex, which makes th...

Please sign up or login with your details

Forgot password? Click here to reset