A Gray Box Interpretable Visual Debugging Approach for Deep Sequence Learning Model

11/20/2018
by   Md Mofijul Islam, et al.
0

Deep Learning algorithms are often used as black box type learning and they are too complex to understand. The widespread usability of Deep Learning algorithms to solve various machine learning problems demands deep and transparent understanding of the internal representation as well as decision making. Moreover, the learning models, trained on sequential data, such as audio and video data, have intricate internal reasoning process due to their complex distribution of features. Thus, a visual simulator might be helpful to trace the internal decision making mechanisms in response to adversarial input data, and it would help to debug and design appropriate deep learning models. However, interpreting the internal reasoning of deep learning model is not well studied in the literature. In this work, we have developed a visual interactive web application, namely d-DeVIS, which helps to visualize the internal reasoning of the learning model which is trained on the audio data. The proposed system allows to perceive the behavior as well as to debug the model by interactively generating adversarial audio data point. The web application of d-DeVIS is available at ddevis.herokuapp.com.

READ FULL TEXT

page 4

page 5

page 7

research
07/17/2018

RuleMatrix: Visualizing and Understanding Classifiers with Rules

With the growing adoption of machine learning techniques, there is a sur...
research
07/24/2019

Visual Interaction with Deep Learning Models through Collaborative Semantic Inference

Automation of tasks can have critical consequences when humans lose agen...
research
09/19/2022

A model-agnostic approach for generating Saliency Maps to explain inferred decisions of Deep Learning Models

The widespread use of black-box AI models has raised the need for algori...
research
11/15/2022

Evaluating the Faithfulness of Saliency-based Explanations for Deep Learning Models for Temporal Colour Constancy

The opacity of deep learning models constrains their debugging and impro...
research
04/05/2023

Physics-Inspired Interpretability Of Machine Learning Models

The ability to explain decisions made by machine learning models remains...
research
06/25/2020

SS-CAM: Smoothed Score-CAM for Sharper Visual Feature Localization

Deep Convolution Neural Networks are often referred to as black-box mode...
research
11/19/2016

Understanding Anatomy Classification Through Visualization

One of the main challenges for broad adoption of deep convolutional neur...

Please sign up or login with your details

Forgot password? Click here to reset