Understanding Patch-Based Learning by Explaining Predictions

06/11/2018
by   Christopher Anders, et al.
0

Deep networks are able to learn highly predictive models of video data. Due to video length, a common strategy is to train them on small video snippets. We apply the deep Taylor / LRP technique to understand the deep network's classification decisions, and identify a "border effect": a tendency of the classifier to look mainly at the bordering frames of the input. This effect relates to the step size used to build the video snippet, which we can then tune in order to improve the classifier's accuracy without retraining the model. To our knowledge, this is the the first work to apply the deep Taylor / LRP technique on any video analyzing neural network.

READ FULL TEXT

page 2

page 7

research
02/08/2017

Video Frame Synthesis using Deep Voxel Flow

We address the problem of synthesizing new video frames in an existing v...
research
08/23/2022

Why is the video analytics accuracy fluctuating, and what can we do about it?

It is a common practice to think of a video as a sequence of images (fra...
research
11/01/2021

Gradient Frequency Modulation for Visually Explaining Video Understanding Models

In many applications, it is essential to understand why a machine learni...
research
10/02/2018

Training compact deep learning models for video classification using circulant matrices

In real world scenarios, model accuracy is hardly the only factor to con...
research
12/09/2018

Towards Neural Network Patching: Evaluating Engagement-Layers and Patch-Architectures

In this report we investigate fundamental requirements for the applicati...
research
07/12/2018

Subsampled Turbulence Removal Network

We present a deep-learning approach to restore a sequence of turbulence-...
research
02/11/2018

Understanding Convolutional Networks with APPLE : Automatic Patch Pattern Labeling for Explanation

With the success of deep learning, recent efforts have been focused on a...

Please sign up or login with your details

Forgot password? Click here to reset