Towards Testing of Deep Learning Systems with Training Set Reduction

01/14/2019
by   Helge Spieker, et al.
0

Testing the implementation of deep learning systems and their training routines is crucial to maintain a reliable code base. Modern software development employs processes, such as Continuous Integration, in which changes to the software are frequently integrated and tested. However, testing the training routines requires running them and fully training a deep learning model can be resource-intensive, when using the full data set. Using only a subset of the training data can improve test run time, but can also reduce its effectiveness. We evaluate different ways for training set reduction and their ability to mimic the characteristics of model training with the original full data set. Our results underline the usefulness of training set reduction, especially in resource-constrained environments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2021

Recommending Training Set Sizes for Classification

Based on a comprehensive study of 20 established data sets, we recommend...
research
04/10/2022

Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environments

Retraining modern deep learning systems can lead to variations in model ...
research
11/24/2022

The Westermo test results data set

There is a growing body of knowledge in the computer science, software e...
research
05/19/2021

A Lightweight Privacy-Preserving Scheme Using Label-based Pixel Block Mixing for Image Classification in Deep Learning

To ensure the privacy of sensitive data used in the training of deep lea...
research
08/25/2023

Accelerating Continuous Integration with Parallel Batch Testing

Continuous integration at scale is costly but essential to software deve...
research
02/12/2019

A new Backdoor Attack in CNNs by training set corruption without label poisoning

Backdoor attacks against CNNs represent a new threat against deep learni...
research
06/25/2021

Evaluation of Deep-Learning-Based Voice Activity Detectors and Room Impulse Response Models in Reverberant Environments

State-of-the-art deep-learning-based voice activity detectors (VADs) are...

Please sign up or login with your details

Forgot password? Click here to reset