Towards Improved Testing For Deep Learning

02/17/2019
by   Jasmine Sekhon, et al.
0

The growing use of deep neural networks in safety-critical applications makes it necessary to carry out adequate testing to detect and correct any incorrect behavior for corner case inputs before they can be actually used. Deep neural networks lack an explicit control-flow structure, making it impossible to apply to them traditional software testing criteria such as code coverage. In this paper, we examine existing testing methods for deep neural networks, the opportunities for improvement and the need for a fast, scalable, generalizable end-to-end testing method. We also propose a coverage criterion for deep neural networks that tries to capture all possible parts of the deep neural network's logic.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2018

Testing Deep Neural Networks

Deep neural networks (DNNs) have a wide range of applications, and softw...
research
07/28/2018

TensorFuzz: Debugging Neural Networks with Coverage-Guided Fuzzing

Machine learning models are notoriously difficult to interpret and debug...
research
12/17/2018

Traceability of Deep Neural Networks

[Context.] The success of deep learning makes its usage more and more te...
research
05/16/2023

One-Shot Online Testing of Deep Neural Networks Based on Distribution Shift Detection

Neural networks (NNs) are capable of learning complex patterns and relat...
research
07/25/2022

p-DkNN: Out-of-Distribution Detection Through Statistical Testing of Deep Representations

The lack of well-calibrated confidence estimates makes neural networks i...
research
04/05/2017

Best Practices for Applying Deep Learning to Novel Applications

This report is targeted to groups who are subject matter experts in thei...
research
10/10/2022

DeepPerform: An Efficient Approach for Performance Testing of Resource-Constrained Neural Networks

Today, an increasing number of Adaptive Deep Neural Networks (AdNNs) are...

Please sign up or login with your details

Forgot password? Click here to reset