Testing Neural Program Analyzers

08/25/2019
by   Md Rafiqul Islam Rabin, et al.
0

Deep neural networks have been increasingly used in software engineering and program analysis tasks. They usually take a program and make some predictions about it, e.g., bug prediction. We call these models neural program analyzers. The reliability of neural programs can impact the reliability of the encompassing analyses. In this paper, we describe our ongoing efforts to develop effective techniques for testing neural programs. We discuss the challenges involved in developing such tools and our future plans. In our preliminary experiment on a neural model recently proposed in the literature, we found that the model is very brittle, and simple perturbations in the input can cause the model to make mistakes in its prediction.

READ FULL TEXT
research
08/25/2019

Testing Neural Programs

Deep neural networks have been increasingly used in software engineering...
research
06/29/2020

A Generative Neural Network Framework for Automated Software Testing

Search Based Software Testing (SBST) is a popular automated testing tech...
research
12/02/2016

Probabilistic Neural Programs

We present probabilistic neural programs, a framework for program induct...
research
02/16/2019

Robustness and Games Against Nature in Molecular Programming

Matter, especially DNA, is now programmed to carry out useful processes ...
research
04/30/2018

Concolic Testing for Deep Neural Networks

Concolic testing alternates between CONCrete program execution and symbO...
research
11/16/2020

Neural Software Analysis

Many software development problems can be addressed by program analysis ...
research
09/28/2018

A Systematic Study on Static Control Flow Obfuscation Techniques in Java

Control flow obfuscation (CFO) alters the control flow path of a program...

Please sign up or login with your details

Forgot password? Click here to reset