Adversarial Robustness for Code

by   Pavol Bielik, et al.

We propose a novel technique which addresses the challenge of learning accurate and robust models of code in a principled way. Our method consists of three key components: (i) learning to abstain from making a prediction if uncertain, (ii) adversarial training, and (iii) representation refinement which learns the program parts relevant for the prediction and abstracts the rest. These components are used to iteratively train multiple models, each of which learns a suitable program representation necessary to make robust predictions on a different subset of the dataset. We instantiated our approach to the task of type inference for dynamically typed languages and demonstrate its effectiveness by learning a model that achieves 88 robustness. Further, our evaluation shows that using the combination of all three components is key to obtaining accurate and robust models.



There are no comments yet.


page 1

page 2

page 3

page 4


Robust Machine Comprehension Models via Adversarial Training

It is shown that many published models for the Stanford Question Answeri...

Semantic Robustness of Models of Source Code

Deep neural networks are vulnerable to adversarial examples - small inpu...

Adversarial Concurrent Training: Optimizing Robustness and Accuracy Trade-off of Deep Neural Networks

Adversarial training has been proven to be an effective technique for im...

A General Path-Based Representation for Predicting Program Properties

Predicting program properties such as names or expression types has a wi...

Gradual Liquid Type Inference

Liquid typing provides a decidable refinement inference mechanism that i...

Adversarial Unsupervised Representation Learning for Activity Time-Series

Sufficient physical activity and restful sleep play a major role in the ...

REST: Robust and Efficient Neural Networks for Sleep Monitoring in the Wild

In recent years, significant attention has been devoted towards integrat...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.