Log In Sign Up

Automated Classification of Overfitting Patches with Statically Extracted Code Features

by   He Ye, et al.

Automatic program repair (APR) aims to reduce the cost of manually fixing defects. However, APR suffers from generating overfitting patches. This paper presents a novel overfitting detection system called ODS. ODS first statically extracts code features from the AST edit script between the generated patch and the buggy program. ODS then automatically learns an ensemble probabilistic model from those features, and the learned model is used to classify and rank new potentially overfitting patches. We conduct a large-scale experiment to evaluate the effectiveness of ODS on classification and ranking based on 713 patches for Defects4J. The empirical evaluation shows that ODS is able to correctly detect 57% of overfitting patches, significantly faster than the related work. ODS is easily applicable, and can be applied as a post-processing procedure to rank the patches generated by any APR systems.


page 1

page 2

page 3

page 4


Automated Patch Assessment for Program Repair at Scale

In this paper, we do automatic correctness assessment for patches genera...

Invalidator: Automated Patch Correctness Assessment via Semantic and Syntactic Reasoning

In this paper, we propose a novel technique, namely INVALIDATOR, to auto...

A Comprehensive Study of Code-removal Patches in Automated Program Repair

Automatic Program Repair (APR) techniques can promisingly help reducing ...

Characterizing Developer Use of Automatically Generated Patches

We present a study that characterizes the way developers use automatical...

pch2csd: an application for converting Nord Modular G2 patches into Csound code

The paper presents the pch2csd project, focused on converting patches of...