A Survey on the Evaluation of Clone Detection Performance and Benchmarking

06/28/2020
by   Jeffrey Svajlenko, et al.
0

There are a great many clone detection tools proposed in the literature. In this paper, we investigate the state of clone detection tool evaluation. We begin by surveying the clone detection benchmarks, and performing a multi-faceted evaluation and comparison of their features and capabilities. We then survey the existing clone detection tool and technique publications, and evaluate how the authors of these works evaluate their own tools/techniques. We rank the individual works by how well they measure recall, precision, execution time and scalability. We select the works the best evaluate all four metrics as exemplars that should be considered by future researchers publishing clone detection tools/techniques when designing the empirical evaluation of their tool/technique. We measure statistics on tool evaluation by the authors, and find that evaluation is poor amongst the authors. We finish our investigation into clone detection evaluation by surveying the existing tool comparison studies, including both the qualitative and quantitative studies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/27/2007

Automatic Generation of Benchmarks for Plagiarism Detection Tools using Grammatical Evolution

This paper has been withdrawn by the authors due to a major rewriting....
research
12/12/2018

Towards Automating Precision Studies of Clone Detectors

Current research in clone detection suffers from poor ecosystems for eva...
research
03/29/2023

Benchmarking Software Vulnerability Detection Techniques: A Survey

Software vulnerabilities can have serious consequences, which is why man...
research
03/24/2016

Evaluating the Performance of Offensive Linemen in the NFL

How does one objectively measure the performance of an individual offens...
research
03/04/2022

Towards Benchmarking and Evaluating Deepfake Detection

Deepfake detection automatically recognizes the manipulated medias throu...
research
04/09/2018

Do Android Taint Analysis Tools Keep their Promises?

In recent years, researchers have developed a number of tools to conduct...
research
06/07/2021

QFuzz: Quantitative Fuzzing for Side Channels

Side channels pose a significant threat to the confidentiality of softwa...

Please sign up or login with your details

Forgot password? Click here to reset