Enhanced Labeling of Issue Reports (with F^3T)

05/05/2019
by   Huy Tu, et al.
0

Standard automatic methods for recognizing problematic code can be greatly improved via the incremental application of human+artificial expertise. In this approach, call F^3T, AI tools explore software to find commits that they guess is most problematic. Humans the apply their expertise to check that guess (perhaps resulting in the AI updating the support vectors within their SVM learner). We recommend this human+AI partnership, for several reasons. When a new domain is encountered, F^3T can learn better ways to label which comments refer to real problems. Further, in studies with 9 open source software projects, F^3T's incremental application of human+artificial intelligence is at least an order of magnitude cheaper to use than existing methods. Lastly, F^3T is very effective. For the data sets explored here, when compared to standard methods, F^3T improved P_opt(20) and G-scores performance by 26% and 48% on median value.

READ FULL TEXT
research
12/23/2020

Antitrust and Artificial Intelligence (AAI): Antitrust Vigilance Lifecycle and AI Legal Reasoning Autonomy

There is an increasing interest in the entwining of the field of antitru...
research
06/28/2019

Artificial Intelligence Governance and Ethics: Global Perspectives

Artificial intelligence (AI) is a technology which is increasingly being...
research
02/06/2018

Augmented Artificial Intelligence

All artificial Intelligence (AI) systems make errors. These errors are u...
research
07/29/2019

The Challenge of Imputation in Explainable Artificial Intelligence Models

Explainable models in Artificial Intelligence are often employed to ensu...
research
11/04/2019

An Expert System for Learning Software Engineering Knowledge (with Case Studies in Understanding Static Code Warning)

Knowledge-based systems reason over some knowledge base. Hence, an impor...
research
11/14/2022

A taxonomic system for failure cause analysis of open source AI incidents

While certain industrial sectors (e.g., aviation) have a long history of...
research
05/09/2018

The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards

Artificial intelligence (AI) systems built on incomplete or biased data ...

Please sign up or login with your details

Forgot password? Click here to reset