Predicting Usefulness of Code Review Comments using Textual Features and Developer Experience

07/12/2018
by   Mohammad Masudur Rahman, et al.
0

Although peer code review is widely adopted in both commercial and open source development, existing studies suggest that such code reviews often contain a significant amount of non-useful review comments. Unfortunately, to date, no tools or techniques exist that can provide automatic support in improving those non-useful comments. In this paper, we first report a comparative study between useful and non-useful review comments where we contrast between them using their textual characteristics, and reviewers' experience. Then, based on the findings from the study, we develop RevHelper, a prediction model that can help the developers improve their code review comments through automatic prediction of their usefulness during review submission. Comparative study using 1,116 review comments suggested that useful comments share more vocabulary with the changed code, contain salient items like relevant code elements, and their reviewers are generally more experienced. Experiments using 1,482 review comments report that our model can predict comment usefulness with 66% prediction accuracy which is promising. Comparison with three variants of a baseline model using a case study validates our empirical findings and demonstrates the potential of our model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2023

Exploring the Advances in Identifying Useful Code Review Comments

Effective peer code review in collaborative software development necessi...
research
02/22/2023

What Makes a Code Review Useful to OpenDev Developers? An Empirical Investigation

Context: Due to the association of significant efforts, even a minor imp...
research
08/24/2021

An Empirical Study on Refactoring-Inducing Pull Requests

Background: Pull-based development has shaped the practice of Modern Cod...
research
08/08/2021

Empirical Analysis on Effectiveness of NLP Methods for Predicting Code Smell

A code smell is a surface indicator of an inherent problem in the system...
research
03/06/2018

Code Review Comments: Language Matters

Recent research provides evidence that effective communication in collab...
research
07/07/2023

Towards Automated Classification of Code Review Feedback to Support Analytics

Background: As improving code review (CR) effectiveness is a priority fo...
research
04/20/2022

Modeling Review History for Reviewer Recommendation:A Hypergraph Approach

Modern code review is a critical and indispensable practice in a pull-re...

Please sign up or login with your details

Forgot password? Click here to reset