Exploratory analysis of text duplication in peer-review reveals peer-review fraud and paper mills

02/07/2022
by   Adam Day, et al.
0

Comments received from referees during peer-review were analysed to determine the rates of duplication and partial duplication. It is very unusual for 2 different referees to submit identical comments, so the rare cases where this happens are of interest. In some cases, it appears that paper-mills create fake referee accounts and use them to submit fake peer-review reports. These include comments that are copied and pasted across multiple reviews. Searching for duplication in referee comments is therefore an effective method to search for misconduct generally, since the forms of misconduct committed by paper-mills go beyond peer-review fraud. These search methods allow the automatic detection of misconduct candidates which may then be investigated carefully to confirm if misconduct has indeed taken place. There are innocent reasons why referees might share template reports, so these methods are not intended to automatically diagnose misconduct.

READ FULL TEXT
research
07/03/2023

Exploring the Advances in Identifying Useful Code Review Comments

Effective peer code review in collaborative software development necessi...
research
10/08/2021

ALL-IN-ONE: Multi-Task Learning BERT models for Evaluating Peer Assessments

Peer assessment has been widely applied across diverse academic fields o...
research
10/08/2019

Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments

Scientific publishing seems to be at a turning point. Its paradigm has s...
research
03/16/2021

Technical Debt in the Peer-Review Documentation of R Packages: a rOpenSci Case Study

Context: Technical Debt is a metaphor used to describe code that is "not...
research
01/11/2022

Automatic Detection and Analysis of Technical Debts in Peer-Review Documentation of R Packages

Technical debt (TD) is a metaphor for code-related problems that arise a...
research
06/21/2023

ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews

Revising scientific papers based on peer feedback is a challenging task ...

Please sign up or login with your details

Forgot password? Click here to reset