DeepAI AI Chat
Log In Sign Up

Some Ethical Issues in the Review Process of Machine Learning Conferences

06/01/2021
by   Alessio Russo, et al.
0

Recent successes in the Machine Learning community have led to a steep increase in the number of papers submitted to conferences. This increase made more prominent some of the issues that affect the current review process used by these conferences. The review process has several issues that may undermine the nature of scientific research, which is of being fully objective, apolitical, unbiased and free of misconduct (such as plagiarism, cheating, improper influence, and other improprieties). In this work, we study the problem of reviewers' recruitment, infringements of the double-blind process, fraudulent behaviors, biases in numerical ratings, and the appendix phenomenon (i.e., the fact that it is becoming more common to publish results in the appendix section of a paper). For each of these problems, we provide a short description and possible solutions. The goal of this work is to raise awareness in the Machine Learning community regarding these issues.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/04/2018

Case for the double-blind peer review

Peer review is a process designed to produce a fair assessment of resear...
11/07/2021

Proposing an Interactive Audit Pipeline for Visual Privacy Research

In an ideal world, deployed machine learning models will enhance our soc...
05/04/2021

A Review on Oracle Issues in Machine Learning

Machine learning contrasts with traditional software development in that...
11/14/2022

Cracking Double-Blind Review: Authorship Attribution with Deep Learning

Double-blind peer review is considered a pillar of academic research bec...
09/28/2021

Generating Summaries for Scientific Paper Review

The review process is essential to ensure the quality of publications. R...
10/11/2020

An Open Review of OpenReview: A Critical Analysis of the Machine Learning Conference Review Process

Mainstream machine learning conferences have seen a dramatic increase in...
11/24/2020

Analyzing the Machine Learning Conference Review Process

Mainstream machine learning conferences have seen a dramatic increase in...