Peer Review: Objectivity, Anonymity, Trust

05/10/2020
by   Daniel Ucko, et al.
0

This dissertation is focused on the role of objectivity in peer review. Through an examination of aspects of peer review including anonymity, trust, expertise, and the question of who has standing to evaluate research, we find that objectivity in peer review differs significantly from other uses of the term objectivity in science. In peer review it is not required for this objectivity to have correspondence to an outside world, instead it is enough for it to operate inside the "rules" of the community. Neither is the objectivity here empirical in the sense of using data about the scientific problem in question. Rather, the objectivity is one of judgment, cleaving to the epistemological standards of a community that are formed by background assumptions and beliefs. As a consequence, we highlight the role of subjectivity in what is usually taken as a practice of objectivity, and arrive at the insight that objectivity is not defined by one core value, but a balance of transparency, confidentiality, trust, representation, and living up to community standards. As such, objectivity in peer review is a highly specific sense of the term that is not reducible to that used in other aspects of scientific practice.

READ FULL TEXT
research
10/07/2020

Empirical Standards for Software Engineering Research

Empirical Standards are natural-language models of a scientific communit...
research
03/29/2022

Empirical Standards for Repository Mining

The purpose of scholarly peer review is to evaluate the quality of scien...
research
06/24/2021

Why ex post peer review encourages high-risk research while ex ante review discourages it

Peer review is an integral component of contemporary science. While peer...
research
03/31/2020

State-of-Art-Reviewing: A Radical Proposal to Improve Scientific Publication

Peer review forms the backbone of modern scientific manuscript evaluatio...
research
12/18/2018

Avoiding a Tragedy of the Commons in the Peer Review Process

Peer review is the foundation of scientific publication, and the task of...
research
07/26/2019

On the Use/Misuse of the Term 'Phoneme'

The term 'phoneme' lies at the heart of speech science and technology, a...
research
10/08/2020

What Can We Do to Improve Peer Review in NLP?

Peer review is our best tool for judging the quality of conference submi...

Please sign up or login with your details

Forgot password? Click here to reset