Diverse Reviewer Suggestion for Extending Conference Program Committees

01/26/2022
by   Christin Katharina Kreutz, et al.
0

Automated reviewer recommendation for scientific conferences currently relies on the assumption that the program committee has the necessary expertise to handle all submissions. However, topical discrepancies between received submissions and reviewer candidates might lead to unreliable reviews or overburdening of reviewers, and may result in the rejection of high-quality papers. In this work, we present DiveRS, an explainable flow-based reviewer assignment approach, which automatically generates reviewer assignments as well as suggestions for extending the current program committee with new reviewer candidates. Our algorithm focuses on the diversity of the set of reviewers assigned to papers, which has been mostly disregarded in prior work. Specifically, we consider diversity in terms of professional background, location and seniority. Using two real world conference datasets for evaluation, we show that DiveRS improves diversity compared to both real assignments and a state-of-the-art flow-based reviewer assignment approach. Further, based on human assessments by former PC chairs, we find that DiveRS can effectively trade off some of the topical suitability in order to construct more diverse reviewer assignments.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

02/09/2021

Making Paper Reviewing Robust to Bid Manipulation Attacks

Most computer science conferences rely on paper bidding to assign review...
06/22/2009

Recommender Systems for the Conference Paper Assignment Problem

Conference paper assignment, i.e., the task of assigning paper submissio...
06/29/2020

Mitigating Manipulation in Peer Review via Randomized Reviewer Assignments

We consider three important challenges in conference peer review: (i) re...
11/08/2018

Rotational Diversity in Multi-Cycle Assignment Problems

In multi-cycle assignment problems with rotational diversity, a set of t...
05/14/2021

On Measuring the Diversity of Organizational Networks

The interaction patterns of employees in social and professional network...
02/14/2012

A Framework for Optimizing Paper Matching

At the heart of many scientific conferences is the problem of matching s...
08/13/2021

Near-Optimal Reviewer Splitting in Two-Phase Paper Reviewing and Conference Experiment Design

Many scientific conferences employ a two-phase paper review process, whe...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.