RevASIDE: Assignment of Suitable Reviewer Sets for Publications from Fixed Candidate Pools

10/06/2021
by   Christin Katharina Kreutz, et al.
0

Scientific publishing heavily relies on the assessment of quality of submitted manuscripts by peer reviewers. Assigning a set of matching reviewers to a submission is a highly complex task which can be performed only by domain experts. We introduce RevASIDE, a reviewer recommendation system that assigns suitable sets of complementing reviewers from a predefined candidate pool without requiring manually defined reviewer profiles. Here, suitability includes not only reviewers' expertise, but also their authority in the target domain, their diversity in their areas of expertise and experience, and their interest in the topics of the manuscript. We present three new data sets for the expert search and reviewer set assignment tasks and compare the usefulness of simple text similarity methods to document embeddings for expert search. Furthermore, an quantitative evaluation demonstrates significantly better results in reviewer set assignment compared to baselines. A qualitative evaluation also shows their superior perceived quality.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

01/25/2022

Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertise

Strategic behavior is a fundamental problem in a variety of real-world a...
04/07/2020

New Datasets and a Benchmark of Document Network Embedding Methods for Scientific Expert Finding

The scientific literature is growing faster than ever. Finding an expert...
11/14/2016

Learning for Expertise Matching with Declination Prediction

We study the problem of finding appropriate experts who are able to comp...
09/29/2020

A network approach to expertise retrieval based on path similarity and credit allocation

With the increasing availability of online scholarly databases, publicat...
06/30/2020

BERTERS: Multimodal Representation Learning for Expert Recommendation System with Transformer

The objective of an expert recommendation system is to trace a set of ca...
02/14/2012

A Framework for Optimizing Paper Matching

At the heart of many scientific conferences is the problem of matching s...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.