Academics evaluating academics: a methodology to inform the review process on top of open citations

06/10/2021
by   Federica Bologna, et al.
0

In the past, several works have investigated ways for combining quantitative and qualitative methods in research assessment exercises. In this work, we aim at introducing a methodology to explore whether citation-based metrics, calculated only considering open bibliographic and citation data, can yield insights on how human peer-review of research assessment exercises is conducted. To understand if and what metrics provide relevant information, we propose to use a series of machine learning models to replicate the decisions of the committees of the research assessment exercises.

READ FULL TEXT
research
10/31/2018

Revisiting the scaling of citations for research assessment

Over the past decade, national research evaluation exercises, traditiona...
research
07/22/2022

Citation models and research evaluation

Citations in science are being studied from several perspectives. On the...
research
01/19/2022

Overton – A bibliometric database of policy document citations

This paper presents an analysis of the Overton policy document database,...
research
08/10/2018

Systematic analysis of agreement between metrics and peer review in the UK REF

When performing a national research assessment, some countries rely on c...
research
08/17/2017

Faculty citation measures are highly correlated with peer assessment of computer science doctoral programs

We study relationship between peer assessment of quality of U.S. Compute...
research
05/03/2021

Trends, Limitations and Open Challenges in Automatic Readability Assessment Research

Readability assessment is the task of evaluating the reading difficulty ...

Please sign up or login with your details

Forgot password? Click here to reset