A Measure of Research Taste

05/17/2021
by   Vladlen Koltun, et al.
0

Researchers are often evaluated by citation-based metrics. Such metrics can inform hiring, promotion, and funding decisions. Concerns have been expressed that popular citation-based metrics incentivize researchers to maximize the production of publications. Such incentives may not be optimal for scientific progress. Here we present a citation-based measure that rewards both productivity and taste: the researcher's ability to focus on impactful contributions. The presented measure, CAP, balances the impact of publications and their quantity, thus incentivizing researchers to consider whether a publication is a useful addition to the literature. CAP is simple, interpretable, and parameter-free. We analyze the characteristics of CAP for highly-cited researchers in biology, computer science, economics, and physics, using a corpus of millions of publications and hundreds of millions of citations with yearly temporal granularity. CAP produces qualitatively plausible outcomes and has a number of advantages over prior metrics. Results can be explored at https://cap-measure.org/

READ FULL TEXT

page 7

page 8

research
01/28/2019

A multi-dimensional framework for characterizing the citation impact of scientific publications

The citation impact of a scientific publication is usually seen as a one...
research
01/02/2020

The Demise of Single-Authored Publications in Computer Science: A Citation Network Analysis

In this study, I analyze the DBLP bibliographic database to study role o...
research
09/20/2018

Over-Optimization of Academic Publishing Metrics: Observing Goodhart's Law in Action

The academic publishing world is changing significantly, with ever-growi...
research
01/15/2020

Unbiased evaluation of ranking metrics reveals consistent performance in science and technology citation data

Despite the increasing use of citation-based metrics for research evalua...
research
11/05/2018

Assessing the varying level of impact measurement accuracy as a function of the citation window length

With the passage of more time from the original date of publication, the...
research
11/15/2017

Understanding the Changing Roles of Scientific Publications via Citation Embeddings

Researchers may describe different aspects of past scientific publicatio...
research
01/21/2019

A principled methodology for comparing relatedness measures for clustering publications

There are many different relatedness measures, based for instance on cit...

Please sign up or login with your details

Forgot password? Click here to reset