A Measure of Research Taste

by   Vladlen Koltun, et al.

Researchers are often evaluated by citation-based metrics. Such metrics can inform hiring, promotion, and funding decisions. Concerns have been expressed that popular citation-based metrics incentivize researchers to maximize the production of publications. Such incentives may not be optimal for scientific progress. Here we present a citation-based measure that rewards both productivity and taste: the researcher's ability to focus on impactful contributions. The presented measure, CAP, balances the impact of publications and their quantity, thus incentivizing researchers to consider whether a publication is a useful addition to the literature. CAP is simple, interpretable, and parameter-free. We analyze the characteristics of CAP for highly-cited researchers in biology, computer science, economics, and physics, using a corpus of millions of publications and hundreds of millions of citations with yearly temporal granularity. CAP produces qualitatively plausible outcomes and has a number of advantages over prior metrics. Results can be explored at https://cap-measure.org/



page 7

page 8


A multi-dimensional framework for characterizing the citation impact of scientific publications

The citation impact of a scientific publication is usually seen as a one...

The Demise of Single-Authored Publications in Computer Science: A Citation Network Analysis

In this study, I analyze the DBLP bibliographic database to study role o...

Over-Optimization of Academic Publishing Metrics: Observing Goodhart's Law in Action

The academic publishing world is changing significantly, with ever-growi...

Unbiased evaluation of ranking metrics reveals consistent performance in science and technology citation data

Despite the increasing use of citation-based metrics for research evalua...

Assessing the varying level of impact measurement accuracy as a function of the citation window length

With the passage of more time from the original date of publication, the...

A principled methodology for comparing relatedness measures for clustering publications

There are many different relatedness measures, based for instance on cit...

Proof of Reference(PoR): A unified informetrics based consensus mechanism

Bibliometrics is useful to analyze the research impact for measuring the...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.