AI Chat AI Image Generator AI Video Text to Speech

A comment to "A General Theory of IR Evaluation Measures"

03/28/2023
∙
by   Fernando Giner, et al.
∙
0
∙

The paper "A General Theory of IR Evaluation Measures" develops a formal framework to determine whether IR evaluation measures are interval scales. This comment shows some limitations about its conclusions.

READ FULL TEXT

page 1

page 2

page 3

page 4

Related Research

research
∙ 07/09/2021

Does QRAT simulate IR-calc? QRAT simulation algorithm for ∀Exp+Res cannot be lifted to IR-calc

We show that the QRAT simulation algorithm of ∀Exp+Res from [B. Kiesl an...
0 Sravanthi Chede, et al. ∙
research
∙ 11/26/2021

Streamlining Evaluation with ir-measures

We present ir-measures, a new tool that makes it convenient to calculate...
0 Sean MacAvaney, et al. ∙
research
∙ 12/22/2022

Response to Moffat's Comment on "Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales"

Moffat recently commented on our previous work. Our work focused on how ...
0 Marco Ferrante, et al. ∙
research
∙ 01/07/2021

Towards Meaningful Statements in IR Evaluation. Mapping Evaluation Measures to Interval Scales

Recently, it was shown that most popular IR measures are not interval-sc...
0 Marco Ferrante, et al. ∙
research
∙ 01/31/2019

An InfoVis Tool for Interactive Component-Based Evaluation

In this paper, we present an InfoVis tool based on Sankey diagrams for t...
0 Giacomo Rocco, et al. ∙
research
∙ 04/02/2023

An Intrinsic Framework of Information Retrieval Evaluation Measures

Information retrieval (IR) evaluation measures are cornerstones for dete...
0 Fernando Giner, et al. ∙
research
∙ 10/26/2020

How to Measure the Reproducibility of System-oriented IR Experiments

Replicability and reproducibility of experimental results are primary co...
0 Timo Breuer, et al. ∙

Please sign up or login with your details

Forgot password? Click here to reset

Out of credits

Refill your membership to continue using DeepAI

Stripe
Paypal