An InfoVis Tool for Interactive Component-Based Evaluation

01/31/2019

∙

In this paper, we present an InfoVis tool based on Sankey diagrams for the exploration of large combinatorial combinations of IR components - the Grid of Points (GoP). The goal of this tool is to ease the comprehension of the behavior of single IR components within fully functioning off-the-shelf IR systems without recurring to complex statistical tools.

READ FULL TEXT

An InfoVis Tool for Interactive Component-Based Evaluation

Does QRAT simulate IR-calc? QRAT simulation algorithm for ∀Exp+Res cannot be lifted to IR-calc

A comment to "A General Theory of IR Evaluation Measures"

Challenges for Measuring Usefulness of Interactive IR Systems with Log-based Approaches

Streamlining Evaluation with ir-measures

Ease and Equity of Point of Interest Accessibility via Public Transit in the U.S

Response to Moffat's Comment on "Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales"

Simplified Data Wrangling with ir_datasets

An InfoVis Tool for Interactive Component-Based Evaluation

Related Research

Does QRAT simulate IR-calc? QRAT simulation algorithm for ∀Exp+Res cannot be lifted to IR-calc

A comment to "A General Theory of IR Evaluation Measures"

Challenges for Measuring Usefulness of Interactive IR Systems with Log-based Approaches

Streamlining Evaluation with ir-measures

Ease and Equity of Point of Interest Accessibility via Public Transit in the U.S

Response to Moffat's Comment on "Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales"

Simplified Data Wrangling with ir_datasets