Evaluation of Information Retrieval Systems Using Structural Equation Modelling

06/25/2018
by   Massimo Melucci, et al.
0

The interpretation of the experimental data collected by testing systems across input datasets and model parameters is of strategic importance for system design and implementation. In particular, finding relationships between variables and detecting the latent variables affecting retrieval performance can provide designers, engineers and experimenters with useful if not necessary information about how a system is performing. This paper discusses the use of Structural Equation Modelling (SEM) in providing an in-depth explanation of evaluation results and an explanation of failures and successes of a system; in particular, we focus on the case of Information Retrieval.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/17/2023

Towards Improving the Explainability of Text-based Information Retrieval with Knowledge Graphs

Thanks to recent advancements in machine learning, vector-based methods ...
research
08/20/2017

Modelling Word Burstiness in Natural Language: A Generalised Polya Process for Document Language Models in Information Retrieval

We introduce a generalised multivariate Polya process for document langu...
research
11/04/2019

Sequential/Spatial, a Survey of Interactive Information Retrieval Methods for Controlled Experimentation and Evaluation

This survey presents studies that investigated non-spatial (sequential) ...
research
02/26/2020

A hypergeometric test interpretation of a common tf-idf variant

Term frequency-inverse document frequency, or tf-idf for short, is a num...
research
10/21/2022

Structural equation modeling with latent variables for diffusion processes based on high-frequency data

We consider structural equation modeling (SEM) with latent variables for...
research
03/27/2013

An Architecture for Probabilistic Concept-Based Information Retrieval

While concept-based methods for information retrieval can provide improv...
research
06/17/2017

Accelerating Innovation Through Analogy Mining

The availability of large idea repositories (e.g., the U.S. patent datab...

Please sign up or login with your details

Forgot password? Click here to reset