Evaluating Information Retrieval Systems for Kids

05/21/2020
by   Ashlee Milton, et al.
0

Evaluation of information retrieval systems (IRS) is a prominent topic among information retrieval researchers–mainly directed at a general population. Children require unique IRS and by extension different ways to evaluate these systems, but as a large population that use IRS have largely been ignored on the evaluation front. In this position paper, we explore many perspectives that must be considered when evaluating IRS; we specially discuss problems faced by researchers who work with children IRS, including lack of evaluation frameworks, limitations of data, and lack of user judgment understanding.

READ FULL TEXT

page 1

page 2

research
11/04/2022

Explainable Information Retrieval: A Survey

Explainable information retrieval is an emerging research area aiming to...
research
08/07/2022

SINR Analysis of an IRS Assisted MU-MISO System

In this work, we characterize the outage probability (OP) of an intellig...
research
01/20/2023

Information Retrieval: Recent Advances and Beyond

In this paper, we provide a detailed overview of the models used for inf...
research
06/15/2021

Does your robot know? Enhancing children's information retrieval through spoken conversation with responsible robots

In this paper, we identify challenges in children's current information ...
research
07/24/2020

Considerations for Eye Tracking Experiments in Information Retrieval

In this survey I discuss ophthalmic neurophysiology and the experimental...
research
11/04/2019

Sequential/Spatial, a Survey of Interactive Information Retrieval Methods for Controlled Experimentation and Evaluation

This survey presents studies that investigated non-spatial (sequential) ...

Please sign up or login with your details

Forgot password? Click here to reset