Leveraging Multi-Method Evaluation for Multi-Stakeholder Settings

12/14/2019
by   Christine Bauer, et al.
0

In this paper, we focus on recommendation settings with multiple stakeholders with possibly varying goals and interests, and argue that a single evaluation method or measure is not able to evaluate all relevant aspects in such a complex setting. We reason that employing a multi-method evaluation, where multiple evaluation methods or measures are combined and integrated, allows for getting a richer picture and prevents blind spots in the evaluation outcome.

READ FULL TEXT

page 1

page 2

page 3

research
03/11/2019

Blameworthiness in Multi-Agent Settings

We provide a formal definition of blameworthiness in settings where mult...
research
12/01/2022

Principled Multi-Aspect Evaluation Measures of Rankings

Information Retrieval evaluation has traditionally focused on defining p...
research
06/29/2020

Multi-sided Exposure Bias in Recommendation

Academic research in recommender systems has been greatly focusing on th...
research
12/18/2022

Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems

There has been great recent advancement in human-computer chat. However,...
research
02/16/2021

User-Inspired Posterior Network for Recommendation Reason Generation

Recommendation reason generation, aiming at showing the selling points o...
research
06/22/2019

Collective Mobile Sequential Recommendation: A Recommender System for Multiple Taxicabs

Mobile sequential recommendation was originally designed to find a promi...

Please sign up or login with your details

Forgot password? Click here to reset