A Process-driven View on Summative Evaluation of Visual Analytics Solutions

10/31/2018
by   Mosab Khayat, et al.
0

Many evaluation methods have been applied to assess the usefulness of visual analytics solutions. These methods are branching from a variety of origins with different assumptions, and goals. We provide a high-level overview of the process employed in each method using the generic evaluation model "GEM" that generalizes the process of usefulness evaluation. The model treats evaluation methods as processes that generate evidence of usefulness as output. Our model serves three purposes: It educate new VA practitioners about the heterogeneous evaluation practices in the field, it highlights potential risks in the process of evaluation which reduces their validity and It provide a guideline to elect suitable evaluation method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2019

The Validity, Generalizability and Feasibility of Summative Evaluation Methods in Visual Analytics

Many evaluation methods have been used to assess the usefulness of Visua...
research
01/19/2018

Evaluating Predictive Models of Student Success: Closing the Methodological Gap

Model evaluation -- the process of making inferences about the performan...
research
05/13/2022

Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications

There are many ways to express similar things in text, which makes evalu...
research
04/18/2019

A Progressive Visual Analytics Tool for Incremental Experimental Evaluation

This paper presents a visual tool, AVIATOR, that integrates the progress...
research
09/07/2018

Challenges for Measuring Usefulness of Interactive IR Systems with Log-based Approaches

The usefulness evaluation model proposed by Cole et al. in 2009 [2] focu...
research
11/05/2018

Bibliometric evaluation of research performance: where do we stand?

This work provides a critical examination of the most popular bibliometr...
research
09/23/2022

An Interdisciplinary Perspective on Evaluation and Experimental Design for Visual Text Analytics: Position Paper

Appropriate evaluation and experimental design are fundamental for empir...

Please sign up or login with your details

Forgot password? Click here to reset