On the Value of ML Models

12/13/2021
by   Fabio Casati, et al.
11

We argue that, when establishing and benchmarking Machine Learning (ML) models, the research community should favour evaluation metrics that better capture the value delivered by their model in practical applications. For a specific class of use cases – selective classification – we show that not only can it be simple enough to do, but that it has import consequences and provides insights what to look for in a “good” ML model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/29/2019

SysML: The New Frontier of Machine Learning Systems

Machine learning (ML) techniques are enjoying rapidly increasing adoptio...
research
07/14/2021

The Benchmark Lottery

The world of empirical machine learning (ML) strongly relies on benchmar...
research
08/22/2021

Evaluation Methodologies for Code Learning Tasks

There has been a growing interest in developing machine learning (ML) mo...
research
05/18/2022

The games we play: critical complexity improves machine learning

When mathematical modelling is applied to capture a complex system, mult...
research
01/22/2021

On managing vulnerabilities in AI/ML systems

This paper explores how the current paradigm of vulnerability management...
research
10/06/2022

Why Should I Choose You? AutoXAI: A Framework for Selecting and Tuning eXplainable AI Solutions

In recent years, a large number of XAI (eXplainable Artificial Intellige...

Please sign up or login with your details

Forgot password? Click here to reset