Understanding the Usability Challenges of Machine Learning In High-Stakes Decision Making

by   Alexandra Zytek, et al.

Machine learning (ML) is being applied to a diverse and ever-growing set of domains. In many cases, domain experts – who often have no expertise in ML or data science – are asked to use ML predictions to make high-stakes decisions. Multiple ML usability challenges can appear as result, such as lack of user trust in the model, inability to reconcile human-ML disagreement, and ethical concerns about oversimplification of complex problems to a single algorithm output. In this paper, we investigate the ML usability challenges present in the domain of child welfare screening through a series of collaborations with child welfare screeners, which included field observations, interviews, and a formal user study. Through our collaborations, we identified four key ML challenges, and honed in on one promising ML augmentation tool to address them (local factor contributions). We also composed a list of design considerations to be taken into account when developing future augmentation tools for child welfare screeners and similar domain experts.



There are no comments yet.


page 3

page 4

page 9

page 10

page 13

page 14

page 15

page 17


Machine Teaching by Domain Experts: Towards More Humane,Inclusive, and Intelligent Machine Learning Systems

This paper argues that a possible way to escape from the limitations of ...

Cloudy with high chance of DBMS: A 10-year prediction for Enterprise-Grade ML

Machine learning (ML) has proven itself in high-value web applications s...

Do ML Experts Discuss Explainability for AI Systems? A discussion case in the industry for a domain-specific solution

The application of Artificial Intelligence (AI) tools in different domai...

An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Center

Gartner, a large research and advisory company, anticipates that by 2024...

Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation

Human annotations play a crucial role in machine learning (ML) research ...

Analysing Wideband Absorbance Immittance in Normal and Ears with Otitis Media with Effusion Using Machine Learning

Wideband Absorbance Immittance (WAI) has been available for more than a ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.