Using Simulation to Aid the Design and Optimization of Intelligent User Interfaces for Quality Assurance Processes in Machine Learning

04/02/2021
by   Yu Zhang, et al.
20

Many mission-critical applications of machine learning (ML) in the real-world require a quality assurance (QA) process before the decisions or predictions of an ML model can be deployed. Because QA4ML users have to view a non-trivial amount of data and perform many input actions to correct errors made by the ML model, an optimally-designed user interface (UI) can reduce the cost of interactions significantly. A UI's effectiveness can be affected by many factors, such as the number of data objects processed concurrently, the types of commands for correcting errors, and the availability of algorithms for assisting users. We propose using simulation to aid the design and optimization of intelligent user interfaces for QA4ML processes. In particular, we focus on simulating the combined effects of human intelligence in selecting appropriate commands and algorithms, and machine intelligence in providing a collection of general-purpose algorithms for reordering data objects to be quality-assured.

READ FULL TEXT

page 6

page 8

research
08/05/2020

More Than Accuracy: Towards Trustworthy Machine Learning Interfaces for Object Recognition

This paper investigates the user experience of visualizations of a machi...
research
02/17/2023

Wizard of Errors: Introducing and Evaluating Machine Learning Errors in Wizard of Oz Studies

When designing Machine Learning (ML) enabled solutions, designers often ...
research
07/18/2019

User-Interactive Machine Learning Model for Identifying Structural Relationships of Code Features

Traditional machine learning based intelligent systems assist users by l...
research
10/18/2016

An Interactive Machine Learning Framework

Machine learning (ML) is believed to be an effective and efficient tool ...
research
09/14/2017

Abstractions for AI-Based User Interfaces and Systems

Novel user interfaces based on artificial intelligence, such as natural-...
research
06/21/2018

Intelligently Assisting Human-Guided Quadcopter Photography

Drones are a versatile platform for both amateur and professional photog...
research
03/06/2020

What is "Intelligent" in Intelligent User Interfaces? A Meta-Analysis of 25 Years of IUI

This reflection paper takes the 25th IUI conference milestone as an oppo...

Please sign up or login with your details

Forgot password? Click here to reset