Fits and Starts: Enterprise Use of AutoML and the Role of Humans in the Loop

01/12/2021
by   Anamaria Crisan, et al.
0

AutoML systems can speed up routine data science work and make machine learning available to those without expertise in statistics and computer science. These systems have gained traction in enterprise settings where pools of skilled data workers are limited. In this study, we conduct interviews with 29 individuals from organizations of different sizes to characterize how they currently use, or intend to use, AutoML systems in their data science work. Our investigation also captures how data visualization is used in conjunction with AutoML systems. Our findings identify three usage scenarios for AutoML that resulted in a framework summarizing the level of automation desired by data workers with different levels of expertise. We surfaced the tension between speed and human oversight and found that data visualization can do a poor job balancing the two. Our findings have implications for the design and implementation of human-in-the-loop visual analytics approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

01/18/2020

How do Data Science Workers Collaborate? Roles, Workflows, and Tools

Today, the prominence of data science within organizations has given ris...
01/13/2021

AutoDS: Towards Human-Centered Automation of Data Science

Data science (DS) projects often follow a lifecycle that consists of lab...
06/14/2021

Toward a Knowledge Discovery Framework for Data Science Job Market in the United States

The growth of the data science field requires better tools to understand...
10/08/2020

Computational Skills by Stealth in Secondary School Data Science

The unprecedented growth in the availability of data of all types and qu...
02/26/2022

Efficient Specialized Spreadsheet Parsing for Data Science

Spreadsheets are widely used for data exploration. Since spreadsheet sys...
06/28/2021

Untidy Data: The Unreasonable Effectiveness of Tables

Working with data in table form is usually considered a preparatory and ...