Optimizing Interactive Systems via Data-Driven Objectives

06/19/2020
by   Ziming Li, et al.
0

Effective optimization is essential for real-world interactive systems to provide a satisfactory user experience in response to changing user behavior. However, it is often challenging to find an objective to optimize for interactive systems (e.g., policy learning in task-oriented dialog systems). Generally, such objectives are manually crafted and rarely capture complex user needs in an accurate manner. We propose an approach that infers the objective directly from observed user interactions. These inferences can be made regardless of prior knowledge and across different types of user behavior. We introduce Interactive System Optimizer (ISO), a novel algorithm that uses these inferred objectives for optimization. Our main contribution is a new general principled approach to optimizing interactive systems using data-driven objectives. We demonstrate the high effectiveness of ISO over several simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2018

Optimizing Interactive Systems with Data-Driven Objectives

Effective optimization is essential for to provide a satisfactory user ...
research
08/15/2017

Towards Learning Reward Functions from User Interactions

In the physical world, people have dynamic preferences, e.g., the same s...
research
01/24/2022

IMO^3: Interactive Multi-Objective Off-Policy Optimization

Most real-world optimization problems have multiple objectives. A system...
research
08/06/2021

Building a Foundation for Data-Driven, Interpretable, and Robust Policy Design using the AI Economist

Optimizing economic and public policy is critical to address socioeconom...
research
08/26/2020

Bandit Data-driven Optimization: AI for Social Good and Beyond

The use of machine learning (ML) systems in real-world applications enta...
research
06/21/2022

Boosting Performance Optimization with Interactive Data Movement Visualization

Optimizing application performance in today's hardware architecture land...
research
05/07/2019

Guided Visual Exploration of Relations in Data Sets

Efficient explorative data analysis systems must take into account both ...

Please sign up or login with your details

Forgot password? Click here to reset