MARLUI: Multi-Agent Reinforcement Learning for Goal-Agnostic Adaptive UIs

09/26/2022
by   Thomas Langerak, et al.
0

The goal of Adaptive UIs is to automatically change an interface so that the UI better supports users in their tasks. A core challenge is to infer user intent from user input and chose adaptations accordingly. Designing effective online UI adaptations is challenging because it relies on tediously hand-crafted rules or carefully collected, high-quality user data. To overcome these challenges, we formulate UI adaptation as a multi-agent reinforcement learning problem. In our formulation, a user agent learns to interact with a UI to complete a task. Simultaneously, an interface agent learns UI adaptations to maximize the user agent's performance. The interface agent is agnostic to the goal. It learns the task structure from the behavior of the user agent and based on that can support the user agent in completing its task. We show that our approach leads to a significant reduction in necessary number of actions on a photo editing task in silico. Furthermore, our user studies demonstrate the generalization capabilities of our interface agent from a simulated user agent to real users.

READ FULL TEXT

page 1

page 7

page 13

page 18

research
02/06/2018

Shared Autonomy via Deep Reinforcement Learning

In shared autonomy, user input is combined with semi-autonomous control ...
research
03/26/2023

Learning Generative Models with Goal-conditioned Reinforcement Learning

We present a novel, alternative framework for learning generative models...
research
04/26/2022

Toward Policy Explanations for Multi-Agent Reinforcement Learning

Advances in multi-agent reinforcement learning (MARL) enable sequential ...
research
05/14/2022

Unified Distributed Environment

We propose Unified Distributed Environment (UDE), an environment virtual...
research
04/21/2022

Learning how to Interact with a Complex Interface using Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning (HRL) allows interactive agents to d...
research
03/04/2022

X2T: Training an X-to-Text Typing Interface with Online Learning from User Feedback

We aim to help users communicate their intent to machines using flexible...
research
03/15/2022

One Agent To Rule Them All: Towards Multi-agent Conversational AI

The increasing volume of commercially available conversational agents (C...

Please sign up or login with your details

Forgot password? Click here to reset