Designing Deep Reinforcement Learning for Human Parameter Exploration

07/01/2019
by   Hugo Scurto, et al.
0

Software tools for generating digital sound often present users with high-dimensional, parametric interfaces, that may not facilitate exploration of diverse sound designs. In this paper, we propose to investigate artificial agents using deep reinforcement learning to explore parameter spaces in partnership with users for sound design. We describe a series of user-centred studies to probe the creative benefits of these agents and adapting their design to exploration. Preliminary studies observing users' exploration strategies with parametric interfaces and testing different agent exploration behaviours led to the design of a fully-functioning prototype, called Co-Explorer, that we evaluated in a workshop with professional sound designers. We found that the Co-Explorer enables a novel creative workflow centred on human-machine partnership, which has been positively received by practitioners. We also highlight varied user exploration behaviors throughout partnering with our system. Finally, we frame design guidelines for enabling such co-exploration workflow in creative digital applications.

READ FULL TEXT

page 4

page 8

page 11

page 12

page 13

page 15

research
06/12/2018

Multi-Agent Deep Reinforcement Learning with Human Strategies

Deep learning has enabled traditional reinforcement learning methods to ...
research
04/30/2022

p5.fab: Direct Control of Digital Fabrication Machines from a Creative Coding Environment

Machine settings and tuning are critical for digital fabrication outcome...
research
05/16/2023

How does agency impact human-AI collaborative design space exploration? A case study on ship design with deep generative models

Typical parametric approaches restrict the exploration of diverse design...
research
02/28/2021

Exploration and Incentives in Reinforcement Learning

How do you incentivize self-interested agents to explore when they prefe...
research
06/25/2020

Noise, overestimation and exploration in Deep Reinforcement Learning

We will discuss some statistical noise related phenomena, that were inve...
research
05/16/2022

A Deep Reinforcement Learning Blind AI in DareFightingICE

This paper presents a deep reinforcement learning AI that uses sound as ...
research
01/25/2021

Computational Workflows for Designing Input Devices

Input devices, such as buttons and sliders, are the foundation of any in...

Please sign up or login with your details

Forgot password? Click here to reset