Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction Techniques

04/15/2022
by   Liwei Chan, et al.
0

Designers reportedly struggle with design optimization tasks where they are asked to find a combination of design parameters that maximizes a given set of objectives. In HCI, design optimization problems are often exceedingly complex, involving multiple objectives and expensive empirical evaluations. Model-based computational design algorithms assist designers by generating design examples during design, however they assume a model of the interaction domain. Black box methods for assistance, on the other hand, can work with any design problem. However, virtually all empirical studies of this human-in-the-loop approach have been carried out by either researchers or end-users. The question stands out if such methods can help designers in realistic tasks. In this paper, we study Bayesian optimization as an algorithmic method to guide the design optimization process. It operates by proposing to a designer which design candidate to try next, given previous observations. We report observations from a comparative study with 40 novice designers who were tasked to optimize a complex 3D touch interaction technique. The optimizer helped designers explore larger proportions of the design space and arrive at a better solution, however they reported lower agency and expressiveness. Designers guided by an optimizer reported lower mental effort but also felt less creative and less in charge of the progress. We conclude that human-in-the-loop optimization can support novice designers in cases where agency is not critical.

READ FULL TEXT

page 7

page 8

research
07/29/2021

Bayesian Optimization in Materials Science: A Survey

Bayesian optimization is used in many areas of AI for the optimization o...
research
09/05/2016

Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints

This work presents PESMOC, Predictive Entropy Search for Multi-objective...
research
09/01/2023

Polynomial-Model-Based Optimization for Blackbox Objectives

For a wide range of applications the structure of systems like Neural Ne...
research
12/07/2020

Adaptive Local Bayesian Optimization Over Multiple Discrete Variables

In the machine learning algorithms, the choice of the hyperparameter is ...
research
04/01/2020

Parallel Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints

Real-world problems often involve the optimization of several objectives...
research
06/11/2022

Enhancing Explainability of Hyperparameter Optimization via Bayesian Algorithm Execution

Despite all the benefits of automated hyperparameter optimization (HPO),...
research
02/20/2020

Computational Design with Crowds

Computational design is aimed at supporting or automating design process...

Please sign up or login with your details

Forgot password? Click here to reset