Optimizing User Interface Layouts via Gradient Descent

02/25/2020
by   Peitong Duan, et al.
0

Automating parts of the user interface (UI) design process has been a longstanding challenge. We present an automated technique for optimizing the layouts of mobile UIs. Our method uses gradient descent on a neural network model of task performance with respect to the model's inputs to make layout modifications that result in improved predicted error rates and task completion times. We start by extending prior work on neural network based performance prediction to 2-dimensional mobile UIs with an expanded interaction space. We then apply our method to two UIs, including one that the model had not been trained on, to discover layout alternatives with significantly improved predicted performance. Finally, we confirm these predictions experimentally, showing improvements up to 9.2 percent in the optimized layouts. This demonstrates the algorithm's efficacy in improving the task performance of a layout, and its ability to generalize and improve layouts of new interfaces.

READ FULL TEXT

page 4

page 5

page 8

page 9

page 10

research
01/14/2020

Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders

It has been of increasing interest in the field to develop automatic mac...
research
07/15/2022

Reflow: Automatically Improving Touch Interactions in Mobile Applications through Pixel-based Refinements

Touch is the primary way that users interact with smartphones. However, ...
research
11/17/2022

Optimizing Function Layout for Mobile Applications

Function layout, also referred to as function reordering or function pla...
research
04/24/2017

A Neural Network model with Bidirectional Whitening

We present here a new model and algorithm which performs an efficient Na...
research
01/06/2014

Speeding up SOR Solvers for Constraint-based GUIs with a Warm-Start Strategy

Many computer programs have graphical user interfaces (GUIs), which need...
research
11/10/2020

Neural Networks Optimally Compress the Sawbridge

Neural-network-based compressors have proven to be remarkably effective ...
research
07/10/2023

Vocal Tract Area Estimation by Gradient Descent

Articulatory features can provide interpretable and flexible controls fo...

Please sign up or login with your details

Forgot password? Click here to reset