Reverse-Engineering Information Presentations: Recovering Hierarchical Grouping from Layouts of Visual Elements

01/13/2022
by   Danqing Shi, et al.
0

Visual elements in an information presentation are often spatially and semantically grouped hierarchically for effective message delivery. Studying the hierarchical grouping information can help researchers and designers better explore layout structures and understand design demographics. However, recovering hierarchical grouping is challenging due to a large number of possibilities for compositing visual elements into a single-page design. This paper introduces an automatic approach that takes the layout of visual elements as input and returns the hierarchical grouping as output. To understand information presentations, we first contribute a dataset of 23,072 information presentations with diverse layouts to the community. Next, we propose our technique with a Transformer-based model to predict relatedness between visual elements and a bottom-up algorithm to produce the hierarchical grouping. Finally, we evaluate our technique through a technical experiment and a user study with thirty designers. Results show that the proposed technique is promising.

READ FULL TEXT
research
08/17/2022

TangibleGrid: Tangible Web Layout Design for Blind Users

We present TangibleGrid, a novel device that allows blind users to under...
research
01/14/2020

Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders

It has been of increasing interest in the field to develop automatic mac...
research
10/14/2021

Does the Layout Really Matter? A Study on Visual Model Accuracy Estimation

In visual interactive labeling, users iteratively assign labels to data ...
research
09/18/2023

EGFE: End-to-end Grouping of Fragmented Elements in UI Designs with Multimodal Learning

When translating UI design prototypes to code in industry, automatically...
research
09/02/2022

Geometry Aligned Variational Transformer for Image-conditioned Layout Generation

Layout generation is a novel task in computer vision, which combines the...
research
07/18/2008

Visual Grouping by Neural Oscillators

Distributed synchronization is known to occur at several scales in the b...
research
12/07/2022

UI Layers Group Detector: Grouping UI Layers via Text Fusion and Box Attention

Graphic User Interface (GUI) is facing great demand with the popularizat...

Please sign up or login with your details

Forgot password? Click here to reset