LayoutDM: Transformer-based Diffusion Model for Layout Generation

05/04/2023
by   Shang Chai, et al.
0

Automatic layout generation that can synthesize high-quality layouts is an important tool for graphic design in many applications. Though existing methods based on generative models such as Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) have progressed, they still leave much room for improving the quality and diversity of the results. Inspired by the recent success of diffusion models in generating high-quality images, this paper explores their potential for conditional layout generation and proposes Transformer-based Layout Diffusion Model (LayoutDM) by instantiating the conditional denoising diffusion probabilistic model (DDPM) with a purely transformer-based architecture. Instead of using convolutional neural networks, a transformer-based conditional Layout Denoiser is proposed to learn the reverse diffusion process to generate samples from noised layout data. Benefitting from both transformer and DDPM, our LayoutDM is of desired properties such as high-quality generation, strong sample diversity, faithful distribution coverage, and stationary training in comparison to GANs and VAEs. Quantitative and qualitative experimental results show that our method outperforms state-of-the-art generative models in terms of quality and diversity.

READ FULL TEXT

page 7

page 8

page 14

page 15

research
03/07/2023

DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer

Generating visual layouts is an essential ingredient of graphic design. ...
research
04/06/2021

Variational Transformer Networks for Layout Generation

Generative models able to synthesize layouts of different kinds (e.g. do...
research
03/09/2023

Unifying Layout Generation with a Decoupled Diffusion Model

Layout generation aims to synthesize realistic graphic scenes consisting...
research
05/18/2023

Constructing a personalized AI assistant for shear wall layout using Stable Diffusion

Shear wall structures are widely used in high-rise residential buildings...
research
06/01/2023

DiffRoom: Diffusion-based High-Quality 3D Room Reconstruction and Generation

We present DiffRoom, a novel framework for tackling the problem of high-...
research
06/15/2022

Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models

Diffusion probabilistic models (DPMs) are a class of powerful deep gener...
research
06/30/2022

Semantic Image Synthesis via Diffusion Models

Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkabl...

Please sign up or login with your details

Forgot password? Click here to reset