MatFormer: A Generative Model for Procedural Materials

07/03/2022
by   Paul Guerrero, et al.
0

Procedural material graphs are a compact, parameteric, and resolution-independent representation that are a popular choice for material authoring. However, designing procedural materials requires significant expertise and publicly accessible libraries contain only a few thousand such graphs. We present MatFormer, a generative model that can produce a diverse set of high-quality procedural materials with complex spatial patterns and appearance. While procedural materials can be modeled as directed (operation) graphs, they contain arbitrary numbers of heterogeneous nodes with unstructured, often long-range node connections, and functional constraints on node parameters and connections. MatFormer addresses these challenges with a multi-stage transformer-based model that sequentially generates nodes, node parameters, and edges, while ensuring the semantic validity of the graph. In addition to generation, MatFormer can be used for the auto-completion and exploration of partial material graphs. We qualitatively and quantitatively demonstrate that our method outperforms alternative approaches, in both generated graph and material quality.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 9

page 10

research
04/25/2023

Generating Procedural Materials from Text or Image Prompts

Node graph systems are used ubiquitously for material design in computer...
research
07/15/2022

Node Graph Optimization Using Differentiable Proxies

Graph-based procedural materials are ubiquitous in content production in...
research
09/14/2021

An Inverse Procedural Modeling Pipeline for SVBRDF Maps

Procedural modeling is now the de facto standard of material modeling in...
research
06/12/2022

TileGen: Tileable, Controllable Material Generation and Capture

Recent methods (e.g. MaterialGAN) have used unconditional GANs to genera...
research
07/02/2022

PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes

Most indoor 3D scene reconstruction methods focus on recovering 3D geome...
research
12/17/2021

A Binded VAE for Inorganic Material Generation

Designing new industrial materials with desired properties can be very e...
research
08/22/2023

MatFuse: Controllable Material Generation with Diffusion Models

Creating high quality and realistic materials in computer graphics is a ...

Please sign up or login with your details

Forgot password? Click here to reset