DeepAI AI Chat
Log In Sign Up

Neurally-Guided Procedural Models: Amortized Inference for Procedural Graphics Programs using Neural Networks

03/19/2016
by   Daniel Ritchie, et al.
0

Probabilistic inference algorithms such as Sequential Monte Carlo (SMC) provide powerful tools for constraining procedural models in computer graphics, but they require many samples to produce desirable results. In this paper, we show how to create procedural models which learn how to satisfy constraints. We augment procedural models with neural networks which control how the model makes random choices based on the output it has generated thus far. We call such models neurally-guided procedural models. As a pre-computation, we train these models to maximize the likelihood of example outputs generated via SMC. They are then used as efficient SMC importance samplers, generating high-quality results with very few samples. We evaluate our method on L-system-like models with image-based constraints. Given a desired quality threshold, neurally-guided models can generate satisfactory results up to 10x faster than unguided models.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/29/2013

Approximate Bayesian Image Interpretation using Generative Probabilistic Graphics Programs

The idea of computer vision as the Bayesian inverse problem to computer ...
12/05/2022

CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphics

Considerable progress has recently been made in leveraging CLIP (Contras...
03/12/2019

Elements of Sequential Monte Carlo

A core problem in statistics and probabilistic machine learning is to co...
05/25/2018

Variational Measure Preserving Flows

Probabilistic modelling is a general and elegant framework to capture th...
02/04/2021

Im2Vec: Synthesizing Vector Graphics without Vector Supervision

Vector graphics are widely used to represent fonts, logos, digital artwo...
11/04/2021

Imagine Networks

In this paper, we introduce an Imagine Network that can simulate itself ...
07/26/2017

Enforcing Constraints on Outputs with Unconstrained Inference

Increasingly, practitioners apply neural networks to complex problems in...