Learning to Rasterize Differentiable

11/23/2022
by   Chenghao Wu, et al.
0

Differentiable rasterization changes the common formulation of primitive rasterization – which has zero gradients almost everywhere, due to discontinuous edges and occlusion – to an alternative one, which is not subject to this limitation and has similar optima. These alternative versions in general are ”soft” versions of the original one. Unfortunately, it is not clear, what exact way of softening will provide the best performance in terms of converging the most reliability to a desired goal. Previous work has analyzed and compared several combinations of softening. In this work, we take it a step further and, instead of making a combinatorical choice of softening operations, parametrize the continuous space of all softening operations. We study meta-learning a parametric S-shape curve as well as an MLP over a set of inverse rendering tasks, so that it generalizes to new and unseen differentiable rendering tasks with optimal softness.

READ FULL TEXT

page 1

page 3

page 6

page 7

research
06/18/2018

RenderNet: A deep convolutional network for differentiable rendering from 3D shapes

Traditional computer graphics rendering pipeline is designed for procedu...
research
04/29/2022

GenDR: A Generalized Differentiable Renderer

In this work, we present and study a generalized family of differentiabl...
research
05/02/2022

Physics-Based Inverse Rendering using Combined Implicit and Explicit Geometries

Mathematically representing the shape of an object is a key ingredient f...
research
11/30/2022

Plateau-free Differentiable Path Tracing

Current differentiable renderers provide light transport gradients with ...
research
10/18/2021

Differentiable Rendering with Perturbed Optimizers

Reasoning about 3D scenes from their 2D image projections is one of the ...
research
06/19/2019

Analytical Derivatives for Differentiable Renderer: 3D Pose Estimation by Silhouette Consistency

Differentiable render is widely used in optimization-based 3D reconstruc...

Please sign up or login with your details

Forgot password? Click here to reset