DeepAI AI Chat
Log In Sign Up

Blind Recovery of Spatially Varying Reflectance from a Single Image

by   Kevin Karsch, et al.

We propose a new technique for estimating spatially varying parametric materials from a single image of an object with unknown shape in unknown illumination. Our method uses a low-order parametric reflectance model, and incorporates strong assumptions about lighting and shape. We develop new priors about how materials mix over space, and jointly infer all of these properties from a single image. This produces a decomposition of an image which corresponds, in one sense, to microscopic features (material reflectance) and macroscopic features (weights defining the mixing properties of materials over space). We have built a large dataset of real objects rendered with different material models under different illumination fields for training and ground truth evaluation. Extensive experiments on both our synthetic dataset images as well as real images show that (a) our method recovers parameters with reasonable accuracy; (b) material parameters recovered by our method give accurate predictions of new renderings of the object; and (c) our low-order reflectance model still provides a good fit to many real-world reflectances.


page 1

page 2

page 4

page 7

page 8

page 9

page 10


Radiometric Scene Decomposition: Scene Reflectance, Illumination, and Geometry from RGB-D Images

Recovering the radiometric properties of a scene (i.e., the reflectance,...

Flexible SVBRDF Capture with a Multi-Image Deep Network

Empowered by deep learning, recent methods for material capture can esti...

Materialistic: Selecting Similar Materials in Images

Separating an image into meaningful underlying components is a crucial f...

Single-Image SVBRDF Capture with a Rendering-Aware Deep Network

Texture, highlights, and shading are some of many visual cues that allow...

Neural Reflectance for Shape Recovery with Shadow Handling

This paper aims at recovering the shape of a scene with unknown, non-Lam...

What Is Around The Camera?

How much does a single image reveal about the environment it was taken i...

Makeup Extraction of 3D Representation via Illumination-Aware Image Decomposition

Facial makeup enriches the beauty of not only real humans but also virtu...