DeepAI AI Chat
Log In Sign Up

Deep Polarization Imaging for 3D shape and SVBRDF Acquisition

by   Valentin Deschaintre, et al.

We present a novel method for efficient acquisition of shape and spatially varying reflectance of 3D objects using polarization cues. Unlike previous works that have exploited polarization to estimate material or object appearance under certain constraints (known shape or multiview acquisition), we lift such restrictions by coupling polarization imaging with deep learning to achieve high quality estimate of 3D object shape (surface normals and depth) and SVBRDF using single-view polarization imaging under frontal flash illumination. In addition to acquired polarization images, we provide our deep network with strong novel cues related to shape and reflectance, in the form of a normalized Stokes map and an estimate of diffuse color. We additionally describe modifications to network architecture and training loss which provide further qualitative improvements. We demonstrate our approach to achieve superior results compared to recent works employing deep learning in conjunction with flash illumination.


page 3

page 4

page 5

page 7

page 8


3D Surface Reconstruction by Pointillism

The objective of this work is to infer the 3D shape of an object from a ...

3D Human Shape Reconstruction from a Polarization Image

This paper tackles the problem of estimating 3D body shape of clothed hu...

Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues

We present a novel 3D shape reconstruction method which learns to predic...

NeROIC: Neural Rendering of Objects from Online Image Collections

We present a novel method to acquire object representations from online ...

Flexible SVBRDF Capture with a Multi-Image Deep Network

Empowered by deep learning, recent methods for material capture can esti...

Deep Appearance Maps

We propose a deep representation of appearance, i. e. the relation of co...

Imaging with SPADs and DMDs: Seeing through Diffraction-Photons

This paper addresses the problem of imaging in the presence of diffracti...