Shading Annotations in the Wild

05/02/2017
by   Balazs Kovacs, et al.
0

Understanding shading effects in images is critical for a variety of vision and graphics problems, including intrinsic image decomposition, shadow removal, image relighting, and inverse rendering. As is the case with other vision tasks, machine learning is a promising approach to understanding shading - but there is little ground truth shading data available for real-world images. We introduce Shading Annotations in the Wild (SAW), a new large-scale, public dataset of shading annotations in indoor scenes, comprised of multiple forms of shading judgments obtained via crowdsourcing, along with shading annotations automatically generated from RGB-D imagery. We use this data to train a convolutional neural network to predict per-pixel shading information in an image. We demonstrate the value of our data and network in an application to intrinsic images, where we can reduce decomposition artifacts produced by existing algorithms. Our database is available at http://opensurfaces.cs.cornell.edu/saw/.

READ FULL TEXT

page 1

page 3

page 6

page 8

research
08/26/2018

CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Rendering

Intrinsic image decomposition is a challenging, long-standing computer v...
research
04/02/2018

Learning Intrinsic Image Decomposition from Watching the World

Single-view intrinsic image decomposition is a highly ill-posed problem,...
research
12/08/2015

Direct Intrinsics: Learning Albedo-Shading Decomposition by Convolutional Regression

We introduce a new approach to intrinsic image decomposition, the task o...
research
11/20/2020

Intrinsic Image Decomposition using Paradigms

Intrinsic image decomposition is the classical task of mapping image to ...
research
10/08/2015

Learning Data-driven Reflectance Priors for Intrinsic Image Decomposition

We propose a data-driven approach for intrinsic image decomposition, whi...
research
11/16/2021

Learning Intrinsic Images for Clothing

Reconstruction of human clothing is an important task and often relies o...
research
03/01/2023

Neural inverse procedural modeling of knitting yarns from images

We investigate the capabilities of neural inverse procedural modeling to...

Please sign up or login with your details

Forgot password? Click here to reset