An Approximate Shading Model with Detail Decomposition for Object Relighting

04/20/2018
by   Zicheng Liao, et al.
0

We present an object relighting system that allows an artist to select an object from an image and insert it into a target scene. Through simple interactions, the system can adjust illumination on the inserted object so that it appears naturally in the scene. To support image-based relighting, we build object model from the image, and propose a perceptually-inspired approximate shading model for the relighting. It decomposes the shading field into (a) a rough shape term that can be reshaded, (b) a parametric shading detail that encodes missing features from the first term, and (c) a geometric detail term that captures fine-scale material properties. With this decomposition, the shading model combines 3D rendering and image-based composition and allows more flexible compositing than image-based methods. Quantitative evaluation and a set of user studies suggest our method is a promising alternative to existing methods of object insertion.

READ FULL TEXT

page 2

page 8

page 9

page 11

page 12

page 15

page 17

page 19

research
08/23/2017

Single Reference Image based Scene Relighting via Material Guided Filtering

Image relighting is to change the illumination of an image to a target i...
research
10/12/2020

Cut-and-Paste Neural Rendering

Cut-and-paste methods take an object from one image and insert it into a...
research
08/12/2020

Image-based Portrait Engraving

This paper describes a simple image-based method that applies engraving ...
research
01/26/2016

Virtual Rephotography: Novel View Prediction Error for 3D Reconstruction

The ultimate goal of many image-based modeling systems is to render phot...
research
06/27/2021

Geometric Processing for Image-based 3D Object Modeling

Image-based 3D object modeling refers to the process of converting raw o...
research
06/02/2022

3D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimation

Image-based object pose estimation sounds amazing because in real applic...
research
01/31/2023

LM-GAN: A Photorealistic All-Weather Parametric Sky Model

We present LM-GAN, an HDR sky model that generates photorealistic enviro...

Please sign up or login with your details

Forgot password? Click here to reset