Automatic Scene Inference for 3D Object Compositing

12/24/2019
by   Kevin Karsch, et al.
0

We present a user-friendly image editing system that supports a drag-and-drop object insertion (where the user merely drags objects into the image, and the system automatically places them in 3D and relights them appropriately), post-process illumination editing, and depth-of-field manipulation. Underlying our system is a fully automatic technique for recovering a comprehensive 3D scene model (geometry, illumination, diffuse albedo and camera parameters) from a single, low dynamic range photograph. This is made possible by two novel contributions: an illumination inference algorithm that recovers a full lighting model of the scene (including light sources that are not directly visible in the photograph), and a depth estimation algorithm that combines data-driven depth transfer with geometric reasoning about the scene layout. A user study shows that our system produces perceptually convincing results, and achieves the same level of realism as techniques that require significant user interaction.

READ FULL TEXT

page 1

page 4

page 5

page 8

page 9

page 11

page 12

page 13

research
04/01/2017

Learning to Predict Indoor Illumination from a Single Image

We propose an automatic method to infer high dynamic range illumination ...
research
07/17/2020

People as Scene Probes

By analyzing the motion of people and other objects in a scene, we demon...
research
02/28/2017

A Data-driven Approach for Furniture and Indoor Scene Colorization

We present a data-driven approach that colorizes 3D furniture models and...
research
02/06/2020

IlluminatedFocus: Vision Augmentation using Spatial Defocusing via Focal Sweep Eyeglasses and High-Speed Projector

Aiming at realizing novel vision augmentation experiences, this paper pr...
research
05/28/2019

Adaptive Lighting for Data-Driven Non-Line-of-Sight 3D Localization and Object Identification

Non-line-of-sight (NLOS) imaging of objects not visible to either the ca...
research
12/08/2021

SIRfyN: Single Image Relighting from your Neighbors

We show how to relight a scene, depicted in a single image, such that (a...
research
01/12/2023

Adaptive Dynamic Global Illumination

We present an adaptive extension of probe based global illumination solu...

Please sign up or login with your details

Forgot password? Click here to reset