DeepAI AI Chat
Log In Sign Up

Automatic Scene Inference for 3D Object Compositing

by   Kevin Karsch, et al.
University of Illinois at Urbana-Champaign

We present a user-friendly image editing system that supports a drag-and-drop object insertion (where the user merely drags objects into the image, and the system automatically places them in 3D and relights them appropriately), post-process illumination editing, and depth-of-field manipulation. Underlying our system is a fully automatic technique for recovering a comprehensive 3D scene model (geometry, illumination, diffuse albedo and camera parameters) from a single, low dynamic range photograph. This is made possible by two novel contributions: an illumination inference algorithm that recovers a full lighting model of the scene (including light sources that are not directly visible in the photograph), and a depth estimation algorithm that combines data-driven depth transfer with geometric reasoning about the scene layout. A user study shows that our system produces perceptually convincing results, and achieves the same level of realism as techniques that require significant user interaction.


page 1

page 4

page 5

page 8

page 9

page 11

page 12

page 13


Learning to Predict Indoor Illumination from a Single Image

We propose an automatic method to infer high dynamic range illumination ...

People as Scene Probes

By analyzing the motion of people and other objects in a scene, we demon...

A Data-driven Approach for Furniture and Indoor Scene Colorization

We present a data-driven approach that colorizes 3D furniture models and...

SIRfyN: Single Image Relighting from your Neighbors

We show how to relight a scene, depicted in a single image, such that (a...

Adaptive Dynamic Global Illumination

We present an adaptive extension of probe based global illumination solu...

Seeing Far in the Dark with Patterned Flash

Flash illumination is widely used in imaging under low-light environment...