Inverse Rendering Techniques for Physically Grounded Image Editing

by   Kevin Karsch, et al.

From a single picture of a scene, people can typically grasp the spatial layout immediately and even make good guesses at materials properties and where light is coming from to illuminate the scene. For example, we can reliably tell which objects occlude others, what an object is made of and its rough shape, regions that are illuminated or in shadow, and so on. It is interesting how little is known about our ability to make these determinations; as such, we are still not able to robustly "teach" computers to make the same high-level observations as people. This document presents algorithms for understanding intrinsic scene properties from single images. The goal of these inverse rendering techniques is to estimate the configurations of scene elements (geometry, materials, luminaires, camera parameters, etc) using only information visible in an image. Such algorithms have applications in robotics and computer graphics. One such application is in physically grounded image editing: photo editing made easier by leveraging knowledge of the physical space. These applications allow sophisticated editing operations to be performed in a matter of seconds, enabling seamless addition, removal, or relocation of objects in images.



There are no comments yet.



Physically-Based Editing of Indoor Scene Lighting from a Single Image

We present a method to edit complex indoor lighting from a single image ...

Material Editing Using a Physically Based Rendering Network

The ability to edit materials of objects in images is desirable by many ...

Calipso: Physics-based Image and Video Editing through CAD Model Proxies

We present Calipso, an interactive method for editing images and videos ...

Automatic Scene Inference for 3D Object Compositing

We present a user-friendly image editing system that supports a drag-and...

Scientific image rendering for space scenes with the SurRender software

Spacecraft autonomy can be enhanced by vision-based navigation (VBN) tec...

LevelMerge: Collaborative Game Level Editing by Merging Labeled Graphs

Game level editing is the process of constructing a full game level star...

Spectral domain decomposition method for physically-based rendering of Royaumont abbey

In the context of a virtual reconstitution of the destroyed Royaumont ab...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.