3D Moments from Near-Duplicate Photos

05/12/2022
by   Qianqian Wang, et al.
9

We introduce 3D Moments, a new computational photography effect. As input we take a pair of near-duplicate photos, i.e., photos of moving subjects from similar viewpoints, common in people's photo collections. As output, we produce a video that smoothly interpolates the scene motion from the first photo to the second, while also producing camera motion with parallax that gives a heightened sense of 3D. To achieve this effect, we represent the scene as a pair of feature-based layered depth images augmented with scene flow. This representation enables motion interpolation along with independent control of the camera viewpoint. Our system produces photorealistic space-time videos with motion parallax and scene dynamics, while plausibly recovering regions occluded in the original views. We conduct extensive experiments demonstrating superior performance over baselines on public datasets and in-the-wild photos. Project page: https://3d-moments.github.io/

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

research
04/08/2019

Neural Rerendering in the Wild

We explore total scene capture -- recording, modeling, and rerendering a...
research
09/14/2023

Empowering Visually Impaired Individuals: A Novel Use of Apple Live Photos and Android Motion Photos

Numerous applications have been developed to assist visually impaired in...
research
04/11/2023

Point-and-Shoot All-in-Focus Photo Synthesis from Smartphone Camera Pair

All-in-Focus (AIF) photography is expected to be a commercial selling po...
research
08/20/2023

Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single Image

We study the problem of synthesizing a long-term dynamic video from only...
research
08/28/2023

Total Selfie: Generating Full-Body Selfies

We present a method to generate full-body selfies – photos that you take...
research
11/10/2015

3D Time-lapse Reconstruction from Internet Photos

Given an Internet photo collection of a landmark, we compute a 3D time-l...
research
08/27/2020

One Shot 3D Photography

3D photography is a new medium that allows viewers to more fully experie...

Please sign up or login with your details

Forgot password? Click here to reset