DiffDreamer: Consistent Single-view Perpetual View Generation with Conditional Diffusion Models

11/22/2022
by   Shengqu Cai, et al.
0

Perpetual view generation – the task of generating long-range novel views by flying into a given image – has been a novel yet promising task. We introduce DiffDreamer, an unsupervised framework capable of synthesizing novel views depicting a long camera trajectory while training solely on internet-collected images of nature scenes. We demonstrate that image-conditioned diffusion models can effectively perform long-range scene extrapolation while preserving both local and global consistency significantly better than prior GAN-based methods. Project page: https://primecai.github.io/diffdreamer .

READ FULL TEXT

page 5

page 6

page 7

page 8

page 15

page 16

page 17

page 18

research
12/17/2020

Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image

We introduce the problem of perpetual view generation – long-range gener...
research
03/23/2023

Persistent Nature: A Generative Model of Unbounded 3D Worlds

Despite increasingly realistic image quality, recent 3D image generative...
research
02/02/2023

SceneScape: Text-Driven Consistent Scene Generation

We propose a method for text-driven perpetual view generation – synthesi...
research
04/21/2023

Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models

Novel view synthesis from a single input image is a challenging task, wh...
research
05/24/2022

StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning

3D scene stylization aims at generating stylized images of the scene fro...
research
10/06/2022

Novel View Synthesis with Diffusion Models

We present 3DiM, a diffusion model for 3D novel view synthesis, which is...
research
12/12/2022

Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models

We address the challenge of recovering an underlying scene geometry and ...

Please sign up or login with your details

Forgot password? Click here to reset