DeepAI AI Chat
Log In Sign Up

Novel View Synthesis for Large-scale Scene using Adversarial Loss

by   Xiaochuan Yin, et al.

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual reality or robotic manipulations, large changes in background may occur due to the egomotion of the camera. Generated images of a large-scale environment from novel views may be distorted if the structure of the environment is not considered. In this work, we propose a novel fully convolutional network, that can take advantage of the structural information explicitly by incorporating the inverse depth features. The inverse depth features are obtained from CNNs trained with sparse labeled depth values. This framework can easily fuse multiple images from different viewpoints. To fill the missing textures in the generated image, adversarial loss is applied, which can also improve the overall image quality. Our method is evaluated on the KITTI dataset. The results show that our method can generate novel views of large-scale scene without distortion. The effectiveness of our approach is demonstrated through qualitative and quantitative evaluation.


page 2

page 12

page 13


Free View Synthesis

We present a method for novel view synthesis from input images that are ...

Inter-View Depth Consistency Testing in Depth Difference Subspace

Multiview depth imagery will play a critical role in free-viewpoint tele...

Deep View Synthesis via Self-Consistent Generative Network

View synthesis aims to produce unseen views from a set of views captured...

Image Completion for View Synthesis Using Markov Random Fields and Efficient Belief Propagation

View synthesis is a process for generating novel views from a scene whic...

Depth Reconstruction of Translucent Objects from a Single Time-of-Flight Camera using Deep Residual Networks

We propose a novel approach to recovering the translucent objects from a...

Generative View Synthesis: From Single-view Semantics to Novel-view Images

Content creation, central to applications such as virtual reality, can b...

Pushing the Boundaries of View Extrapolation with Multiplane Images

We explore the problem of view synthesis from a narrow baseline pair of ...