Deep View Morphing

03/07/2017
by   Dinghuang Ji, et al.
0

Recently, convolutional neural networks (CNN) have been successfully applied to view synthesis problems. However, such CNN-based methods can suffer from lack of texture details, shape distortions, or high computational complexity. In this paper, we propose a novel CNN architecture for view synthesis called "Deep View Morphing" that does not suffer from these issues. To synthesize a middle view of two input images, a rectification network first rectifies the two input images. An encoder-decoder network then generates dense correspondences between the rectified images and blending masks to predict the visibility of pixels of the rectified images in the middle view. A view morphing network finally synthesizes the middle view using the dense correspondences and blending masks. We experimentally show the proposed method significantly outperforms the state-of-the-art CNN-based view synthesis method.

READ FULL TEXT

page 14

page 20

page 21

page 22

page 25

page 26

page 27

page 28

research
01/05/2021

Novel View Synthesis via Depth-guided Skip Connections

We introduce a principled approach for synthesizing new views of a scene...
research
01/19/2021

Deep View Synthesis via Self-Consistent Generative Network

View synthesis aims to produce unseen views from a set of views captured...
research
03/29/2021

Self-Supervised Visibility Learning for Novel View Synthesis

We address the problem of novel view synthesis (NVS) from a few sparse s...
research
05/19/2018

Fast Disparity Estimation using Dense Networks

Disparity estimation is a difficult problem in stereo vision because the...
research
04/03/2019

SFNet: Learning Object-aware Semantic Correspondence

We address the problem of semantic correspondence, that is, establishing...
research
04/20/2022

Complete identification of complex salt-geometries from inaccurate migrated images using Deep Learning

Delimiting salt inclusions from migrated images is a time-consuming acti...
research
06/17/2013

Two-View Matching with View Synthesis Revisited

Wide-baseline matching focussing on problems with extreme viewpoint chan...

Please sign up or login with your details

Forgot password? Click here to reset