Adaptive Multiplane Image Generation from a Single Internet Picture

11/26/2020
by   Diogo C. Luvizon, et al.
0

In the last few years, several works have tackled the problem of novel view synthesis from stereo images or even from a single picture. However, previous methods are computationally expensive, specially for high-resolution images. In this paper, we address the problem of generating a multiplane image (MPI) from a single high-resolution picture. We present the adaptive-MPI representation, which allows rendering novel views with low computational requirements. To this end, we propose an adaptive slicing algorithm that produces an MPI with a variable number of image planes. We present a new lightweight CNN for depth estimation, which is learned by knowledge distillation from a larger network. Occluded regions in the adaptive-MPI are inpainted also by a lightweight CNN. We show that our method is capable of producing high-quality predictions with one order of magnitude less parameters compared to previous approaches. The robustness of our method is evidenced on challenging pictures from the Internet.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
07/11/2021

LiveView: Dynamic Target-Centered MPI for View Synthesis

Existing Multi-Plane Image (MPI) based view-synthesis methods generate a...
research
07/18/2022

MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effects

Partial occlusion effects are a phenomenon that blurry objects near a ca...
research
03/27/2021

MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis

In this paper, we propose MINE to perform novel view synthesis and depth...
research
02/12/2020

Learning light field synthesis with Multi-Plane Images: scene encoding as a recurrent segmentation task

In this paper we address the problem of view synthesis from large baseli...
research
05/24/2022

Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Images

This paper deals with the challenging task of synthesizing novel views f...
research
05/01/2019

Pushing the Boundaries of View Extrapolation with Multiplane Images

We explore the problem of view synthesis from a narrow baseline pair of ...
research
11/30/2020

Cross-MPI: Cross-scale Stereo for Image Super-Resolution using Multiplane Images

The combination of various cameras is enriching the way of computational...

Please sign up or login with your details

Forgot password? Click here to reset