VIINTER: View Interpolation with Implicit Neural Representations of Images

11/01/2022
by   Brandon Yushan Feng, et al.
0

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to achieve viewpoint transitions. We propose several techniques that significantly enhance the interpolation quality. VIINTER signifies a new way to achieve view interpolation without constructing 3D structure, estimating camera poses, or computing pixel correspondence. We validate the effectiveness of VIINTER on several multi-view scenes with different types of camera layout and scene composition. As the development of INR of images (as opposed to surface or volume) has centered around tasks like image fitting and super-resolution, with VIINTER, we show its capability for view interpolation and offer a promising outlook on using INR for image manipulation tasks.

READ FULL TEXT

page 6

page 11

page 12

page 13

page 14

page 16

page 17

page 18

research
12/17/2020

Neural Radiance Flow for 4D View Synthesis and Video Processing

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatia...
research
12/09/2022

Neural Volume Super-Resolution

Neural volumetric representations have become a widely adopted model for...
research
07/03/2023

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion

This paper introduces MVDiffusion, a simple yet effective multi-view ima...
research
07/18/2022

Geometry-Aware Reference Synthesis for Multi-View Image Super-Resolution

Recent multi-view multimedia applications struggle between high-resoluti...
research
12/11/2020

Detailed 3D Human Body Reconstruction from Multi-view Images Combining Voxel Super-Resolution and Learned Implicit Representation

The task of reconstructing detailed 3D human body models from images is ...
research
10/12/2012

A polygon-based interpolation operator for super-resolution imaging

We outline the super-resolution reconstruction problem posed as a maximi...
research
09/21/2023

Beyond Image Borders: Learning Feature Extrapolation for Unbounded Image Composition

For improving image composition and aesthetic quality, most existing met...

Please sign up or login with your details

Forgot password? Click here to reset