Geometry-Aware Reference Synthesis for Multi-View Image Super-Resolution

07/18/2022
by   Ri Cheng, et al.
0

Recent multi-view multimedia applications struggle between high-resolution (HR) visual experience and storage or bandwidth constraints. Therefore, this paper proposes a Multi-View Image Super-Resolution (MVISR) task. It aims to increase the resolution of multi-view images captured from the same scene. One solution is to apply image or video super-resolution (SR) methods to reconstruct HR results from the low-resolution (LR) input view. However, these methods cannot handle large-angle transformations between views and leverage information in all multi-view images. To address these problems, we propose the MVSRnet, which uses geometry information to extract sharp details from all LR multi-view to support the SR of the LR input view. Specifically, the proposed Geometry-Aware Reference Synthesis module in MVSRnet uses geometry information and all multi-view LR images to synthesize pixel-aligned HR reference images. Then, the proposed Dynamic High-Frequency Search network fully exploits the high-frequency textural details in reference images for SR. Extensive experiments on several benchmarks show that our method significantly improves over the state-of-the-art approaches.

READ FULL TEXT

page 2

page 4

page 7

page 8

page 14

page 15

page 16

page 17

research
04/12/2019

MAANet: Multi-view Aware Attention Networks for Image Super-Resolution

In most recent years, deep convolutional neural networks (DCNNs) based i...
research
07/03/2023

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion

This paper introduces MVDiffusion, a simple yet effective multi-view ima...
research
12/13/2012

Robust image reconstruction from multi-view measurements

We propose a novel method to accurately reconstruct a set of images repr...
research
06/03/2019

3D Appearance Super-Resolution with Deep Learning

We tackle the problem of retrieving high-resolution (HR) texture maps of...
research
03/28/2022

Neural Vocoder is All You Need for Speech Super-resolution

Speech super-resolution (SR) is a task to increase speech sampling rate ...
research
11/01/2022

VIINTER: View Interpolation with Implicit Neural Representations of Images

We present VIINTER, a method for view interpolation by interpolating the...
research
01/11/2023

Geometry-biased Transformers for Novel View Synthesis

We tackle the task of synthesizing novel views of an object given a few ...

Please sign up or login with your details

Forgot password? Click here to reset