SphereSR: 360° Image Super-Resolution with Arbitrary Projection via Continuous Spherical Image Representation

12/13/2021
by   Youngho Yoon, et al.
0

The 360imaging has recently gained great attention; however, its angular resolution is relatively lower than that of a narrow field-of-view (FOV) perspective image as it is captured by using fisheye lenses with the same sensor size. Therefore, it is beneficial to super-resolve a 360image. Some attempts have been made but mostly considered the equirectangular projection (ERP) as one of the way for 360image representation despite of latitude-dependent distortions. In that case, as the output high-resolution(HR) image is always in the same ERP format as the low-resolution (LR) input, another information loss may occur when transforming the HR image to other projection types. In this paper, we propose SphereSR, a novel framework to generate a continuous spherical image representation from an LR 360image, aiming at predicting the RGB values at given spherical coordinates for super-resolution with an arbitrary 360image projection. Specifically, we first propose a feature extraction module that represents the spherical data based on icosahedron and efficiently extracts features on the spherical surface. We then propose a spherical local implicit image function (SLIIF) to predict RGB values at the spherical coordinates. As such, SphereSR flexibly reconstructs an HR image under an arbitrary projection type. Experiments on various benchmark datasets show that our method significantly surpasses existing methods.

READ FULL TEXT

page 3

page 7

page 14

page 15

page 16

research
04/26/2023

Super-NeRF: View-consistent Detail Generation for NeRF super-resolution

The neural radiance field (NeRF) achieved remarkable success in modeling...
research
01/11/2023

Learning Continuous Mesh Representation with Spherical Implicit Surface

As the most common representation for 3D shapes, mesh is often stored di...
research
06/10/2012

Revolvable Indoor Panoramas Using a Rectified Azimuthal Projection

We present an algorithm for converting an indoor spherical panorama into...
research
08/07/2022

Adaptive Local Implicit Image Function for Arbitrary-scale Super-resolution

Image representation is critical for many visual tasks. Instead of repre...
research
06/21/2021

Applying VertexShuffle Toward 360-Degree Video Super-Resolution on Focused-Icosahedral-Mesh

With the emerging of 360-degree image/video, augmented reality (AR) and ...
research
03/15/2023

Spherical Space Feature Decomposition for Guided Depth Map Super-Resolution

Guided depth map super-resolution (GDSR), as a hot topic in multi-modal ...
research
02/16/2023

Continuous Remote Sensing Image Super-Resolution based on Context Interaction in Implicit Function Space

Despite its fruitful applications in remote sensing, image super-resolut...

Please sign up or login with your details

Forgot password? Click here to reset