Enhancing Multi-Scale Implicit Learning in Image Super-Resolution with Integrated Positional Encoding

12/10/2021
by   Ying-Tian Liu, et al.
0

Is the center position fully capable of representing a pixel? There is nothing wrong to represent pixels with their centers in a discrete image representation, but it makes more sense to consider each pixel as the aggregation of signals from a local area in an image super-resolution (SR) context. Despite the great capability of coordinate-based implicit representation in the field of arbitrary-scale image SR, this area's nature of pixels is not fully considered. To this end, we propose integrated positional encoding (IPE), extending traditional positional encoding by aggregating frequency information over the pixel area. We apply IPE to the state-of-the-art arbitrary-scale image super-resolution method: local implicit image function (LIIF), presenting IPE-LIIF. We show the effectiveness of IPE-LIIF by quantitative and qualitative evaluations, and further demonstrate the generalization ability of IPE to larger image scales and multiple implicit-based methods. Code will be released.

READ FULL TEXT

page 1

page 7

research
03/02/2023

OPE-SR: Orthogonal Position Encoding for Designing a Parameter-free Upsampling Module in Arbitrary-scale Image Super-Resolution

Implicit neural representation (INR) is a popular approach for arbitrary...
research
07/18/2023

Soft-IntroVAE for Continuous Latent space Image Super-Resolution

Continuous image super-resolution (SR) recently receives a lot of attent...
research
03/29/2023

Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution

Implicit neural representation has recently shown a promising ability in...
research
10/23/2022

Single Image Super-Resolution via a Dual Interactive Implicit Neural Network

In this paper, we introduce a novel implicit neural network for the task...
research
08/07/2022

Adaptive Local Implicit Image Function for Arbitrary-scale Super-resolution

Image representation is critical for many visual tasks. Instead of repre...
research
06/21/2023

Dynamic Implicit Image Function for Efficient Arbitrary-Scale Image Representation

Recent years have witnessed the remarkable success of implicit neural re...
research
10/17/2022

ITSRN++: Stronger and Better Implicit Transformer Network for Continuous Screen Content Image Super-Resolution

Nowadays, online screen sharing and remote cooperation are becoming ubiq...

Please sign up or login with your details

Forgot password? Click here to reset