Implicit Transformer Network for Screen Content Image Continuous Super-Resolution

12/12/2021
by   Jingyu Yang, et al.
2

Nowadays, there is an explosive growth of screen contents due to the wide application of screen sharing, remote cooperation, and online education. To match the limited terminal bandwidth, high-resolution (HR) screen contents may be downsampled and compressed. At the receiver side, the super-resolution (SR) of low-resolution (LR) screen content images (SCIs) is highly demanded by the HR display or by the users to zoom in for detail observation. However, image SR methods mostly designed for natural images do not generalize well for SCIs due to the very different image characteristics as well as the requirement of SCI browsing at arbitrary scales. To this end, we propose a novel Implicit Transformer Super-Resolution Network (ITSRN) for SCISR. For high-quality continuous SR at arbitrary ratios, pixel values at query coordinates are inferred from image features at key coordinates by the proposed implicit transformer and an implicit position encoding scheme is proposed to aggregate similar neighboring pixel values to the query one. We construct benchmark SCI1K and SCI1K-compression datasets with LR and HR SCI pairs. Extensive experiments show that the proposed ITSRN significantly outperforms several competitive continuous and discrete SR methods for both compressed and uncompressed SCIs.

READ FULL TEXT

page 2

page 4

page 6

page 7

research
10/17/2022

ITSRN++: Stronger and Better Implicit Transformer Network for Continuous Screen Content Image Super-Resolution

Nowadays, online screen sharing and remote cooperation are becoming ubiq...
research
08/21/2022

HST: Hierarchical Swin Transformer for Compressed Image Super-resolution

Compressed Image Super-resolution has achieved great attention in recent...
research
07/18/2023

Soft-IntroVAE for Continuous Latent space Image Super-Resolution

Continuous image super-resolution (SR) recently receives a lot of attent...
research
03/02/2023

OPE-SR: Orthogonal Position Encoding for Designing a Parameter-free Upsampling Module in Arbitrary-scale Image Super-Resolution

Implicit neural representation (INR) is a popular approach for arbitrary...
research
03/05/2023

Super-Resolution Neural Operator

We propose Super-resolution Neural Operator (SRNO), a deep operator lear...
research
10/18/2020

Boosting High-Level Vision with Joint Compression Artifacts Reduction and Super-Resolution

Due to the limits of bandwidth and storage space, digital images are usu...
research
03/29/2023

Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution

Implicit neural representation has recently shown a promising ability in...

Please sign up or login with your details

Forgot password? Click here to reset