Super-Resolution by Predicting Offsets: An Ultra-Efficient Super-Resolution Network for Rasterized Images

10/09/2022
by   Jinjin Gu, et al.
11

Rendering high-resolution (HR) graphics brings substantial computational costs. Efficient graphics super-resolution (SR) methods may achieve HR rendering with small computing resources and have attracted extensive research interests in industry and research communities. We present a new method for real-time SR for computer graphics, namely Super-Resolution by Predicting Offsets (SRPO). Our algorithm divides the image into two parts for processing, i.e., sharp edges and flatter areas. For edges, different from the previous SR methods that take the anti-aliased images as inputs, our proposed SRPO takes advantage of the characteristics of rasterized images to conduct SR on the rasterized images. To complement the residual between HR and low-resolution (LR) rasterized images, we train an ultra-efficient network to predict the offset maps to move the appropriate surrounding pixels to the new positions. For flat areas, we found simple interpolation methods can already generate reasonable output. We finally use a guided fusion operation to integrate the sharp edges generated by the network and flat areas by the interpolation method to get the final SR image. The proposed network only contains 8,434 parameters and can be accelerated by network quantization. Extensive experiments show that the proposed SRPO can achieve superior visual effects at a smaller computational cost than the existing state-of-the-art methods.

READ FULL TEXT

page 3

page 8

page 10

page 11

page 12

research
07/26/2019

Image Enhancement by Recurrently-trained Super-resolution Network

We introduce a new learning strategy for image enhancement by recurrentl...
research
02/17/2022

Single Image Super-Resolution Methods: A Survey

Super-resolution (SR), the process of obtaining high-resolution images f...
research
07/25/2016

Local- and Holistic- Structure Preserving Image Super Resolution via Deep Joint Component Learning

Recently, machine learning based single image super resolution (SR) appr...
research
12/21/2019

Style-based Variational Autoencoder for Real-World Super-Resolution

Real-world image super-resolution is a challenging image translation pro...
research
03/29/2016

FAST: A Framework to Accelerate Super-Resolution Processing on Compressed Videos

State-of-the-art super-resolution (SR) algorithms require significant co...
research
03/06/2021

ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic

We aim at accelerating super-resolution (SR) networks on large images (2...
research
01/18/2012

A PCA-Based Super-Resolution Algorithm for Short Image Sequences

In this paper, we present a novel, learning-based, two-step super-resolu...

Please sign up or login with your details

Forgot password? Click here to reset